AI Infrastructure Engineer

Liang Li

I build the infrastructure AI agents run on — and I've written the frameworks myself: agent runtimes in Go (agent-go) and Rust (harness-rs, on crates.io), a memory + RAG + knowledge-graph engine (cortexdb), and an LLM evaluation framework (eval-go). I turn LLM demos into agents that run unattended in production.

OPEN TO REMOTE ROLES & CONTRACT — AI agent infrastructure Get in touch → GitHub
Location
Chengdu, CN · Remote
Stack
Go · Rust · TS/React
Focus
Agents · RAG · MCP · Local LLM
Status
● Available — remote role or contract
01Services — what you can hire me for

Agent System Architecture

For
Teams with an LLM prototype that needs to run reliably in production.
Get
Agent loop, tool & skill integration, memory, evals, and guardrails.
Time
Typically 2–6 weeks.

RAG & Knowledge Graphs

For
Teams that need agents to answer accurately over their own data.
Get
Ingestion, vector + hybrid retrieval, GraphRAG — embedded or hosted.
Time
Typically 2–4 weeks.

MCP Tool Integration

For
Teams whose agents need to take real actions in real systems.
Get
Custom MCP servers wiring up internal tools, APIs, and databases.
Time
Typically 1–3 weeks.
02Agent Frameworks, Orchestration & Evaluation
harness-rs RUST
A production-ready Rust foundation for custom agents — so you build on a solid base instead of from scratch. ReAct loop, pluggable tools & skills, cross-session memory, scheduler, sandbox, and MCP client/server. Published on crates.io.
agent-go GO
Drop AI agents straight into your existing Go services — teams, tasks, memory, MCP, and tool calling, with fewer external dependencies to deploy.
eval-go GO
Know whether your agent actually works — a native-Go LLM/RAG/agent evaluation framework: 27 metrics, synthetic data, red-teaming, regression gates, and judge-alignment (measure whether the LLM judge itself agrees with humans). A dependency-free alternative to RAGAS / DeepEval.
roma GO
Coordinate several agents on one task — a runtime orchestrator for multi-agent systems.
03Memory · Knowledge Graphs · RAG
cortexdb ★ flagship GO
Give agents reliable retrieval without standing up a separate database. A pure-Go, single-file AI memory & knowledge-graph engine: vector + hybrid (BM25/FTS5) search, GraphRAG, one-pass structured-data import — zero external services, fully embedded.
askdoc GO
Point an agent at your own documents and get grounded answers — a working RAG pipeline for internal docs.
04MCP Servers — connect anything to an agent
mcp-swagger-server GO
Connect an existing API to an agent without writing glue code — turn any Swagger / OpenAPI spec into ready-to-use agent tools, cutting integration setup time.
mcp-websearch-server GO
Give agents live, multi-engine web search with content extraction — exposed as MCP tools.
mcp-sqlite-server GO
Let an agent safely query a SQLite database over MCP. (+ mcp-snapshot-server)
05Local-LLM & Infrastructure Tooling
ollama-go GO
Run local models from your Go code — a Go client library for Ollama, for teams that need on-prem or private LLMs.
lmstudio-go GO
A Go client for LM Studio: chat, embeddings, tool calling, model management.
gosible · dispatch GO
Infrastructure & multi-server automation in Go. (+ ollama-queue: a task queue for Ollama)
06FAQ
What does Liang Li do?

I help teams turn LLM demos into production AI agents — building agent systems, RAG and knowledge-graph retrieval, and MCP integrations that connect agents to your real tools, APIs, and databases. Primarily in Go and Rust.

Can you take our AI prototype from demo to production?

Yes — that's the core of the work. I take an LLM prototype and turn it into a reliable system that runs unattended inside your real environment, with evals, guardrails, documentation, and a clear deployment path.

Can you work with our existing codebase?

Yes. I'm comfortable joining an existing codebase and integrating agent, RAG, and MCP capabilities into systems you already run — not only greenfield projects.

Do you build custom MCP tools for internal systems?

Yes. I build custom MCP servers that let agents take real actions — connecting internal tools, APIs, and databases so an agent can do useful work, not just chat.

Are you open to a remote role, and do you work async with US / EU teams?

Yes — open to a full-time remote role or contract. I'm remote-first and async-friendly, based in Chengdu (UTC+8), and work with US and EU teams through clear written communication and documentation. Reach me at ll_faw@hotmail.com.

What are the main projects?

harness-rs (a Rust agent framework on crates.io), agent-go (a Go AI agent SDK), cortexdb (a pure-Go AI memory + knowledge-graph engine with vector/hybrid search and GraphRAG), eval-go (a native-Go LLM/agent evaluation framework with judge-alignment), and a suite of MCP servers for Swagger/OpenAPI, web search, and SQLite. I build the tooling agents are made of, not just apps that call an LLM.

I take an LLM from “demo” to running unattended inside your systems.