about 2 hours ago
New York, NY, USA +3 more
Senior
Base Salary
$167k - $219k/yr
Responsibilities
- Build and evolve MCP servers connecting internal systems and data sources.
- Expand and operate LLM gateway infrastructure for routing and observability.
- Create shared prompt libraries and policy-as-code for safe team operations.
- Maintain structured context artifacts for accurate reasoning by LLMs.
- Improve knowledge discoverability for both humans and agents.
- Partner with domain teams to standardize and update key sources of truth.
- Build sandbox environments for safe AI experimentation.
- Create self-service tools for non-engineers to prototype AI workflows.
- Develop evaluation harnesses for testing internal AI agents.
Requirements
- 5+ years of backend development experience in complex production systems.
- Fluency across programming languages and platform engineering.
- Hands-on experience with LLM-powered systems and production deployment.
- Understanding of tradeoffs in AI deployments, including cost and safety.
- High-agency and self-directed with the ability to find high-leverage work.
- Clear communication skills for technical and non-technical audiences.
Categories
AI & MLBackend