Software Engineer, AI Agents
Blockit AI8 months ago
San Francisco, CA, USAMid Level
Responsibilities
- Write and refine prompts across orchestrator agents, sub-agents, and tools.
- Build and maintain evaluations to measure agent quality and catch regressions.
- Debug agent failures and determine why agents misunderstood requests or made poor decisions.
- Implement new agent capabilities as user needs expand.
- Experiment with new architectures and techniques as models improve.
- Instrument and analyze agent behavior to identify patterns and failure modes.
- Architect and build real-world AI agents used in production.
Requirements
- At least 2 years of experience shipping and owning production software.
- Strong backend engineering skills and the ability to work across the stack when needed.
- Experience working with LLMs in production systems, or demonstrated ability to learn quickly in this area.
- Deep curiosity about agent architectures and the evolution of AI systems beyond simple prompt-based approaches.
- Clear and structured communication skills for explaining system performance and issues.
Benefits
- On-site in San Francisco, California four days per week.
Categories