Senior Gen AI Developer
Orion Innovation4 months ago
Responsibilities
- Design and implement single-agent and multi-agent architectures, including planning, routing, reflection, critique, and task decomposition.
- Build tool-using agents with function calling, authorization, retries, rate limiting, and sandboxing.
- Implement RAG, memory, retrieval, context assembly, and grounding or citation behaviors.
- Develop workflow orchestration with state machines or graphs, concurrency controls, and deterministic execution where possible.
- Productionize GenAI services with APIs, background jobs, streaming responses, caching, and cost or latency optimization.
- Establish agent evaluation using golden sets, simulation-based evaluations, LLM-as-judge mitigations, task-success metrics, and regression testing.
- Build observability and safety capabilities, including tracing, token and tool telemetry, anomaly detection, prompt-injection defenses, data-leakage prevention, and policy enforcement.
- Collaborate with product, security, and platform teams to integrate solutions with internal data, identity, and workflow systems.
- Mentor engineers, establish coding standards, and contribute to architecture reviews and technical roadmaps.
Requirements
- At least 6 years of software engineering experience and at least 2 years building LLM or GenAI systems in production.
- Strong programming skills in Python and/or TypeScript/Node.js.
- Hands-on experience building agents with tool calling, planning, routing, and multi-step workflows beyond simple chatbots.
- Understanding of prompting, context-window management, grounding, hallucination failure modes, and mitigation strategies.
- Experience with RAG, embeddings, vector databases, chunking strategies, hybrid retrieval, and re-ranking.
- Experience shipping production services using Docker, Kubernetes, REST/gRPC, CI/CD, monitoring, and basic incident response.
- Strong data and security instincts, including secrets management, PII handling, secure tool access, and least privilege.
Tech Stack
Categories
About Orion Innovation
Orion Innovation delivers next-generation solutions in Data, AI, Cloud, and Digital Experience, empowering organizations to innovate, scale, and embrace future technologies. With deep software engineering expertise and a strong understanding of industry-specific challenges, we build data-driven products and solutions that enhance customer experiences, accelerate growth, and drive long-term value. Envision what's next. Build what matters. For more information, visit www.orioninnovation.com.