
Gen AI Engineer
Tiger Analytics Inc.2 months ago
Remote, Canada or Toronto, CanadaSenior
Responsibilities
- Build high-performance API services using Python and AWS infrastructure.
- Integrate Generative AI and LLM APIs, including AWS Bedrock and other model providers.
- Design and implement end-to-end RAG pipelines with retrievers, vector stores, embeddings, and generators.
- Develop autonomous or semi-autonomous agents using frameworks such as LangChain, CrewAI, or Semantic Kernel.
- Manage agent orchestration, tool integration, memory, context, error handling, and external API interactions.
- Optimize latency, relevance, grounding accuracy, hallucination detection, and overall production performance.
- Use evaluation frameworks such as RAGAS and TruLens to measure and improve system performance.
- Work with DevOps, CI/CD pipelines, and ML pipelines within the AWS ecosystem.
Requirements
- At least 7 years of professional experience in software development and AI engineering.
- Strong Python programming skills and experience building backend API services.
- Hands-on experience integrating Generative AI or LLM APIs, AWS Bedrock, and other model providers.
- Experience building Gen AI or agentic AI applications and managing their efficiency, latency, and backend infrastructure.
- Strong understanding of OpenAI API standards, JSON, RESTful API design, and LLM orchestration.
- Experience designing RAG systems, including document chunking, embeddings, retrievers, vector stores, relevance tuning, and latency optimization.
- Practical experience developing agents with frameworks such as LangChain, CrewAI, or Semantic Kernel.
- Experience managing memory and context in multi-turn interactions and integrating external APIs.
- Familiarity with evaluation frameworks such as RAGAS and TruLens.
- Experience with Bedrock Agent and Core services is preferred.
Benefits
- Fully remote position based in Canada.
- Significant career development opportunities as the company grows.
- Opportunity to work in a small, fast-growing, challenging, and entrepreneurial environment.
- High degree of individual responsibility.