Senior Software Engineer, AI
Lattice
about 4 hours ago
Remote, Canada
Senior
H1B Sponsor
Responsibilities
- Design and ship a robust, end-to-end AI evaluation framework.
- Define and instrument key performance metrics for AI agents.
- Build and maintain evaluation datasets and automated scoring pipelines.
- Identify drivers of agent quality improvement.
- Architect and implement reusable agent infrastructure.
- Build and scale retrieval infrastructure and RAG pipelines.
- Make informed build vs. buy decisions for AI tools.
- Contribute to production AI systems with a focus on reliability.
- Own projects end-to-end and drive them to completion.
- Partner with engineering leads to inform technical direction.
- Raise the AI engineering bar through code review and documentation.
Requirements
- 5+ years of professional software engineering experience in production AI/ML systems.
- Deep hands-on experience with LLM-based systems and evaluation metrics.
- Proven ability to work with data and understand statistics.
- Experience building and operating agentic AI systems in production.
- Strong command of AI evaluation frameworks.
- Production-grade Python engineering skills.
Benefits
- Medical and dental insurance.
- Life, AD&D, and disability insurance.
- Wellness apps and natural disaster support.
- Paid parental leave and paid time off.
- Remote work stipend and WFH office setup stipend.
- Retirement plan and financial planning support.
- Learning and development budget.
Tech Stack
AWSDatadogGoogle Cloud PlatformMLflowPythonTypeScript
Categories
AI & MLData Science