Senior Software Engineer, AI
Lattice
about 4 hours ago
Remote, Canada
Senior
H1B Sponsor
Responsibilities
- Design and ship an end-to-end AI evaluation framework.
- Define and instrument key performance metrics for AI agents.
- Build and maintain evaluation datasets and automated scoring pipelines.
- Architect and implement reusable agent infrastructure.
- Contribute to production AI systems with a focus on reliability and performance.
- Own projects end-to-end and collaborate with engineering leads.
Requirements
- 5+ years of professional software engineering experience in production AI/ML systems.
- Deep hands-on experience with LLM-based systems and evaluation metrics.
- Proven ability to work with data and understand statistics.
- Strong command of AI evaluation and experience building eval frameworks.
- Production-grade Python engineering skills.
- Familiarity with LangGraph or comparable agent orchestration frameworks.
Benefits
- Medical and dental insurance.
- Life, AD&D, and disability insurance.
- Wellness apps and paid parental leave.
- Paid time off including holidays and sick time.
- Remote work stipend and WFH office set-up stipend.
- Retirement plan and financial planning support.
Tech Stack
AWSDatadogGoogle Cloud PlatformMLflowPythonTypeScript
Categories
AI & MLData Science