Software Engineer, Developer Experience - AIIT
Lyft
3 months ago
Toronto, Canada
Mid Level / Senior
H1B Sponsor
Responsibilities
- Design, build, and maintain AI infrastructure platforms including LLM gateways and prompt management systems.
- Build intelligent agents and AI-powered automation to enhance developer workflows.
- Develop centralized automation workflow services with a user-friendly UI experience.
- Implement observability, monitoring, and cost management systems for AI infrastructure.
- Plan and execute high-level cross-team AI infrastructure projects.
- Partner with ML Platform and product engineering teams to design scalable AI solutions.
- Establish best practices for LLM integration and agent development.
- Write well-crafted, maintainable code for AI infrastructure components.
- Lead incident responses for AI infrastructure issues and mentor the team.
- Build internal tooling for prompt testing and AI performance benchmarking.
- Participate in on-call rotations for AI infrastructure systems.
- Mentor engineers on AI infrastructure best practices.
Requirements
- Bachelor's degree in Computer Science or a related field, or equivalent experience.
- 3+ years of experience in software development and infrastructure engineering.
- Experience building or integrating with AI/ML systems and LLM APIs.
- Strong understanding of LLM capabilities and AI safety considerations.
- Experience with API design and building developer-facing platforms.
- Proficiency in Python and/or Go for scalable AI infrastructure.
- Experience with Kubernetes and cloud infrastructure at scale.
- Familiarity with vector databases and RAG architectures.
- Proven ability to design and build robust infrastructure components.
- Experience with observability tools and monitoring systems.
- Ability to write clear technical documentation.
Benefits
- Extended health and dental coverage options, along with life insurance and disability benefits.
- Mental health benefits.
- Family building benefits.
- Child care and pet benefits.
- Access to a Lyft funded Health Care Savings Account.
- RRSP plan to help save for your future.
- Flexible paid time off policy allowing team members to take off as much time as needed.
- 18 weeks of paid time off for new parents.
- Subsidized commuter benefits.
Tech Stack
GoKubernetesPythonReact
Categories
AI & MLBackendDevOps