about 6 hours ago
Toronto, Canada +3 moreMid Level
H1B Sponsor
Base Salary
$165k - $330k/yr
Responsibilities
- Own the internal AI developer platform end to end, including architecture, development, rollout, operation, and measurement.
- Evaluate and integrate third-party AI coding tools such as Claude Code, Cursor, and Codex, and build the context layer for the monorepo.
- Build frameworks that enable engineers to create their own agents without deep LLM expertise.
- Establish an evaluation practice for AI-assisted development and use it to guide investment decisions.
- Drive adoption through good defaults, clear documentation, and low-friction developer experience rather than mandates.
- Work with engineering teams to identify useful AI applications and generalize them into platform capabilities.
- Own permissions, secrets handling, audit trails, and cost management for the AI platform.
- Build repository context infrastructure, internal MCP servers, shared skills, subagents, hooks, and sandboxed environments.
- Create project templates, onboarding workflows, self-service infrastructure, model access gateways, authentication, and audit logging.
- Develop evaluation harnesses and usage instrumentation, and integrate agents into CI/CD with appropriate guardrails.
Requirements
- 4+ years of relevant industry experience building and enabling AI-native software development lifecycles.
- Strong proficiency in Python and/or Go, building tools that other engineers use daily.
- Hands-on experience with LLMs and agent frameworks, including tool calling, MCP, context management, orchestration, and failure handling.
- Experience shipping an agentic system used by real people rather than only prototyping.
- Deep personal fluency with AI coding tools and informed opinions about their limitations.
- Experience with developer tooling, CI/CD, and Kubernetes/Docker fundamentals.
- Ability to work comfortably in an ambiguous and rapidly changing technical space.
- Excellent written communication skills for creating scalable documentation, templates, and examples.
Benefits
- Competitive compensation including meaningful equity is offered.
- Medical, dental, and vision insurance are fully covered for employees and dependents.
- Flexible PTO is provided, including a company-wide Winter Break from Christmas Eve through New Year's Day.
- Paid parental leave is provided.
- A fertility and family-building stipend is available through Carrot.
- The company facilitates a 401(k).
- The role offers exposure to a variety of ML startups and related learning and networking opportunities.
About Baseten
Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.