2 months ago
Toronto, Canada +3 moreMid Level
H1B sponsor
Base Salary
$165k - $330k/yr
Responsibilities
- Own the internal AI developer platform end to end, including architecture, development, rollout, operation, and measurement.
- Evaluate and integrate AI coding tools such as Claude Code, Cursor, and Codex, and build the context layer for Baseten's monorepo.
- Build frameworks that enable engineers to create agents without deep LLM expertise.
- Establish evaluation practices for AI-assisted development and use results to guide investment decisions.
- Drive adoption through developer experience, good defaults, documentation, and low-friction workflows.
- Work with engineering teams to identify useful AI applications and generalize them into platform capabilities.
- Own platform safety controls covering permissions, secrets handling, audit trails, and cost management.
- Build agent infrastructure, MCP servers, shared skills, subagents, hooks, sandboxed environments, project templates, onboarding, model-access gateways, authentication, cost controls, audit logging, evaluation harnesses, usage instrumentation, and CI/CD guardrails.
Requirements
- 4+ years of relevant industry experience building and enabling AI-native software development lifecycles.
- Strong proficiency in Python and/or Go, with experience building tools used daily by other engineers.
- Hands-on experience with LLMs and agent frameworks, including tool calling, MCP, context management, orchestration, and failure handling.
- Experience shipping an agentic system used by real people.
- Deep fluency with AI coding tools and informed perspectives on their limitations.
- Developer tooling, CI/CD, and Kubernetes/Docker fundamentals.
- Ability to work effectively in an ambiguous and rapidly changing area.
- Excellent written communication skills for producing documentation, templates, and examples.
Benefits
- Competitive compensation including meaningful equity, with no base salary amount specified.
- 100% medical, dental, and vision insurance coverage for employees and dependents.
- Flexible PTO and company-wide Winter Break from Christmas Eve through New Year's Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups and related learning and networking opportunities.
Tech Stack
Categories
About Baseten
Baseten builds an AI inference platform that provides tooling, infrastructure, and hardware to deploy, scale, and serve machine-learning models in production. The company sells managed model serving and developer tooling to software teams at AI product companies, with customers including Notion, Abridge, Writer, and Cursor. Privately held and headquartered in San Francisco, it focuses on high-availability, globally distributed inference for production workloads.