4 hours ago
Responsibilities
- Build and evolve AI platform capabilities supporting GenAI-powered applications.
- Design, develop, and deploy scalable infrastructure for model training and serving, feature and data workflows, orchestration, deployment, and evaluation.
- Work hands-on across backend services, execution infrastructure, and integrations with AI models and tooling.
- Set technical direction across AI/ML and AI evaluation platform surfaces and drive multi-quarter roadmaps.
- Evaluate AI infrastructure frameworks and tools and make build, buy, and adoption decisions.
- Build and operate distributed production systems, including responsibility for reliability, on-call support, and incident leadership.
- Drive projects to completion with measurable business impact and mentor and raise the technical bar of other engineers.
Requirements
- 10+ years of professional software engineering experience with staff-level or equivalent technical leadership scope.
- 3+ years of production AI/ML infrastructure experience, including model serving, feature platforms, training or orchestration systems, or ML observability.
- Hands-on experience with production LLM-powered systems, such as LLM gateways or proxies, prompt and model lifecycle management, RAG or agentic architectures, and LLM workload cost optimization.
- Experience building or operating AI evaluation systems, including offline evaluation pipelines, LLM-as-judge approaches, calibration against human judgment, regression testing, or A/B measurement of AI features.
- Deep experience designing, building, and operating reliable distributed systems at meaningful scale.
- Experience owning production services, participating in on-call responsibilities, and leading incidents.
- Ability to use AI coding tools and validate, critique, and refine AI-generated output.
Categories
About Thumbtack
Thumbtack builds a marketplace and app that connects U.S. homeowners with service professionals for repairs, maintenance, and home improvements. Pros pay for leads and bookings generated on the platform, and can use built-in tools for scheduling, messaging, and payments. Founded in 2008 and headquartered in San Francisco, it features a network of about 300,000 local businesses and has supported over 11 million projects nationwide.