21 hours ago
Responsibilities
- Build infrastructure for agent runtime, evaluation, quality measurement, and model optimization.
- Create evaluation tooling that identifies coverage gaps and unsupported user questions.
- Design signal pipelines for user frustration, agent failures, and quality issues.
- Help define HubSpot-specific AI benchmarks for real workloads.
- Evaluate models across agents to improve quality, reduce cost, and support model routing.
- Make fine-tuning and task-specific optimization more repeatable.
- Influence senior engineers and leaders and set technical direction for company-wide AI infrastructure.
Requirements
- Deep experience with production machine learning, LLM, or AI infrastructure.
- Experience building systems at scale where reliability, latency, quality, and cost matter.
- Platform-oriented thinking and experience solving foundational infrastructure problems.
- Ability to collaborate across infrastructure, product, backend, and ML teams.
- Experience with evaluation frameworks, model serving, fine-tuning, signal extraction, experimentation, feedback loops, or model optimization.
- Strong technical credibility, judgment, and ability to influence senior engineers and leaders.
Benefits
- Annual cash compensation range is $285,800—$457,300 USD, including base salary, eligible on-target commission, and annual bonus targets; some roles may also include RSUs and overtime eligibility.
- HubSpot offers benefits and perks to support employee growth.
- Remote and office work options are available, with required regional-office onboarding for Engineering hires and additional in-person Product events where applicable.
- Accommodation support is available for travel limitations, disabilities, or other needs.
Categories
About HubSpot
HubSpot builds a cloud-based CRM platform with marketing automation, sales, customer service, content management, and operations tools for businesses, especially SMBs. It sells freemium and subscription SaaS plans with add-ons and a marketplace of integrations. Founded in 2006 and headquartered in Cambridge, Massachusetts, the public company (NYSE: HUBS) reports serving more than 250,000 customers globally.