1 day ago
Boston, MA, USA or San Francisco, CA, USASenior
Base Salary
$160k - $190k/yr
Responsibilities
- Partner with engineers and product managers to identify workflow bottlenecks, prioritize problems, and own solutions from requirements and architecture through rollout and iteration.
- Own evaluation and observability systems for AI products, including automated and human review, regression detection, and comparisons across models, prompts, and pipelines.
- Build internal applications and self-service tools for inspecting AI results, investigating failures, and collecting feedback, with potential customer-facing extensions.
- Build scripts, data pipelines, integrations, and automations connecting internal systems, third-party services, LLMs, and Model Context Protocol tools.
- Create unified analytics layers from evaluation results, customer feedback, and telemetry while maintaining data quality and schema evolution.
- Design RAG-based information repositories and tooling for component data and domain knowledge.
- Integrate AI insights with CI/CD workflows and help improve AI workflow reliability, cost, latency, and cache effectiveness.
- Document technical findings, communicate with technical and non-technical audiences, mentor teammates, and champion code quality, testing, and reliability.
Requirements
- 4+ years of software engineering experience focused on tooling, data platforms, or full-stack web development, with senior-level ownership of dependable systems or products.
- Strong SQL skills and experience designing data pipelines and storage schemas, managing data quality and schema evolution, and using analytics tools.
- Proficiency in Python scripting and automation for data pipelines, integrations, and internal tools.
- Experience building web applications or customer-facing tools with modern frameworks such as Vue, React, or TypeScript.
- Practical experience shipping or maintaining LLM-enabled systems, including evaluation pipelines, observability, or integrations, with awareness of non-determinism and cost, latency, quality, and reliability tradeoffs.
- Bachelor’s degree or higher in a technology-related field, or equivalent practical experience.
- Strong communication, customer focus, project management, stakeholder collaboration, autonomy, and comfort with ambiguity.
- Preferred familiarity with business analytics and data visualization tools, LLM evaluation frameworks, GitHub Actions, monitoring and observability tools, and common web architectures and APIs.
Benefits
- Flexible work with preferred availability for hybrid work from the San Francisco or Boston flex offices 2–3 times per week.
- Competitive salary and equity, health, dental, and vision benefits, generous PTO, and a home office stipend.
- Supportive colleagues, flexible work, and the opportunity to make a significant impact.
Tech Stack
AWSDatadogGitHub ActionsGoGrafanaJavaScriptJupyter NotebookMetabasePostgreSQLPythonReactSQLTerraformTypeScriptVue.js
Categories
AI ApplicationsData Engineering
About AllSpice
AllSpice builds a git-based collaboration and workflow platform for hardware and electronics teams to manage PCB and schematic changes, reviews, and documentation. It sells a SaaS product with deep integrations to ECAD tools and an AI design review agent (DRCY) that runs automated, auditable checks. Founded in 2020 and headquartered in Boston, it targets enterprise hardware organizations seeking version control and a system of record for complex designs.