Software Engineer I - LLM Observability
Honeycomb.io4 days ago
Remote, United StatesEntry Level
Base Salary
$160k - $180k/yr
Responsibilities
- Deliver AI observability capabilities end to end, from ingestion to in-product visualizations.
- Contribute to the data model and infrastructure for observing AI agents and their ecosystems.
- Build systems that analyze and surface AI-specific signals including cost, token usage, errors, and anomalies.
- Collaborate with product managers and designers to create usable features and meaningful workflows.
- Explore and communicate ways to understand AI system behavior across conversations and workloads.
- Iterate through experimentation and fast feedback loops, sharing both successes and failures.
Requirements
- 3+ years of software engineering experience.
- Experience shipping customer-facing features at a SaaS company beyond internal tooling.
- Full-stack proficiency with backend development in Go and/or Python and frontend development in TypeScript and React.
- Experience collaborating with product managers and designers.
- Regular hands-on use of AI tools in day-to-day engineering work.
- Experience being on call and willingness to join the rotation after approximately 90 days.
- Ability to navigate ambiguity and shifting requirements in a fast-moving, experimental environment.
- Bonus: experience building LLM- or agent-powered features in production.
- Bonus: hands-on experience with observability tooling such as OpenTelemetry.
Benefits
- Fully distributed and remote work environment.
- Generous equity with an employee-friendly stock program.
- Unlimited paid time off.
- Home office, coworking, and internet stipend.
- Full benefits coverage for employees, with additional dependent coverage available.
- Up to 16 weeks of paid parental leave regardless of path to parenthood.
- Annual development allowance.
- Transparent pay levels based on experience.
Tech Stack
Categories
About Honeycomb.io
Honeycomb.io builds a SaaS observability platform for software engineering, SRE, and DevOps teams to debug and operate distributed systems using tracing, event data, and high-cardinality queries. Its product integrates with OpenTelemetry and supports SLOs, instrumentation, and production debugging workflows. Founded in 2016 and headquartered in San Francisco, the company is privately held and counts customers such as Slack, HelloFresh, LaunchDarkly, and Vanguard.