Staff Software Engineer
Fiddler AIResponsibilities
- Own and build Fiddler’s SDKs, instrumentation libraries, connectors, and ingestion systems for customer AI telemetry.
- Lead OpenTelemetry and OTLP strategy, including instrumentation, collectors, exporters, sampling, tracing, and ecosystem contributions.
- Define semantic conventions and mapping across LangChain, LangGraph, Strands, custom agents, and other OTLP sources.
- Architect distributed ingestion and processing services for high-throughput ML and agentic observability signals.
- Design scalable APIs, data infrastructure, and services that meet compliance requirements and service-level objectives.
- Drive SDK developer experience through ergonomics, versioning, backward compatibility, documentation, and examples.
- Build new evaluation and metric capabilities for GenAI and agentic use cases.
- Improve reliability, latency, SLOs, observability, CI/CD, testing, error handling, efficiency, and resiliency.
- Interview, mentor, coach, and help grow the engineering team.
Requirements
- Bachelor’s or Master’s degree in Computer Science or a related field and 10+ years of industry software development experience.
- Hands-on expertise with OpenTelemetry and OTLP, including instrumentation, collectors, semantic conventions, sampling, and tracing ecosystems.
- Deep Python proficiency and strong experience with Kafka, Postgres, and Redis for large-scale streaming and storage systems.
- Proven experience building developer-facing SDKs, client libraries, plugins, or data connectors.
- Strong distributed-systems design, production troubleshooting, and system optimization skills.
- Ability to plan and deliver complex work, guide a small team, operate autonomously, and collaborate cross-functionally.
- Strong technical leadership, code and design review experience, coaching, mentorship, and collaboration skills.
- Preferred experience with AWS, GCP, Kubernetes, ClickHouse, or Druid.
- Preferred experience deploying ML or LLM models in production and working with LangChain, LangGraph, Strands, HuggingFace, vLLM, LiteLLM, Ragas, or MLflow.
- Preferred familiarity with Databricks, MLflow, SageMaker, Vertex AI, and ML-platform integration patterns.
- Open-source contributions to observability or instrumentation projects such as OpenTelemetry or OpenInference are preferred.
Tech Stack
Categories
About Fiddler AI
Fiddler is the AI Control Plane, the system of trust, for first-party and third-party agents from the creation layer to production. Continuous evaluation, reliable monitoring, enforceable policy, and auditable governance give enterprises the centralized controls and actionable insights to scale AI with trust. Integral to the platform are the secure Fiddler Centor Models, which power the industry’s fastest guardrails and evaluations that require low latency and cost-effectiveness or complex reasoning with accuracy. Compared to external LLMs, Fiddler Centor Models offer a low TCO with no hidden costs. Fortune 100 organizations use Fiddler to deliver high performance agentic and predictive applications, protect from costly risks, and maximize ROI. An integral part of the platform, the Fiddler Trust Service provides quality and moderation controls for AI agents and GenAI applications. Powered by cost-effective, task-specific, and scalable Fiddler-developed trust models — including cloud and VPC deployments for secure environments — it delivers the fastest guardrails in the industry. Fortune 500 organizations use Fiddler to scale AI agents, GenAI, and ML deployments. This helps them deliver high performance AI, avoid costly AI risks, and maximize ROI.