Data Infra - Telemetry and Observability (IC)
Matter Intelligence4 hours ago
Responsibilities
- Build a common telemetry model connecting mission, data, infrastructure, model, environment, agent, tool, decision, cost, latency, and feedback signals.
- Instrument distributed training, data loading, GPU utilization, checkpointing, experiments, batch and online inference, model serving, and agent workflows.
- Connect mission state, hardware context, time, geometry, and geolocation with relevant datasets and model results.
- Establish service objectives, alerts, incident interfaces, rollout and rollback signals, and escalation paths across platform, model, environment, and agent failures.
- Build capacity and cost visibility across storage, processing, accelerators, training, evaluation, inference, retrieval, and agent execution.
Requirements
- Experience with ML observability, telemetry, time-series systems, distributed training or inference, cloud infrastructure, or production AI platforms.
- Strong hands-on engineering skills in observability, automation, APIs, infrastructure, incident tooling, and systems debugging.
- Understanding of metrics, logs, traces, events, model and data monitoring, service objectives, capacity, release safety, and incident diagnosis.
- Ability to reason about AI failure modes including bad datasets, training instability, stale checkpoints, drift, version mismatch, environment bugs, and agent-tool failure.
- Experience designing telemetry schemas and correlation workflows across multiple systems, time domains, and ownership boundaries.
- Preferred experience includes MLOps, GPU workloads, model serving, agent observability, reinforcement-learning environments, mission telemetry, scientific instrumentation, high-throughput inference, streaming systems, geospatial pipelines, mixed cloud and edge deployments, reliability platforms, or regulated aerospace and defense operations.
Benefits
- Competitive compensation based on experience, early-stage equity, and 100% employer-paid health, dental, and vision coverage.
- Opportunity to work on novel sensing, data, and AI systems with real-world deployment paths.
- Based in San Francisco, California, with required onsite work.
Categories
DevOpsSite Reliability
About Matter Intelligence
Matter specializes in advancing sensors and geospatial AI that capture "extreme-resolution" images of natural and artificial materials from space to surface, creating never-seen data of all matter globally. Our sensors simultaneously measure shape, composition, and temperature to understand and predict real-world events like never before. Matter's data accelerates computer vision and contextual geospatial modeling to unlock the next generation of intelligence.