Machine Learning Infrastructure Engineer
Astera Labsabout 4 hours ago
San Jose, CA, USAEntry Level / Mid Level
H1B Sponsor
Base Salary
$140k - $165k/yr
Responsibilities
- Build and improve internal AI infrastructure for LLM applications and model-backed workflows.
- Own inference deployment paths across managed and self-serve environments.
- Build platform layers such as model gateways, routing, and telemetry.
- Develop AI Ops capabilities for evaluation, observability, and incident triage.
- Create dashboards, tracing, logging, and alerting for production AI systems.
- Improve performance and unit economics through optimization techniques.
- Create reusable APIs, SDKs, and platform abstractions for AI systems.
Requirements
- 1–5 years of experience in software engineering, ML infrastructure, or related roles.
- Strong Python skills and systems instincts.
- Experience with AWS or GCP and production service ownership.
- Familiarity with inference deployments and model APIs.
- Experience with observability, telemetry, and reliability engineering.
- Understanding of evaluation systems and debugging non-deterministic AI behavior.
- Ability to translate complex platform needs into scalable infrastructure.