Senior AI Platform Engineer
Code Metal11 hours ago
Remote, United States +3 moreSenior
Base Salary
$170k - $210k/yr
Responsibilities
- Own one or more AI platform components from design through production operation.
- Build and operate model-serving, agentic infrastructure, context-engineering, observability, or experimentation services.
- Write clean, modular, well-tested production code and review teammates’ code and designs.
- Debug production issues such as tail latency, GPU memory pressure, and failing or looping agent runs.
- Scope and estimate work with internal customers, identify risks, and contribute across the platform stack.
- Mentor and onboard new engineers.
- Run focused benchmarks and experiments to inform platform decisions.
Requirements
- Production-grade Python and strong platform engineering fundamentals, including API and service design, distributed systems, containers, orchestration, and testing.
- Production experience in at least one focus area: LLM model serving, agentic infrastructure, or observability and experimentation.
- Solid data science and AI research fundamentals, including transformers, LLM inference, experiment design, benchmarking, and model evaluation.
- Working familiarity with PyTorch and Hugging Face.
- Experience owning a production service or component, including debugging and reliability improvements.
- Experience writing design documents, reviewing code, and mentoring or onboarding teammates.
- Typically 4+ years of software engineering experience, including 2+ years building and operating ML, AI, or LLM systems in production.
- Preferred: experience across more than one focus area; LLM gateways or proxies; inference optimization; durable workflows, agent frameworks, or MCP; language-model fine-tuning and distributed training; MLflow or Weights & Biases; and on-premises or regulated-domain AI deployments.
Benefits
- Health care plan with 100% premium coverage, including medical, dental, and vision.
- 401(k) with 5% matching.
- Uncapped vacation, sick leave, and public holidays.
- Flexible hybrid or remote work arrangement.
- Relocation assistance for qualifying employees.
- US citizenship may be required for certain assignments involving security clearance.
Tech Stack
Categories
About Code Metal
Code Metal builds an AI-assisted code transpilation and verification platform that translates algorithms into optimized implementations for heterogeneous hardware (GPUs, FPGAs, ASICs, and edge SoCs). It serves defense, automotive, aerospace, and semiconductor teams deploying DSP, RF, communications, and embedded signal-processing workloads to constrained devices. Privately held and founded in 2023, the company is headquartered in Boston, MA.