Member of Technical Staff, Cloud Infrastructure
Fireworks AIover 1 year ago
Base Salary
$175k - $220k/yr
Responsibilities
- Architect and build scalable, resilient backend infrastructure for distributed training, inference, and data-processing pipelines.
- Design and implement backend services such as job schedulers, resource managers, autoscalers, and model-serving layers.
- Lead technical design discussions, mentor engineers, and establish infrastructure engineering best practices.
- Optimize compute costs, storage lifecycles, network performance, system scalability, and operational efficiency.
- Collaborate with ML, DevOps, product, and infrastructure teams to translate research and product requirements into robust solutions.
- Evaluate and integrate cloud-native and open-source technologies to improve platform capabilities and reliability.
- Own systems end to end from design through deployment and observability, with emphasis on reliability and fault tolerance.
- Develop monitoring, alerting, logging, and tracing solutions and address disaster recovery, scaling bottlenecks, and performance issues across multi-cloud infrastructure.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- At least 5 years of experience designing and building backend infrastructure in cloud environments.
- Proven experience with machine learning infrastructure and tooling.
- Strong software development skills in Python or C++.
- Deep understanding of distributed systems, including scheduling, orchestration, storage, networking, and compute optimization.
- Master’s or PhD in Computer Science or a related field is preferred.
- Experience leading infrastructure projects for large-scale ML/AI workloads or high-throughput systems is preferred.
- Familiarity with infrastructure-as-code and CI/CD tooling is preferred.
- A track record of improving system performance, reliability, and cost efficiency is preferred; open-source contributions are a plus.
Benefits
- Opportunity to work on large-scale AI infrastructure and generative AI workloads.
- Collaboration with experienced engineers and AI researchers.
- Equal-opportunity and inclusive workplace.
- No remote, hybrid, or office logistics are stated.
Tech Stack
Categories
About Fireworks AI
Fireworks AI builds a generative AI platform for developers and enterprises to train, fine-tune, and serve open models for production use across text, image, audio, embeddings, and multimodal workloads. It offers managed inference and tooling via APIs on globally distributed infrastructure, with a usage-based SaaS model. Founded in 2022 and headquartered in San Mateo, CA, Fireworks AI is a privately held, Series D company.