Software Engineer, AI Infrastructure
Fireworks AI2 months ago
San Mateo, CA, USA or New York, NY, USAMid Level / Senior
H1B Sponsor
Responsibilities
- Contribute to the design and development of scalable backend infrastructure for distributed training and inference.
- Build and maintain core backend services such as LLM CI/CD pipeline and model serving systems.
- Support performance optimization and reliability improvements across compute, storage, and networking layers.
- Build frameworks to ensure the best model quality in the industry.
- Collaborate with performance, training, and product teams to translate needs into infrastructure solutions.
- Participate in code reviews and continuous integration and deployment processes.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field.
- 3 years of experience in software engineering focused on infrastructure or machine learning systems.
- Strong programming skills in Python, Go, or a similar language.
- Proven experience in ML infrastructure and tooling such as PyTorch and Kubernetes.
- Basic understanding of LLM knowledge.
Benefits
- Solve hard problems at the forefront of AI infrastructure.
- Work with bleeding-edge technology impacting global AI usage.
- Enjoy ownership and impact in a fast-growing team.
- Collaborate with world-class engineers and AI researchers.