2 days ago
Tel Aviv-Yafo, IsraelStaff+
Responsibilities
- Design and operate reliable managed AI services focused on serving and scaling LLM workloads.
- Build automation and reliability tooling for distributed AI pipelines and inference services.
- Define, measure, and improve SLIs/SLOs across AI workloads.
- Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters.
- Automate observability and develop telemetry and performance-tuning strategies for latency-sensitive AI services.
- Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling.
- Contribute to distributed-system architecture for AI-first environments.
Requirements
- Strong software engineering background building production-grade systems beyond scripting or Bash.
- Demonstrated experience designing and implementing distributed systems.
- Hands-on experience with large language models or AI/ML infrastructure.
- Experience defining and measuring SLIs/SLOs, building monitoring and observability systems, improving performance and reliability, designing fault-tolerant systems, and creating automated testing strategies.
- Proficiency in at least one of Python, Go, Java, or C++.
- Deep working knowledge of Kubernetes, including cluster architecture, networking, scheduling, and workload management.
- Strong collaboration and communication skills and the ability to thrive in a fast-paced, mission-driven environment.
- Experience scaling LLM inference or training workloads is preferred.
Benefits
- Competitive benefits package supporting financial security, health, and overall well-being.
- Benefits tailored to local market standards, including pension contributions and additional work-life-balance perks.
Tech Stack
Categories
Site Reliability
About Crusoe
Crusoe builds and operates GPU-powered data centers and an AI cloud platform for enterprises running large-scale AI training and inference. It vertically integrates energy supply with compute, using stranded and renewable power to reduce emissions and costs, and sells capacity via cloud services and managed infrastructure. Founded in 2018 and headquartered in Denver, the company is privately held.