1 day ago
Tel Aviv-Yafo, IsraelMid Level / Senior
Responsibilities
- Build and operate backend systems for AI-powered features in production.
- Design inference pipelines and orchestration layers around models.
- Manage production concerns including monitoring, logging, and incident response.
- Optimize latency and throughput across inference, caching, batching, and streaming.
- Ensure APIs are stable and support seamless integration with frontend and ML systems.
Requirements
- Strong backend engineering fundamentals in production environments.
- Experience running high-throughput, low-latency services.
- Familiarity with AI inference patterns such as LLMs and embeddings.
- Comfortable debugging distributed systems under load.
- A bias toward shipping and learning from production behavior.