about 4 hours ago
Remote, Worldwide +2 moreSenior
Responsibilities
- Design and build backend services for AI-powered product features.
- Develop inference pipelines and orchestration layers around LLMs.
- Create reliable APIs used by web, desktop, and mobile applications.
- Optimize latency, throughput, caching, batching, and streaming.
- Build monitoring, logging, alerting, and observability across production services.
- Debug distributed systems and improve platform reliability.
- Collaborate with product, infrastructure, and AI engineers to enhance performance.
Requirements
- Strong backend engineering experience in production environments.
- Experience building high-throughput, low-latency distributed systems.
- Excellent Python skills; Node.js is a plus.
- Hands-on experience deploying and operating services on Kubernetes and Docker.
- Experience with SQL and NoSQL databases.
- Familiarity with modern AI infrastructure, including LLM inference and embeddings.
- A pragmatic engineering mindset focused on shipping reliable software.