1 year ago
Base Salary
$149k - $240k/yr
Responsibilities
- Design, build, and maintain scalable, high-performance services for AI-driven applications.
- Develop APIs and microservices connecting cloud-based AI models with edge devices.
- Optimize data pipelines and storage for real-time AI inference and processing.
- Build and optimize an agent orchestration runtime supporting tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
- Implement security and privacy best practices for distributed AI systems.
- Collaborate with AI researchers, infrastructure engineers, and frontend developers on end-to-end AI solutions.
- Develop logging, monitoring, and alerting systems to support system reliability.
Requirements
- Require 5+ years of backend software development experience.
- Require strong proficiency in Java, C++, or Python.
- Require experience integrating LLMs into multi-agent systems, including agent orchestration, tool use, and memory/context management.
- Require experience with distributed systems, microservices, and cloud-native applications.
- Require knowledge of secure, privacy-aware interfaces between models, devices, and external services.
- Require familiarity with SQL and NoSQL database management systems and data streaming technologies.
- Prefer experience deploying and integrating AI models into backend services.
- Prefer knowledge of edge computing, networking, and security best practices.
- Prefer exposure to cloud-edge hybrid architectures and distributed AI workloads.
- Prefer familiarity with TensorFlow Lite, ONNX Runtime, or CoreML.
Benefits
- Health, dental, and vision insurance.
- Long-term and short-term disability insurance, life insurance, an employee assistance program, and a flexible spending account.
- Flexible paid time off and sick leave, 11 paid holidays, and 4–12 weeks of fully paid parental leave based on tenure.
- Flexible work environment and comprehensive full-time employee benefits.
