1 year ago
Base Salary
$190k - $270k/yr
Responsibilities
- Design, build, and maintain scalable, high-performance services supporting AI-driven applications across edge and cloud environments.
- Develop APIs and microservices integrating cloud-based AI models with edge devices.
- Optimize data pipelines and storage solutions for real-time AI inference and processing.
- Build and optimize an agent orchestration runtime supporting tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
- Implement security and privacy best practices for distributed AI systems.
- Collaborate with AI researchers, infrastructure engineers, and frontend developers on end-to-end AI solutions.
- Develop logging, monitoring, and alerting systems to support system reliability.
Requirements
- 10+ years of backend software development experience.
- Strong proficiency in Java, C++, or Python.
- Experience integrating LLMs into multi-agent systems, including agent orchestration, tool use, and memory or context management.
- Experience with prompting, task decomposition, tool use, and structured outputs for LLMs.
- Experience building distributed systems, microservices, and cloud-native applications.
- Knowledge of secure, privacy-aware interfaces between models, devices, and external services.
- Familiarity with SQL and NoSQL database management systems and data streaming technologies.
- Preferred: experience deploying and integrating AI models into backend services.
- Preferred: knowledge of edge computing, networking, and security best practices.
- Preferred: exposure to cloud-edge hybrid architectures and distributed AI workloads.
- Preferred: familiarity with TensorFlow Lite, ONNX Runtime, or CoreML.
Benefits
- Health, dental, and vision insurance.
- Long-term and short-term disability insurance, life insurance, employee assistance program, and flexible spending account.
- 4–12 weeks of fully paid parental leave based on tenure, 11 paid holidays, and flexible paid vacation and sick leave.
- Flexible work environment with autonomy and flexibility.
