Software Engineer (AI Platforms)
SingleStoreResponsibilities
- Build and evolve backend services for agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations.
- Design secure, tenant-aware APIs and control-plane workflows for AI platform components.
- Implement MCP-style tool discovery and integration patterns for agents, connectors, and internal services.
- Engineer for reliability and scale through latency and cost controls, rate limiting, fallbacks, rollouts, and incident readiness.
- Establish evaluation practices including offline test sets, regression detection, prompt/model/version tracking, and quality gates.
- Contribute to secure AI capabilities involving permissions, data boundaries, prompt-injection defenses, and auditability.
- Collaborate with product managers, designers, customers, and partner engineering teams, mentor junior engineers, and contribute to team practices.
Requirements
- Strong software engineering skills and experience with distributed systems using Go, Python, or similar languages.
- Experience building cloud-native services with Kubernetes, containers, service-to-service APIs, and CI/CD.
- At least 4 years of experience working on a SaaS product or production platform.
- Solid understanding of supervised learning, LLM concepts, embeddings, and vector search fundamentals.
- Strong debugging and problem-solving skills across services and infrastructure, including incident-style troubleshooting.
- Preferred: hands-on experience with AI agents, orchestration frameworks, RAG systems, reranking, grounding, evaluation, and model serving.
- Preferred: knowledge of AI security, vector databases or vector capabilities, observability stacks, and SLO-driven engineering.
Tech Stack
Categories
About SingleStore
The core of all AI, business intelligence and applications is data — various bits and bytes that come in all different formats. Only when we sift through this data, reason with it and build on top of it in real time does it give way to vast amounts of information and knowledge. Real-time insights are key to the way we live our lives today; the way we entertain ourselves; the way we listen to music; the way we order groceries. Real-time insights keep your BI tools fresh; they keep your ride-sharing app with the most current price; and they ensure you never miss a fraudulent payment. SingleStoreDB is the world’s only database that empowers users to transact, analyze and search data in real time. It empowers the world’s makers to build, deploy and scale modern, intelligent applications — backed by streaming data ingestion, a unique table type that supports both transactional (OLTP) and analytical (OLAP) workloads, limitless point-in-time recovery and a distributed (shared-nothing), MySQL-compatible architecture.