Principal Software Engineer
Standard Template Labs1 year ago
Base Salary
$200k - $250k/yr
Responsibilities
- Architect the platform’s intelligence layer across data ingestion, embeddings, retrieval, graph reasoning, agents, and real-time inference.
- Define and implement integrations for LLMs and predictive models across backend services, APIs, and user-facing experiences.
- Build production AI-powered features, including reasoning services, agent workflows, RAG pipelines, hybrid search, anomaly explanations, topology discovery, and natural-language querying.
- Develop scalable backend, data, inference, vector-search, and graph-traversal systems for AI workloads.
- Establish practices for prompt and schema design, context assembly, evaluation, guardrails, observability, and model monitoring.
- Collaborate on user experiences that make AI outputs understandable, actionable, trustworthy, and debuggable.
- Shape deployment, scaling, monitoring, rollback, reliability, security, explainability, and compliance strategies for AI services.
- Mentor senior engineers, lead architecture reviews and technical deep-dives, and influence engineering standards and culture.
- Evaluate and integrate AI frameworks, agent runtimes, orchestration tools, model APIs, and AI-assisted development tools where they provide user value.
Requirements
- 10+ years of professional software engineering experience, including technical leadership in complex, high-scale systems.
- Proven experience architecting and shipping distributed systems with meaningful AI, automation, or intelligent decisioning components.
- Hands-on experience with LLMs, embeddings, vector databases, RAG pipelines, agent frameworks, or model integration patterns.
- Strong system-design skills across APIs, data modeling, event-driven architectures, caching, storage, and performance optimization.
- Comfort working across backend services and user-facing or API-layer design.
- Proficiency in at least one of Go, Rust, Python, Java, or C++.
- Experience mentoring senior engineers and driving engineering best practices.
- Familiarity with AI-assisted development workflows and modern DevOps tooling.
- Experience operationalizing ML or LLM workloads in production at scale is preferred.
- Experience with microservices, event-driven systems, real-time data pipelines, high-throughput or low-latency systems, frontend frameworks, open-source contributions, or technical leadership in distributed systems or AI tooling is preferred.
Benefits
- Opportunity to architect foundational systems for an AI-first enterprise platform.
- Ownership of critical systems intended to scale to millions of users.
- Culture emphasizing craftsmanship, autonomy, and technical excellence.
- Competitive compensation, equity, and a comprehensive benefits package.
Categories
About Standard Template Labs
Standard Template Labs builds an AI-native service and configuration management platform for enterprises, designed to learn how work happens and automate coordination across teams. The product uses a graph-based architecture and is offered as enterprise software for IT operations and business process owners. The company is privately held, headquartered in New York, and founded in 2025.