Senior Software Engineer, AI Agentic Platform

4 hours ago

H1B sponsor

Base Salary

$177k - $216k/yr

Responsibilities

Design and build production-grade agentic platform infrastructure, including orchestration pipelines, tool-use abstractions, MCP integrations, and context and memory management.
Architect high-throughput, low-latency LLM inference routing, caching strategies, and semantic search interfaces.
Establish evaluation, tracing, observability, and debugging frameworks for agent execution and accuracy.
Build developer tooling, agent SDKs, and CI/CD automation for safe deployment of autonomous AI agents.
Implement guardrails, rate limiting, sandboxing, and security policies for model execution and tool access.
Make architectural decisions involving service boundaries, data consistency, multi-agent communication, and system reliability.
Set technical standards, evaluate emerging AI tooling, and mentor engineering peers.

At least 6 years of backend software engineering experience focused on distributed systems, platform infrastructure, and high-load production environments.
At least 2 years of hands-on experience architecting and deploying agentic AI systems, LLM orchestration frameworks, or AI platform tooling.
Strong proficiency in Python, Java, or TypeScript, with production experience in asynchronous concurrency, API design, and performance tuning.
Production experience with agentic frameworks and protocols such as LangGraph, Anthropic MCP, Google ADK, AutoGen, A2A, or LlamaIndex.
Expertise in microservices architecture, Kubernetes, and AWS.
Experience with observability and LLMOps, including metrics, distributed tracing, structured logging, and agent-run debugging.
Knowledge of relational databases, vector databases, Kafka, SQS, and caching patterns.
Experience using AI-powered development tools such as Claude Code or GitHub Copilot.
Strong technical communication and ability to document complex AI architectures and collaborate cross-functionally.
Advanced degree in computer science, machine learning, or a related technical field is a plus.
Experience with customized agent harnesses, model fine-tuning, RLHF/RLAIF optimization loops, security compliance, open-source agent frameworks, MCP servers, or technical writing is a plus.

Office-first work arrangement requiring employees to be onsite at least four days per week.
Healthcare benefits, 401(k), short- and long-term disability coverage, basic life insurance, stock option plan, and bonus plans may be available.