1 month ago
Santa Clara, CA, USAEntry Level
Base Salary
$150k - $270k/yr
Responsibilities
- Contribute to API serving, state management, policy enforcement, and execution-runtime infrastructure for agentic workflows.
- Build and maintain distributed services for model APIs, including request routing, rate limiting, and multi-tenant isolation.
- Develop data pipelines for API logs, usage analytics, and billing with an emphasis on correctness and freshness.
- Develop and improve internal SDKs and libraries using clean, well-tested code and clear contracts.
- Support conversational context and memory systems, including retrieval, caching, vector-store integration, and retrieval pipelines.
- Add structured logging, tracing, and metrics, and help investigate and resolve reliability issues.
- Collaborate with ML and product teams on model serving, voice runtime, and tooling infrastructure.
Requirements
- 0–2 years of professional software engineering experience; internships, co-ops, and strong personal or open-source projects count.
- A recent computer science degree with equivalent hands-on work may qualify.
- Solid programming fundamentals and an interest in backend and distributed systems, including concurrency and fault tolerance.
- Exposure to backend services, APIs, or data processing through work, coursework, or projects.
- Proficiency in at least one of Python, Go, Java, Rust, or C++, with willingness to learn additional languages.
- Familiarity with AWS or GCP, Docker or Kubernetes, version control, and CI/CD, or clear enthusiasm to learn them quickly.
- Curiosity, strong communication, collaboration, and receptiveness to feedback.
- Bonus qualifications include exposure to LLM serving, retrieval, agentic systems, Kafka, Kinesis, Spark, Flink, Airflow, agent frameworks, real-time media, or latency-sensitive systems.
- Experience shipping an end-to-end side project, hackathon build, or open-source contribution is a plus.
Benefits
- Early-career role with mentorship from senior engineers and meaningful production responsibility from day one.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSC++DockerGoGoogle Cloud PlatformJavaKubernetesPythonRust
Categories
