Julius AI

Software Engineer - Infrastructure (Mid - Senior)

Julius AI
Apply
5 months ago
San Francisco, CA, USAMid Level / Senior

Base Salary

$150k - $200k/yr

Responsibilities

  • Design and operate secure, multi-tenant container infrastructure with fast startup and intelligent autoscaling.
  • Ship cloud deployments with SSO, network controls, and audit logging.
  • Drive observability through metrics, traces, and logs with clear SLOs, and lead incident response.
  • Optimize container images, scheduling, networking, and infrastructure cost.
  • Build fair-use and rate-limiting controls.

Requirements

  • Production experience with Kubernetes and container internals, including Docker or containerd.
  • Strong networking fundamentals and experience with cloud platforms such as AWS, GCP, or Azure.
  • Experience with infrastructure as code and deployment tooling including Terraform and Helm.
  • Familiarity with monitoring and logging technologies such as Prometheus, Grafana, OpenTelemetry, ELK, or Vector.
  • Knowledge of security best practices for containerized, multi-tenant systems.
  • Nice-to-have experience with gVisor, Kata, Firecracker, Cilium, eBPF, GPU scheduling, KEDA, Knative, or Karpenter.
  • Experience building an AI side project and interest in LLMs is a plus.

Benefits

  • Health and dental insurance, gym reimbursement, daily team meals, and commuter benefits.

Categories

Julius AI

About Julius AI

11-50 employees

Julius AI builds an AI-powered workspace for data analysis and visualization that turns questions into finished work, from querying datasets to producing dashboards and presentations. It serves analysts, business teams, and researchers through a web app used by more than 2 million users, including organizations such as Nvidia and Harvard Business School. The company is privately held and headquartered in San Francisco.

Contact me