Julius AI

Software Engineer - Infrastructure (Mid - Senior)

Julius AI
Apply
3 months ago
San Francisco, CA, USAMid Level / Senior

Base Salary

$150k - $200k/yr

Responsibilities

  • Design and operate secure, multi-tenant container infrastructure with fast startup and intelligent autoscaling.
  • Ship cloud deployments with SSO, network controls, and audit logging.
  • Drive observability through metrics, traces, and logs with clear SLOs, and lead incident response.
  • Optimize container images, scheduling, networking, and infrastructure cost.
  • Build fair-use and rate-limiting controls.

Requirements

  • Production experience with Kubernetes and container internals, including Docker or containerd.
  • Strong networking fundamentals and experience with cloud platforms such as AWS, GCP, or Azure.
  • Experience with infrastructure as code and deployment tooling including Terraform and Helm.
  • Familiarity with monitoring and logging technologies such as Prometheus, Grafana, OpenTelemetry, ELK, or Vector.
  • Knowledge of security best practices for containerized, multi-tenant systems.
  • Nice-to-have experience with gVisor, Kata, Firecracker, Cilium, eBPF, GPU scheduling, KEDA, Knative, or Karpenter.
  • Experience building an AI side project and interest in LLMs is a plus.

Benefits

  • Health and dental insurance, gym reimbursement, daily team meals, and commuter benefits.

Categories

DevOpsSecuritySite Reliability
Julius AI

About Julius AI

1-10 employees

Your AI Data Scientist: Easily analyze, visualize and transform data