Base Salary
$149k - $235k/yr
Responsibilities
- Architect and implement scalable distributed infrastructure for model serving, including load balancing, autoscaling, batch scheduling, and global KV caching.
- Optimize model-inference latency and throughput under production workloads.
- Build reliable, highly concurrent serving systems capable of handling billions of requests.
- Benchmark, fine-tune, and accelerate inference engines.
- Create CI/CD infrastructure for model deployment and inference-engine updates.
- Partner with senior ML engineers to fine-tune and deploy open-source large language models.
Requirements
- 5+ years of software engineering experience and 2+ years of systems performance optimization experience.
- Deep low-level systems programming experience with C/C++ or Rust.
- Experience building and operating large-scale, highly concurrent production-serving systems.
- Experience with GPU inference engines such as vLLM, SGLang, Triton, or TensorRT-LLM.
- Strong background in batching, caching, load balancing, parallelism, and other systems optimizations.
- Preferred: experience with GPU kernels, quantization, speculative decoding, distillation, testing, benchmarking, inference-service reliability, and CI/CD infrastructure for inference.
Benefits
- Office, home, or hybrid work options are available, subject to working in a country where Atlassian has a legal entity.
- Benefits may include health and wellbeing resources and paid volunteer days.
- The role may also be eligible for bonuses, commissions, equity, and other benefits.
Categories
About Atlassian
Atlassian powers the collaboration that helps teams accomplish what would otherwise be impossible alone. From space missions and motor racing to bugs in code and IT requests, no task is too large or too small with the right team, the right tools, and the right practices. Over 300,000 global companies and 80% of the Fortune 500 rely on Atlassian’s software, like Jira, Confluence, Loom, and Trello, to help their teams work better together and deliver quality results on time. With our 300,000+ customers and team of 10,000+ Atlassians, we are building the next generation of team collaboration and productivity software. We believe the power of teams has the potential to change the world — one that is more open, authentic, and inclusive.