Base Salary
$148k - $233k/yr
Responsibilities
- Architect and implement scalable distributed infrastructure for model serving, including load balancing, auto-scaling, batch scheduling, and global KV caching.
- Optimize model-inference latency and throughput under real production workloads.
- Build reliable, high-concurrency serving systems capable of handling billions of requests.
- Benchmark, fine-tune, and accelerate inference engines.
- Create CI/CD infrastructure for model deployment and inference-engine updates.
- Partner with senior ML engineers to fine-tune and deploy open-source LLMs.
Requirements
- At least 3 years of software engineering experience.
- Deep low-level systems programming experience with C, C++, or Rust.
- Experience with large-scale, high-concurrency production serving.
- Experience with GPU inference engines such as vLLM, SGLang, Triton, or TensorRT-LLM.
- Preferred experience with system performance optimization, GPU kernels, quantization, speculative decoding, distillation, inference-service testing and benchmarking, reliability engineering, CI/CD infrastructure, batching, caching, load balancing, and parallelism.
Benefits
- Flexible work options, including office-based, remote, or hybrid work where Atlassian has a legal entity.
- Health and wellbeing resources.
- Paid volunteer days.
- Potential eligibility for benefits, bonuses, commissions, and equity.
Categories
About Atlassian
Atlassian powers the collaboration that helps teams accomplish what would otherwise be impossible alone. From space missions and motor racing to bugs in code and IT requests, no task is too large or too small with the right team, the right tools, and the right practices. Over 300,000 global companies and 80% of the Fortune 500 rely on Atlassian’s software, like Jira, Confluence, Loom, and Trello, to help their teams work better together and deliver quality results on time. With our 300,000+ customers and team of 10,000+ Atlassians, we are building the next generation of team collaboration and productivity software. We believe the power of teams has the potential to change the world — one that is more open, authentic, and inclusive.