7 hours ago
Sydney, Australia +2 moreSenior
Responsibilities
- Design, build, ship, and operate agentic LLM harness solutions for existing and new AI features.
- Improve quality and reduce cost across production LLM systems.
- Build datasets, evaluations, benchmarks, and robust evaluation capabilities for systems operating at scale.
- Contribute to fine-tuning and model serving, including potentially serving LLMs with NVIDIA Triton Inference Server.
- Set long-term technical direction for LLM harness engineering and execute architectural improvements end to end.
- Lead small virtual squads owning critical components and coach junior engineers.
- Partner with Engineering Managers, Heads of Engineering, product teams, and cross-functional stakeholders to influence technical direction.
Requirements
- Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
- At least 4 years of related industry experience in machine learning, including hands-on experience designing, evaluating, and operating LLM-based or agentic systems.
- Strong coding skills in Kotlin and/or Python, with the ability to write performant, production-quality code.
- Experience building and operating machine learning systems in production, including practices for improving quality, reliability, and cost.
- Experience building datasets, evaluations, and benchmarks at scale, with familiarity with SQL, distributed data processing, and cloud data environments.
- Track record of owning ambiguous technical outcomes from problem definition through delivery and operation.
- Strong communication and influencing skills across diverse and cross-functional audiences.
- Experience leading technical work and coaching engineers in a collaborative team or virtual squad.
- Preferred experience includes fine-tuning smaller language models, using NVIDIA Triton Inference Server, applying ML to personalization or context-aware experiences, and solving problems in enterprise SaaS or similarly large-scale product environments.
Benefits
- Flexible work location, including office, home, or hybrid arrangements, with hiring available in countries where Atlassian has a legal entity.
- Health and wellbeing resources.
- Paid volunteer days.
- Recruitment accommodations or adjustments are available when needed.
Categories
About Atlassian
Atlassian powers the collaboration that helps teams accomplish what would otherwise be impossible alone. From space missions and motor racing to bugs in code and IT requests, no task is too large or too small with the right team, the right tools, and the right practices. Over 300,000 global companies and 80% of the Fortune 500 rely on Atlassian’s software, like Jira, Confluence, Loom, and Trello, to help their teams work better together and deliver quality results on time. With our 300,000+ customers and team of 10,000+ Atlassians, we are building the next generation of team collaboration and productivity software. We believe the power of teams has the potential to change the world — one that is more open, authentic, and inclusive.