1 day ago
Australia (city not specified)Senior
Responsibilities
- Lead complex, end-to-end delivery of production-ready agentic AI solutions.
- Design and compare AI models using measures such as quality, reliability, latency, performance, and cost.
- Build agentic AI workflows involving prompts, RAG/retrieval, context, memory, routing, tool use, and human hand-offs.
- Design AI evaluation frameworks covering datasets, benchmarking, regression testing, bias, data leakage, uncertainty, scoring, and model performance.
- Lead Responsible AI, AI safety, and safeguard testing for prompt injection, sensitive data, unsafe outputs, permissions, privacy, and human oversight.
- Monitor production AI solutions using traces, drift, feedback, and cost analysis to diagnose issues and improve performance.
- Provide technical leadership, conduct design and code reviews, mentor AI Scientists, and develop reusable AI patterns, standards, and guidance.
Requirements
- Proven experience leading complex, production-ready AI solutions and personally resolving difficult technical or methodological problems.
- Strong hands-on coding and engineering capability across agentic AI, including LLMs, RAG/retrieval, context, memory, routing, tool use, and human hand-offs.
- Experience using coding agents for complex delivery, including task planning, appropriate autonomy, automated verification, and human oversight.
- Strong model evaluation experience covering LLM quality, accuracy, latency, token usage, cost, routing, and fallback strategies.
- Ability to design robust AI evaluation methods using representative datasets, benchmarking, regression testing, uncertainty, bias, and data-leakage analysis.
- Strong Responsible AI and AI safety expertise, including adversarial testing, prompt injection, sensitive data, permissions, privacy, safeguards, and human approval.
- Technical leadership experience involving mentoring AI Scientists, design and code reviews, and stakeholder influence.
- Experience in banking or another regulated environment is highly desirable.
Benefits
- Special offers on banking products and discounts from top brands, including employee-only mortgage rates.
- Flexible work arrangements and leave options including Culture, Lifestyle, and Wellbeing leave.
- Tailored learning and development opportunities.
- Opportunities to participate in community volunteering initiatives.
- Supportive and inclusive community with recruitment adjustments available for accessibility needs.
Categories
About Westpac
Westpac is an Australian banking group that provides retail, business, and institutional banking, payments, and wealth/insurance services to consumers and enterprises. Founded in 1817 and headquartered in Sydney, it operates across Australia and New Zealand under brands including Westpac, St.George, BankSA, Bank of Melbourne, BT Financial Group, and RAMS. Its business model centers on deposit-taking, lending, and financial services fees delivered via branches, digital channels, and partner networks.
