3 days ago
Sydney, AustraliaSenior
Responsibilities
- Build and operate shared AI platform capabilities, including agent runtimes, tool and Xplan API integrations, AI gateways, guardrails, and privacy-conscious data handling.
- Create evaluation frameworks, golden datasets, regression tests, and release quality gates for AI behavior.
- Improve prompts and context, investigate inconsistent model responses, and troubleshoot production failures.
- Establish practices for tracing, monitoring, reliability, latency, cost, and changing model behavior.
- Partner with Data teams on retrieval-augmented generation, data pipelines, retrieval capabilities, access controls, and audit trails.
- Provide reusable APIs, SDKs, reference implementations, documentation, and hands-on support for other engineering teams.
- Work with Product, domain experts, and engineering teams to deliver secure, measurable AI experiences.
Requirements
- Hands-on experience building, deploying, and operating LLM- or agent-based systems in production; personal projects and proof-of-concept work alone are insufficient.
- Strong software engineering fundamentals and practical Python and/or TypeScript experience, including API development or reusable engineering patterns.
- Experience systematically evaluating AI-generated outputs using evaluation frameworks, golden datasets, and regression testing.
- Practical prompt and context engineering skills, including the ability to investigate model behavior and improve production results.
- Understanding of production AI requirements including performance, latency, reliability, failure handling, and cost.
- Experience building and operating production software with observability, privacy, access controls, and auditability.
- Strong communication and collaboration skills for explaining AI limitations, risks, and trade-offs to technical and non-technical teams.
- Experience with RAG, vector search, PII handling, Databricks, or data pipelines is advantageous.
Benefits
- Hybrid working in Sydney or Melbourne.
- Eight additional paid days per year to extend weekends.
- Generous cash bonus for every successful referral.
- Starting school leave of 8.5 days.
- Up to 26 weeks’ paid parental leave for primary carers and up to 4 weeks for secondary carers, with part-time work available when returning.
- Three days’ paid leave per year for charity initiatives.
- Discounted health insurance premiums.
- Access to learning and development programs through LinkedIn Learning.
- Full-time employee position.
Tech Stack
Categories
About Iress
Iress builds software for financial services, including trading and market data platforms, order management systems, portfolio and wealth advice tools, and mortgage and insurance solutions. It sells subscriptions and enterprise software to banks, brokers, wealth managers, insurers, and advice firms, serving more than 10,000 businesses and 500,000 users globally. Founded in 1993 and headquartered in Melbourne, it is listed on the ASX and operates across APAC, EMEA, and North America.