Senior Software Development Engineer in Test - AI Tooling & Automation
InformaticaBase Salary
$149k - $224k/yr
Responsibilities
- Design, build, and maintain scalable AI-first testing frameworks and automation suites for complex workflows and agentic capabilities.
- Translate quality strategies into automation plans for LLM integrations, prompt accuracy, and deterministic system behavior.
- Perform white-box testing, analyze application code and architecture, identify quality gaps, and fix code and test flakiness.
- Implement human-in-the-loop evaluation for response relevance, user safety, contextual accuracy, and other subjective AI quality dimensions.
- Collaborate with developers, product managers, AI/ML engineers, and data scientists to integrate quality throughout the delivery lifecycle.
Requirements
- Strong Java skills and technical fundamentals in data structures and algorithms.
- Hands-on experience evaluating Large Language Models and familiarity with GPT-like models or AI evaluation frameworks is a plus.
- Proven experience delivering test automation in fast-paced CI/CD environments.
- Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
- Strong software engineering and coding background, including experience with white-box testing and fixing code, preferred.
- Experience testing autonomous agents, conversational user interfaces, or generative AI workflows preferred.
- Experience with AWS, Azure, or GCP and foundational Salesforce platform knowledge preferred; Salesforce certifications are a plus.
Benefits
- Salesforce offers time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program.
Tech Stack
Categories
About Informatica
Informatica (NYSE: INFA), a leader in AI-powered enterprise cloud data management, helps businesses unlock the full value of their data and AI. As data grows in complexity and volume, Informatica’s Intelligent Data Management Cloud™ delivers a complete, end-to-end platform with a suite of industry-leading, integrated solutions to connect, manage and unify data across any cloud, hybrid or multi-cloud environment. Powered by CLAIRE® AI, Informatica’s platform integrates natively with all major cloud providers, data warehouses and analytics tools— giving organizations the freedom of choice, avoiding vendor lock-in and delivering better ROI by enabling access to governed data, simplifying operations and scaling with confidence. Trusted by approximately 5,000 customers in nearly 100 countries—including over 80 of the Fortune 100—Informatica is the backbone of platform-agnostic, cloud data-driven transformation. Informatica. Where data and AI come to life.™ Contact: PR@informatica.com