Lead Test Framework Architect (M/F/D)
Agilent Technologies21 days ago
Barcelona, SpainStaff+
Responsibilities
- Lead AI software development lifecycle adoption for quality engineering and scale reference workflows across product teams.
- Own strategy for AI-assisted test authoring, execution, triage, and maintenance, including integration with CI/CD quality gates.
- Design and build AI-native frameworks for unit, contract, integration, end-to-end, performance, and AI feature testing.
- Develop evaluation and regression frameworks for LLM- and agent-powered capabilities, including grounding, hallucination, drift, and observability measures.
- Define test architecture standards for Kubernetes-based microservices, including ephemeral namespaces, environment-as-code, test data, contract testing, and containerized E2E testing.
- Integrate AI-assisted testing into validated environments while preserving audit trails, traceability, data integrity, and regulatory compliance.
- Establish human-in-the-loop governance, review checkpoints, acceptance criteria, and rollback triggers for AI-generated code and tests.
- Measure impact using DORA metrics and AI-specific measures such as coverage delta, defect-escape rate, mean-time-to-triage, and evaluation-suite pass rates.
- Lead organizational change through champions, enablement, playbooks, and adoption initiatives.
Requirements
- 10+ years of software engineering experience, including 3+ years in test architecture or quality engineering architecture roles.
- Daily hands-on experience with AI-assisted development and testing tools such as GitHub Copilot, Claude Code, or Cursor.
- Deep hands-on Kubernetes expertise for ephemeral namespace provisioning, container-based test infrastructure, and environment-as-code.
- Strong experience designing multi-level test automation frameworks for distributed systems, including unit, contract, integration, E2E, and performance testing.
- Experience architecting CI/CD pipelines and integrating quality gates using GitHub Actions, Jenkins, or equivalent tools.
- Contract testing experience with Pact or consumer-driven contract testing for microservices and API-first architectures.
- Demonstrated ability to deliver reusable test frameworks adopted across multiple product teams.
- Experience with testability-by-design and influencing software architecture to improve testability.
- Experience leading organizational adoption and change with defensible outcome metrics.
- Preferred experience testing AI/ML, LLM, or agent-based systems using evaluation frameworks such as deepeval, promptfoo, LangSmith, Langfuse, or Maxim AI.
- Preferred knowledge of regulated software validation, including 21 CFR Part 11, GxP, GAMP 5, CSA, CSV, and IEC 62304.
- Preferred experience with LLM context engineering, prompt and specification design, RAG, MCP servers, and project-memory patterns.
- Preferred experience with OpenTelemetry GenAI Semantic Conventions, performance and load testing, infrastructure-as-code, and GitOps.
- Background in scientific instrument software, laboratory platforms, life sciences, or diagnostics is preferred.
Benefits
- Full-time daytime schedule with approximately 25% travel and no stated end date.
- Work/life balance, learning and growth opportunities, and collaboration in a growth-oriented organization.
- Depending on country, benefits may include an Agilent Result Bonus, Stock Purchase Plan, life insurance, pension, healthcare, Employee Assistance Program, holiday, and company activities.
- Pay ranges vary by country, location, skills, experience, and education or training; country-specific information is available through Agilent’s careers locations page.
Tech Stack
Categories
About Agilent Technologies
Agilent Technologies builds analytical instruments, lab software, diagnostic and genomics solutions, plus consumables and services used by pharmaceutical, chemical, environmental, and clinical labs. It sells systems such as chromatography and mass spectrometry platforms, pathology and molecular diagnostic kits, and supports lab operations through its CrossLab services business. Founded in 1999 and headquartered in Santa Clara, California, Agilent is a public company listed on the NYSE (ticker: A) with global manufacturing and R&D sites.