about 4 hours ago
Responsibilities
- Develop a deep understanding of Tekion’s AI agents and ML models.
- Own end-to-end quality for ML models and AI features.
- Design and implement automated testing frameworks for various AI components.
- Validate model correctness, accuracy, and behavioral consistency.
- Define and execute evaluation strategies for AI capabilities.
- Use AI tools to generate test cases and synthetic data.
- Build regression suites to detect quality drift.
- Validate integration of ML models into ARC products.
- Drive root cause analysis for production model issues.
- Define quality metrics and automated monitoring.
Requirements
- 5–8 years in SDET, quality engineering, or software engineering.
- Strong programming skills in Python and/or Java.
- Hands-on experience testing data-intensive or ML/AI systems.
- Solid understanding of ML concepts and evaluation metrics.
- Experience designing evaluation frameworks or working with eval datasets.
- Familiarity with LLM/agent concepts and generative failure modes.
- Experience with CI/CD and API/integration testing.
- Strong analytical and debugging skills.
- Excellent collaboration and communication skills.