Senior QA Analyst / Tester
Orion Innovation4 hours ago
Responsibilities
- Design and execute adversarial testing campaigns against large language models, multimodal systems, and autonomous agents.
- Research attack vectors, prompt injection techniques, model vulnerabilities, jailbreaks, and unintended behaviors.
- Conduct red team exercises covering deployment scenarios and edge cases, including testing for bias, toxicity, misinformation, and other harmful outputs.
- Evaluate and introduce AI security tools to reduce detection and response time for AI-specific threats.
- Create adversarial datasets and benchmarks to evaluate model robustness under attack conditions.
- Collaborate with security teams and developers to conduct red teaming activities and improve the organization’s security posture.
- Document and present vulnerabilities, findings, risks, and remediation recommendations.
- Maintain process documentation, produce testing reports, track operational metrics, and support other AI Red Team program activities.
Requirements
- Minimum five years of penetration testing, red team operations, or AI Red Team experience.
- Bachelor's or higher degree in computer science, information technology, programming, development, artificial intelligence, or cybersecurity, or equivalent work experience.
- Background in AI red teaming, red teaming, or offensive cyber operations.
- Understanding of artificial intelligence, machine learning, software applications, cloud computing, and networking.
- Experience with relevant testing and security tools such as SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike, Mythic, Nmap, and sqlmap, or similar tools.
- Knowledge of web application technologies and Layer 7 protocols including HTTP, DNS, and FTP.
- Technical knowledge of Generative AI, Agentic AI, A2A, and/or MCP.
- Programming experience with Python, Ruby, Go, C++, PowerShell, bash, or similar languages.
- Relevant AI red team or security certifications such as OSCP, GPEN, GPXN, AI Teamer Job Role Path, AISEC+, GASAE, GOAA, or OSAI+ is desired.
- Strong communication and stakeholder management skills, with the ability to work across geographies and time zones.
About Orion Innovation
Orion Innovation delivers next-generation solutions in Data, AI, Cloud, and Digital Experience, empowering organizations to innovate, scale, and embrace future technologies. With deep software engineering expertise and a strong understanding of industry-specific challenges, we build data-driven products and solutions that enhance customer experiences, accelerate growth, and drive long-term value. Envision what's next. Build what matters. For more information, visit www.orioninnovation.com.