4 hours ago
Remote, IndiaSenior
Responsibilities
- Design, build, and maintain automated frontend, backend, API, and contract test suites using Playwright and TypeScript.
- Test long-running Temporal workflows through worker-kill, provider-outage, retry-storm, idempotency, and compensation or saga failure scenarios.
- Verify multi-tenant isolation, cross-tenant data protection, configuration boundaries, cost attribution, sandboxing, and egress controls.
- Develop adversarial and non-deterministic AI tests using statistical assertions, semantic-similarity scoring, confidence thresholds, synthetic data, and prompt-injection corpora.
- Validate human-in-the-loop escalation and ensure gated or irreversible actions require authorization.
- Automate performance, concurrency, queue backpressure, provider failover, tracing, token accounting, and alerting verification.
- Integrate automated suites into CI/CD as hard release gates and produce auditable evidence for client milestone sign-offs.
- Maintain test environments, mocked LLM and provider layers, synthetic-data generators, and reusable testing frameworks.
- Collaborate with AI, platform, and evaluation engineers from the design stage to improve testability and observability.
- Mentor mid-level QA engineers and contribute AI testing patterns to the internal quality engineering practice and AI Academy.
Requirements
- At least 8 years of test automation experience, including API testing and adoption-oriented test framework development.
- Hands-on experience testing LLM-powered or other non-deterministic systems, including statistical assertions, semantic scoring, and model-variance management.
- Experience testing asynchronous and event-driven systems with failure injection, idempotency verification, and eventual-consistency assertions; Temporal or a similar workflow engine is a strong plus.
- Strong CI/CD integration skills and experience designing release gates, preferably with GitHub Actions or an equivalent tool.
- Solid SQL and data-validation skills, including synthetic test-data pipelines and dataset-quality measurement.
- Security-testing and adversarial testing experience, including prompt-injection techniques or a strong AppSec background.
- Strong Playwright and TypeScript proficiency is mandatory.
- Extensive experience building Playwright- and TypeScript-based automation frameworks and integrating them into high-security CI/CD pipelines.
- Deep understanding of LLM behavior, prompt sensitivity, and common RAG failure modes.
- Strong statistical-analysis skills for interpreting evaluation scores and advising AI engineers on prompt tuning.
- Preferred experience with performance or load tools such as k6 or Locust, multi-tenant SaaS isolation, AI evaluation and observability stacks, compliance evidence, accessibility testing, document extraction, LLM-generated test assets, high-concurrency agentic systems, or qTest.
Benefits
- Full-time position based in India, with Ciklum teams in Chennai and Pune.
- Internal events, meetups, conferences, workshops, Udemy access, language courses, and company-paid certifications.
- Internal mobility opportunities across diverse domains and projects.
- Company-paid medical insurance, mental health support, and financial and legal consultations.
- Collaborative community and opportunities to work on large-scale, globally impactful projects.
Tech Stack
Categories
About Ciklum
Ciklum is an IT services firm that builds custom digital products and provides nearshore engineering teams, QA, DevOps, data analytics, and UX for enterprises and high-growth startups. It operates a services model spanning product engineering, e-commerce solutions, and managed delivery centers. Founded in 2002 and headquartered in London, the privately held company serves global clients including Just Eat and Zurich Insurance.