4 days ago
Remote, IndiaSenior
Responsibilities
- Design, build, and maintain automated frontend, backend, API, and contract test suites.
- Test long-running Temporal workflows using failure injection, idempotency checks, eventual-consistency assertions, and compensation or saga validation.
- Automate multi-tenant isolation, sandboxing, egress-control, and negative security testing.
- Develop statistical, semantic-similarity, confidence-threshold, adversarial, and golden-dataset tests for LLM-driven behavior.
- Verify HITL escalation, authorization gates, platform NFRs, concurrency, backpressure, provider failover, tracing, token accounting, and cost accuracy.
- Integrate automated tests into CI/CD as release gates with pull-request regression flagging.
- Maintain test environments, mocked LLM/provider layers, synthetic-data generators, and reusable test infrastructure.
- Produce reproducible test-evidence packs for client milestone sign-off.
- Partner with AI and platform engineers on acceptance criteria, testability, and observability.
- Mentor mid-level QA engineers and contribute AI-testing patterns to internal frameworks and the quality engineering practice.
Requirements
- 8+ years of test automation experience, including API testing and building reusable test frameworks.
- Hands-on experience testing LLM-powered or other nondeterministic systems with statistical assertions, semantic scoring, and model-variance management.
- Experience testing asynchronous and event-driven systems, including failure injection, idempotency, and eventual consistency; Temporal experience is a strong plus.
- Strong CI/CD integration and release-gate design skills, including GitHub Actions or equivalent.
- Solid SQL and data-validation skills, including synthetic test-data pipelines and dataset-quality measurement.
- Security-testing or adversarial-testing experience, including prompt-injection techniques or AppSec testing.
- Strong proficiency in Playwright and TypeScript is mandatory.
- Deep understanding of LLM behavior, prompt sensitivity, and common RAG failure modes.
- Strong statistical-analysis skills for interpreting evaluation scores and advising AI engineers on prompt tuning.
- Ability to assess test sufficiency under milestone pressure and communicate quality evidence to non-engineering stakeholders.
Benefits
- Friendly, open-door community of professionals and opportunities to work on large-scale global projects.
- Internal meetups, conferences, workshops, Udemy access, language courses, and company-paid certifications.
- Internal mobility opportunities across diverse domains and projects.
- Company-paid medical insurance, mental health support, and financial and legal consultations.
- Full-time position in India.
Tech Stack
Categories
About Ciklum
Ciklum is an IT services firm that builds custom digital products and provides nearshore engineering teams, QA, DevOps, data analytics, and UX for enterprises and high-growth startups. It operates a services model spanning product engineering, e-commerce solutions, and managed delivery centers. Founded in 2002 and headquartered in London, the privately held company serves global clients including Just Eat and Zurich Insurance.