23 hours ago
Amman, JordanMid Level / Senior
Responsibilities
- Execute data quality checks for accuracy, completeness, and consistency.
- Perform source-to-target validation and reconciliation, investigate data anomalies using SQL and Python, and support regression testing.
- Develop, maintain, and execute automated test cases using Python and testing frameworks such as PyTest.
- Validate AI/ML model outputs against business requirements and assess model accuracy, reliability, and data quality.
- Perform prompt-based and scenario-based testing for GenAI, LLM, and RAG applications, including identifying hallucinations and unexpected behavior.
- Use AI-assisted development tools, skills files, prompt instructions, and MCP integrations in AI-powered testing workflows.
- Collaborate with Data Scientists, Data Engineers, ML Engineers, and Product teams on requirements, test scenarios, defect documentation, and root-cause analysis.
Requirements
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
- 2–4 years of experience in Software QA, Data QA, Data Engineering, or a related technical role.
- Good programming skills in Python and SQL.
- Practical experience with automated testing frameworks, preferably PyTest or similar tools.
- Understanding of data quality, data validation, and basic machine learning fundamentals.
- Basic prompt engineering knowledge and experience testing AI/LLM-based applications.
- Familiarity with AI-agent workflows, skills files, configuration and instruction files, and MCP.
- Exposure to Claude Code or similar AI-assisted development tools.
- Practical exposure to Generative AI, LLM applications, or RAG architecture.
- Familiarity with AI evaluation tools such as Ragas, TruLens, or DeepEval.
- Understanding of LLM concepts, hallucinations, model accuracy, and data/model drift.
- Exposure to AI platforms such as OpenAI, Anthropic, or Llama.
- Familiarity with AWS, Azure, or GCP.
- Basic understanding of CI/CD processes and automated test execution.
- Strong analytical, problem-solving, communication, documentation, and collaboration skills.
Benefits
- Purpose-led workplace where employees can create meaningful impact.
- Ongoing learning and development opportunities.
- Recognition celebrating employee achievements.
- Collaborative community built on trust, curiosity, and shared momentum.
- Supportive environment offering space to grow, connect, and contribute meaningfully.
About Almosafer
Almosafer provides travel booking and management services for consumers, companies, and government across Saudi Arabia and the wider region, covering flights, hotels, packages, activities, and Hajj & Umrah. Revenue comes from online bookings and managed travel services delivered through brands including Almosafer (consumer), Almosafer Business, Discover Saudi (destination management), and Mawasim. Founded in 2012 and headquartered in Riyadh, it operates as part of Seera Group.