4 hours ago
Responsibilities
- Design prompts that drive GitLab Duo AI agents across software development lifecycle workflows.
- Translate developer requirements into reusable prompt templates, agent behaviors, prompt libraries, and reusable patterns.
- Define evaluation criteria and acceptance testing for AI-generated outputs.
- Conduct prompt experimentation, benchmarking, and regression testing.
- Improve prompt reliability, determinism, and adherence to guardrails.
- Collaborate with AI engineers on context design and tool utilization.
- Document prompt standards, approval processes, and governance artifacts.
- Support user acceptance testing with development teams and optimize prompts using production feedback.
Requirements
- At least 3 years of experience in software engineering, AI, or automation is required.
- Experience with Large Language Models such as OpenAI, Anthropic, Gemini, or similar is required.
- Understanding of prompt engineering methodologies and familiarity with Git-based software development workflows are required.
- Experience defining evaluation criteria for AI systems and translating technical requirements into AI behaviors is required.
- Strong written communication and analytical skills are required.
- Experience with GitLab Duo or GitHub Copilot Enterprise is preferred.
- Experience designing enterprise AI assistants or agents is preferred.
- Familiarity with Retrieval-Augmented Generation is preferred.
- Experience supporting SDLC automation initiatives and knowledge of secure software development practices are preferred.
Tech Stack
Categories
About Capco
Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to deliver end-to-end data-driven solutions and fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting-edge ingenuity is brought to life through its Innovation Labs and award-winning Be Yourself At Work culture and diverse talent.