Responsibilities
- Lead architecture and strategy for the AS Copilot RAG pipeline upgrade, including reranking, grounding, citations, and evaluation.
- Oversee RAG pipeline audits, baseline KPI definition, and evaluation frameworks using RAGAS and related tools.
- Design cross-encoder reranker tuning on Azure Machine Learning and architectures for multi-turn grounding and claim-level citations.
- Architect AST-aware tokenization and semantic chunking for IEC 61131-3 structured text and Code-RAG use cases.
- Ensure production-grade Python delivery, conduct architectural code reviews, and direct senior and mid-level engineers.
- Collaborate with clients in a SAFe cadence, drive joint architectural decisions, and enable knowledge transfer.
- Ensure AI components are securely delivered as Python source code into the client’s Azure DevOps environment.
Requirements
- Strong background in Computer Science, Machine Learning, Data Science, or a related technical field at an architectural level.
- Deep practical and architectural expertise with Large Language Models and advanced Retrieval-Augmented Generation architectures.
- Expert proficiency in Python and experience designing systems with PostgreSQL, pgvector, and BM25-plus-dense hybrid search.
- Architectural-level hands-on experience with Azure, Azure OpenAI, Azure Machine Learning, and Azure DevOps.
- Deep familiarity with LLM evaluation methodologies, including RAGAS, DeepEval, or custom Python test harnesses.
- Extensive exposure to Abstract Syntax Trees or custom grammar parsing for code-generation use cases is highly desirable.
- Strong problem-solving skills and the ability to provide high-level, client-facing technical leadership in an embedded co-delivery partnership.
Benefits
- Full remote working possibilities.
- Internal meetups, conferences, workshops, Udemy access, language courses, and company-paid certifications.
- Opportunities for internal mobility across diverse domains and projects.
- Company-paid premium medical package through Luxmed.
- Access to the MyBenefit cafeteria platform.
- Full-time employment with Ciklum in Poland.
Tech Stack
Categories
About Ciklum
Ciklum is a global Experience Engineering firm that stands at the forefront of innovation, blending next-generation product engineering, exceptional customer experiences, and cutting-edge AI. The business revolutionizes the way people live by developing technologies that reimagine, reshape, and redefine the future. For over 20 years, Ciklum has been a trusted partner to global enterprises and digital disruptors, spearheading the creation of digital solutions that tackle complex corporate challenges while propelling businesses toward accelerated growth and success. Its global team of over 4,000 highly skilled engineers, experience design specialists and consultants joins forces to engineer technology that paves the way for the future of your business. Ciklum builds tailored digital solutions that leverage emerging technologies for such clients as Just Eat, Metro Markets, EFG International, Zurich Insurance and others. For more information about us visit www.ciklum.com