Senior AI Engineer
MSG Global Solutions6 days ago
Milan, ItalySenior
Responsibilities
- Translate business processes into agent workflows with defined steps, tools, handoffs, and human escalation points.
- Design and build retrieval pipelines using chunking, indexing, embeddings, hybrid search, filtering, reranking, and grounding.
- Develop versioned prompt and context engineering practices with testing and measurement.
- Build evaluation layers with golden datasets, automated and model-graded scoring, and regression suites.
- Instrument production systems to monitor traces, token cost, latency, failures, quality, and model or data drift.
- Diagnose and resolve failures across retrieval, reasoning, tool design, and underlying data.
- Select and revisit models while balancing quality, cost, and latency.
- Collaborate with business experts to convert domain logic into testable specifications.
- Deploy agents with platform and infrastructure teams and remain accountable for their production behavior.
Requirements
- At least 5 years of software development experience, including at least 2 years building LLM-based systems that reached production and real users.
- Strong Python skills and professional engineering practices including version control, testing, code review, and incremental delivery.
- Experience with asynchronous work, FastAPI, and Pydantic or equivalent technologies.
- Hands-on experience with an agent orchestration framework such as LangGraph, LlamaIndex Workflows, OpenAI Agents SDK, or Temporal.
- Experience serving models through AWS Bedrock, Azure AI Foundry, Google Vertex AI, or provider APIs, including streaming, structured output, prompt caching, and rate-limit handling.
- Production vector-search experience with technologies such as pgvector, Qdrant, Pinecone, Weaviate, Milvus, or Azure AI Search.
- Deep practical retrieval experience covering chunking, metadata filtering, query rewriting, hybrid search, and reranking.
- Experience with tool and function calling, structured output, multi-step agent design, and failure analysis.
- Hands-on MCP experience, including building and consuming servers, designing tool interfaces, and handling authentication, permissions, and errors.
- Demonstrated evaluation discipline, including building an evaluation harness and measuring results before and after improvements.
- Ability to work through ambiguity with business experts and determine when rules engines or queries are preferable to language models.
- Fluent English.
- Preferred qualifications include fine-tuning or LoRA, open-weight model serving with vLLM, quantisation, GPU cost management, multi-agent orchestration, A2A interoperability, document understanding, human-agent interaction design, relevant industry exposure, open-source contributions, technical writing, or conference talks.
Benefits
- Competitive salary of €55,000–€65,000.
- Broad range of benefits.
- Inclusive global team environment valuing diversity and cultural differences.
- Opportunity to work with SAP and industry experts on enterprise AI solutions.
Tech Stack
Categories
About MSG Global Solutions
MSG Global Solutions is a Zurich‑based, privately held systems integrator and product developer specializing in SAP enterprise software, with a core focus on insurance and financial services. The company delivers consulting, implementation, and application management for SAP for Insurance (policy, claims, billing, commissions) and analytics on SAP BTP, while also building AI‑enabled extensions; founded in 2008, it operates as part of the msg group and serves multiple industries worldwide.