1 day ago
Erfurt, Germany +12 moreStaff+
Responsibilities
- Design Enterprise Private AI and GenAI platforms for on-premises, private-cloud, hybrid, and sovereign AI environments.
- Create high-level and low-level designs, blueprints, and reusable reference architectures, frameworks, and accelerators.
- Architect LLM, RAG, and agentic AI solutions and scalable inference architectures using open-source and self-hosted technologies.
- Deploy AI platforms to production with Kubernetes, containerization, MLOps, and LLMOps, covering deployment, evaluation, monitoring, and governance.
- Advise customers on AI strategy, platform modernization, infrastructure readiness, and AI operating models, and advance POCs, MVPs, and enterprise initiatives.
- Connect AI, infrastructure, cloud, security, and data engineering while contributing to RFPs, proposals, and effort estimates.
- Optimize GPU and AI infrastructure, model serving, quantization, batching, autoscaling, distributed inference and training, capacity, performance, latency, and availability.
Requirements
- 15+ years of IT experience, including at least five years in AI/ML architecture.
- Successful delivery of enterprise AI or GenAI solutions in private-cloud, on-premises, or hybrid environments.
- Deep expertise in LLMs, RAG, vector databases, prompt engineering, and agentic AI.
- Experience with LangChain, LlamaIndex, Haystack, or Semantic Kernel and open-source models such as Llama, Mistral, DeepSeek, or Qwen.
- Strong Kubernetes and Docker/OpenShift expertise, plus MLOps/LLMOps experience with technologies such as MLflow, Kubeflow, KServe, Ray, vLLM, or Ollama.
- Knowledge of AI evaluation, tracing, monitoring, drift detection, and production AI operations.
- Understanding of NVIDIA GPU infrastructure, CUDA, MIG, model serving, quantization, batching, autoscaling, distributed inference/training, and capacity planning.
- Understanding of Zero Trust, IAM/RBAC, encryption, data residency, regulatory compliance, security, privacy, and sovereign AI.
- Strong stakeholder management and consulting skills, with German language proficiency at C1 level or higher.
Benefits
- Flexible working hours with flex-time arrangements, with travel time counted as working time.
- Home-office and remote-work options, including mobile work from other EU countries; workplace equipment and compensation support may be available.
- 30 days of vacation plus December 24 and December 31 as non-working days.
- Sabbatical option of up to one year.
- Benefits including company pension, JobRad, Jobticket, corporate discounts, health and preventive-care programs, accident insurance, and family services.
- Internal and external training through the NTT DATA Academy, including certifications, soft-skill training, and Udemy access.
- Diverse communities and initiatives, including diversity, equity and inclusion and ESG programs, plus a team-oriented culture with substantial autonomy.
Tech Stack
Categories
Solutions Engineering
About NTT DATA
NTT DATA is a Tokyo‑headquartered, publicly traded IT services firm within the NTT Group. It provides consulting, application development, system integration, cloud and enterprise application services, and managed/outsourcing services for large enterprises and public-sector organizations. The company operates in more than 50 countries and is listed on the Tokyo Stock Exchange.