1 day ago
Erfurt, Germany +12 moreStaff+
Responsibilities
- Design, develop, configure, and implement Private AI and GenAI platforms and produce high-level and low-level designs, blueprints, and reference architectures.
- Develop and implement LLM, RAG, and agentic-AI solutions spanning ingestion pipelines, vector databases, tool integrations, orchestration, and evaluation components.
- Bring AI platforms into production using Kubernetes, containerization, and MLOps/LLMOps, owning deployment, monitoring, governance, and troubleshooting.
- Deploy and optimize self-hosted foundation models and enterprise AI workloads, including GPU utilization, quantization, batching, autoscaling, latency, and inference architecture.
- Advise customers on AI strategy, platform modernization, and infrastructure readiness; lead POCs and MVPs and contribute to RFPs, proposals, and effort estimates.
Requirements
- 10–13 years of IT experience, including at least five years in AI/ML architecture.
- Successful implementation of enterprise AI or GenAI solutions in private-cloud, on-premises, or hybrid environments.
- Hands-on experience with Private AI, GenAI, LLMs, RAG, vector databases, prompt engineering, and agentic AI.
- Experience with frameworks such as LangChain, LlamaIndex, Haystack, or Semantic Kernel and open-source models such as Llama, Mistral, DeepSeek, or Qwen.
- Experience with Kubernetes, Docker or OpenShift, MLOps/LLMOps, and technologies such as MLflow, Kubeflow, KServe, Ray, vLLM, or Ollama.
- Knowledge of evaluation, tracing, monitoring, drift detection, production support, GPU and AI infrastructure, model serving, quantization, distributed inference/training, storage, and networking.
- Ability to optimize AI workloads for performance, scalability, and availability; understanding of security, privacy, and sovereign AI.
- German language proficiency at a minimum C1 level and confidence working with varied stakeholders.
Benefits
- Flexible working hours with a flex-time arrangement, with travel time counted as working time.
- Home-office options with possible equipment and compensation support, plus remote and mobile work from other EU countries.
- 30 days of vacation, with December 24 and December 31 also provided as non-working days.
- Sabbatical options of up to one year.
- Benefits including company pension, JobRad, Jobticket, corporate discounts, health and preventive-care programs, accident insurance, and family services.
- Internal and external training through NTT DATA Academy, certifications, soft-skills training, and Udemy access.
- Team-oriented culture with substantial autonomy, communities, diversity initiatives, and opportunities for learning and networking.
Tech Stack
Categories
Forward Deployed
About NTT DATA
NTT DATA is a Tokyo‑headquartered, publicly traded IT services firm within the NTT Group. It provides consulting, application development, system integration, cloud and enterprise application services, and managed/outsourcing services for large enterprises and public-sector organizations. The company operates in more than 50 countries and is listed on the Tokyo Stock Exchange.