Accenture

AI LLM Architect - Engineering Services (All Genders) (Open)

Accenture
Apply
2 days ago
Berlin, GermanySenior

Responsibilities

  • Design, build, integrate, and test software components across AI architectures from initial design through delivery.
  • Design and implement individual and multi-agent architectures, including prompts, tools, skills, orchestration, state management, error recovery, and memory systems.
  • Evaluate design options, technical frameworks, models, and integration approaches against capability, cost, performance, and reliability objectives.
  • Build evaluation strategies and harnesses measuring agent and system quality, including accuracy, relevance, and faithfulness.
  • Architect foundation-model integrations using fine-tuning, retrieval-augmented generation, and custom model integration.
  • Design model adaptation and fine-tuning pipelines using knowledge of transformer-based architectures.
  • Build context layers, context graphs, ingestion pipelines, embeddings, vector storage, semantic and hybrid retrieval, reranking, and RAG pipelines.
  • Implement context assembly and conversational memory components connected to structured and unstructured enterprise data sources.
  • Design for cost efficiency, latency, throughput, inference performance, caching, and resource utilization.
  • Implement security and Responsible AI controls, including guardrails, prompt-injection defenses, PII handling, and access controls.
  • Build governance and observability capabilities including versioning, audit logging, lineage tracking, logging, tracing, monitoring, alerting, and cost tracking.
  • Produce architecture decision records, blueprints, design documents, component diagrams, data-flow diagrams, and integration specifications.
  • Collaborate with data engineers, ML engineers, application developers, and other cross-functional delivery teams on client solutions.

Requirements

  • Bachelor's degree or equivalent.
  • Proven experience designing and deploying AI/ML solutions using at least one cloud vendor as an AI/ML architect.
  • Industry experience in Engineering Services.
  • Experience with agentic systems, LLMs, and generative AI, preferably in manufacturing and operations.
  • Professional experience architecting and operationalizing LLM-driven application architecture patterns.
  • Practical experience coding and engineering machine learning, deep learning, and NLP solutions and applications.
  • Coding experience using Python.
  • B2-level German language proficiency.

Benefits

  • Flexible working models including home office.
  • Access to more than 30,000 technical and soft-skills training courses.
  • Certifications and learning platforms.
Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me