BCG

BCG Platinion | Senior AI Tech Architect - AI Platforms

BCG
Apply
4 months ago
Atlanta, GA, USASenior

Base Salary

$150k - $150k/yr

Responsibilities

  • Contribute to AI and LLM-based system architecture and solution design under the guidance of senior architects.
  • Implement agentic AI components, RAG-based solutions, prompt workflows, retrieval strategies, and integrations with enterprise systems.
  • Build prototypes and proofs of concept using modern AI frameworks and libraries.
  • Support batch and real-time inference pipelines with attention to performance and reliability.
  • Deploy, monitor, troubleshoot, and improve AI platform components in development and production environments.
  • Collaborate with engineers, data scientists, product team members, and client stakeholders to deliver agreed solutions.
  • Prepare technical documentation and presentations and participate in technical working sessions and design discussions.
  • Support junior team members through knowledge sharing and contribute to proposals or internal initiatives when needed.

Requirements

  • Bachelor’s degree in information technology, computer science, engineering, or a related field; a master’s degree is a plus.
  • 4+ years of experience in software engineering, data engineering, or AI development.
  • Strong foundation in software development and distributed systems concepts.
  • Hands-on experience building or integrating AI/ML or LLM-based components.
  • Proficiency in one or more programming languages such as Python or JavaScript is preferred.
  • Experience using AI-assisted coding tools such as Cursor, Claude Code, Replit, or Lovable.
  • Familiarity with LangChain, LlamaIndex, Semantic Kernel, or similar AI frameworks and libraries.
  • Working understanding of agentic AI concepts, RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
  • Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
  • Experience deploying AI workloads on cloud platforms and integrating AI components with APIs and data sources.
  • Familiarity with containerization concepts, including Docker; Kubernetes exposure is a plus.
  • Strong problem-solving, code-quality, communication, collaboration, and iterative-delivery skills.
  • GenAI fluency, including proven use of tools such as ChatGPT or Claude and validation of responses.
  • Willingness to learn in ambiguous environments and travel to work with clients and BCG teams as needed.

Benefits

  • Base benefits include medical, dental, and vision coverage with zero-dollar premiums for employees, spouses, and children.
  • Benefits include $10 copays for doctors, urgent care, and generic prescriptions; dental orthodontia coverage up to $5,000; and annual vision coverage.
  • Includes gym and fitness reimbursement, fully vested annual retirement contributions, paid time off, holidays, and an annual Christmas/New Year office closure.
  • Includes paid parental leave and family benefits such as elective egg-freezing, surrogacy, and adoption reimbursement.
  • Includes an annual discretionary performance bonus and BCG Profit Sharing and Retirement Fund contribution.
  • Available in Atlanta, Austin, Boston, Brooklyn, Chicago, Dallas, Denver, Detroit, Durham, Houston, Miami, Minneapolis, Nashville, New York, Philadelphia, Pittsburgh, Summit, and Washington; travel is required as needed.
BCG

About BCG

10,000+ employees
Contact me