5 months ago
Atlanta, GA, USAStaff+
Base Salary
$230k - $230k/yr
Responsibilities
- Define scalable, modular, and low-latency architectures for AI, LLM, and agentic solutions.
- Design RAG, memory, task-planning, model-orchestration, context-management, and enterprise-integration patterns.
- Create prototypes and proof-of-concepts to validate model architectures, RAG flows, and agent orchestration.
- Evaluate and implement AI frameworks and agent orchestration tools.
- Establish architecture blueprints, governance frameworks, and standards for model versioning, data lineage, testing, monitoring, and responsible AI.
- Oversee performance, observability, governance, and the transition of AI solutions from prototype to production.
- Provide technical direction, mentorship, quality oversight, and management for junior team members.
- Lead client workshops, presentations, strategic working sessions, and executive communications.
- Collaborate with product managers, data scientists, and engineers to translate business goals into AI system designs.
- Support business development through technical proposals, technology roadmaps, client relationship management, thought leadership, and conference participation.
- Plan and manage large, complex projects and support organizational adoption of new systems and processes.
- Travel to client sites and BCG offices based on project needs.
Requirements
- Bachelor’s degree in information technology, business administration, computer science, information systems, systems controls and engineering, or a related field; a master’s degree is a plus.
- 10+ years of technology consulting or software engineering experience, including more than 5 years in architecture.
- Strong foundation in software architecture and distributed systems design.
- Proven experience designing or scaling AI/ML or LLM-based applications.
- Proficiency in one or more of Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
- Familiarity with modern AI and agentic frameworks, including LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, and LlamaIndex.
- Understanding of RAG, multi-agent orchestration, memory modules, vector databases, function calling, observability, safety, deployment strategies, and governance.
- Understanding of cloud architecture, data management, and API-based system integration across multi-cloud and hybrid environments.
- Experience with containerization and orchestration technologies including Docker, Kubernetes, Helm, and Istio, including GPU autoscaling.
- Experience with AI coding tools such as Cursor, Replit, Lovable, Claude Code, and Codex.
- Experience with vector databases, embeddings, context retrieval, and prompt orchestration; Pinecone, Qdrant, Cosmos DB, and Azure Search experience is a plus.
- Knowledge of knowledge graphs such as Neo4j and knowledge representation techniques is a plus.
- Exposure to agentic memory engines such as mem0, Redis Memory, and Postgres Memory is a plus.
- Experience with MLOps or LLMOps pipelines, observability, evaluation frameworks, and intelligent application interfaces using React or Next.js is preferred.
- Strong analytical, creative problem-solving, communication, executive presentation, customer-orientation, and results-orientation skills.
- Experience managing decision processes in large organizations and planning and managing large, complex projects.
- Willingness to travel significantly when required by client projects.
Benefits
- U.S. base compensation is $230,000, plus an annual discretionary performance bonus and retirement contribution.
- Medical, dental, and vision coverage is provided with zero-dollar premiums for employees, spouses, and children.
- Health plans include $10 copays for doctor visits, urgent care, and generic prescriptions, plus dental orthodontia benefits up to $5,000.
- Vision coverage, gym and fitness reimbursement, and fully vested annual retirement contributions are provided.
- Paid time off includes vacation, holidays, and an annual office closure between Christmas and New Year’s.
- Paid parental leave and family benefits including elective egg freezing, surrogacy, and adoption reimbursement are available.
- The role is based in one of the listed U.S. locations and includes travel to client sites and BCG offices as needed.
Tech Stack
AWSAzureDockerGoogle CloudGrafanaHelmIstioJavaScriptKerasKubernetesNeo4jNext.jsNode.jsPostgreSQLPrometheusPythonPyTorchReactRedisTensorFlowTypeScript
Categories
About BCG
Boston Consulting Group provides management consulting, technology, and design services to large enterprises, governments, and nonprofits, helping with strategy, digital transformation, and operations. The firm works on a project-based, fee-for-service model and also incubates products and ventures through BCG X. Founded in 1963 and headquartered in Boston, it is a global partnership with offices worldwide.