4 months ago
Atlanta, GA, USAStaff+
Base Salary
$230k - $230k/yr
Responsibilities
- Define scalable, modular, and low-latency architectures for AI, LLM, and agentic solutions.
- Design RAG, memory, task-planning, model-orchestration, context-management, and enterprise-integration patterns.
- Create prototypes and proof-of-concepts to validate model architectures, RAG flows, and agent orchestration.
- Evaluate and implement AI frameworks and agent orchestration tools.
- Establish architecture blueprints, governance frameworks, and standards for model versioning, data lineage, testing, monitoring, and responsible AI.
- Oversee performance, observability, governance, and the transition of AI solutions from prototype to production.
- Provide technical direction, mentorship, quality oversight, and management for junior team members.
- Lead client workshops, presentations, strategic working sessions, and executive communications.
- Collaborate with product managers, data scientists, and engineers to translate business goals into AI system designs.
- Support business development through technical proposals, technology roadmaps, client relationship management, thought leadership, and conference participation.
- Plan and manage large, complex projects and support organizational adoption of new systems and processes.
- Travel to client sites and BCG offices based on project needs.
Requirements
- Bachelor’s degree in information technology, business administration, computer science, information systems, systems controls and engineering, or a related field; a master’s degree is a plus.
- 10+ years of technology consulting or software engineering experience, including more than 5 years in architecture.
- Strong foundation in software architecture and distributed systems design.
- Proven experience designing or scaling AI/ML or LLM-based applications.
- Proficiency in one or more of Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
- Familiarity with modern AI and agentic frameworks, including LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, and LlamaIndex.
- Understanding of RAG, multi-agent orchestration, memory modules, vector databases, function calling, observability, safety, deployment strategies, and governance.
- Understanding of cloud architecture, data management, and API-based system integration across multi-cloud and hybrid environments.
- Experience with containerization and orchestration technologies including Docker, Kubernetes, Helm, and Istio, including GPU autoscaling.
- Experience with AI coding tools such as Cursor, Replit, Lovable, Claude Code, and Codex.
- Experience with vector databases, embeddings, context retrieval, and prompt orchestration; Pinecone, Qdrant, Cosmos DB, and Azure Search experience is a plus.
- Knowledge of knowledge graphs such as Neo4j and knowledge representation techniques is a plus.
- Exposure to agentic memory engines such as mem0, Redis Memory, and Postgres Memory is a plus.
- Experience with MLOps or LLMOps pipelines, observability, evaluation frameworks, and intelligent application interfaces using React or Next.js is preferred.
- Strong analytical, creative problem-solving, communication, executive presentation, customer-orientation, and results-orientation skills.
- Experience managing decision processes in large organizations and planning and managing large, complex projects.
- Willingness to travel significantly when required by client projects.
Benefits
- U.S. base compensation is $230,000, plus an annual discretionary performance bonus and retirement contribution.
- Medical, dental, and vision coverage is provided with zero-dollar premiums for employees, spouses, and children.
- Health plans include $10 copays for doctor visits, urgent care, and generic prescriptions, plus dental orthodontia benefits up to $5,000.
- Vision coverage, gym and fitness reimbursement, and fully vested annual retirement contributions are provided.
- Paid time off includes vacation, holidays, and an annual office closure between Christmas and New Year’s.
- Paid parental leave and family benefits including elective egg freezing, surrogacy, and adoption reimbursement are available.
- The role is based in one of the listed U.S. locations and includes travel to client sites and BCG offices as needed.
Tech Stack
AWSAzureDockerGoogle CloudGrafanaHelmIstioJavaScriptKerasKubernetesNeo4jNext.jsNode.jsPostgreSQLPrometheusPythonPyTorchReactRedisTensorFlowTypeScript
Categories
