5 months ago
Atlanta, GA, USASenior
Base Salary
$150k - $150k/yr
Responsibilities
- Contribute to AI and LLM-based system architecture and solution design under the guidance of senior architects.
- Implement agentic AI components, RAG-based solutions, prompt workflows, retrieval strategies, and integrations with enterprise systems.
- Build prototypes and proofs of concept using modern AI frameworks and libraries.
- Support batch and real-time inference pipelines with attention to performance and reliability.
- Deploy, monitor, troubleshoot, and improve AI platform components in development and production environments.
- Collaborate with engineers, data scientists, product team members, and client stakeholders to deliver agreed solutions.
- Prepare technical documentation and presentations and participate in technical working sessions and design discussions.
- Support junior team members through knowledge sharing and contribute to proposals or internal initiatives when needed.
Requirements
- Bachelor’s degree in information technology, computer science, engineering, or a related field; a master’s degree is a plus.
- 4+ years of experience in software engineering, data engineering, or AI development.
- Strong foundation in software development and distributed systems concepts.
- Hands-on experience building or integrating AI/ML or LLM-based components.
- Proficiency in one or more programming languages such as Python or JavaScript is preferred.
- Experience using AI-assisted coding tools such as Cursor, Claude Code, Replit, or Lovable.
- Familiarity with LangChain, LlamaIndex, Semantic Kernel, or similar AI frameworks and libraries.
- Working understanding of agentic AI concepts, RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
- Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
- Experience deploying AI workloads on cloud platforms and integrating AI components with APIs and data sources.
- Familiarity with containerization concepts, including Docker; Kubernetes exposure is a plus.
- Strong problem-solving, code-quality, communication, collaboration, and iterative-delivery skills.
- GenAI fluency, including proven use of tools such as ChatGPT or Claude and validation of responses.
- Willingness to learn in ambiguous environments and travel to work with clients and BCG teams as needed.
Benefits
- Base benefits include medical, dental, and vision coverage with zero-dollar premiums for employees, spouses, and children.
- Benefits include $10 copays for doctors, urgent care, and generic prescriptions; dental orthodontia coverage up to $5,000; and annual vision coverage.
- Includes gym and fitness reimbursement, fully vested annual retirement contributions, paid time off, holidays, and an annual Christmas/New Year office closure.
- Includes paid parental leave and family benefits such as elective egg-freezing, surrogacy, and adoption reimbursement.
- Includes an annual discretionary performance bonus and BCG Profit Sharing and Retirement Fund contribution.
- Available in Atlanta, Austin, Boston, Brooklyn, Chicago, Dallas, Denver, Detroit, Durham, Houston, Miami, Minneapolis, Nashville, New York, Philadelphia, Pittsburgh, Summit, and Washington; travel is required as needed.
Tech Stack
Categories
About BCG
Boston Consulting Group provides management consulting, technology, and design services to large enterprises, governments, and nonprofits, helping with strategy, digital transformation, and operations. The firm works on a project-based, fee-for-service model and also incubates products and ventures through BCG X. Founded in 1963 and headquartered in Boston, it is a global partnership with offices worldwide.