Senior Gen AI Engineer
Fractal Analytics6 days ago
Cambridge, MA, USASenior
Base Salary
$120k - $150k/yr
Responsibilities
- Design, develop, and maintain scalable, secure, highly available GenAI platforms and AI-powered applications on AWS.
- Architect agentic AI solutions, multi-agent systems, tool integrations, function calling, and workflow orchestration frameworks.
- Implement enterprise RAG solutions using embeddings, vector databases, semantic search, reranking, and knowledge retrieval techniques.
- Build AI applications with Amazon Bedrock for LLM inference, prompt management, model orchestration, and foundation-model integrations.
- Develop reusable AI platform components, SDKs, APIs, accelerators, reference architectures, cloud-native microservices, and Python services.
- Build knowledge-driven AI systems using vector stores, graph databases, and knowledge graph technologies.
- Create AI evaluation and benchmarking frameworks covering quality, accuracy, latency, safety, and performance.
- Implement AI governance, security controls, responsible AI practices, guardrails, and compliance mechanisms.
- Develop observability capabilities for telemetry, monitoring, tracing, logging, and operational dashboards.
- Automate cloud infrastructure provisioning and deployment with Terraform and Infrastructure as Code practices.
- Build and maintain deployment pipelines for AI and cloud workloads.
- Collaborate with engineering, security, product, architecture, and business teams to drive platform adoption and best practices.
- Mentor junior engineers and contribute to architecture reviews, technical leadership, documentation, and knowledge sharing.
Requirements
- 8–10 years of software engineering experience, including at least 3 years of GenAI or AI solution development experience.
- Strong hands-on experience building production-grade Generative AI solutions.
- Expertise in agentic AI, AI agents, multi-agent architectures, tool calling, function calling, orchestration, and MCP.
- Strong experience designing and implementing RAG architectures, embeddings, vector databases, retrieval pipelines, reranking, and semantic search.
- Hands-on experience with Amazon Bedrock, foundation-model integration, inference optimization, prompt engineering, and model orchestration.
- Deep understanding of LLMs, prompt engineering, evaluation, model selection, and deployment patterns.
- Strong Python proficiency for backend development, AI application development, and API implementation.
- Strong experience with AWS services including Bedrock, Lambda, ECS/EKS, API Gateway, S3, IAM, CloudWatch, DynamoDB, OpenSearch, and Step Functions.
- Experience with Terraform and Infrastructure as Code for cloud automation and platform deployment.
- Experience building cloud-native applications using APIs, microservices, Docker, Kubernetes, and deployment pipelines.
- Understanding of AI observability, monitoring, tracing, and telemetry.
- Knowledge of relational, NoSQL, vector, and graph databases.
- Experience with security, governance, compliance, and responsible AI frameworks.
- Preferred experience with LangChain, LangGraph, Semantic Kernel, LlamaIndex, OpenAI Agents SDK or similar agent frameworks, and vector database technologies such as Pinecone, Weaviate, Chroma, and FAISS.
- Preferred experience with OpenTelemetry, Langfuse, Arize Phoenix, MLflow, Grafana, Prometheus, Neo4j, MLOps, LLMOps, distributed systems, fine-tuning, model evaluation, and AI benchmarking frameworks.
- Strong communication, stakeholder management, problem-solving, collaboration, ownership, technical leadership, mentoring, documentation, and independent working skills.
Benefits
- Onsite role in Cambridge, Massachusetts.
- Health, dental, vision, life insurance, and disability benefits for eligible full-time employees or hourly employees working more than 30 hours per week.
- Benefits eligibility begins on the first day of employment.
- 401(k) plan eligibility begins after 30 days of employment.
- 11 paid holidays and 12 weeks of parental leave.
- Free-time PTO policy allowing flexibility for sick time and vacation.
- Potential eligibility for a discretionary bonus.
Tech Stack
Categories
About Fractal Analytics
Fractal builds enterprise AI and analytics solutions—delivered as consulting services and software products—for large global enterprises, especially Fortune 500 firms. Its teams embed AI in decisions across marketing, pricing, supply chain, forecasting, and customer experience. Founded in 2000 and headquartered in New York, Fractal is publicly listed and operates across North America, EMEA, and APAC.