AI Systems Engineer
Suffolk Construction2 years ago
Boston, MA, USASenior
Responsibilities
- Architect and build distributed, service-oriented, and event-driven systems that support enterprise AI workloads.
- Design and deploy production RAG architectures, multi-model AI agents, model-routing strategies, orchestration frameworks, guardrails, and evaluation frameworks.
- Optimize inference pipelines and AI agents for cost, performance, accuracy, latency, reliability, and safe degradation during outages.
- Design APIs, asynchronous processing pipelines, storage strategies, and reliability mechanisms including retries, circuit breakers, idempotent consumers, and dead-letter queues.
- Implement observability, traceability, LLMOps, cost monitoring, usage analytics, model versioning, security, governance, and access controls.
- Define architectural standards and documentation for AI platform services and collaborate with product managers, site AI engineers, data scientists, and nontechnical stakeholders.
Requirements
- 6+ years of professional software engineering experience, excluding vibe coding.
- Demonstrated production experience designing distributed or service-oriented systems.
- Strong backend engineering skills in Python plus at least one of Java, NodeJS, Rust, or Kotlin.
- Experience building and deploying event-driven architectures using SNS/SQS, Kafka, EventBridge, or similar systems.
- Experience integrating LLMs into production systems, including Bedrock, OpenAI, or Anthropic.
- Hands-on experience with RAG pipelines, vector databases, and multi-agent AI systems.
- Deep understanding of distributed-system failure modes, API lifecycle management, concurrency and consistency tradeoffs, and LLM cost, latency, and reliability constraints.
- Preferred experience includes internal AI platforms or shared infrastructure, large-scale SaaS or mission-critical systems, multi-agent or orchestration frameworks, Databricks Lakehouse architecture, or construction, manufacturing, and operational industries.
Benefits
- Hybrid work arrangement based in Boston.
- Competitive salary and a comprehensive total rewards package.
- Medical, dental, vision, virtual care, and emotional and mental health benefits.
- Generous paid time off, 401(k) plan with employer match, and financial resources.
- Company-paid and voluntary life insurance, tax-deferred savings accounts, short- and long-term disability, and commuter benefits.
- Auto allowances and gas cards for certain roles, plus 10 backup daycare days annually.