AI Software Engineer
Second Front Systems2 days ago
Remote, United StatesMid Level
Base Salary
$150k - $160k/yr
Responsibilities
- Architect, build, and ship production agentic AI systems using LangGraph, LangChain, tool-calling, and multi-step orchestration.
- Develop ingestion pipelines, embedding strategies, chunking, retrieval, re-ranking, tool suites, and integrations with knowledge bases, vector databases, and APIs.
- Build and consume Model Context Protocol servers and clients to connect agents with enterprise tools and knowledge.
- Establish and operate AI cloud infrastructure using Amazon EKS, Terraform, Helm, and GitOps delivery patterns.
- Create evaluation and regression suites measuring groundedness, faithfulness, relevance, retrieval quality, and overall LLM output quality in CI.
- Advise Product and Engineering teams on AI opportunities, agent architecture, model selection, implementation, and responsible AI governance.
- Create documentation and reusable components that expand organizational AI capability.
Requirements
- At least 2 years of full-time software, ML, or AI engineering experience building and shipping LLM-based systems in production.
- Hands-on experience with agentic AI systems, tool-calling agents, and multi-step orchestration using LangGraph, LangChain, or equivalent.
- Production experience with retrieval-augmented generation, vector stores, embedding models, chunking strategies, and retrieval quality optimization.
- Experience deploying containerized AI services with Docker, Kubernetes, and infrastructure as code; EKS and Terraform are preferred.
- Ability to communicate AI concepts and recommendations to non-technical stakeholders and cross-functional teams.
- U.S. citizenship and residence in an approved hiring hub: DC/Maryland/Virginia; Raleigh/Durham/Chapel Hill, NC; Denver/Colorado Springs, CO; or Dallas/Fort Worth, TX.
- Preferred: experience building MCP servers or clients, integrating agents with enterprise tools and knowledge bases, or using AWS Bedrock Knowledge Bases, AgentCore, and OpenSearch.
- Preferred: experience operating LLM gateways or serving infrastructure such as LiteLLM, vLLM, and GPU-backed self-hosted models, including single- and multi-tenant designs.
- Preferred: experience driving AI adoption across a product organization and working with the Department of Defense, federal agencies, or regulated environments.
- Preferred: familiarity with NIST 800-53, FedRAMP, or NATO D32.
Benefits
- Full-time position with flexible remote work opportunities; candidates must reside in an approved hiring hub.
- 100% employer-paid medical, dental, and vision coverage for employees and dependents.
- 401(k) with a 3% company contribution.
- Wellness benefits including One Medical membership, mental health resources, and family planning support.
- Equity incentive plan, flexible paid time off, and all federal holidays.
- New-hire technology and home-office stipend and annual professional development stipend.
- Generous parental leave and employee referral bonus program.
Tech Stack
Categories
About Second Front Systems
Second Front Systems builds a SaaS/PaaS platform that streamlines software accreditation, hosting, and continuous delivery on government and classified networks, helping vendors achieve ATO and FedRAMP/DoD IL compliance. It sells to U.S. defense and civilian agencies and to commercial ISVs entering regulated markets, supporting environments used by the DoD, UK Ministry of Defence, and NATO. The company is privately held and headquartered in Wilmington, Delaware.