AI Software Engineer
Second Front Systems12 days ago
Remote, United StatesMid Level
Base Salary
$150k - $160k/yr
Responsibilities
- Architect and ship production agentic AI systems using LangGraph and LangChain with reliability, traceability, and measurable output quality.
- Build ingestion pipelines, embedding and chunking strategies, retrieval and re-ranking systems, vector database integrations, and tool suites.
- Construct MCP servers and consuming clients to connect agents with corporate tools and knowledge.
- Establish and operate AI cloud infrastructure using Amazon EKS, Terraform, Helm, and GitOps delivery patterns.
- Create and run CI-based evaluation and regression suites for groundedness, faithfulness, relevance, and retrieval quality.
- Partner with Product and Engineering teams on AI workflow scope, agent architecture, model selection, output standards, and responsible AI governance.
- Develop documentation and reusable components that expand organizational AI capability.
Requirements
- At least 2 years of full-time software, ML, or AI engineering experience building and shipping LLM-based systems in production.
- Hands-on experience with agentic AI systems, tool-calling agents, and multi-step orchestration using LangGraph, LangChain, or equivalent.
- Production experience with Retrieval-Augmented Generation, vector stores, embedding models, chunking strategies, and retrieval quality optimization.
- Experience deploying containerized AI services with Docker, Kubernetes, and infrastructure as code; EKS and Terraform are preferred.
- Ability to communicate AI concepts and recommendations to nontechnical stakeholders and cross-functional teams.
- U.S. citizenship and residence in an approved hiring hub: DC/Maryland/Virginia; Raleigh/Durham/Chapel Hill, North Carolina; Denver/Colorado Springs, Colorado; or Dallas/Fort Worth, Texas.
- Preferred experience includes MCP servers or clients, enterprise tool and knowledge-base integrations, AWS Bedrock Knowledge Bases, AgentCore, OpenSearch, LiteLLM, vLLM, GPU-backed self-hosted models, LLM gateways, AI adoption, Department of Defense or federal work, regulated environments, NIST 800-53, FedRAMP, or NATO D32.
Benefits
- Full-time position with flexible remote work opportunities, subject to approved hiring hub requirements.
- 100% employer-paid medical, dental, and vision coverage for the employee and dependents.
- 401(k) with a 3% company contribution.
- Wellness benefits including One Medical membership, mental health resources, and family planning support.
- Equity incentive plan, new-hire technology and home-office stipend, and annual professional development stipend.
- Flexible paid time off, federal holidays, generous parental leave, and an employee referral bonus program.
Tech Stack
Categories
About Second Front Systems
Second Front Systems builds a SaaS/PaaS platform that streamlines software accreditation, hosting, and continuous delivery on government and classified networks, helping vendors achieve ATO and FedRAMP/DoD IL compliance. It sells to U.S. defense and civilian agencies and to commercial ISVs entering regulated markets, supporting environments used by the DoD, UK Ministry of Defence, and NATO. The company is privately held and headquartered in Wilmington, Delaware.