Senior AI Software Engineer
General Dynamics Information Technology3 days ago
Remote, United StatesSenior
Base Salary
$130k - $173k/yr
Responsibilities
- Build and deploy LLM-based applications and agents with APIs, backend services, tool calling, structured outputs, and multi-step workflows.
- Develop RAG and document-processing pipelines covering ingestion, embeddings, vector search, and reranking.
- Implement evaluation using test datasets, regression tests, quality metrics, and human review.
- Deploy and operate AI solutions in production with platform and DevOps engineers using containers, CI/CD, monitoring, and cost controls.
- Collaborate with security engineers on access control, audit logging, PII handling, AI-action approvals, and federal authorization documentation.
- Produce technical documentation, architecture diagrams, deployment procedures, and operational runbooks.
- Advise technical and non-technical stakeholders, communicate tradeoffs, recommend approaches, and mentor engineers.
Requirements
- Bachelor’s degree or equivalent experience.
- Either 7+ years of professional software engineering experience including 1+ year building LLM applications, or 5+ years of AI/ML application development including 2+ years with LLMs.
- Production experience building and supporting an LLM application beyond a basic chat interface, such as tool calling, RAG, agents, or multi-step workflows.
- Experience with agent frameworks such as LangGraph, LangChain, Strands Agents, or CrewAI.
- Strong Python skills and experience building APIs and backend services, with Git, automated testing, and code review.
- Experience with major model providers such as OpenAI, Anthropic, Google, Azure AI, or Amazon Bedrock.
- Experience deploying and debugging cloud applications with containers and CI/CD.
- Ability to obtain and maintain a Public Trust.
- Preferred experience with LLM evaluation, tracing, and prompt-versioning tools such as LangSmith, Langfuse, or Ragas.
- Preferred experience with Model Context Protocol server development and integration.
- Preferred AWS experience, including Amazon Bedrock or Bedrock AgentCore, or relevant AWS certifications.
- Preferred experience fine-tuning or customizing foundation models, working with knowledge bases and vector stores, using Terraform, and supporting scientific research, federal government, healthcare, or regulated environments.
Benefits
- Fully remote work from any location in the United States with a 40-hour scheduled work week and no travel required.
- Medical, dental, vision, HSA, 401(k) with company match, paid vacation, sick and personal leave, paid holidays, and paid parental, military, bereavement, and jury-duty leave.
- Up to 160 hours of paid family leave in a rolling 12-month period for eligible employees.
- Short- and long-term disability, life, accidental death and dismemberment, personal accident, critical illness, and business travel and accident insurance.
About General Dynamics Information Technology
General Dynamics Information Technology (GDIT) delivers enterprise IT, systems integration, cybersecurity, cloud, and software engineering services to U.S. federal agencies, including defense and intelligence organizations. It provides contract-based professional and managed services ranging from network operations and unified communications to training and simulation. GDIT is a business unit of General Dynamics (NYSE: GD) and is headquartered in Falls Church, Virginia.