Software Engineer - Inference

1 month ago

Laurel, MD, USAMid Level

Base Salary

$85k - $120k/yr

Responsibilities

Procure, configure, test, and prepare inference models for release to users.
Develop in-house services and techniques to provide continual high-quality inference service.
Collaborate with model vendors to create reliable pipelines for closed-source model usage.
Support short-term, high-priority inference needs through surge efforts.
Establish service infrastructure and integrate LLM-powered tools with other organizational teams.

Active Top Secret (TS/SCI) clearance with polygraph is required.
U.S. citizenship is required; green card holders and permanent residents are not eligible.
Bachelor's degree in a technical discipline, with four additional years of experience substituting for the degree.
Experience with Python and/or other modern programming languages.
Experience with Kubernetes and Helm.
Familiarity with Argo CD and/or other CI/CD frameworks.
Familiarity with AWS or other cloud service providers.
Strong communication skills, willingness to ask questions, and ability to learn new technologies quickly.
Applicants selected must obtain or maintain a government security clearance.

100% employee-owned company with employee participation in company success.
15% retirement contribution, consisting of a 5% 401(k) match and 10% ESOP contribution.
Four weeks of paid time off, 12 paid holidays, comp time, overtime, and flexible work hours.
80 hours of paid parental leave plus an $8,000 supplemental payment upon returning from maternity leave.
Medical, dental, and vision benefits for individuals and families; employees waiving medical benefits receive an additional $4,160 per year.
Annual $600 lifestyle bonus for gyms, fitness, new technology, or an HSA.
Annual merit increases and performance-based bonuses.
Term life insurance and short-term and long-term disability coverage.

51-200 employees