GenAI Engineer (LLM)
State Farm1 day ago
Bloomington, IL, USA +3 moreStaff+
Base Salary
$85k - $142k/yr
Responsibilities
- Design, develop, and maintain the LARRY FastAPI backend and REST API endpoints for conversation, ingestion, and knowledge retrieval.
- Build and support LLM-powered RAG pipelines using the kcd-repository knowledge base.
- Lead backend architecture decisions and mentor junior engineers.
- Collaborate with stakeholders, product owners, architects, and subject-matter experts on knowledge processing and retrieval.
- Implement and maintain GitLab CI/CD pipelines for deployment to ROSA on OpenShift.
- Perform code reviews, unit testing, and integration testing.
- Integrate Entra ID (Azure AD) for authentication and secure API access.
- Research and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracy.
Requirements
- Strong Python or React experience, including FastAPI or similar asynchronous web frameworks.
- Experience integrating LLMs and implementing RAG architecture patterns.
- Experience designing, developing, and maintaining RESTful APIs.
- Hands-on experience with CI/CD pipelines and containerized deployment.
- Solid understanding of Git and version-control workflows.
- Experience with AWS or other cloud environments.
- Preferred: experience transforming JCL, DB2, and COBOL mainframe artifacts into structured knowledge objects.
- Preferred: experience with vector databases, embedding-based systems, JSON schema design, knowledge graphs, or structured data patterns.
Benefits
- Hybrid work arrangement requiring approximately 40% in-office time each month beginning in late 2027, with hub locations in Bloomington, IL; Dunwoody, GA; Richardson, TX; or Tempe, AZ.
- Health, vision, dental, telemedicine, mental-health, and wellbeing programs, with State Farm paying most of the healthcare premium.
- Training programs, tuition assistance, employee resource groups, and mentoring.
- Fertility, IVF, adoption, college coaching, discount, and financial-wellness programs.
- Paid time off, parental leave, paid holidays, celebration day, life leave, bereavement leave, and community service or education support days.
- Matching gifts, community grants, and an employee assistance fund.
- 401(k) plan with company contributions and access to financial advisors.
About State Farm
State Farm is a U.S. mutual insurance group that sells auto, home, renters, life, health, and small-business coverage, plus select financial services. It markets policies primarily through a large network of local agents and earns revenue from premiums and investing customer reserves. Founded in 1922 and headquartered in Bloomington, Illinois, it is among the largest personal lines insurers in the United States.