AI Engineer
Caterpillar3 days ago
East Peoria, IL, USA or Irving, TX, USAMid Level
Base Salary
$98k - $158k/yr
Responsibilities
- Design, version, tune, and optimize system, contextual, and dynamic prompts across open-source and proprietary LLMs.
- Build and orchestrate multi-agent systems, multi-step reasoning workflows, RAG pipelines, semantic search, embeddings, vector database queries, and tool-calling integrations.
- Develop automated evaluation, regression testing, CI/CD validation, guardrail, and observability systems for AI agents and LLM applications.
- Monitor semantic drift, token usage, costs, latency, RAG accuracy, prompt stability, agent trajectories, and tool-calling performance in production.
- Collaborate with Product Managers, Data Scientists, and Software Engineers to translate commercial requirements into deterministic AI capabilities.
- Track advances in LLMs, evaluation frameworks, and orchestration libraries and apply relevant innovations.
Requirements
- Bachelor’s or master’s degree in computer science, Data Science, Artificial Intelligence, Computational Linguistics, Mathematics, or another highly technical discipline.
- At least 2 years of dedicated professional experience developing production software integrated with GenAI or LLM pipelines.
- Expertise in structured prompt formats, system-level steering, context-window optimization, prompt tuning, and prompt risk mitigation.
- High proficiency in Python or TypeScript for backend AI logic, asynchronous data streams, and API integrations.
- Hands-on experience with LangChain, LangGraph, or native AI model SDKs.
- Experience with vector databases, including Azure AI Search or AWS OpenSearch, and hybrid search retrieval methods.
- Strong data manipulation, data cleaning, token handling, and foundational NLP transformer knowledge.
- A proven portfolio of deployed RAG systems or operational AI agents in commercial environments.
- Preferred experience with Application Insights, OpenLLMetry, custom evaluation or guardrail layers, QLoRA, PEFT, Hugging Face, PyTorch, TensorFlow, Docker, Kubernetes, AWS, or GCP.
Benefits
- Medical, dental, and vision benefits, subject to eligibility and plan terms.
- Paid time off including vacation, holidays, and volunteer time.
- 401(k) savings plans, Health Savings Account, and Flexible Spending Accounts.
- Health Lifestyle Programs, Employee Assistance Program, voluntary benefits, and employee discounts.
- Career development, tuition reimbursement, incentive bonus, disability benefits, life insurance, parental leave, and adoption benefits.
- The position requires working onsite five days per week in East Peoria, IL, or Irving, TX.
- The posting is open from October 27, 2026 through November 8, 2026.
Tech Stack
Categories
About Caterpillar
Caterpillar Inc. designs, manufactures, and services construction and mining equipment, diesel and natural gas engines, industrial gas turbines, and diesel-electric locomotives for infrastructure, resource, and energy customers. The public company, founded in 1925 and headquartered in Irving, Texas, sells primarily through an independent worldwide dealer network and provides equipment financing. It operates through Construction Industries, Resource Industries, and Energy & Transportation segments, with shares traded on the NYSE and Euronext Paris.