Caterpillar

Senior AI Automation Engineer, Data Annotation Services

Caterpillar
Apply
2 days ago
Irving, TX, USASenior
H1B sponsor

Base Salary

$113k - $183k/yr

Responsibilities

  • Develop and deploy automated labeling and captioning solutions for perception and Vision-Language-Action datasets.
  • Train, fine-tune, and evaluate AI models for auto-labeling, auto-captioning, and annotation quality automation.
  • Build data pipelines covering automated labeling, human review, quality validation, and dataset publication.
  • Implement and extend NVIDIA Cosmos Curator, Cosmos Reason, and other AI automation technologies.
  • Integrate Caterpillar data systems with external annotation providers and human-in-the-loop workflows.
  • Ensure reliability, scalability, observability, and operational excellence across annotation automation services.

Requirements

  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Robotics, or a related field.
  • Production-grade software development experience using Python, modern software engineering practices, and containerization platforms such as Docker or Kubernetes.
  • Experience designing and implementing distributed systems, APIs, and data processing pipelines.
  • Experience training, fine-tuning, or deploying machine learning models.
  • At least 2 years of experience generating and managing camera and LiDAR sensor datasets for perception or machine learning applications, including collection pipeline design and ground-truth generation.
  • At least 1 year of experience in data annotation and quality assurance for autonomous systems or computer vision projects.
  • Experience defining annotation guidelines, identifying labeling defects, and improving dataset accuracy.
  • Experience with annotation and dataset management tools such as Labelbox, Supervisely, Roboflow, or similar tools.
  • Experience with machine learning frameworks and training tools such as PyTorch, TensorFlow, ONNX, Weights & Biases, or MLflow.
  • Preferred experience with computer vision, robotics, autonomy, Physical AI, multimodal AI, AI-assisted annotation, foundation models, vision models, VLA datasets, sensor data, cloud platforms, MLOps, deployment pipelines, and human-in-the-loop quality automation.

Benefits

  • Full-time onsite work at the Irving, Texas office, five days per week.
  • Domestic relocation assistance is available.
  • Medical, dental, and vision benefits.
  • Paid time off including vacation, holidays, and volunteer time.
  • 401(k) savings plans, Health Savings Account, and Flexible Spending Accounts.
  • Health lifestyle programs, employee assistance, voluntary benefits, and employee discounts.
  • Career development, disability benefits, life insurance, parental leave, adoption benefits, and tuition reimbursement.
  • Visa sponsorship is available for eligible applicants.

Tech Stack

Categories

Data EngineeringML Engineering
Caterpillar

About Caterpillar

10,000+ employees

Caterpillar Inc. designs, manufactures, and services construction and mining equipment, diesel and natural gas engines, industrial gas turbines, and diesel-electric locomotives for infrastructure, resource, and energy customers. The public company, founded in 1925 and headquartered in Irving, Texas, sells primarily through an independent worldwide dealer network and provides equipment financing. It operates through Construction Industries, Resource Industries, and Energy & Transportation segments, with shares traded on the NYSE and Euronext Paris.

Contact me