Autonomy Simulation Engineer (World Sim)
Caterpillar2 days ago
Wuxi, China or Shanghai, ChinaEntry Level
Responsibilities
- Build high-fidelity 3D digital scenes using 3D Gaussian Splatting, NeRF, and related neural-rendering technologies.
- Transfer real mining sites, construction sites, and road environments into simulation platforms while improving reconstruction quality, rendering efficiency, and asset-management workflows.
- Participate in the development and training of vision-language-action models for language-driven agent behavior, task understanding, decision execution, and behavior evaluation.
- Design and implement world models for dynamic environment prediction, scene evolution simulation, and long-horizon decision reasoning.
- Develop automated simulation data-generation toolchains and closed-loop validation systems for large-scale testing of perception, planning, and control algorithms.
- Contribute to simulation-scene development, data management, test-result analysis, and the application of generative AI, foundation models, and reinforcement learning to agent training and behavior modeling.
Requirements
- Expected to graduate in 2027 with a master's degree or above; excellent bachelor's candidates may also qualify.
- Degree background in computer science, artificial intelligence, automation, robotics, mathematics, electronic engineering, or a related field.
- Knowledge of computer vision fundamentals and familiarity with 3D reconstruction, multi-view geometry, SLAM, or neural rendering.
- Knowledge of NeRF, 3D Gaussian Splatting, world models, Transformers, large language models, and vision-language models; experience with these areas is preferred where stated.
- Strong interest in vision-language-action systems, embodied AI, and autonomous-intelligence applications.
- Simulation-environment development experience is preferred.
- Proficiency in Python and familiarity with the PyTorch deep-learning framework.
- Experience using Linux development environments and a solid foundation in data structures and algorithms.
- Ability to read English technical literature and research papers, with strong learning, research, communication, and collaboration skills.
Categories
About Caterpillar
Caterpillar Inc. designs, manufactures, and services construction and mining equipment, diesel and natural gas engines, industrial gas turbines, and diesel-electric locomotives for infrastructure, resource, and energy customers. The public company, founded in 1925 and headquartered in Irving, Texas, sells primarily through an independent worldwide dealer network and provides equipment financing. It operates through Construction Industries, Resource Industries, and Energy & Transportation segments, with shares traded on the NYSE and Euronext Paris.