Physical AI Engineer
Ernst and Young12 days ago
Toronto, CanadaMid Level
Responsibilities
- Research emerging developments in Physical AI, robotics, multimodal foundation models, computer vision, and agentic systems.
- Design, develop, and evaluate control architectures for humanoid, quadruped, and other robotic platforms.
- Build multimodal data-fusion pipelines using cameras, LiDAR, audio, telemetry, and other modalities for perception and localization tasks.
- Train, fine-tune, evaluate, and deploy machine learning models for robotics and Physical AI use cases.
- Integrate VLMs, VLAs, multimodal foundation models, LLMs, and agentic AI with robotic systems.
- Develop and test robotic capabilities in simulation and on physical platforms, including edge computing environments.
- Build modular Python software, APIs, services, SDK integrations, and containerized components for reusable AI and robotics capabilities.
- Design experiments and evaluation methods for real-world Physical AI scenarios.
- Create and deliver robotics and Physical AI demonstrations for clients and internal teams.
- Support the configuration, maintenance, and continuous improvement of the Physical AI Lab environment.
Requirements
- Bachelor's or master's degree in robotics, engineering, computer science, artificial intelligence, machine learning, or a related technical field.
- Understanding of robotics fundamentals including perception, localization, navigation, motion planning, kinematics, and control.
- Practical computer vision or video-processing experience, including object detection, segmentation, tracking, pose estimation, or scene understanding.
- Hands-on experience with robotic platforms, sensors, robotic SDKs/APIs, autonomous systems, or edge devices.
- Experience with NVIDIA Isaac Sim, Gazebo, MuJoCo, or equivalent robotics simulation environments.
- Hands-on experience with ROS or ROS2.
- Experience with VLMs, VLAs, imitation learning, and reinforcement learning.
- Strong Python software engineering experience developing AI/ML, robotics, automation, or system-integration solutions.
- Experience translating real-world processes and specifications into Physical AI functions, objectives, and constraints.
- Experience developing client-facing technology prototypes, demonstrations, or innovation solutions.
- Ability to work independently and experience with physical AI hardware such as motors, sensors, edge devices, and communication devices.
- Preferred experience with PyTorch, TensorFlow, Hugging Face, Docker, Git, REST APIs, CI/CD, C++, LLM integration, and agentic AI frameworks.
- Strong foundation in machine learning and data science, including data preparation, model development, training, evaluation, experimentation, and deployment.
Benefits
- The role is based in and supports operation of the EY.ai Lab, including robotics, AI, simulation, and edge-computing environments.
- The position includes client demonstrations, innovation workshops, applied research, and opportunities to prototype Physical AI use cases across multiple industries.
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public ‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.