Senior Machine Learning Engineer, Perception and Sensor Simulation

The Simulator Team at Waymo builds state-of-the-art simulations of realistic environments for testing and training the Waymo Driver. Your team will be a diverse, and collaborative group of machine learning (ML) engineers, software engineers and data scientists. We develop industry-leading simulation solutions using advanced ML algorithms that measure and enhance the performance of the Waymo Driver. We achieve those goals by jointly modeling the real world, including realistic agents (vehicles, pedestrians, cyclists, motorcyclists), roads, traffic control systems, and weather conditions, and the full sensor suite including camera, Lidar and radars.

To increase the fidelity, scalability and controllability of our simulations,we employ the latest ML technologies such as large language models, foundational world models, and reconstructive methods trained on large-scale datasets with both generative and reconstructive technologies.

In this hybrid role, you will report to a Senior Staff Engineering Manager

You will:

• Join our world-class research engineering team and drive innovation in ultra-realistic sensor data and perception simulation for autonomous vehicles. You will develop the latest simulation technologies using foundation models for embodied agents.
• Apply your deep Machine Learning (ML) expertise, in Generative AI (GenAI), to push the boundaries of simulation realism and directly influence the advancement of autonomous driving technology.
• Work in close collaboration with Waymo's foundational AI research team to transfer State-of-The-Art research into scalable and production-ready solutions.

You have:

• 5+ years of experience with ML engineering and applied Deep Learning
• 5+ years of experience simulating sensor data (Camera, Lidar or Radar), 2+ years using Multi-modal Generative Models, including diffusion models or autoregressive foundational world models
• 5+ years of experience with machine learning based 3D Reconstruction rendering techniques preferably 2+ years 3D Gaussian Splatting (3DGS) and Neural Radiance Field (Nerf), depth estimation models.
• 5+ years of experience with high productivity in Python, with experience developing ML software using frameworks such as PyTorch, TensorFlow and Jax/Flax.
• PhD in Computer Science, Machine Learning (ML), Robotics, or similar technical field of study, or equivalent practical experience.
• 3+ years of experience with sensor data processing (Lidar, Camera, or MIMO Radar).
• Experience with autonomous systems including robotics or autonomous vehicles (L4, L3+)
• 3+ years of experience in C++, particularly in integrating ML models into a production system
• 3+ years of experience training large-scale models on GPU/TPU clusters

#LI-Hybrid