End-to-End Autonomous Driving: Perception, Prediction, Planning and Simulation @CVPR2023

A diversity of computer vision capabilities are all critical in building industry-level autonomous driving systems, ranging from 2D to 3D perception, prediction, planning, to scene simulation. This has inspired a surge of relevant research, growing at a fast pace with increasingly accurate and efficient new methods (e.g. BEV-based 3D detection, HDMapNet, NeRF) developed continuously. Much more than simple combination of individual independently developed methods, autonomous driving also requires synergistic integration of different functions as a whole. This however is far away from the current situation that researchers in the sub-fields of perception, planning and simulation make largely limited idea exchange and communication. This calls for a system-level perspective on the advancement of autonomous driving. This workshop aims to provide a platform where researchers from different sub-fields can focus on exchanging the frontier ideas across boundaries, leading to holistic system-aware understanding and systematic research attempts in the future. Suggested topics include, but are not limited to:

  • - 3D obejct detetion
  • - Traffic lane detection and HD map construction
  • - End-to-end perception, prediction and planning
  • - Autonomous driving environment simulation



Paper submission will follow CVPR 2023 format. All papers will be reviewed with double blind policy. Sbumission is through CMT.

CMT Submission

Important Dates

Action Date
Paper submission deadline March 20th, 2023
Notification to authors March 29th, 2023
Camera ready deadline April 5th, 2023




12:30-12:35 Welcome and introduction


12:35-13:10 Philipp Krähenbühl
13:10-13:45 Pei Sun
13:45-14:20 Jia Deng

Prediction & Planing

14:20-14:55 Kashyap Chitta
14:55-15:30 Nikolai Smolyanskiy
15:30-16:05 Alex Kendall
16:05-16:40 Raquel Urtasun
16:40-17:15 Daniel Cremers


17:15-17:50 Angjoo Kanazawa
17:50-18:25 Matthias Niessner
18:25-19:00 Bolei Zhou

Closing remark

19:00-19:05 Closing remark