End-to-End Deep Learning for Self-Driving Cars

End-to-End Deep Learning for Self-Driving Cars

In a new automotive application, we have used convolutional neural networks (CNNs) to map the raw pixels from a front-facing camera to the steering commands for a self-driving car. This powerful end-to-end approach means that with minimum training data from humans, the system learns to steer, with or without lane markings, on both local roads and highways. The system can also operate in areas with unclear visual guidance such as parking lots or unpaved roads. Figure 1: NVIDIA’s self-driving car in action. We designed the end-to-end learning system using an NVIDIA DevBox running Torch 7 for training. An NVIDIA DRIVETM PX self-driving car computer, also with Torch 7,  was used to determine where to drive—while operating at 30 frames per second (FPS). The system is trained to automatically learn the…


Link to Full Article: End-to-End Deep Learning for Self-Driving Cars