Pedestrian and Vehicle Detection on the Carla Simulator

Pedestrian and Vehicle detection using Yolov3

https://user-images.githubusercontent.com/42083679/129405414-38308de9-e001-4b26-be7e-e77b304d8007.mp4

Pedestrian detection in image or video data is a very important and challenging task in security surveillance. The difficulty of this task is to locate and detect pedestrians of different scales in complex scenes accurately.

To solve these problems, a deep neural network (RT-YOLOv3) is proposed to realize real-time pedestrian detection at different scales in security monitoring. RT-YOLOv3 improves the traditional YOLOv3 algorithm. Firstly, the deep residual network is added to extract vehicle features.

Then six convolutional neural networks with different scales are designed and fused with the corresponding scale feature maps in the residual network to form the final feature pyramid to perform pedestrian detection tasks. This method can better characterize pedestrians.

In order to further improve the accuracy and generalization ability of the model, a hybrid pedestrian data set training method is used to extract pedestrian data.

Output Video

https://user-images.githubusercontent.com/42083679/129405442-37e28c84-b852-4fe8-9782-acb51f0349da.mp4

Thank You