TY - JOUR
T1 - Low-cost camera and 2-D LIDAR fusion for target vehicle corner detection and tracking
T2 - Applications to micromobility devices
AU - Alai, Hamidreza
AU - Rajamani, Rajesh
N1 - Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2024/1/1
Y1 - 2024/1/1
N2 - This paper develops a cost-effective vehicle detection and tracking system based on fusion of a 2-D LIDAR and a monocular camera to protect electric micromobility devices, especially e-scooters, by predicting the real- time danger of a car- scooter collision. The cost and size disadvantages of 3-D LIDAR sensors make them an unsuitable choice for micromobility devices. Therefore, a 2-D RPLIDAR Mapper sensor is used. Although low-cost, this sensor comes with major shortcomings such as the narrow vertical field of view and its low density of data points. Due to these factors, the sensor does not have a robust output in outdoor applications, and the measurements keep jumping and sliding on the vehicle surface. To improve the performance of the LIDAR, a single monocular camera is fused with the LIDAR data not only to detect vehicles, but also to separately detect the front and side of a target vehicle and to find its corner. It is shown that this corner detection method is more accurate than strategies that are only based on the LIDAR data. The corner measurements are used in a high-gain observer to estimate the location, velocity, and orientation of the target vehicle. The developed system is implemented on a Ninebot e-scooter platform, and multiple experiments are performed to evaluate the performance of the algorithm.
AB - This paper develops a cost-effective vehicle detection and tracking system based on fusion of a 2-D LIDAR and a monocular camera to protect electric micromobility devices, especially e-scooters, by predicting the real- time danger of a car- scooter collision. The cost and size disadvantages of 3-D LIDAR sensors make them an unsuitable choice for micromobility devices. Therefore, a 2-D RPLIDAR Mapper sensor is used. Although low-cost, this sensor comes with major shortcomings such as the narrow vertical field of view and its low density of data points. Due to these factors, the sensor does not have a robust output in outdoor applications, and the measurements keep jumping and sliding on the vehicle surface. To improve the performance of the LIDAR, a single monocular camera is fused with the LIDAR data not only to detect vehicles, but also to separately detect the front and side of a target vehicle and to find its corner. It is shown that this corner detection method is more accurate than strategies that are only based on the LIDAR data. The corner measurements are used in a high-gain observer to estimate the location, velocity, and orientation of the target vehicle. The developed system is implemented on a Ninebot e-scooter platform, and multiple experiments are performed to evaluate the performance of the algorithm.
KW - Collision prediction
KW - Electric scooters
KW - Sensor fusion
KW - State estimation
KW - Vehicle detection
KW - Vehicle tracking
UR - http://www.scopus.com/inward/record.url?scp=85176147944&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85176147944&partnerID=8YFLogxK
U2 - 10.1016/j.ymssp.2023.110891
DO - 10.1016/j.ymssp.2023.110891
M3 - Article
AN - SCOPUS:85176147944
SN - 0888-3270
VL - 206
JO - Mechanical Systems and Signal Processing
JF - Mechanical Systems and Signal Processing
M1 - 110891
ER -