Journal Home > Volume 4 , Issue 3
Purpose

The purpose of this paper is to develop a proof-of-concept (POC) Forward Collision Warning (FWC) system for the motorcyclist, which determines a potential clash based on time-to-collision and trajectory of both the detected and ego vehicle (motorcycle).

Design/methodology/approach

This comes in three approaches. First, time-to-collision value is to be calculated based on low-cost camera video input. Second, the trajectory of the detected vehicle is predicted based on video data in the 2 D pixel coordinate. Third, the trajectory of the ego vehicle is predicted via the lean direction of the motorcycle from a low-cost inertial measurement unit sensor.

Findings

This encompasses a comprehensive Advanced FWC system which is an amalgamation of the three approaches mentioned above. First, to predict time-to-collision, nested Kalman filter and vehicle detection is used to convert image pixel matrix to relative distance, velocity and time-to-collision data. Next, for trajectory prediction of detected vehicles, a few algorithms were compared, and it was found that long short-term memory performs the best on the data set. The last finding is that to determine the leaning direction of the ego vehicle, it is better to use lean angle measurement compared to riding pattern classification.

Originality/value

The value of this paper is that it provides a POC FWC system that considers time-to-collision and trajectory of both detected and ego vehicle (motorcycle).


menu
Abstract
Full text
Outline
About this article

Forward collision warning system for motorcyclist using smart phone sensors based on time-to-collision and trajectory prediction

Show Author's information Qun Lim1( )Yi Lim1Hafiz Muhammad2Dylan Wei Ming Tan1U-Xuan Tan1
Department of Engineering Product Development, Singapore University of Technology and Design, Singapore, Singapore
Department of Information Systems Technology and Design, Singapore University of Technology and Design, Singapore, Singapore

Abstract

Purpose

The purpose of this paper is to develop a proof-of-concept (POC) Forward Collision Warning (FWC) system for the motorcyclist, which determines a potential clash based on time-to-collision and trajectory of both the detected and ego vehicle (motorcycle).

Design/methodology/approach

This comes in three approaches. First, time-to-collision value is to be calculated based on low-cost camera video input. Second, the trajectory of the detected vehicle is predicted based on video data in the 2 D pixel coordinate. Third, the trajectory of the ego vehicle is predicted via the lean direction of the motorcycle from a low-cost inertial measurement unit sensor.

Findings

This encompasses a comprehensive Advanced FWC system which is an amalgamation of the three approaches mentioned above. First, to predict time-to-collision, nested Kalman filter and vehicle detection is used to convert image pixel matrix to relative distance, velocity and time-to-collision data. Next, for trajectory prediction of detected vehicles, a few algorithms were compared, and it was found that long short-term memory performs the best on the data set. The last finding is that to determine the leaning direction of the ego vehicle, it is better to use lean angle measurement compared to riding pattern classification.

Originality/value

The value of this paper is that it provides a POC FWC system that considers time-to-collision and trajectory of both detected and ego vehicle (motorcycle).

Keywords: Forward collision warning, Advanced driving assistance system, Time-to-collision, Motorcycles

References(16)

Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M. and Kudlur, M. (2016), "Tensorflow: a system for large-scale machine learning", 12th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 16), pp. 265-283.

Alghamdi, T., Elgazzar, K., Bayoumi, M., Sharaf, T. and Shah, S. (2019), "Forecasting traffic congestion using ARIMA modeling", 2019 15th International Wireless Communications Mobile Computing Conference (IWCMC), pp. 1227-1232.

Goli, S.A., Far, B.H. and Fapojuwo, A.O. (2018), "Vehicle trajectory prediction with gaussian process regression in connected vehicle environment?", 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 550-555.

Heravi, E.J. and Khanmohammadi, S. (2011), "Long term trajectory prediction of moving objects using gaussian process", 2011 First International Conference on Robot, Vision and Signal Processing, pp. 228-232.

Hossam-E-Haider, M., Islam, T., Islam, M.S. and Shajid-Ul-Mahmud, M. (2017), "Comparison of complementary and Kalman filter based data fusion for attitude heading reference system", AIP Conference Proceedings, vol. 1919, doi: 10.1063/1.5018520.

Lauren, S. and Harlili, S.D. (2014), "Stock trend prediction using simple moving average supported by news classification", 2014 International Conference of Advanced Informatics: Concept, Theory and Application (ICAICTA), pp. 135-139.

Lim, Q., He, Y. and Tan, U. (2018), "Real-time forward collision warning system using nested Kalman filter for monocular camera", 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 868-873.

Lim, Q., Johari, K. and Tan, U. (2019), "Gaussian process auto regression for vehicle center coordinates trajectory prediction", TENCON 2019 - 2019 IEEE Region 10 Conference (TENCON), pp. 25-30.

Park, S.H., Kim, B., Kang, C.M., Chung, C.C. and Choi, J.W. (2018), "Sequence-to-sequence prediction of vehicle trajectory via LSTM Encoder-Decoder architecture", 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 1672-1678.

Radziukynas, V. and Klementavicius, A. (2014), "Short-term wind speed forecasting with ARIMA model", 2014 55th International Scientific Conference on Power and Electrical Engineering of Riga Technical University (RTUCON), pp. 145-149.

Redmon, J., Divvala, S., Girshick, R. and Farhadi, A. (2016), "You only look once: unified, Real-Time object detection", 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779-788.

Salari, E. and Ouyang, D. (2013), "Camera-based forward collision and lane departure warning systems using SVM", 2013 IEEE 56th International Midwest Symposium on Circuits and Systems (MWSCAS), pp. 1278-1281.

Schulz, J., Hubmann, C., Löchner, J. and Burschka, D. (2018), "Multiple model unscented Kalman filtering in dynamic Bayesian networks for intention estimation and trajectory prediction", 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pp. 1467-1474.

Sulandari, W. and Yudhanto, Y. (2015), "Forecasting trend data using a hybrid simple moving average-weighted fuzzy time series model", 2015 International Conference on Science in Information Technology (ICSITech), pp. 303-308.

Tavenard, R., Faouzi, J., Vandewiele, G., Divo, F., Androz, G., Holtz, C., Payne, M., Yurchak, R., Ruß wurm, M., Kolar, K. and Woods, E. (2020), "Tslearn, a machine learning toolkit for time series data", Journal of Machine Learning Research, Vol. 21 No. 118, pp. 1-6, available at: http://jmlr.org/papers/v21/20-091.html

Zhao, J., Xie, B. and Huang, X. (2014), "Real-time lane departure and front collision warning system on an FPGA", 2014 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1-5.

Publication history
Copyright
Rights and permissions

Publication history

Received: 13 November 2020
Revised: 29 June 2021
Accepted: 24 August 2021
Published: 15 September 2021
Issue date: December 2021

Copyright

© 2021 Qun Lim, Yi Lim, Hafiz Muhammad, Dylan Wei Ming Tan and U-Xuan Tan. Published in Journal of Intelligent and Connected Vehicles. Published by Emerald Publishing Limited.

Rights and permissions

This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence maybe seen at http://creativecommons.org/licences/by/4.0/legalcode

Return