Journal Home > Volume 2 , Issue 2
Purpose

This paper aims to present a summary of the performance measurement and evaluation plan of the Wyoming connected vehicle (CV) Pilot Deployment Program (WYDOT Pilot).

Design/methodology/approach

This paper identified 21 specific performance measures as well as approaches to measure the benefits of the WYDOT Pilot. An overview of the expected challenges that might introduce confounding factors to the evaluation effort was outlined in the performance management plan to guide the collection of system performance data.

Findings

This paper presented the data collection approaches and analytical methods that have been established for the real-life deployment of the WYDOT CV applications. Five methodologies for assessing 21 specific performance measures contained within eight performance categories for the operational and safety-related aspects. Analyses were conducted on data collected during the baseline period, and pre-deployment conditions were established for 1 performance measures. Additionally, microsimulation modeling was recommended to aid in evaluating the mobility and safety benefits of the WYDOT CV system, particularly when evaluating system performance under various CV penetration rates and/or CV strategies.

Practical implications

The proposed performance evaluation framework can guide other researchers and practitioners identifying the best performance measures and evaluation methodologies when conducting similar research activities.

Originality/value

To the best of the authors’ knowledge, this is the first research that develops performance measures and evaluation plan for low-volume rural freeway CV system under adverse weather conditions. This paper raised some early insights into how CV technology might achieve the goal of improving safety and mobility and has the potential to guide similar research activities conducted by other agencies.


menu
Abstract
Full text
Outline
About this article

Performance evaluation framework of Wyoming connected vehicle pilot deployment program: summary of Phase 2 pre-deployment efforts and lessons learned

Show Author's information Mohamed M. Ahmed1( )Guangchuan Yang1Sherif Gaweesh1Rhonda Young2Fred Kitchener3
University of Wyoming College of Engineering and Applied Science, Laramie, Wyoming, USA
Gonzaga University, Spokane, Washington, USA
McFarland Management, LLC, Boise, Idaho, USA

Abstract

Purpose

This paper aims to present a summary of the performance measurement and evaluation plan of the Wyoming connected vehicle (CV) Pilot Deployment Program (WYDOT Pilot).

Design/methodology/approach

This paper identified 21 specific performance measures as well as approaches to measure the benefits of the WYDOT Pilot. An overview of the expected challenges that might introduce confounding factors to the evaluation effort was outlined in the performance management plan to guide the collection of system performance data.

Findings

This paper presented the data collection approaches and analytical methods that have been established for the real-life deployment of the WYDOT CV applications. Five methodologies for assessing 21 specific performance measures contained within eight performance categories for the operational and safety-related aspects. Analyses were conducted on data collected during the baseline period, and pre-deployment conditions were established for 1 performance measures. Additionally, microsimulation modeling was recommended to aid in evaluating the mobility and safety benefits of the WYDOT CV system, particularly when evaluating system performance under various CV penetration rates and/or CV strategies.

Practical implications

The proposed performance evaluation framework can guide other researchers and practitioners identifying the best performance measures and evaluation methodologies when conducting similar research activities.

Originality/value

To the best of the authors’ knowledge, this is the first research that develops performance measures and evaluation plan for low-volume rural freeway CV system under adverse weather conditions. This paper raised some early insights into how CV technology might achieve the goal of improving safety and mobility and has the potential to guide similar research activities conducted by other agencies.

Keywords: Connected vehicles, Driver behaviors and assistance, Performance measures, Adverse weather, Microsimulation modeling, Wyoming connected vehicle pilot

References(43)

Abdulsattar, H., Mostafizi, A. and Wang, H. (2018), “Surrogate safety assessment of work zone rear-end collisions in a connected vehicle environment: agent-based modeling framework”, Journal of Transportation Engineering, Part A: System, Vol. 144 No. 8, doi: 10.1061/JTEPBS.0000164.

Bahaaldin, K., Fries, R., Bhavsar, P. and Das, P. (2017), “A case study on the impacts of connected vehicle technology on no-notice evacuation clearance time”, Journal of Advanced Transportation, Vol. 2017, doi: 10.1155/2017/6357415.

Chen, C., Zhao, X., Liu, H., Ren, G., Zhang, Y. and Liu, X. (2019), “Assessing the influence of adverse weather on traffic flow characteristics using a driving simulator and VISSIM”, Sustainability, Vol. 11 No. 3, doi: 10.3390/su11030830.

FHWA (2018), Connected Vehicle Pilot Deployment Program, U.S. Department of Transportation, Washington, DC, available at: www.its.dot.gov/pilots/ (accessed 10 December 2018)

Fountoulakis, M., Bekiaris-Liberis, N., Roncoli, C., Papamichail, I. and Papageorgiou, M. (2017), “Highway traffic state estimation with mixed connected and conventional vehicles: microscopic simulation-based testing”, Transportation Research Part C: Emerging Technologies, Vol. 78, pp. 13-33.

Fyfe, M. and Sayed, T. (2017), “Safety evaluation of connected vehicles for a cumulative travel time adaptive signal control microsimulation using the surrogate safety assessment model”, Proceedings of the 96th Annual Meeting of the Transportation Research Board, Washington, DC.
Galgano, S., Talas, M., Opie, K., Marsico, M., Weeks, A., Wang, Y., Benevelli, D., Rausch, R., Ozbay, K. and Muthuswamy, S. (2016), “Connected vehicle pilot deployment program phase 1, performance measurement and evaluation support plan – New York city”, Report No. FHWA-JPO-16-302, U.S. Department of Transportation, Washington, DC.

Genders, W. and Raviza, S.N. (2016), “Impact of connected vehicle on work zone network safety through dynamic route guidance”, Journal of Computing in Civil Engineering, Vol. 30 No. 2, doi: 10.1061/(ASCE)CP.1943-5487.0000490.

Gettman, D. and Head, L. (2003), “Surrogate safety measures from traffic simulation models”, Transportation Research Record: Journal of the Transportation Research Board, Vol. 1840 No. 1, pp. 104-115.

Gopalakrishna, D., Garcia, V., Ragan, A., English, T., Zumpf, S., Young, R., Ahmed, M., Kitchener, F. and Serulle, N.U. (2016a), “Connected vehicle pilot deployment program phase 1, concept of operation (ConOps), ICF/Wyoming”, Report No. FHWA-JPO-16-287, U.S. Department of Transportation, Washington, DC.
Gopalakrishna, D., Garcia, V., Ragan, A., English, T., Zumpf, S., Young, R., Ahmed, M., Kitchener, F., Serulle, N.U. and Hsu, E. (2016b), “Connected vehicle pilot deployment program phase 1, comprehensive pilot deployment plan, ICF/Wyoming”, Report No. FHWA-JPO-16-297, U.S. Department of Transportation, Washington, DC.
Hammit, B., James, R., Ahmed, M. and Young, R. (2019), “Towards the development of weather-dependent microsimulation models”, Proceedings of the 98th Transportation Research Board Annual Meeting, Washington, DC.
DOI
Hammit, B., Ahmed, M. and Young, R. (2017), “Feasibility of using connected vehicle data for rural roadway weather conditions in WY”, Proceedings of the 96th Transportation Research Board Annual Meeting, Washington, DC.

Khavas, R.G., Hellinga, B. and Masouleh, A.Z. (2017), “Identifying parameters for microsimulation modeling of traffic in inclement weather”, Transportation Research Record: Journal of the Transportation Research Board, Vol. 2613 No. 1, pp. 52-60.

Kitchener, F., Young, R., Ahmed, M., Yang, G., Gaweesh, S., English, T., Garcia, V., Ragan, A., Serulle, N.U. and Gopalakrishna, D. (2018), “Connected vehicle pilot deployment program phase 2, final system performance report, baseline conditions – WYDOT CV pilot”, Report No. FHWA-JPO-17-474, U.S. Department of Transportation, Washington, D. C.
Kitchener, F., Young, R., Ahmed, M., Yang, G., Gaweesh, S., Gopalakrishna, D., Garcia, V., Ragan, A., English, T., Zumpf, S., Serulle, N.U. and Hsu, E. (2016), “Connected vehicle pilot deployment program phase 2, updated performance measurement and evaluation support plan – WY”, Report No. FHWA-JPO-16-290, U.S. Department of Transportation, Washington, DC.

Liu, J. and Khattak, A. (2016), “Delivering improved alerts, warnings, and control assistance using basic safety messages transmitted between connected vehicles”, Transportation Research Part C: Emerging Technologies, Vol. 68, pp. 83-100.

Mack, A. (2018), “Wyoming connected vehicle pilot showcases highway safety applications”, available at: http://transportationtech.com/wyoming-connected-vehicle-pilot-showcases-highway-safety-applications/ (accessed 10 December 2018).

Mahmassani, H.S. (2016), “50th anniversary invited article – autonomous vehicles and connected vehicle systems: flow and operations considerations”, Transportation Science, Vol. 50 No. 4, pp. 1140-1162.

Nair, G.S., Eltayeb, M.E., Heath, R.W., Bhat, C.R. and Ruiz-Juri, N. (2018), “A microsimulation approach to quantify the safety benefits of connected vehicles: a road hazard warning application”, Proceedings of the 97th Transpiration Research Board Annual Meeting, Washington, DC.
NYCDOT (2018), “NYC connected vehicle pilot: for safer transportation”, New York City Department of Transportation, New York, NY, available at: www.cvp.nyc (accessed 4 January 2019).

Olia, A., Abdelgawad, H., Abdulhai, B. and Razavi, S.N. (2016), “Assessing the potential impacts of connected vehicles: mobility, environmental, and safety perspectives”, Journal of Intelligent Transportation Systems, Vol. 20 No. 3, pp. 229-243.

Olia, A., Genders, W. and Razavi, S.N. (2013), “Microsimulation-based impact assessment of the vehicle-to-vehicle (V2V) system for work zone safety”, CSCE 2013 General Conference, Montreal, Quebec.

Paikari, E., Kattan, L., Tahmasseby, S. and Far, B.H. (2013), “Modeling and simulation of advisory speed and re-routing strategies in connected vehicles systems for crash risk and travel time reduction”, The 26th IEEE Canadian Conference of Electrical and Computer Engineering, Regina, Canada, doi: 10.1109/CCECE.2013.6567837.

Park, J., Abdel-Aty, M., Wu, Y. and Mattei, I. (2018), “Enhancing in-vehicle driving assistance information under connected vehicle environment”, IEEE Transactions on Intelligent Transportation Systems, doi: 10.1109/TITS.2018.2878736.

Raddaoui, O. and Ahmed, M. (2019), “User experience and human machine interface design for connected heavy trucks: lessons learned in support of the WY DOT connected vehicle pilot”, ITS America 2019 Annual Meeting, Washington, DC.
Raddaoui, O., Gaweesh, S. and Ahmed, M. (2019), “Evaluation of connected vehicle Real-Time weather and work zone warnings on the behavior of truck drivers: a driving simulator study”, Transportation Research Board 98th Annual Meeting, Washington, DC.

Rahman, M.S., Abdel-Aty, M., Wang, L. and Lee, J. (2018), “Understanding the highway safety benefits of different approaches of connected vehicles in reduced visibility conditions”, Transportation Research Record: Journal of the Transportation Research Board, Vol. 2672 No. 19, pp. 91-101.

Rakha, H., Krechmer, D., Cordahi, G., Zohdy, I., Sadek, S. and Arafeh, M. (2009), “Microscopic analysis of traffic flow in inclement weather”, Report No. FHWA-JPO-09-066, U.S. Department of Transportation, Washington, DC.

Shladover, S.E. (2018), “Connected and automated vehicle systems: introduction and overview”, Journal of Intelligent Transportation Systems, Vol. 22 No. 3, pp. 190-200.

Smith, S. and Razo, M. (2016), “Using traffic microsimulation to assess deployment strategies for the connected vehicle safety pilot”, Journal of Intelligent Transportation Systems, Vol. 20 No. 1, pp. 66-74.

Songchitruksa, P., Bibeka, A., Lin, L. and Zhang, Y. (2016), “Incorporating driver behaviors into connected and automated vehicle simulation”, Report: ATLAS-2016-13, Texas A&M Transportation Institute, College Station, TX.
THEA (2018), Walk, ride, drive, smarter: THEA Connected Vehicle Pilot. Tamp Hillsborough Expressway Authority, Tampa, FL, available at: www.tampacvpilot.com (accessed 4 January, 2019).
THEA (2016), “Connected vehicle pilot deployment program phase 1, performance measurement and evaluation support plan – tampa (THEA)”, Report No. FHWA-JPO-16-314, U.S. Department of Transportation, Washington, DC.

Tian, D., Wu, G., Boriboonsomsin, K. and Barth, M.J. (2018), “Performance measurement evaluation framework and co-benefit/tradeoff analysis for connected and automated vehicles (CAV) applications: a survey”, IEEE Intelligent Transportation Systems Magazine, Vol. 10 No. 3, pp. 110-122.

USDOT (2017), “Connected vehicle pilot deployment program: wyoming”, Report No. FHWA-JPO-17-503, U.S. Department of Transportation, Washington, DC.
Vasudevan, M. and Asare, S.K. (2016), “USDOT guidance summary for connected vehicle deployment: performance measurement”, Report No. FHWA-JPO-16-341, U.S. Department of Transportation, Washington, DC.

Wang, W., Liu, C. and Zhao, D. (2017a), “How much data is enough? A statistical approach with case study on longitudinal driving behavior”, IEEE Transactions on Intelligent Vehicles, Vol. 2 No. 2, pp. 85-98.

Wang, J., Wang, C., Lv, J., Zhang, Z. and Li, C. (2017b), “Modeling travel time reliability of road network considering connected vehicle guidance characteristics indexes”, Journal of Advanced Transportation, Vol. 2017, doi: 10.1155/2017/2415312.

WYDOT (2018), WY DOT Connected Vehicle Pilot: Improving Safety and Travel Reliability on 1-80 in WY, WY Department of Transportation, Cheyenne, WY, available: https://wydotcvp.wyoroad.info/ (accessed 4 January 2019).

Xie, K., Yang, D., Ozbay, K. and Yang, H. (2019), “Use of real-world connected vehicle data in identifying high-risk locations based on a new surrogate safety measure”, Accident Analysis & Prevention, Vol. 125, pp. 311-319.

Yang, G., Ahmed, M. and Gaweesh, S. (2019), “Impact of variable speed limit in a connected vehicle environment on truck driver behavior under adverse weather conditions: driving simulator study”, Transportation Research Record: Journal of the Transportation Research Board, Vol. 2673 No. 7, doi: 10.1177/0361198119842111.

Yang, H., Wang, Z. and Xie, K. (2017), “Impact of connected vehicle on mitigating secondary crash risk”, International Journal of Transportation Science and Technology, Vol. 6 No. 3, pp. 196-207.

Publication history
Copyright
Rights and permissions

Publication history

Received: 17 March 2019
Revised: 17 June 2019
Accepted: 27 July 2019
Published: 30 December 2019
Issue date: December 2019

Copyright

© 2019 Mohamed M Ahmed, Guangchuan Yang Sherif Gaweesh, Rhonda Young and Fred Kitchener. Published in Journal of Intelligent and Connected Vehicles. Published by Emerald Publishing Limited.

Rights and permissions

This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode

Return