Connected Vehicle Pilot Deployment Project Operational

1U.S. Department of Transportation

TODAY’S AGENDA

New York City’s

Connected Vehicle Pilot Deployment Project Operational Capability Showcase


TODAY’S AGENDA

▪ Purpose of this webinar

□ Demonstrate the Operational Capability of CV safety technology in NYC

□ Share challenges and lessons learned in deploying CV technology in

NYC

▪ Webinar Content

□ NYC CV Pilot Deployment Program and Project Overview and Goals

□ NYC CV Pilot Operational Capability Showcase

□ Q&A

▪ Webinar Protocol

□ Please mute your device during the entire webinar.

□ You are welcome to ask questions in the chatbox. Questions will be

answered during the Q&A section at the end.


New York City CV Pilot

Deployment Project

Concept of Operations

Overview

Operational Capability

Showcase HostDr. Mohamad Talas

NYCDOT


Presenters (Administration)

▪ Dr. Mohamad Talas – NYCDOT, CVPD Project Manager,

Director of ITS Management and System Engineering

▪ Ken Leonard – USDOT, Director of ITS Joint Program Office

(JPO)

▪ Margaret Forgione – NYCDOT, First Deputy Commissioner

▪ Keith Kerman – NYC DCAS, Chief Fleet Officer and Deputy

Commissioner

▪ Dr. Jonathan Walker – USDOT, Chief of Policy, Architecture,

and Knowledge Transfer


Presenters (Technical)

▪ David Benevelli – JHK Engineering (TransCore), CVPD System

Engineering Lead

▪ Dr. Kaan Ozbay – NYU, Professor at the Dept of Civil and Urban

Engineering (CUE) Director of the C2SMART Center

▪ Eric Richardson – NYC DCAS, Deputy Chief Fleet Management

Officer

▪ Keir Opie – Cambridge Systematics, CVPD Performance

Measurement Lead

▪ Bob Rausch – JHK Engineering (TransCore), CVPD System

Deployment Lead

▪ Dr. Arthur O’Connor – USDOT, Sr. ITS/Operations Engineer

Office of Program Management



Deployment Project


Overview

USDOT Connected Vehicle Pilot

ProgramKen Leonard

USDOT



Deployment Project


OverviewNYCDOT Vision Zero and CV

ProgramMargaret Forgione

NYCDOT


NYCDOT CV Participation

“Traffic Death and Injury on City streets is not

acceptable”

▪ .

The NYC pilot will

evaluate the

safety benefits and

challenges of

implementing CV

technology with a

significant number of

vehicles

in the

dense urban

environment.

Source: USDOT


NYC Transportation Challenges



Deployment Project


Overview

NYC Fleet Management and

DCAS ParticipationKeith Kerman

NYC DCAS


NYC and US DOT Partnership


Safe Fleet Transition Plan



Deployment Project


OverviewUSDOT CV Program Goals

Dr. Jonathan Walker

USDOT


CONNECTED VEHICLE PILOT DEPLOYMENT PROGRAMP

RO

GR

AM

GO

AL

S

PILOT SITES

WYDOT

NYCDOT

Tampa (THEA)NY

CD

OT

SC

HE

DU

LE


CV Pilot Deployment Objectives

▪ Transition from research and development to practical

sustainable deployment of CV infrastructure and

applications

▪ Provide a roadmap for future deployers:

□ CV Pilots utilized the Systems Engineering Process to

lead and inspire future developers of connected

vehicles

□ CV Pilots produced a common documentation set for

reference by future deployers

□ CV Pilots demonstrated their devices are interoperable


CV Pilots Interoperability Test

▪ Dates/Location:□ June 25 – 28, 2018 at FHWA Turner-Fairbank Highway Research Center (TFHRC)

▪ Participating Organizations (63 attendees in total):□ USDOT, technical support contractor (Noblis), Saxton Laboratory (STOL) contractor

(Leidos)

□ New York City Pilot: NYCDOT and Transcore

□ Tampa Pilot: THEA, HNTB, Siemens, CUTR and Brandmotion

□ Wyoming Pilot: ICF and Neaera Consulting Group

□ OBU/RSU Vendors: Commsignia, Danlaw, Lear, Savari, Siemens and Sirius XM

□ Others: Certification (OmniAir), Independent Evaluator (TTI), Photographers (BAH)

Video: https://youtu.be/0dja4B9qCSU

https://youtu.be/0dja4B9qCSU



Deployment Project


Overview

NYCDOT CV Project Goals and

AccomplishmentsDr. Mohamad Talas

NYCDOT


Project Objectives

▪ Support the Vision Zero initiative by providing drivers with

information regarding potential safety situations

▪ Provide the opportunity for selected NYC fleets to be early

adopters of this safety-focused technology

▪ Create a CV technology deployment to inspire spreading the

technology throughout North America

▪ Support the overall CV technology implementation by

providing project experience, benefits, and feedback

regarding the challenges and opportunities for implementing

this technology in a dense urban environment


NYC CV Infrastructure

• Infrastructure: 450 Roadside Units (RSU)

• Vehicles: 2800+ increasing to 3000

• Safety applications: 13

• Operations applications: 8

• This is a large-scale deployment with challenges:

• Location accuracy – urban canyons

• RSU density

• Application arbitration/interference

• DSRC media only – channel management

• First full-scale security deployment

• Security boundary expanded to include all ITS communications

• Utilize edge computing concepts to minimize bandwidth


0

500

1000

1500

2000

2500

3000

1/1/2021 2/1/2021 3/1/2021 4/1/2021 5/1/2021 6/1/2021

Miles (x100)

Hrs (x10)

Veh (CV-GT)

Fleet Weekly OperationsCriteria Jan 3 – May 29, 2021

Totals

VMT 4,138,000

Hrs 277,000

BSM Generated 15,967,000,000

BSM Evts/Ops Used 26,000,000

Date


Project Accomplishments

▪ Infrastructure installation of RSU and OBU/ASD

▪ Proven operational concepts for managing CV devices

▪ Improved CV device operations with improvements in the areas of:

□ Location accuracy

□ Safety applications

□ Security operations

□ Communications

□ Spectrum utilization

▪ Extensive project deployment lessons are contributing to further

standards evolution and procurement guidelines



Deployment Project


OverviewNYCDOT CV Safety Applications

David Benevelli

JHK Engineering


Manhattan South Crashes

4-week period ending July 4, 2021 Total: 643


CV Applications - 1

Vehicle-to-Vehicle (V2V)

Safety Applications

▪ Forward Collision Warning FCW

▪ Emergency Electronic Brake Light EEBL

▪ Blind Spot Warning BSW

▪ Lane Change Warning/Assist LCA

▪ Intersection Movement Assist IMA

▪ Vehicle Turning Right in Front of Bus Warning VTRW


CV Applications - 2

Vehicle-to-Infrastructure (V2I)

Safety Applications

▪ Red Light Violation Warning RLVW

▪ Speed Compliance SPDCOMP

▪ Curve Speed Compliance CSPDOMP

▪ Speed Compliance/Work Zone SPDCMPWZ

▪ Oversize Vehicle Compliance OVC

□ Prohibited Facilities (Parkways)

□ Over Height

▪ Emergency Communications and Evacuation Information (Using the

traveler information features) EVACINFO


CV Applications - 3

Other Applications

▪ Pedestrian in Signalized Intersection Warning PEDINXWALK

▪ Mobile [Visually Impaired] Ped Signal System PED-SIG

▪ CV Data for Intelligent Traffic Signal System I-SIGCVDAT

Operations, Maintenance, and Performance Analysis▪ RF Monitoring RFMON

▪ OTA Firmware Update FRMWUPD

▪ Parameter Up/Down Loading PARMLD

▪ Traffic data collection TDC

▪ Event History Recording EVTRECORD

▪ Event History Up Load EVTCOLLECT

To Meet USDOT

Requirements for

Benefit Analysis


CV Safety Applications Video



Deployment Project


OverviewNYC CV Pedestrian Signal

ApplicationDr. Kaan Ozbay

NYU


Pedestrian Signal Application

PED-SIG: Mobile Accessible Pedestrian Signal System

Advancing Social Equity with CVs

• Equip 25+ pedestrians with

a Personal Information

Devices (PID)

• Field tests with predefined

routes

• Obfuscate, encrypt, and

transmit data to secure

servers to protect privacy

• Learn the participants’

experiences through the

CV-equipped intersections

Assist visually impaired pedestrians in

safely crossing the streets

Pedestrian Information Device (PID)



Visually Challenged Pedestrian

Application Context Diagram

• Encrypt the collected data and transmit the encrypted data to a configured IP address through the broad-band carrier service

NYCDOT

Application vendor

C2SMART/NYU

• Participant

coordination

and support

• Transmit

obfuscated

data

• Database

management

• Performance

Evaluation

• Mobile application

development and testing

• Connected Vehicle

Support System



Data necessary for the PED-SIG application:▪ PID Operations Logs

▪ Field test observations

▪ Pre- and Post Experiment Survey

Challenges in testing the PED-SIG application

in NYC urban environment• COVID-19 pandemic impacts: New precautions will

need to be taken. Proposed solution: Follow

COVID-19 mitigation strategies required by local

research sites

• Smartphone-based issues: For example, the digital

compass needing recalibration when the phone is

near a large metal object in the environment.

Proposed solution: Designed routes with multiple

batches of participants + field tests accompanied by

IRB-certified NYU researchers to ensure safety

Aggregated Performance

Measures for the PID /

PED-SIG Application

Pedestrian Crossing Speed and crossing Travel Time

Pedestrian Crossing Waiting Time

PID Compliance Rate

Inadequate Crossing Time

Pedestrian Crossing Violations

Time to Step into the Crosswalk when Walk Phase is On

Times Out of Crosswalk



Deployment Project


OverviewNYC CV Stakeholder

ParticipationEric Richardson

NYC DCAS


NYC Fleet Participating Agencies

▪ Department of Transportation

(DOT)

▪ Parks Department (Parks)

▪ Department of Corrections (DOC)

▪ Department of Buildings (DOB)

▪ Dept. of Environmental Protection

(DEP)

▪ Dept. of Homeless Services (DHS)

▪ Taxi and Limousine Commission

(TLC)

▪ Human Resources Administration

(HRA)

▪ Administration for Children's

Services (ACS)

▪ Dept. of Design and Construction

(DDC)

▪ Housing Preservation &

Development (HPD)

▪ Office of Chief Medical Examiner

(OCME)

▪ Dept. of Education (DOE)

▪ Dept. of Health and Mental Hygiene

(DHMH)

▪ Office of Emergency Management

(OEM)

▪ Dept. of Consumer Affairs (DCA)

▪ Dept. of Info. Tech. & Telecom.

(DOITT)


Safe Fleet Transition Plan


NYC in Real Time


NYC Fleet Show: CV on Display



Deployment Project


OverviewNYC CV Performance

MeasurementKeir Opie

Cambridge Systematics


Performance Measurement Program

▪ Safety is Job #1.

▪Once alerts are activated in a vehicle, they won’t be silenced.

▪ User Needs related to Performance Measurement

▪Maintain privacy of users throughout pilot and data collection

▪No enforcement

▪No driver evaluation

▪ Consider impacts of CV data combined with data from

other sources.

▪ Approach to collecting the performance information.

▪ Approach to using data collection bins of performance

information.

▪ Control Group vs. Treatment Group


Performance Measures

FHWA-JPO-16-302


CV Event Records

▪ Data from ASD/OBU to

time period surrounding

a warning issued

▪ Detailed information:

□ Identifies exact time and

precise location

□ Records detailed vehicle

trajectory and movement

▪ Data retention keeps

data from event until it

can be transmitted to

the TMC


CV Event Obfuscation Process


ASD Event Log Obfuscation

Obfuscate

Time and Location

• Obfuscation process to scrub precise time and

location data• Relative details retained

• Non-obfuscated data will be destroyed

following the obfuscation process

Obfuscated ASD Action Log DataRaw ASD Action Log Data

Warning at 7:32:45 AM at

40.744891,73.976167 degrees

Warning at time=0

(0.000, 0.000) feet


CV Events by Type

▪ 14,520 Total Fleet Events

▪ 2640 Installed Vehicles

▪ May VMT: 957,000 (Est)

▪ May Hrs: 66,000 (Est)

▪ Includes Both Silent and

Active Alerts

▪ Notes:

□ Disregards early ASD firmware

versions

□ Disregards Test Vehicle Events

□ Includes Events passing error

tests

□ Includes Treatment and Control

Vehicles

MAY 2021Blind Spot Warning

243

Emergency Electronic Brake Light

32

Forward Collision Warning

2946

Intersection Movement

Assist588

Lane Change Warning

254

Vehicle Turning Right in front of Bus Warning

0

Emergency Communications and Evacuation

Information284

Curve Speed Compliance

772

Oversize Vehicle Compliance

104

Pedestrian in Signalized Intersection Warning

1

Red Light Violation Warning255

Speed Compliance8606

Speed Compliance/Work Zone

435


FCW Events

▪May 2021 Events

1 10


SPDCOMP Events

▪May 2021 Events

▪V2I areas only

1 250


Obfuscated Event Analysis

Sample: EEBL Warning

Time:

Warning Issued in

Host Vehicle at:

(X,Y) = (0, 0) meters

time = 0 seconds

Target Vehicle

Rapid

Deceleration


▪ https://www.its.dot.gov/data

▪ https://data.transportation.gov/

stories/s/Connected-Vehicle-

Pilot-Sandbox/hr8h-ufhq#new-

york-city-dot-(nycdot)-pilot

▪ https://data.transportation.gov/

stories/s/Connected-Vehicle-

Pilot-Sandbox/hr8h-ufhq#cv-

pilot-data-sandbox

▪ Event data in the Sandbox

updates weekly

Obfuscated Event Data at ITS DataHub

https://www.its.dot.gov/data

https://data.transportation.gov/stories/s/Connected-Vehicle-Pilot-Sandbox/hr8h-ufhqnew-york-city-dot-(nycdot)-pilot

https://data.transportation.gov/stories/s/Connected-Vehicle-Pilot-Sandbox/hr8h-ufhq#cv-pilot-data-sandbox


System Operations Dashboards

System Operations Dashboards


NYC DOT Website: CVP.NYC

CVP.NYC



Deployment Project


OverviewNYC CV Project Lessons

Bob Rausch

JHK Engineering


Challenges - Everywhere

▪ Stakeholder privacy concerns vs. USDOT desire for broad evaluation data

▪ Stakeholder requirements to avoid distracting “cockpit” displays

▪ Density of Roadside DSRC Transponders (RSU)

□ ~76 M for short blocks

□ ~200 M for the long blocks (between avenues)

▪ Bandwidth limitations of the wireless backhaul (RSU to TMC)

▪ Ongoing maintenance and support (in-vehicle and infrastructure) of the large-

scale deployment (3,000 Vehicles and 450 RSUs)

▪ SCMS* for all applications & DSRC Over-the-air (OTA) certificate distribution

▪ OTA [DSRC] data collection – bandwidth limited

▪ OTA [DSRC] software updates

▪ OTA [DSRC] parameter management

▪ Location accuracy in the urban canyons (both relative V2V and absolute V2I)

DSRC – Nominal 300M

*Security Credential Management System


Lessons Learned

▪ Location accuracy remains a challenge in the urban canyon environment. Urban location accuracy requires more than GPS.

▪ Grade separation is a challenge in dealing with elevation element of location accuracy. Elevation is an essential component of the safety applications in the urban environment.

▪ The number of FCW and SPDCOMP events dominate the data collected and tend to skew any analysis of events spanning multiple types.

▪ Breadcrumb were essential to analyzing anomalies and operational issues.

▪ O&M data collected confirms RF data reception ranges impact OBU & RSU device loading due to device density.

▪ Need to collect additional data: Until we began analyzing events, we couldn’t determine that there is additional information that would make analysis easier. For example, for RLVW, adding the specific intersection identification triggering the alert in the event header would make analysis easier. Also, when analyzing BSMs, the MAP/SPaT/TIM being heard would impact interpretation of driver behavior.



Deployment Project


OverviewNYC ITS Sub Regional

ArchitectureDr. Arthur O’Connor

USDOT


NYC Sub Regional Architecture

▪NYC CV Pilot program successes

▪NYC CV Pilot’s relationship to the ITS Sub

Regional Architecture

▪Urban environment model experience

▪Next steps



Deployment Project


OverviewNYC CV Team Members

Dr. Mohamad Talas

NYCDOT


NYC CV Team Members

▪USDOT Team

▪NYCDOT Team

▪NYC DCAS Team

▪NYC Fleet

▪Consulting Team

□ JHK Engineering (TransCore)

□ Cambridge Systematics

□ KLD Engineering

□ University Transportation Research Center (UTRC)

□ New York University (NYU)



Deployment Project


OverviewQuestions?

Dr. Mohamad Talas

NYCDOT


STAY CONNECTED

Join us for the Getting Ready for

Deployment Series

▪ Discover more about the CV Pilot

Sites

▪ Learn the Essential Steps to CV

Deployment

▪ Engage in Technical Discussion

Website: http://www.its.dot.gov/pilots

Twitter: @ITSJPODirector

Facebook:

https://www.facebook.com/USDOTResearch

Contact for CV Pilots Program:

▪ Kate Hartman, WYDOT Site AOR

[email protected]

▪ Jonathan Walker, NYCDOT Site AOR

[email protected]

▪ Mohamad Talas, NYCDOT CVPD

Project Manager

[email protected]

CV Pilot Sites Document Repositoryhttp://www.its.dot.gov/pilots/cv_pubs.htm

Please visit the CV pilots website for the

recording and the briefing material of the

previous webinars: http://www.its.dot.gov/pilots/technical_assistan

ce_events.htm

http://www.its.dot.gov/pilots

http://www.twitter.com/ITSJPODirector

https://www.facebook.com/USDOTResearch

mailto:[email protected]



http://www.its.dot.gov/pilots/cv_pubs.htm

http://www.its.dot.gov/pilots/technical_assistance_events.htm

Documents

Connected Vehicle Pilot Deployment Project Operational