Patty Broers Research Coordination Unit Chief. “The most serious mistakes are not being made...

Patty BroersResearch Coordination

Unit Chief

Evaluation and Performance Review

“The most serious mistakes are not being made because of wrong answers. The truly dangerous thing is asking the wrong question.” Peter Drucker

“One of the great mistakes is to judge policies and programs by their intentions than their results.” Milton Friedman

“True genius resides in the capacity for evaluation of uncertain, hazardous, and conflicting information.” Winston Churchill

Points to Ponder

Contract Research Organizational Structure

David LippertEngineer of Materials and Physical Research

Amy SchutzbachEngineer of Physical Research

Research Coordination UnitPatty Broers - Research Coordination Manager Tom Bukowski – Graduate Public Service

Intern (GPSI)

ICT Administrative Structure

Imad Al-QadiDirector

Leslie ElbleAssistant to the

Director

Sam CarpenterAssociate Director

Associate Director for Outreach

Associate Director for

Facilities

Jim MeisterResearch Eng.

Jeff KernResearch Eng.

Part Time Help

Deputy Director

Mary FriesOutreach

Dave KingFiscal/Admin

Support

Leslie MyrickTechnical Editor

Josh HoustonIT Support

Lori CarpenterCommunication

Coordinator

Outreach Coordinator

Quarterly reports IDOT approval of subcontractors IDOT approval of work plans/budgets before work

can begin Interim deliverables and final report Semi-annual evaluations – TRP/PI

Intergovernmental Agreement Requirements

Research Problem Statement

Semi-annual solicitation

Key Element: IDOT Sponsor/Champion

Key Element: Clearly Identify Benefit to IDOT

IDOT’s ICT Executive Committee Organizational Structure

Traffic/Roadside Public/Intermodal Transportation

Environment

TAG’sas appropriate

BMPR

Executive Committee Members – Directors of Offices/Divisions within IDOT, one member from FHWA, ICT Director

Structures and Bridges

Safety Planning Construction

Pavement & Materials

Determine research needs: Review and/or create problem statements Prioritize/recommend to executive committee Appoints technical review panel to oversee funded

research

Technical Advisory Group (TAG) Activities

Evaluate RFP submittals and select researcher Provide technical expertise Develop an implementation plan Communication Review quarterly progress reports Evaluation – semi-annual and close-out Champion implementation of research findings

when possible

Technical Research Panel (TRP) Activities

Required for each project Plan should identify:

Needs and benefits Primary panel members to oversee research Ad hoc members as project progresses needed to

promote implementation Interim deliverables Necessity for upper management close-out

Implementation Plan

Developing Evaluation Tools

RFP Evaluation

Oversight panel evaluates: Research team Proposal approach Strengths/

Weaknesses Equipment/Facilities

Project Dashboard

http://ict.illinois.edu/IDOTprojects.asp

Connected to web-based quarterly reports

Quarterly Report

Web-basedAutomatic

notificationsTRP chair

comments

Principal Investigator Evaluation

Deliverables, communication, and timeliness

“Needs Improvement” justification

PIs similarly evaluate TRP

Principal Investigator Evaluation of Oversight Panel

Panel Evaluation: Good

communication Clear objectives Timely report

review

Series of questions by e-mail Rate success of research (1–low to 5–high) Explain results expected and deliverables received If applicable, describe what was not accomplished Indicate implementation actions taken Improvements that could be made in the future regarding

similar research

Close-out Evaluation

Administrative Performance Evaluation

Evaluate: Timeliness Responsiveness Communication Problem resolution

Monthly meetings Minutes that include action items Key issues:

Project meeting issues Discuss semi-annual evaluations Budget concerns Investigator selection

Administrative Meetings

Abraham Lincoln Presidential Library and Museum

The Lincoln Family

Illinois Old Capitol Building