Austin, Texas

NLPES Fall ProFessional DeveloPment seminar

sePtember 22 – 25, 2013

Sponsored byNational Legislative Program

Evaluation Society

Hosted byTexas Sunset Advisory Commission

Texas State Auditor’s OfficeTexas Legislative Budget Board

To find a web version of this program and otherNLPES Professional Development Seminar

information please visit:www.sunset.state.tx.us.

National Conference of State LegislaturesThe Forum for America’s Ideas

Seminar Schedule

Monday, September 23

6:45 a.m. – 4:00 p.m.Bluebonnet Foyer, Main Level, DoubleTree Hotel

Registration

7:00 a.m. – 7:45 a.m.Longhorn Room, Main Level, DoubleTree Hotel

Continental Breakfast

8:30 a.m. – 9:15 a.m.House Chamber, Room 2W.5, Capitol Building

GreetingSpeakers: The Honorable Joe Straus, Speaker – Texas House of Representatives Rick DeLeon, Sergeant-at-Arms – Texas Senate; and President – National

Legislative Services and Security Association (NLSSA) Karl Spock, Senior Manager – Texas Sunset Advisory Commission; and

Immediate Past Chair – National Legislative Program Evaluation Society (NLPES)

9:30 a.m. – 11:30 a.m.Capitol Extension Auditorium, Room E1.004, Capitol Extension

Pew-MacArthur Results First Initiative: A Special UpdateSpeakers: Gary VanLandingham, Director, Pew-MacArthur Results First Initiative –

The Pew Charitable Trusts Adrea Turner, Senior Associate, Pew-MacArthur Results First Initiative –

The Pew Charitable Trusts

11:45 a.m. – 12:45 p.m.Legislative Conference Center, Room E2.002, Capitol Extension

Lunch

1:00 p.m. – 2:30 p.m.Room E2.010, Capitol Extension

Evaluating Economic Development: Overcoming Challenges and Maximizing Opportunities Moderator: Dale Carlson, Senior Auditor Evaluator – California State Auditor’s OfficeSpeakers: Patricia Berger, Senior Counsel/Project Manager – Pennsylvania

Legislative Budget and Finance Committee Michael Boutte, Performance Audit Manager – Louisiana Legislative

Auditor’s Office Stephanie Meese, Legal Counsel – Nebraska Legislative Audit Office Katrin Osterhaus, Principal Auditor – Kansas Legislative Division of Post

Audit

1:00 p.m. – 2:30 p.m. Room E2.014, Capitol Extension

Drinking From the Fire Hose: Balancing Coverage, Resources, and Risk When Planning Audits and Evaluations Moderator: Greg Fugate, Audit Manager – Colorado Office of the State AuditorSpeakers: Karen LeBlanc, Performance Audit Manager – Louisiana Legislative

Auditor’s Office Justin Stowe, Deputy Post Auditor – Kansas Legislative Division of Post

Audit Sarah Kirkle, Senior Policy Analyst – Texas Sunset Advisory Commission

2:30 p.m. – 2:45 p.m.Legislative Conference Center, Room E2.002, Capitol Extension

Break

2:45 p.m. – 4:15 p.m. Room E2.010, Capitol Extension

Improving the Education PipelineModerator: Rachel Hibbard, Deputy Auditor – Hawaiʻi Office of the AuditorSpeakers: Max Arinder, Executive Director – Mississippi Joint Legislative PEER

Committee Michael Weinberg, Program Evaluation Manager – New Mexico

Legislative Finance Committee Bryon Welch, Principal Evaluator, Office of Performance Evaluations –

Idaho State Legislature

2:45 p.m. – 4:15 p.m.Room E2.014, Capitol Extension

Evaluating Highly Complex Areas: Marijuana, Bonds, and InvestmentsModerator: Lisa Kieffer, Deputy Director, Performance Audit Division – Georgia

Department of Audits and AccountsSpeakers: David Arner, Deputy Director – Georgia Department of Audits and

Accounts Nina Frant, Audit Supervisor – Colorado Office of the State Auditor Rick Graycarek, Economist, Staff Economists’ Office – Kentucky

Legislative Research Commission

5:00 p.m. – 10:00 p.m.Texas Disposal Systems Exotic Game Ranch

Joint Evening Reception for NLPES and NLSSA

Tuesday, September 24

7:30 a.m. – 4:30 p.m.Bluebonnet Foyer, Main Level, DoubleTree Hotel

Registration

7:30 a.m. – 8:15 a.m.Longhorn Room, Main Level, DoubleTree Hotel

Continental Breakfast

8:15 a.m. – 9:45 a.m.Bluebonnet Meeting Rooms I and II, Main Level, DoubleTree Hotel

Medicaid and Healthcare Programs: Are You Getting What You Think You’re Paying For? Moderator: Nathalie Molliet-Ribet, Senior Division Chief – Virginia Joint Legislative

Audit and Review CommissionSpeakers: Derek Barber, Performance Audit Senior – Arizona Office of the Auditor

General Lonnie Edgar, Principal Analyst – Mississippi Joint Legislative PEER

Committee Doug Spencer, Audit Supervisor – Arkansas Division of Legislative Audit Scott Wahlbrink, Performance Audit Manager – Illinois Office of the

Auditor General

8:15 a.m. – 9:45 a.m.Houston Meeting Rooms I and II, Second Floor, DoubleTree Hotel

Discovering and Maintaining Top Talent Moderator: Kelly Linder, Assistant State Auditor – Texas State Auditor’s OfficeSpeakers: Monica Bowers, Deputy State Auditor – Colorado Office of the State

Auditor Katrin Osterhaus, Principal Auditor – Kansas Legislative Division of Post

Audit Jan Yamane, Acting State Auditor – Hawaiʻi Office of the Auditor

10:00 a.m. – 11:30 a.m.Room 120, John H. Reagan Building, Capitol Complex

Using Effective Research Methods Moderator: Wayne Kidd, Audit Supervisor – Utah Office of the Legislative Auditor

GeneralSpeakers: Justin Brown, Senior Division Chief – Virginia Joint Legislative Audit and

Review Commission Peter Heineccius, Research Analyst – Washington Joint Legislative Audit

and Review Committee Diedra Murray, Senior Performance Auditor – Montana Office of the

Legislative Auditor Division

10:00 a.m. – 11:30 a.m.Houston Meeting Rooms I and II, Second Floor, DoubleTree Hotel

Broaden Your Technology Horizons Moderator: Richard Corbell, Senior Analyst for Information Technology – Texas

Legislative Budget BoardSpeakers: Gerald Hoppmann, Program Evaluation Manager, Program Evaluation

Section – Wyoming Legislative Services Jill Mooney, Research Analyst – West Virginia Performance Evaluation

and Research Division Jake Schindler, Program Evaluation Supervisor – Wisconsin Legislative

Audit Bureau Justin Stowe, Deputy Post Auditor – Kansas Legislative Division of Post

Audit

11:45 a.m. – 1:30 p.m. Bluebonnet Meeting Rooms I and II, Main Level, DoubleTree Hotel

NLPES Awards Luncheon

2:00 p.m. – 3:30 p.m.Room 120, John H. Reagan Building, Capitol Complex

Contracting and Procurement: Tips, Tricks, and Thoughts for Improving Transparency, Accessibility, and Oversight Moderator: Katrin Osterhaus, Principal Auditor – Kansas Legislative Division of Post

AuditSpeakers: Beth Ashcroft, Office of Program Evaluation and Government

Accountability – Maine State Legislature Matt Dry, Analyst – Mississippi Joint Legislative PEER Committee John Keel, State Auditor – Texas State Auditor’s Office

2:00 p.m. – 3:30 p.m.Houston Meeting Rooms I and II, Second Floor, DoubleTree Hotel

Get the Picture? The Role of Graphics and Data Visualization in Reporting Results Moderator: Angus Maciver, Deputy Legislative Auditor – Montana Office of the

Legislative AuditorSpeakers: David Choo, Editor – Hawaiʻi Office of the Auditor Phil Doss, Director, Offices of Research and Education Accountability –

Tennessee Comptroller of the Treasury Jim Schlouch, Performance Audit Director – Illinois Office of the Auditor

General Carol Shaw, Principal Program Evaluator – North Carolina Program

Evaluation Division

3:30 p.m. – 4:00 p.m.Robert E. Johnson Building Conference Center

Break

4:00 p.m. – 5:30 p.m. Robert E. Johnson Building Conference Center

Communicating With the Legislature Moderator: Ursula Parks, Director – Texas Legislative Budget BoardSpeakers: Chris Griesel, Parliamentarian – Texas House of Representatives The Honorable Four Price, State Representative – Texas House of

Representatives The Honorable Leticia Van de Putte, State Senator – Texas Senate

6:00 p.m. – 7:00 p.m.15th Street Café, Pool and Patio Area, DoubleTree Hotel

Evening Reception

7:30 p.m.Scholz Beer Garten, 1607 San Jacinto Blvd.

Optional Networking

Wednesday, September 25

8:00 a.m. – 11:00 a.m.Bluebonnet Foyer, Main Level, DoubleTree Hotel

Registration

8:00 a.m. – 8:30 a.m.Longhorn Room, Main Level, DoubleTree Hotel

Continental Breakfast

8:30 a.m. – 10:00 a.m. Bluebonnet Meeting Rooms I and II, Main Level, DoubleTree Hotel

Stakeholder Involvement in Evaluation

Moderator: Lisa Kieffer, Deputy Director, Performance Audit Division – Georgia

Department of Audits and AccountsSpeakers: Andrew Knauer, Audit Supervisor – Colorado Office of the State Auditor Rakesh Mohan, Director, Office of Performance Evaluations – Idaho State

Legislature Joe Walraven, Assistant Director – Texas Sunset Advisory Commission

8:30 a.m. – 10:00 a.m.Houston Meeting Rooms I and II, Second Floor, DoubleTree Hotel

So, What Difference Did It Make?Moderator: Marcia Lindsay, Audit Manager – South Carolina Legislative Audit

CouncilSpeakers: John Billington, Senior Auditor Evaluator – California State Auditor’s

Office Justin Brown, Senior Division Chief – Virginia Joint Legislative Audit and

Review Commission Greg Fugate, Audit Manager – Colorado Office of the State Auditor

10:15 a.m. – 11:45 a.m.Bluebonnet Meeting Rooms I and II, Main Level, DoubleTree Hotel

Program Evaluation – Past, Present, FutureModerator: Ken Levine, Director – Texas Sunset Advisory CommissionSpeakers: Max Arinder, Executive Director – Mississippi Joint Legislative PEER

Committee Tim Osterstock, Audit Manager – Utah Office of the Legislative Auditor

General Gary VanLandingham, Director, Pew-MacArthur Results First Initiative –

The Pew Charitable Trusts Jan Yamane, Acting State Auditor – Hawaiʻi Office of the Auditor

2013 NLPES ExEcutivE committEE

Lisa Kieffer, GA (Chair)

Dale Carlson, CA

Greg Fugate, CO

Rachel Hibbard, HI

Wayne Kidd, UT

Marcia Lindsay, SC

Angus Maciver, MT

Nathalie Molliet-Ribet, VA

Katrin Osterhaus, KS

Charles Sallee, NM

Karl Spock, TX (Immediate Past Chair)

NLPES would like to thankSpeaker of the Texas House of Representatives Joe Straus, Texas State

Representative and Legislative Sponsor Dennis Bonnen, The Pew Charitable Trusts, and the National Legislative Services and Security Association for

their contributions to the seminar. The event would not have been possible without their assistance and cooperation.

National Conference of State LegislaturesThe Forum for America’s Ideas

NCSL is a bipartisan organization that serves the legislators and staffs of the nation’s 50 states, its commonwealths and territories. NCSL provides research, technical assistance and opportunities for policymakers to exchange ideas on state issues. NCSL also advocates for the interests of

state legislatures before Congress and federal agencies.

National Conference of State Legislatures7700 East First PlaceDenver, CO 80230

303.364.7700/Fax: 303.364.7800