P765
- 1. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE September 27-30, 2010 Use Performance Information to Drive Decision Making Arlington, VA FEATURING TWO INTERACTIVE COURSES: Capture and Utilize Accurate PERFORMANCE AUDITING: Achieving Maximum Impact Data to Prove • Create successful strategies to improve performance auditing that Government • Develop relevant program measures to better improve program objectives Programs are PROGRAM EVALUATION: Developing and Performing High-Priority Evaluation Activities Achieving their • Learn to determine if a program is accomplishing its intended outcomes Intended Outcomes • Understand key steps to build an evaluation system within your organization In Association with: www.PerformanceInstitute.org/Audit
- 2. Day 1 PERFORMANCE AUDITING: ACHIEVING MAXIMUM IMPACT Monday, September 27, 2010 AUDIT PERFORMANCE INFORMATION — 8:30 12:00 Conference Registration and Continental Breakfast Lunch Break 9:00 1:00 Understand Definitions and Phases of a Discuss and Understand How Vulnerability is Assessed Performance Audit • Obtain an understanding of the program: Inputs, • Define financial and performance audits under processes, outputs and outcomes auditing standards • Assess vulnerability (the COSO/ERM and TX State • Understand the phases and outputs of a performance audit Auditor models) • Learn the importance of the planning phase in order to • Review audit-ability of high risk/high vulnerability programs receive high impact auditing results • Identify terms associated with risk and Case Study: Conduct a Risk and Vulnerability Assessment vulnerability assessment • Identify high risk/high vulnerability issues • Report out and reach consensus on selecting issues Identify Risks Associated with Government Programs and for audit Use Conceptual Models to Interpret and Assess the Risks • Summarize risk and vulnerability assessment • Discover the inherent risk model and relationship to program performance expectations or goals 4:00 • Identify and evaluate sources of program performance Adjourn expectations or goals • Review types of performance measures and understand how inherent risks, performance expectations/goals and performance measures are interrelated “There is solid evidence Examine How Inherent Risks Are Assessed that each dollar spent on • Review principles of risk • Develop methods for evaluating and ranking risk using program integrity…yields risk factors $1.60 in savings and reduced • Determine sources of risk information • Learn how to document and report on risk assessment results erroneous payments.” — Peter Orszag, Director, Office of Management and Budget WHO SHOULD ATTEND? • Government Auditors • Project Managers • Division Managers • Inspectors General • Program Analysts • Program Planners • Program Managers • Strategic Planners • City and County Executives 2 www.PerformanceInstitute.org/Audit
- 3. PERFORMANCE AUDITING: ACHIEVING MAXIMUM IMPACT Day 2 Tuesday, September 28, 2010 AUDIT PERFORMANCE INFORMATION — 8:30 Become a Conference Registration and Continental Breakfast Certified Government Performance Manager 9:00 To ensure professional success, you must continually expand Formulate Performance Audit Objectives and your skills and education. The bar has been raised in Sub-Objectives Based on Risks and Vulnerabilities government agencies and organizations and managers • Understand the importance of asking the right question want to hire, promote and work with the most skilled • Examine the relationship between audit objectives and individuals possible. performance aspects • Apply steps for defining audit objectives and sub-objectives To address this need, The Institute offers a Certificate in • Review relationships between audit objectives Government Performance Management. Completing a and methodologies certification program is easy. Just attend the three “core” courses and an additional three “elective” courses based Case Study: Develop High Impact Audit Objectives and on the topics that meet your agency’s unique needs. The Sub-Objectives Based On Risk and Vulnerability Assessment skills you acquire will then be used to complete a “capstone project” on a particular issue that you and your department • Select high risk/high vulnerability issues are facing, which will then be evaluated by an expert • Develop high impact objectives and sub-objectives member of our staff. • Report out and assess potential impacts 12:00 Customize a Program to Fit Your Needs Lunch Break Working with Institute training managers, you can select courses that will have direct application and impact to your work. 1:00 For more information about certification, please contact Review and Understand How to Select Data Chris Hicks at 202-739-9548 or email him at Collection/Analysis Methodologies Chris.Hicks@PerformanceInstitute.org • Relate audit methodologies to appropriate and sufficient evidence • Review quantitative analysis (ratio analysis, trend and 5 REASONS TO ATTEND: time-series analysis, regression analysis, cost-benefit, cost-effectiveness and others) • Examine qualitative analysis (survey/interview/focus groups, 1 USE data and evaluation to drive continuous program performance observation--participant observation, trained observer) • Understand relationship of methodology selection to 2 EXAMINE the different types of program evaluation and how to use them audit-ability and audit project budgets Discover Best Practices in Risk and Measurement Based 3 DETERMINE program relevancy to the agency’s mission Performance Auditing • Learn to create a checklist which identifies successful 4 USE evaluation methods to discover program strengths and weaknesses strategies related to performance auditing 5 UNDERSTAND the relationships between performance auditing, performance measurement, program evaluation and organizational learning 4:00 Adjourn www.PerformanceInstitute.org/Audit 3
- 4. Day 3 DEVELOPING & PERFORMING HIGH-PRIORITY EVALUATION ACTIVITIES Wednesday, September 29, 2010 PROGRAM EVALUATION — 8:30 Conference Registration and Continental Breakfast About the Trainers: 9:00 Stephen L. Morgan, CIA, CGAP, Setting the Stage: A Federal Perspective on the Current CGFM, CFE, is the former city auditor of Austin, Texas, State of Program Evaluation within Government Agencies who directed a full scope audit office that conducts • Examine the Obama Administration’s “increased performance audits, fraud investigations, and emphasis on program evaluation” and what new consulting engagements. Mr. Morgan played a key processes may await Federal evaluators leadership role in helping the City of Austin evolve its • Understand the relationship between evaluation and performance measurement and management system performance auditing, performance measurement, into a model for other government organizations. program evaluation and organizational learning Before joining the City Auditor’s Office, Mr. • Review what key agencies have done to better improve Morgan was an evaluator in the U.S. Government their evaluation practices Accountability Office’s National Productivity Group. • Discuss what challenges await as new management His Institute of Internal Auditors’ offices have included requirements are presented president and governor, Austin Chapter, chair of the International Government Relations Committee, TED KNIKER, Executive Consultant, Federal Consulting Group, North American Director on the Global Board, National Business Center, U.S. Department of the Interior chair of the North American Board, and chair of the North American Nominating Committee. In January 10:30 2001 Mr. Morgan was appointed (reappointed Phase One of Learning Approach to Evaluation: in 2005) by the Comptroller General of the United Focus the Inquiry States to the Advisory Council on Government • Establish a common framework on basic evaluation terms Auditing Standards. He co-authored three textbooks: • Review the impetus for evaluation Performance Auditing: A Measurement Approach (first • Understand the organization’s context and second editions) and Auditor Roles in Government • Develop the logic model Performance Measurement: A Guide to Exemplary Practices at the Local, State, and Provincial Levels. In 12:00 May 2009, Mr. Morgan received the Victor Z. Brink Lunch Break Memorial Award for Distinguished Service, the IIA’s highest global audit leadership award. In May 2007, Mr. Morgan accepted the National Intergovernmental 1:00 Phase One of Learning Approach to Evaluation: Audit Forum’s Excellence in Government Performance Focus the Inquiry (continued) and Accountability Award from the Comptroller General of the United States. Also, in March 2002, • Clarify the purpose of the evaluation Mr. Morgan became the fourth annual recipient of the • Develop the evaluation’s key questions Harry Hatry Distinguished Performance Measurement • Think explicitly about the use of findings Practice Award from the American Society of Public Administration honoring his lifetime of contributions to Phase Two of Learning Approach to Evaluation: public service. Mr. Morgan holds a Bachelor of Arts Carry out the Inquiry degree in government (with honors) from the University • Develop and implement the evaluation plan of Texas at Austin; he was elected to Phi Beta Kappa. He also holds an MPA from the Lyndon B. Johnson 4:00 School of Public Affairs of the University of Texas. Adjourn 4
- 5. DEVELOPING & PERFORMING HIGH-PRIORITY EVALUATION ACTIVITIES Day 4 Thursday, September 30, 2010 PROGRAM EVALUATION — 8:30 Conference Registration and Continental Breakfast Rosalie Torres is a recent past board member of the American Evaluation Association, 9:00 serves on the editorial boards of major evaluation Phase Three of Learning Approach to journals and served as the staff director for the1994 Evaluation: Apply Learning revision of the Joint Committee’s Program Evaluation • Interpret the data and develop communications Standards. With over 30 years experience conducting and reports program evaluation in human service settings, she • Support the action plan based on evaluation findings has taught graduate level research and evaluation • Monitor and provide feedback on actions taken courses at several universities, and routinely conducts workshops on various topics related to evaluation Build and Evaluation System Within practice. She has authored/co-authored numerous Your Organization books and articles articulating practice-based • Gather and review information about theories of evaluation use; the relationship between organization’s mission, purpose, strategic plan, evaluation and individual, team and organizational structure and staffing learning; and effective strategies for communicating • Diagnose status of organization’s infrastructure and reporting evaluation findings. Among them critical to organizational learning and design of are: Evaluation Strategies for Communicating and evaluation system Reporting: Enhancing Learning in Organizations, • Reach shared understanding on the organization’s 2nd edition (Sage, 2005), and Evaluative Inquiry overall theory of change for Learning in Organizations (Sage, 1999). Her organization was recently awarded a National Science Foundation grant to conduct research on 12:00 Lunch Break logic model use in the design, implementation and evaluation of complex, multi-year educational reform systems. She earned her Ph.D. in research and 1:00 evaluation in 1989 from the University of Illinois. Build an Evaluation System Within Your Organization (Continued) • Use theory of change and logic models to identify inquiry questions for informing organizational “The instructor has an improvement and success • Identify additional measures needed and complete in-depth knowledge of plan for data collection, analysis, reporting and use • Implement and evaluate the evaluation system the subject matter as well as a keen knowledge of 4:00 Training Adjourns other resources useful for my job.” — MC, Program Analyst, Internal Revenue Service www.PerformanceInstitute.org/Audit 5
- 6. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE In-House Training & Customization One of the more popular vehicles for accessing the Institute’s educational offerings is the delivery of on-site trainings and management facilitations. Bringing a training or facilitation in-house gives you the opportunity to customize a program that addresses your exact challenges and provides a more personal learning experience, while virtually eliminating travel expenses. Whether you require training for your department or for an organization-wide initiative, the advanced learning methods employed by The Performance Institute will create an intimate training atmosphere that maximizes knowledge transfer to enhance the talent within your organization. Customization: We realize that not all obstacles can be overcome by applying an “off-the-shelf” solution. While many training providers will offer you some variation of their standard training, The Performance Institute’s subject matter experts will work with you and your team to examine your programs and determine your exact areas of need. The identification of real life examples will create a learning atmosphere that resonates with participants while at the same time providing immediate return on your training investment. Using interactive exercises that employ actual projects or scenarios from your organization, instructors can address specific challenges and align the curriculum of each session to your objectives. While the majority of on-site trainings are focused on smaller groups, The Performance Institute also has the ability to accommodate organization-wide training initiatives. Utilizing multiple instructors, the Institute has the capacity to deliver courses to groups of up to 300 participants per day. Areas of Expertise: On-site delivery of single courses, certification programs and entire packages of specialized courses are available in the following areas: • Strategic Planning • Performance-Based Contracting • Performance Measurement • Performance Reporting • Project Management • Program Evaluation • Lean Six Sigma • Administrative Management • Workforce Management • Leadership and Change • Performance-Based Budgeting For more information about in-house training and certification options, please contact Jennifer Mueller at 202-739-9619 or email her at Jennifer.Mueller@performanceinstitute.org. Sponsorship Opportunities: As a conference and training provider, The Performance Institute is an expert in bringing together leaders to share and discuss best practices and innovations. We connect decision-makers with respected solutions providers. The Institute offers four different pre-designed sponsorship packages: • Event Co-Sponsor • Session Sponsor • Luncheon Sponsor • Exhibit Booth Sponsor For more information on sponsorships or to get started, contact Meredith Mason at 202-739-9707 or email her at Meredith.Mason@PerformanceInstitute.org 6 www.PerformanceInstitute.org/Audit
- 7. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE Venue & Hotel Venue & Hotel: Quality Assurance: Audit and Evaluate Program Performance will be held at The The Performance Institute strives to provide you with the most Performance Institute in Arlington, VA, just one block east of the productive and effective educational experience possible. If Courthouse Metro stop on the Orange Line. A public parking after completing the course you feel there is some way we garage is located just inside of the building. can improve, please write your comments on the evaluation form provided upon your arrival. Should you feel dissatisfied The Performance Institute Conference Center with your learning experience and wish to request a credit or 1515 N. Courthouse Rd., Suite 600 refund, please submit it in writing no later than 10 business Arlington, VA 22201 days after the end of the training to: 877-992-9521 The Performance Institute: Quality Assurance A limited number of rooms have been reserved at the 805 15th Street, NW, 3rd Floor Arlington Rosslyn Courtyard by Marriott at the prevailing Washington, DC 20005 rate of $229. This rate is based on the Government Per Diem and is subject to change. Please call the hotel directly and Note: As speakers are confirmed six months before the reference code “Audit and Evaluate Program Performance” event, some speaker changes or topic changes may occur when making reservations to get the discounted rate. The in the program. The Performance Institute is not responsible hotel is conveniently located three blocks from the Rosslyn for speaker changes, but will work to ensure a comparable Metro station. Please ask the hotel about a complimentary speaker is located to participate in the program. shuttle that is also available for your convenience. If for any reason The Performance Institute decides to Arlington Rosslyn Courtyard by Marriott cancel this conference, The Performance Institute accepts no 1533 Clarendon Blvd. responsibility for covering airfare, hotel or other costs incurred Arlington, VA 22209 by registrants, including delegates, sponsors and guests. Phone: 703-528-2222 / 1-800-321-2211 www.courtyardarlingtonrosslyn.com Discounts: • All ‘Early Bird’ Discounts must require payment at time of Tuition & Group Discounts: registration and before the cut-off date in order to receive The tuition rate for attending Audit and Evaluate Program any discount. Performance is as follows: • Any discounts offered whether by The Performance Institute Offerings Early Bird Regular Rate (including team discounts) must also require payment at the Individual Course $769* $869 time of registration. Attend Both and Save! $1499* $1599 • All discount offers cannot be combined with any other offer. * For the Early Bird rate, register before: August 2, 2010. • Discounts cannot be applied retroactively For more information on group discounts for Audit and Payment must be secured prior to the conference. If payment Evaluate Program Performance please contact: is not received by the conference start date, a method of Chris Hicks at 202-739-9548 or email him at payment must be presented at the time of registration in order Chris.Hicks@PerformanceInstitute.org to guarantee your participation at the event. www.PerformanceInstitute.org/Audit 7
- 8. AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE Registration Form CALL FAX THIS FORM TO VISIT 877-992-9521 866-234-0680 www.PerformanceInstitute.org/Audit Registration Form Yes! Register me for Audit and Evaluate Program Performance Yes! Register me for Auditing Performance Information Yes! Register me for Program Evaluation Please call me. I am interested in a special group discount for my team Delegate Information Name Title Organization Dept. Address City State Zip Telephone Fax Email Payment Information Check Purchase Order/Training Form Credit Card Credit Card Number Expiration Date Verification no. Name on Card Billing Address Please make checks payable to: The Performance Institute CANCELLATION POLICY: The Performance Institute will provide a full refund less a $399 administration fee for cancellations requested four weeks prior to the event start date unless cancellation occurs within two weeks prior to the event start date. If a cancellation is requested less than two weeks prior to the event start date, no refund will be issued. Registrants who fail to attend and do not cancel prior to the event will be charged the entire registration fee. All cancellations must be requested through the cancellation link found in your attendance confirmation email. Please note that cancellation is not final until you receive a cancellation confirmation email. I have read and accepted the Cancellation Policy above. ACKNOWLEDGED AND AGREED By: ______________________________________________________________________________________________ Date: _______________________________________ Priority Code: P765-WEB