Jack J. Phillips is chairman of the ROI Institute, Inc. A world-renowned expert on measurement and evaluation, Phillips provides consulting services to Fortune 500 companies and workshops for major conference providers throughout the world. Phillips is the author or editor of more than thirty books and more than one hundred articles.
Bruce C. Aaron is responsible for research and evaluation of learning and knowledge management initiatives within Accenture, a global management consulting, technology services, and outsourcing company. During his tenure, Accenture Education has received several awards from professional associations for excellence in measurement and evaluation, including the 2004 ASTD ROI Impact
Study of the Year award.
The ROI Institute, Inc., is a benchmarking, research, and information sharing organization that provides consulting services, workshops, and certification in the ROI Methodology. Widely considered the leading authority on evaluation and measurement of learning and development in organizations, the ROI Institute conducts workshops and offers certification for thousands of practitioners through a variety of strategic partners.
Principles of the ROI Methodology.
1. The Importance of Isolating the Effects of Programs.
Challenges in Understanding a Program's Impact.
Case Study: What Caused the Improvement?
Preliminary Issues in Isolating Program Effects.
Pager: Please do not italicize the Contents H1 items or the sublists to this level.
The Need to Isolate Program Effects.
Chain of Impact: Initial Evidence of Program Effects.
Identification of Factors Other Than the Program: A First Step.
Final Thoughts.
2. Use of Control Groups.
Control Group Design.
Threats to Validity.
Basic Control Group Design.
Ideal Experimental Design.
Posttest-Only Control Group Design.
Which Design to Choose.
Issues When Considering Control Groups.
Viability.
Practicality.
Ethicial Considerations.
Problems with Control Groups: A Case Example.
Feasibility.
Control Group Example 1: Retail Merchandise Company.
Setting.
Audience.
Solution.
Measures That Matter.
Selection Criteria.
Size of Groups.
Duration of Experiment.
Control Group Example 2: Federal Information Agency.
Setting.
Audience.
Solution.
Measures That Matter.
Selection Criteria.
Size of Groups.
Duration of Experiment.
Control Group Example 3: Midwest Electric, Inc.
Setting.
Needs Assessment.
Audience.
Solution.
Measures That Matter.
Selection Criteria.
Size of Groups.
Duration of Experiment.
Control Group Example 4: International Software Company.
Setting.
Audience.
Solution.
Measures That Matter.
Selection Criteria.
Size of Groups.
Duration of Experiment.
Final Thoughts.
3. Use of Trend Lines and Forecasts.
Trend Lines.
Forecasts.
Trend Line Analysis Example 1: Micro Electronics.
Setting.
Audience.
Solution.
Measures That Matter.
Conditions Test.
Trend Line Analysis Example 2: Healthcare, Inc.
Setting.
Audience.
Solution.
Measures That Matter.
Conditions Test.
Trend Line Analysis Example 3: National Book Company.
Setting.
Audience.
Solution.
Measures That Matter.
Conditions Test.
Final Thoughts.
4. Use of Expert Estimates.
Participants’ Estimates of Program Impact.
Using Focus Groups to Obtain Participant Estimates.
Using Questionnaires to Obtain Participant Estimates.
Using Interviews to Obtain Participant Estimates.
Advantages and Disadvantages of Participant Estimates.
Case Study.
Pager: Please style the following items as a sublist to the previous list.
Setting.
Audience.
Solution.
Measures.
Estimates Provided.
Credibility Check.
Methodology.
Pager: End of sublist.
Immediate Managers’ Estimates of Program Impact.
Senior Management’s Estimates of Program Impact.
Customers? Estimates of Program Impact.
Experts’ Estimates of Program Impact.
Determining the Impact of Other Factors.
Estimate Example 1: Global Financial Services.
Setting.
Audience and Solution.
Measures.
Estimates Provided.
Estimate Example 2: Cracker Box.
Setting.
Audience and Solution.
Measures.
Estimates Provided.
Estimate Example 3: Public Bank of Malaysia.
Setting.
Audience and Solution.
Measure.
Estimates Provided.
Estimate Example 4: Multi-National, Inc.
Setting.
Audience, Solution, and Measures.
Estimates Provided.
The Power of Estimates.
Research.
A Demonstration.
Participant Reaction.
Management Reaction.
The Wisdom of Crowds.
Key Issues in Using Estimates.
Final Thoughts.
5. Use of Isolation Techniques.
Matching Exercise: Isolating the Effects of a Program.
Case Study.
National Computer Company, Part A.
Pager: Please style the following items as a sublist.
Questions for Discussion.
Responses.
Pager: End of sublist.
National Computer Company, Part B.
Pager: Please style the following items as a sublist.
Questions for Discussion.
Responses.
Pager: End of sublist.
National Computer Company, Part C.
Pager: Please style the following items as a sublist.
Questions for Discussion.
Responses.
Pager: End of sublist.
National Computer Company, Part D.
Pager: Please style the following items as a sublist.
Questions for Discussion.
Responses.
Pager: End of sublist.
Why Isolation Is a Key Issue.
Other Factors Are Always There.
Without It, There Is No Business Link: Evidence Versus Proof.
Other Factors and Influences Have Protective Owners.
To Do It Right Is Not Easy.
Without It, the Study Is Not Valid.
Isolation Myths.
Build Credibility with the Isolation Process.
Selecting the Technique.
Using Multiple Methods.
Building Credibility.
Final Thoughts.
Index.
About the Authors.
外文書商品之書封,為出版社提供之樣本。實際出貨商品,以出版社所提供之現有版本為主。部份書籍,因出版社供應狀況特殊,匯率將依實際狀況做調整。
無庫存之商品,在您完成訂單程序之後,將以空運的方式為你下單調貨。為了縮短等待的時間,建議您將外文書與其他商品分開下單,以獲得最快的取貨速度,平均調貨時間為1~2個月。
為了保護您的權益,「三民網路書店」提供會員七日商品鑑賞期(收到商品為起始日)。
若要辦理退貨,請在商品鑑賞期內寄回,且商品必須是全新狀態與完整包裝(商品、附件、發票、隨貨贈品等)否則恕不接受退貨。