Training Evaluation Case Studies

Emergent Futures Consulting Inc.

Function: Evaluation of Open Space Technology Training at Capital Health
March – August 2009

Capital Health is Nova Scotia’s largest provider of health services. With an operating budget of almost $800 million, they serve the 400,000 residents of the district and provide specialist services to the rest of Nova Scotia and Atlantic Canada.

Donna Clark from Emergent Futures Consulting Inc. delivered a series of “train the trainer” training sessions in 2009 for Open Space Technology (OST) as part of the organizational transformation initiative at Capital Health. Emergent Futures retained Hal Richman to conduct a third-party evaluation of the training results and impacts on the organization. The evaluation process included surveys, focus groups and key informant interviews.

The survey and focus group findings supported the catalyst effects of OST training on communication, attitudes and work culture, and provided Emergent Futures will actionable information for using Open Space Technology to drive organizational results.

Asian Development Bank

Function: Consulting in Results Based Management for the Government of Sri Lanka
March 2009 –July 2009

The Asian Development Bank (ADB) undertook a special program of capacity-building for Sri Lanka under its Managing for Development Results Program. Part of the process involved the articulation of capacity development plans, including the conceptual design and terms of reference for information systems, to address the capacity gaps identified in the regional assessments.

Hal Richman was asked to join the project team for the mission held March/April 2009 to assist the four ministries in developing their results-based management framework, provide training and coaching in the principles of results-based management, and specify various IT-based capacity development initiatives. Hal also helped introduce the Program Activity Architecture (PAA) from the Treasury Board of the Government of Canada to the central planning ministry. The PAA helps Government roll out and manage high level results from agencies and departments by requiring them to link their program activities to strategic results.

Canadian International Development Agency (CIDA)

Function: Monitoring and Evaluation of E-Learning and Knowledge Network Program for Bosnia-Herzegovina
March 2003 – August 2008

Goss Gilroy Inc. (Ottawa, Canada) and Productivity Solutions Inc. (Hal Richman) were awarded a five-year contract by the Canadian International Development Agency (CIDA) to conduct a Project Review and Evaluation for the E-Learning and Knowledge Network Program for Bosnia-Herzegovina. This project involved capacity building in all aspects of learning design and delivery for the E-NET Centar at the University of Sarajevo, as well as capacity building and training for key sectors such as municipal management and judicial management.

This assignment involved the application of a formal evaluation framework to the numerous outputs, outcomes and impacts of the initiative (based in Sarajevo), including detailed needs assessments and baseline studies. This initiative utilized Hal Richman’s business development expertise in eLearning to complement the senior evaluation team.

Wellcome Trust via RSM Robson Rhodes (London, UK)

Function: Marketing Analysis and Product Design for Online Learning
November 2006 – January 2007

The Wellcome Trust is an independent research-funding charity, established under the will of Sir Henry Wellcome in 1936, with an endowment of around £15 billion. The Trust wished to make a leap forward in terms of scope, depth and impact of their worldwide learning product offerings. Given his extensive background in health, international development and learning, Hal Richman was invited to join the consulting team and assist the Trust in revising the strategic direction of their learning division.

The work included an assessment of worldwide value networks (NGOs, ministries of health, WHO, health education institutions) for disease areas such as dengue fever and malaria in which the Trust is active. Hal’s contribution focused on designing new approaches and products that support learning and knowledge management for doctors, nurses, ministries of health, clinical officers and community health workers worldwide. His special contribution was introducing the concept of performance support and continuous learning to complement training activities, as well as the use of innovative delivery methods such as mobile learning.