** Evaluating e-learning initiatives - Bastiaens et al 2004 ** - The Diigo Meta page

• 24 Mar 09
  

  Youenn Leborgne

  Notions:
  e-learning, evaluation, framework, reaction, learning, performance
  
  Kirpatrick's four-level evaluation framework:
  1. Reaction level: what participants think of the training
  2. Learning level: what participants have learned
  3. Performance level: to what extent the participants change their behaviour on the job
  4. Organization level: monitors the organisational improvement
  
  The evaluation requires a clear plan describing the goal, the object and the criteria
  It's also important to specify the evaluation goal, design and arrangements (management and organisational issues)
  
  ** A very detailed example is used **
  
  In addition to a detailed elaboration of the framework, it's advisable to take into account general aspects such as authenticity, exploration, scale, time requirements, objectivity required and focus
  
  The approach proposed by Kirpatrick is partial and has to be revised conceptually to be applicable, particularly in e-learning environments today:
  - the main problem with the evaluation of satisfaction is the atheoretical approach
  - the effect of a course on learning cannot be measured by a simple test just after completion of the course but should be measured in an authentic situation
  - it is very difficult to measure the transfer of learning on work behaviours
  - the same applies to the measure of the impact on organisations (in terms of results, etc.)
  
  Because a four-level evaluation is quite demanding, it's not wise to perform one for every learning event but only for the implementation of a new media or course type (otherwise, the cost of the evaluation may exceed that of the e-learning initiative itself).
  As a minimum, the authors recommend performing an evaluation at the reaction level every time the e-learning event takes place.
  Finally, evaluation has to be based on a well-considered theoretical model

  e-learning ECDEL_MSc evaluation research feedback design

Would you like to comment?

Join Diigo for a free account, or sign in if you are already a member.