It was decided to do "group" card sorts both to get as much feedback as possible, as well as to allow the facilitators of the card sort the chance to observe the discussion and debate within the groups. There were five card sort groups of three people each, which included participants from many different levels and every unit in the IST/OCIO organization. As this was an "open" card sort (meaning the categories were not predefined), participants were given blank index cards on which to write the categories into which they would group the cards. The groups had an hour to an hour-and-a-half to complete the card sorts. Some groups finished the sorting relatively quickly, and some groups took longer because they had more debate about the categories. A key learning from this process was that having too many cards could be frustrating for participants, and that it may have been helpful for the evaluators to create fewer cards that were a little less granular so the groups could finish the exercise more quickly.
Watching five different groups allowed the evaluators to see common patterns in the way the participants viewed the information, and several of the groups came up with very innovative ways to intuitively organize the information.
Worked Example - Hotel Reservation System