From Spagetti Towers to Peer Rating Criteria
How do we define quality at the EMC2? How do we evaluate quality? And who should be involved in the evaluation process? These are some of the core questions we worked with in the EMCC workshop in Oslo. The workshop provided valuable input to the further development process of EMC2 in 2016.
Written by Ragnhild Kr. Olsen
Photos by Robert Wallace Vaagan
Oslo and Akershus University College of Applied Sciences (HiOA) was the host of the ‘Peer Rating’ workshop, the sixth workshop of the EMC2 in December 2015. The aim of the workshop was to define quality evaluation standards and procedures for the EMC2 within a total quality management framework and with a peer perspective. Assistant professor Ragnhild Kr. Olsen chaired the workshop. Associate Professor Robert Wallace Vaagan who is on the EMC2 Board, participated in parts of the program to aid the transfer of knowledge from previous workshop and project deliverables to this one.
In addition, the following participants contributed in the workshop:
- Alper Kirklar, Istanbul Bilgi University
- Christien Kintzen, HvA
- Asbjørn Slot Jørgensen, DMJX
- Angela Joséphine Prinzivalli, HdM Stuttgart
- Julian Wildmann, HdM Stuttgart
- Berk Erkara, Istanbul Bilgi University
- Ceyla Dayı, Istanbul Bilgi University
- Carine Versteeg, HvA
- Lau Lefholm Bruus, DMJX
- Charlotte Krohn Jayer, HiOA
- Margret Stray-Pedersen, HiOA
The program of the workshop was based on introductory lectures and case studies followed by practical work in groups. Both The Norwegian Broadcasting Company (NRK) and Norway’s leading local newspaper group Amedia served as cases studies for our work. Project manager Helene Hillestad introduced us to NRKs peer rating system “Janus”, and on our excursion to Amedia, we were presented to their user measurement systems.
Creative students and teachers
It was an important goal for the workshop to create a feeling of joint ownership for the process and the end result among the participants. By emphasizing group work the workshop aimed for a high degree of involvement by both students and teachers. The students were encouraged to take responsibility for the progress of the group work in self-organizing teams. The teachers were mostly working in a separate team but provided assistance and advice when required by the student teams.
Already in the opening sequence of the workshop the creativity and cooperative skills of the two participants group were put to the test as the teachers and students were challenged to build high rises – of spaghetti and marshmallows. The buildings were indicative for the days to follow – great cooperation and loads of creativity resulted in impressive towers!
Deliverables and challenges
During the course of the five days workshop the groups worked with to main challenges. First to define quality stakeholders and quality values and indicators for the different parts of the EMC2. Secondly to describe quality control and peer rating procedures when working with an assignment or as lecturer at the EMC2.
The program of the workshop was based on introductory lectures and case studies followed by practical work in groups. Both The Norwegian Broadcasting Company (NRK) and Norway’s leading local newspaper group Amedia served as cases studies for our work. Project manager Helene Hillestad introduced us to NRKs peer rating system “Janus”, and on our excursion to Amedia we were presented to their user measurement systems.
In the morning session of our last day the groups presented the result of their work on this. The presentation was attended by the EMC2 project leader, Professor Lars Rinsdorf via Skype and Associate Professor Anne Fogt, head of the Department of Journalism and Media Studies at HiOA. After the presentation the groups worked on narratives explaining the visualization and the work in the groups. This was defined as the workshop deliverables and presented in a detailed report from the workshop.