The Challenge
From July 2002 to the end of March 2003 Connexions Lincolnshire and Rutland undertook the delivery of the first strategic pilot for the local management of the Millennium Volunteers (MV) programme by a Connexions Partnership. The Pilot would provide an opportunity for the exploration, development and promotion of the MV programme as a whole, of joint working practices between local providers and of the involvement of young people in MV policy and delivery activities.
As part of their evaluation activities, they needed an independent company to measure areas of success and areas for development for the programme. That company was Spinnaker Marketing.
The Approach
The evaluation of this activity was people focussed. Therefore, we began by recommending that a qualitative, as well as a quantitative approach was needed to identify and measure emotive aspects, issues and experiences of those involved in the programme. By consulting with managers, practitioners and the volunteers themselves we could gain a valuable account of the programme over the year.
Our objective was to measure the success of the Pilot against its key aims of developing a coherent approach to the strategic management of MV volunteering through the development of provider relationships, sharing of good practice and the proactive involvement of young people. To achieve this we used primary and secondary research skills; working through paper based evidence of activities as well as directly gaining the feedback of participants of the programme through written and verbal questioning.
The key areas of research and evaluation focussed upon:
-
Management of the MV Strategic Pilot
-
Communications
-
Involving Young People
-
MV Providers Working in Partnership
-
MV Programme Development
-
Participant Opinions and Experiences of the MV Programme
Upon agreeing our approach, we identified 31 potential candidates to take part in the evaluation. These included those professionals involved in the management and delivery of MV and those young people who were actively volunteering on the programme. Recognising the different levels of commitment, availability and needs of our two core audience groups our contact methods were structured to best fit their profiles. As such, written questionnaires were sent out to those professionals involved in MV whilst a telephone survey of the volunteers was undertaken. Both approaches of questioning used a range of techniques that would provide opinions, viewpoints, ratings, preferences and free comment about the MV programme.
Of the 31 participants identified and approached, we obtained 25 completed responses. These were then collated with the data extracted, analysed and evaluated whereby we presented our findings in a written report and at a meeting with MV management and team members.
The Results
Using structured research and evaluation methods Spinnaker Marketing was able to provide Connexions Lincolnshire and Rutland with a clear picture that identified areas of success and areas for development in the management of its MV programme activities.
The combination of qualitative and quantitative methods applied gave a more emotive and personal view of the programme, but was also verified by clear rating and scoring measurements. A comprehensive report outlined the aims and objectives of the research, the methods undertaken and the findings. Spinnaker Marketing also gave recommendations with regards to progressing and strengthening the strategic planning and delivery of the MV programme within Lincolnshire and Rutland.
How did they do? The majority of evaluation participants cited clear benefits as a result of the Pilot and Connexions Lincolnshire and Rutland continues to provide a worthwhile MV programme for young people in the region.
How did we do? We went on to research and evaluate the delivery activities of the programme, undertaking a second project that measured the effectiveness and efficiency of the day-to-day operations of MV in the region.