EPSA 2013

Assessment and evaluation methodology

The EPSA assessment and evaluation methodology – impartial, independent and effective

All submitted projects, which meet the eligibility criteria, are assessed against eight evaluation criteria (Innovation, Appropriateness of Actions Taken, Impact/Results, Sustainability, Transferability and Learning Capacity, Stakeholder Support, Social Equity, and Effect on Economic Growth). Sufficient detail must also be provided in the applications to demonstrate the quality of the achievements of the case and the lessons learnt.
The assessment is carried out in an independent and impartial multi-step evaluation process.

In the first step, a set number of projects within a concrete award category is allocated to each evaluator based on their professional background and sector (a mix of academia, the practice field and the private sector), nationality (evaluators may not assess projects from their country of origin or employment) and gender. Each project is assessed online, independently and exclusively, by three different experts (the so-called assessment in ‘triplets’). The evaluators do not know who is part of their evaluation triplet, or how the other two evaluators assessed the respective project.

During the Consensus Meeting (Step 2), all evaluators come together to review and discuss the first available provisional ranking based on their individual scorings and possible discrepancies. Furthermore, they unanimously decide on the Best Practice Certificate Recipients, the honorary mentions and on the top short-listed projects in each award category for the on-site visits.

The third step - the onsite visits - serves to validate and verify the results and recommendations of the previous two evaluation steps, i.e. to spot-check whether the content of the application form of the project corresponds to the “reality”; to find the answers to the un-answered questions raised by the evaluators, to detect possible inconsistencies and to gather additional or missing information and data. EIPA representatives do not (re)assess the projects!
The fourth and final step consists of the Jury Meeting, where five jurors (high-ranking stakeholders and/or political personalities, separate from the evaluators) decide on the nominees and the award winners in each category based on the short-listed projects of the on-site visits.

“The approach made in the on-site visit was very useful for our team. We received more information about EIPA and its activities. At the same time, it was a good opportunity for us to present in loco the results of our project.”
(EPSA 2011 short-listed applicant)