ref2014 hodoms birmingham 8 th april ann dowling: chairman of ref main panel b john toland: chairman...
TRANSCRIPT
![Page 1: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/1.jpg)
REF2014
HODOMS Birmingham 8th April
Ann Dowling: Chairman of REF Main Panel B
John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences
![Page 2: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/2.jpg)
The REF assessment framework
First meeting of Sub-panels
Graeme Rosenberg, REF Manager
![Page 3: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/3.jpg)
The assessment framework
The REF is a single assessment framework, within which panels have flexibility to develop aspects of the criteria and working methods
![Page 4: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/4.jpg)
Key documents
During 2011, our task is to produce two key documents:
• Guidance on submissions
• Panel criteria and working methods
These will set in stone what HEIs need to include in their submissions, and how the panels will assess them
![Page 5: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/5.jpg)
Timetable
![Page 6: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/6.jpg)
The overall assessment framework
65% 15% 20%
![Page 7: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/7.jpg)
Outputs Environment Impact
4* 3* 2* 1* u/c
0 40 40 20 0
4* 3* 2* 1* u/c
20 45 35 0 0
65%
Overall Quality Profile
12
4*
0104236
u/c1*2*3*
4* 3* 2* 1* u/c
12.8 32.5 43.3 11.4 0
15% 20%
Quality Level
% of the submission
![Page 8: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/8.jpg)
Submissions
Each submission to a UOA will include staff selected by the HEI, their research outputs and associated environment and impact:
• Normally one submission by an HEI to a UOA
• Multiple submissions in exceptional cases
• Joint submissions
• Sub-panels to produce UOA descriptors and boundaries
![Page 9: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/9.jpg)
Research staff
Submissions to include:
• Details of eligible staff selected by the HEI
• Up to 4 outputs per selected researcher
• The number of outputs may be reduced without penalty for staff with circumstances that constrained their productivity:
– Early career researchers
– Clearly defined periods of absence
– Complex circumstances
![Page 10: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/10.jpg)
Research outputs
• All research outputs placed in the public domain during the publication period (1 Jan 2008 to 31 Dec 2013) will be eligible
• Outputs from all types of research to be treated equally
• Main panels to expand on:
– The diversity of expected output types
– How co-authorship will be handled
– Requirements for additional information
– Criteria for ‘double-weighting’ outputs of exceptional scale and scope
![Page 11: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/11.jpg)
Citation data
We expect some panels will use citation information to support their review of outputs:
• We will identify a standard approach to making data available to panels and provide guidance:
– Judgements based on expert review; citations only inform ‘academic influence’
– All types of research to be treated equally
– Clear limitations for recently published outputs
• Main panels to:
– Decide whether or not citation data will be used
– Be explicit about any use of citation data
![Page 12: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/12.jpg)
Research environment• A structured template to describe, for example:
– Overview
– Strategy
– People
– Income, infrastructure and facilities
– Collaboration and contribution
• Standard data on research income and research students
• Main panels to explain:
– What kinds of evidence or information are required
– The relative importance of each section
– The approach to forming an environment ‘sub-profile’
![Page 13: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/13.jpg)
Research impact• A broad generic definition of (non academic) impact
• Sub-panels will make judgements based on:
– Case studies detailing specific impacts
– Information about how the unit has supported and enabled impact
• Generic templates and scale for the number of cases
• Main panels to expand on:
– How the criteria (reach and significance) will be applied
– Types of impacts and evidence appropriate to their disciplines
– Suitable evidence of underpinning research quality
– How the ‘impact template’ will influence the sub-profile
![Page 14: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/14.jpg)
Equalities and diversity
We have built on the measures taken in the 2008 RAE:
• A consistent approach to enabling staff with constraining circumstances to submit fewer outputs
• All institutions to adhere to a code of practice on the fair and transparent selection of staff
• Evidence of support for equalities and diversity (within the research environment)
• Analysis of selection rates at sector level
• Panels will be briefed on equalities
• Ongoing advice from an equalities expert panel
![Page 15: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/15.jpg)
Panel working methods
Working methods to explain:
• How the main panels will in practice carry out their roles in providing oversight and governance
• How the sub-panels will in practice carry out the assessment, including:
– The approach to making use of assessors
– The approach to allocating and reviewing
submissions
– Procedural matters
![Page 16: REF2014 HODOMS Birmingham 8 th April Ann Dowling: Chairman of REF Main Panel B John Toland: Chairman of REF Sub-Panel B10: Mathematical Sciences](https://reader035.vdocuments.mx/reader035/viewer/2022062511/551bbfbf550346be588b49a7/html5/thumbnails/16.jpg)
A note on assessors
• For the criteria phase, the funding bodies have appointed panels with broad expertise to develop the criteria; and with numbers in proportion to each panel’s remit
• Additional assessors will be appointed in 2013 where the breadth or depth of a panel’s expertise needs to be extended, to undertake the assessment:
– Assessors (either academic or user) will play a full and equal role to panel members in developing the sub-profiles (either outputs or impact)
– They will be trained and briefed and attend meetings as necessary during the assessment phase