environmental sciences 2007 research evaluation, including sense research … · 2014-11-06 ·...
TRANSCRIPT
Environmental Sciences 2007Research Evaluation,
including SENSE Research School
December 2007
� QANU/ResearchEvaluationEnvironmentalSciences�007
QualityAssuranceNetherlandsUniversities(QANU)Catharijnesingel56POBox80353503RAUtrechtTheNetherlands
Phone: +31(0)30�303100Telefax: +31(0)30�3031�9E-mail: [email protected]: www.qanu.nl
©�007QANUTextandnumericalmaterialfromthispublicationmaybereproducedinprint,byphotocopy-ingorbyanyothermeanswiththepermissionofQANUifthesourceismentioned.
3QANU/ResearchEvaluationEnvironmentalSciences�007
Table of contents
Foreword 5
Part I Report of the General Committee 7
Summary of evaluation of SENSE school & Acknowledgements 9
1. Introduction 11�. EvaluationofSENSEResearchSchool 133. EvaluationofSENSEResearchInstitutes �1
Appendices 39
AppendixA EvaluationofSENSEResearchSchoolFollowingECOSCriteria 41AppendixB ECOSCriteria 45AppendixC SENSEDisciplinaryFieldsandCoreThemes 49AppendixD ScheduleoftheGeneralReviewCommittee 51
Part II Reports of the Programme Review Committees 53
General remarks about the programme review procedures 55
Committee reports: assessments per institute and per programme At the end of all committee reports three appendices are given which contain the CV’s, an overview of the scores and the schedule of the site visit.
Committee Environmental Sociology, Economics 57and Policy Studies (ESEP)
1. Thereviewcommitteeandthereviewprocedures 59�. Generalremarks 613. WageningenUniversity,InstituteWIMEK 634. VrijeUniversiteitAmsterdam,InstituteIVM 695. UtrechtUniversity,CopernicusInstitute 75
Committee Environmental Biology and Ecology (EBE) 83
1. Thereviewcommitteeandthereviewprocedures 85�. Generalremarks 873. WageningenUniversity,InstituteWIMEK 894. VrijeUniversiteitAmsterdam,InstituteIES 935. RadboudUniversity 996. UtrechtUniversity,CopernicusInstitute 103
4 QANU/ResearchEvaluationEnvironmentalSciences�007
Committee Environmental Earth Sciences (EES) 109
1. Thereviewcommitteeandthereviewprocedures 111�. Generalremarks 1133. WageningenUniversity,InstituteWIMEK 115
Committee Environmental Chemistry, Microbiology, Ecotoxicology and Biotechnology (ECMEB) 127
1. Thereviewcommitteeandthereviewprocedures 1�9�. Generalremarks 1333. WageningenUniversity,InstituteWIMEK 1354. VrijeUniversiteitAmsterdam,InstitutesIVMandIES 139
Committee Integrated Assessment, Sustainable Systems Analysis and Spatial Management (ISS) 145
1. Thereviewcommitteeandthereviewprocedures 147�. Generalremarks 1513. WageningenUniversity,InstituteWIMEK 1534. VrijeUniversiteitAmsterdam,InstituteIVM 1575. UtrechtUniversity,CopernicusInstitute 1616. UniversityofGroningen,InstituteIVEM 1657. MaastrichtUniversity,InstituteICIS 167
5QANU/ResearchEvaluationEnvironmentalSciences�007
FOREWORD
ThisreportispartoftheperiodicqualityassessmentofallpubliclyfinancedresearchintheNetherlands,usingtheStandardEvaluationProtocol�003-�009forPublicResearchOrgani-sations(SEP)thatwasdevelopedbyVSNU,KNAWandNWO.Thepurposeofthisreportistopresentareliablepictureoftheresultsoftheresearchsubmittedforthisreviewandtogivefeedbacktotheinternalqualityassuranceoftheorganisationsconcerned.
Thereviewcoverstheresearchintheperiod�001-�006intheresearchprogrammesandinsti-tutesthatparticipateintheresearchschoolforSocio-EconomicandNaturalSciencesoftheEnvironment(SENSE),plustheactivitiesoftheresearchschoolassuch.
The review was commissioned jointly by the Boards of the universities that participate inSENSE and by the Board of SENSE.The review committees were supported by QANU(Quality Assurance Netherlands Universities). QANU cooperated with SENSE to ensurecompliancewithSEPinallaspectsandtoproduceindependentassessmentreportswithpeerreviewcommitteesofinternationalexpertsintheacademicfieldsinvolved.
Thisreportconsistsoftwoparts.
Thefirstpart,theReportoftheGeneralCommittee,buildsontheprogrammereviewsanddealswith:a) theresearchschoolSENSE,withthreegeneralfunctions: • SchoolforEnvironmentalResearchersandProfessionals • NetworkforEnvironmentalSciences • BridgetoSocietyandEnvironmentalGovernance.b) theresearchinstitutes(WIMEK-WU,IVM-VU,IES-VU,Copernicus-UU,IVEM-RUG,
ICIS-UM).
Thesecondpartofthisreportcontainsthefindingsofthefiveprogrammereviewcommittees,regardingthetwenty-tworesearchprogrammessubmittedforreview.
QANUwishestothankthechairpersonsandmembersoftheReviewCommitteesfortheirparticipationinthisassessmentandforthededicationwithwhichtheycarriedoutthistask.Wealsothankthestaffoftheresearchschoolandinstitutesconcernedfortheircarefullypre-pareddocumentationandfortheirco-operationduringtheassessment.
QualityAssuranceNetherlandsUniversities
Mr.ChrisJ.Peels Dr.JanG.F.VeldhuisDirector ChairmanoftheBoard
6 QANU/ResearchEvaluationEnvironmentalSciences�007
7QANU/ResearchEvaluationEnvironmentalSciences�007
PART I: REPORT OF ThE GENERAl COMMITTEE
8 QANU/ResearchEvaluationEnvironmentalSciences�007
9QANU/ResearchEvaluationEnvironmentalSciences�007
SUMMARY OF EVAlUATION OF SENSE SChOOl
SENSEasanorganizationhastwomainde facto functions:thetrainingofyoungenviron-mentalscientistsandtheadvancementofenvironmentalresearchthroughnetworking.Ithasbeenverysuccessfulinpursuingthesegoals.Asapracticalmatter,itwouldbeworthwhiletorevisetheSENSEmissionstatementtoreflectthesede factofunctions.Besidesthis,SENSEisfurtherdevelopingitsfunctionasabridgebetweentheenvironmentalsciencesononehandandsocietyandenvironmentalgovernanceontheother.ThroughitsPhDprogramme,SENSEismakingamajorcontributiontothetrainingofthenextgenerationofenvironmentalresearchersandprofessionalsintheNetherlandsandinter-nationally.TheorganizationandenthusiasminthePhDprogrammeisoutstanding.Never-theless,notallmemberinstitutesfullyparticipateintheSchool’sPhDprogramme.SincethetrainingofyoungscientistsisoneofthecentraltasksofSENSE,werecommendthatstepsbetakentoincreasetheparticipationofallinstitutesintheproceduresandguidelinesoftheSchool’sPhDprogramme.
Throughtheachievementsofitsscientistsandresearchgroups,SENSEhasbecomewellrec-ognizedasamajorplayer inthefieldsofenvironmentalsciencesandglobalchange.ItwasnotedthatSENSEhasnotachievedthisreputationbybeinga“topdown”researchorganiza-tion.Infact,theSchoolhasneitherthefunds,organizationalstructure,nor(apparently)theambitiontobeatopdownresearchorganization.Instead,theSchoolcontributestoresearchmainlythroughitsnetworkingactivities–i.e.building,strengtheningandsupportingapow-erfulnetworkofenvironmentalresearchinstitutesinNL.Thisapproachexploitsthetalentsofmemberinstitutesanddoesnotchallengetheirautonomy.
WhilethelevelofnetworkingandcollaborationishighbetweenandwithinmanySENSEinstitutes, it isnotuniformlyhigh.This is unfortunatebecauseoneof themain valuesofSENSEistosupportsynergisticrelationshipsbetweenresearchgroups.Hence,highpriorityshouldbegiven toproviding incentives for increasing the levelofcollaborationwithin theSENSEcommunityandforstrengtheningtheSchool’smulti-disciplinaryapproachtoenvi-ronmentalresearch.
10 QANU/ResearchEvaluationEnvironmentalSciences�007
Acknowledgments
TheReviewCommitteewishestoexpressitsthankstothestaffofSENSEandQANUfortheirgoodwillandhelpfulnessduringthereview.Wefoundthearrangementsforthereviewtobewell-organizedandsmooth-running.
11QANU/ResearchEvaluationEnvironmentalSciences�007
1. Introduction
1.1. Scope of the Review
ThisreportispartoftheexternalreviewoftheactivitiesintheresearchschoolforSocio-Eco-nomicandNaturalSciencesof theEnvironment (SENSE).The reviewcovers the researchin theperiod�001-�006 in the researchprogrammesand institutes thatparticipate in theresearchschool,plustheactivitiesoftheresearchschoolassuch.Thismeansthattheentirereviewisonthreelevels:
• theresearchschoolSENSE.• theresearchinstitutes(WIMEK-WU,IVM-VU,IES-VU,Copernicus-UU,IVEM-RUG,
ICIS-UM)• theresearchprogrammes
This reviewwas commissioned jointlyby theBoardsof theuniversities thatparticipate inSENSE and by the Board of SENSE.The review committees were supported by QANU(Quality Assurance Netherlands Universities). QANU cooperated with SENSE to ensurecompliancewithSEPinallaspectsandtoproduceindependentassessmentreportswithpeerreviewcommitteesofinternationalexpertsintheacademicfieldsinvolved.
For the reviewof the�� researchprogrammes, five reviewcommitteeswere installed.Thefindings of the programme review committees are laid down in separate reports. For thereviewoftheinstitutesandtheresearchschool,asixthcommitteewasinstalled.ThisGeneralCommitteeconsistedofthechairpersonsofthefiveprogrammereviewcommitteesplusanindependentchairman:
• Prof.JosephAlcamo,Chairman,UniversityofKassel• Prof.AvielVerbruggen,UniversityofAntwerp• Prof.JanneBengtsson,SwedishUniversityofAgriculturalSciences• Prof.AndreaRinaldo,UniversityofPadova• Prof.WillyVerstraete,GhentUniversity• Prof.LeaKauppi,FinnishEnvironmentInstitute(SYKE).
SecretaryofthiscommitteewasRoelBennink,QANU.
ThefindingsoftheGeneralCommitteearepresentedinthisreport.
Thisreportdealswith
• theresearchschoolSENSE,withthreegeneralfunctions:• School for Environmental Researchers and Professionals• Network for Environmental Sciences• Bridge to Society and Environmental Governance.
• theresearchinstitutes(WIMEK-WU,IVM-VU,IES-VU,Copernicus-UU,IVEM-RUG,ICIS-UM)
1� QANU/ResearchEvaluationEnvironmentalSciences�007
1.2. Data Provided
TheCommitteehasreceiveddetaileddocumentationconsistingofthefollowingparts:
1. Selfevaluationreportsperinstitute�. SelfevaluationreportSENSE3. ReportontheSENSEPhDInquiry�0074. GuidelinesforCourseCoordinators;InformationbookletforPhDstudents5. CDwithallevaluationdocumentsforthe�007review.
1.3. Procedures of Review
Thereviewprocesswassetupinsuchwaythattheprogrammereviewcommitteesinterviewedthemanagementoftheinstitutesandthemanagement,staffandboardoftheresearchschool.(SeeAppendixD).AsummaryofthefindingsoftheGeneralCommitteewaspresentedtorepresentativesoftheinstitutesandSENSEintheafternoonofJune��,�007.
The reviewof the researchprogrammes and institutes follows theguidelinesof theStand-ardEvaluationProtocol�003-�009forPublicResearchOrganisations(SEP),publishedbyKNAW,NWOandVSNU.Therefore,thiselementofthereviewservesthepurposeoftheexternalqualityassessmentoftheuniversityresearch,asoutlinedinSEP.
Thereviewoftheresearchschoolfollowstheguidelinesoftheprotocolfortheaccreditationofresearchschools,developedbytheResearchSchoolAccreditationCommittee(ECOS)oftheKNAW.Thiselementofthereview(togetherwiththeresultsoftheresearchreviews)isintendedtoserveintheprocessofre-accreditationoftheresearchschoolbytheKNAW.
1.4. limitations of Review
Whiletheself-evaluationsprovidedtotheCommitteewerecomprehensiveandinformative,itisnecessaryforaCommitteeofthistypetoconstructitsownpictureoftheevaluatedorganiza-tionsthroughdirectdiscussionsandquestioningoftheorganizationsbeingevaluated.Never-theless,theCommitteeonlyhadahalf-dayfordiscussionswithSENSESchoolofficials,andonly one dayformeetingwithrepresentativesfromsixseparateSENSEinstitutes.AlthoughthemembersoftheCommitteehadspentmuchoftheweekmeetingwiththeresearchpro-grammes,theirevaluationshadbeenorganizedby discipline and groupratherthanbyinstitute.Inthefuture,ifevaluationsofmoredepthareneededoftheSchoolandthecoordinatingroleof its Institutes,werecommendthatmoretimebeallowedfor interviewswithSchoolandinstituterepresentatives.Atthesametimewerecommendthatreviewsbeheldlessfrequently(similarreviewswereheldin�000and�004).
13QANU/ResearchEvaluationEnvironmentalSciences�007
2. Evaluation of the Sense Research School
2.1. Basis for the Review
To evaluate the SENSE Research School we considered not only the material we receivedabouttheSchoolbutalsotookintoaccountinformationwecouldgleanfromourevaluationofitsconstituentinstitutesandresearchgroups.
Firstofall,weconsideredthemissionstatementoftheSchool,whichis:
Topromoteanintegratedunderstandingofenvironmentalchangeintermsofmechanismsthatcauseitandtheconsequencesthatresultfromit.ResearchandeducationinSENSEarededicatedtodevelopinghighqualityscientificresultsthatmaybeappliedtopracticallyandcriticallyinformsustainableenvironmentalgovernanceanddecision-making.
Tofulfilthismission,thecombinedprogrammesofresearchandeducationwithinSEN-SEareaimedatthedevelopmentandfurtherimprovementofscientificconceptsandme-thodsthatarerequiredforaneffectivedisciplinaryandmulti-disciplinaryunderstandingofenvironmentalchange.
Although this is certainly avaluablemission statement, itdoesnotmakeclear the relativeimportanceofthewords“research”versus“education”.Inreality,theCommitteenotedthattheBoardandmanagementofSENSEhaveneitherthefundsnorinstitutionalinstrumentstocoordinatetheresearchoforbetweenitsmemberinstitutes.Indeed,theinstitutesareautono-mous when it comes to the details of their own research plans.With regards to research,SENSEhastheroleoffacilitatingresearchcooperation,ofmaintainingquality,andsometimescatalyzingnewresearchthemes.
Indeed,afterexaminingtheSENSEResearchSchoolatall levels(researchgroups,memberinstitutes,andtheschooladministrationitself )theCommitteeconcludesthattheSchool’sde factofunctionsaretwo-fold:
• Toprovidetrainingforyoungscientistsinthemanyfieldsofenvironmentalscienceandpolicy,especiallythroughtheeducationofPhDstudents.
• Tofosterworld-classenvironmentalresearchbysupportinganationalnetworkofenviron-mentalresearchinstitutes.
Theseareveryworthwhileandadmirablefunctions,andwerecommendtheSchoolmakeitmoreclearinarevisedmissionstatementthatitsactivitiesareguidedbythem.Wehaveevalu-atedtheSchoolwithreferencetothesetwinfunctions.
2.2. The PhD Training Programme
Introduction Asnotedabove,weconsiderthePhDTrainingProgrammetobeoneofthetwocorefunctionsoftheSchool.Ouropinionisthatthisprogrammeisthe“glue”thatbindstheSENSEcom-munitytogether.
14 QANU/ResearchEvaluationEnvironmentalSciences�007
Particular StrengthsTheCommitteeconsidersthePhDprogrammeoneofthegreatsuccessesofSENSE.ThroughthisprogrammeSENSEmakesamajorcontributiontothetrainingofthenextgenerationofenvironmentalresearchersandprofessionalsintheNetherlandsandinternationally.
TheCommitteenotesthehighmotivationandenthusiasmofthePhDstudents.Averyposi-tiveaspectofthePhDProgramistheengagedmanagerialstyleoftheprogrammecoordinatorswhoareopentofeedbackandimprovements.
TheCommitteeapprovesofcurrenteffortstoimprovethesupervisionofstudentsandbettercommunicatethe“T-approach”oftheprogramme.
Wealsofindthat:
1. Theprogramiswell-organizedandcomprehensiveinthatitinvolvesin-depthdisciplinaryandmulti-disciplinarycourses,aswellasgeneralskillcourses.
�. TheorganizationalstructureoftheprogrammepromoteseffectivenetworkingwithinandoutsideoftheSENSEcommunity(Seenextsection).
3. Theprogrammeencouragesstudentstobe“entrepreneurial”inapositivesense,becauseSENSEsupportsself-organizedstudentactivities.
The committee applauds the efforts to increase the number of international and summercourses&workshopswhichwillmakethePhDcourseprogramevenmorevaluable.
Suggested Improvements
Achieving Full Participation WhiletheSchoolhasadoptedexcellentguidelinesandproceduresforPhDstudy,theseguide-linesareunfortunatelynotfollowedorrecognizedbyallthememberinstitutesoftheSchool.Forexample,notallmember institutes require theirdoctoral students to followaSENSE-authorized“IndividualTrainingandSupervisionPlan”(ITSP).The Committee believes that member institutes should be required to cooperate and comply with the School’s PhD programme or at least with a designated set of core objectives and courses. (Itmaybedesirabletomaketheselectionofmandatorycoursessomewhatdifferentforparticularmem-berinstitutesoracademicdisciplines.)WerecommendthatstepsbetakentoensurethatallinstitutesfullyparticipateintheproceduresandguidelinesoftheSchool’sPhDprogrammeunlesstherearefactorsthatmakethisimpossible.
Improving PhD SupervisionBecauseofthekeyroleofsupervisioninthesuccessofPhDstudents,wearehappytoseethatSENSEistakingstepstoimprovethissupervisionbyorganizingworkshopsonconductingandsupervisingPhDstudies,andbydevelopingadministrativeguidelinesforsupervisors.
Raising the Visibility of the S-CertificateDespitethequalityofthePhDprogram,thestudentsfeltthattheS-Certificatewasstillnotaveryvaluableassetfortheircareersbecauseitisrelativelyunknownamongpotentialemploy-ers.TomaketheS-CertificatemorevaluabletoPhDgraduates,SENSEshouldtrytoraisethecertificate’svisibilityamongtheprofessionalenvironmentalcommunity(e.g.governmentagencies,environmentalfirms).
15QANU/ResearchEvaluationEnvironmentalSciences�007
Preparing for Non-Academic Careers Itiswell-knownthataveryhighpercentageofSENSE-PhDsgointonon-academiccareers(perhaps80%).Ononehand,theSchooltakesthisintoaccountbymakingitsscientificresearch and training as relevant as possible to sustainable development issues.The “T-shaped” model of training (depth of analysis as well as on width of understanding andcommunication)isindeedveryrelevantbothforscientificcareersandforcareersoutsidescientificresearch.Ontheotherhand,CommitteebelievesthatthePhDtrainingprogramcould better prepare its students for non-academic careers.We recommend that variousactionsbetakentobroadenthetrainingprogram.Inparticular,theSchoolshouldprovidemoreopportunitiesforinteractionbetweenPhDstudentsandprofessionals.Forexample,studentsshouldbeencouragedtotakecoursestodevelop“soft”butimportantskillssuchasprojectmanagement,projectplanning,andpublicspeaking.TheSchoolshouldalsoorgan-izespecial“workfairs”wherestudentscanmeetwithpotentialemployers.
Achieving a Four-Year TargetBasedoninternationalexperiencetheReviewCommitteebelievesthatundernormalcircum-stancesfouryearsisanadequatetimeforachievingaPhDinNL.Thecommitteebelievesthatthefollowingstepsshouldbetakentoachievethefouryeartarget:
(i) continuingastrict“Go-NoGo”decisionafteroneyear,(ii) providingincentivesforpublicationsandforfinishingwithinfouryears;(iii)continuingtoprovidetimemanagementcoursesforstudents;(iv)urgingsupervisorstodevelopafouryearplanfortheirdoctoralstudents.
Maintaining the Quality of Sandwich PhD’sTheinternational“sandwichPhD”programmeisacommendableeffortatcapacitybuildingandbridgingtodevelopingcountries.However,SENSEshouldtakestepstoensurethehighresearchstandardssetbytheSchoolaremaintainedinthisprogram.SENSEshouldensurethatthenumbersofsandwichPhDstudentsacceptedbychairresearchgroupsdonotexceedthecapacityofthesegroupstoprovideadequatesupervision.
Targeting core courses to particular audiencesThecommitteebelievesthatthemandatorycorecoursesofferedbythePhDprogrammearethecoreofSENSEresearch trainingprogramme.Becauseof themulti-disciplinarynatureof theresearchinSENSEandbecausethePhDstudentshaveaverydiverseacademicbackground,thenumberofmandatorycoursescannotbeverylarge,andforthatreasontheoptionalelementsintheprogrammealsoperformaveryimportantroleinthequalityandcoherenceofthetraining.ThereforeitisimportanttoSENSEthatitsPhDstudentsfullyparticipateinbothitsmandatoryandoptionalcourses.However,therealityisthattheparticipationofPhDstudentsinoptionalcoursesisdisappointinglysmallbecausetheyareadiversegroupandoftenselectoptionalcoursesfromoutsideofSENSE.Asnotedabove,asolutionwouldbeforSENSEtomaketheselectionofmandatorycoursessomewhatdifferentforparticularmemberinstitutesoracademicdisciplines.
2.3. Research Activities
Introduction Hereweevaluatetheresearch-relatedactivitiesoftheSENSEResearchSchool.Animportantpoint tomakeat theoutset is thatSENSEhasneither the funds,organizational structure,
16 QANU/ResearchEvaluationEnvironmentalSciences�007
nor(apparently)theambitiontobea“topdown”researchorganization.Duringmanyinter-viewsitbecameclearthatvirtuallyallmembersoftheSENSEcommunityweresatisfiedwithits “bottomup”approach to setting researchprioritiesandcoordinating researchactivities.Indeed, it is theviewof theCommittee that the researchactivitiesof theSchool are (andshouldbe)concentratedonnetworkingactivities–i.e.building,strengtheningandsupport-ingapowerfulnetworkofenvironmentalresearchinstitutesinNL.(SeeSection�.1ofthisreport).Conversely,thegoaloftheSENSEResearchSchoolisnot(primarily)thecoordina-tionofafully“optimized”researchprogramme.
OuracceptanceofSENSEasprimarilyanetworkingorganizationdifferstosomedegreefromformer evaluations1.We recommend that future evaluations also judge the effectiveness ofSENSEasaresearchorganizationbasedprimarilyonitsnetworkingactivities.Withregardstothecoherenceofitsresearchprogramme–webelievethatfutureevaluationsshouldconsiderthedifficultiesinachievingresearchcoherenceamonganetworkofautonomousinstitutes.ConclusionsregardingthequalityofresearchinthevariousresearchprogrammesofSENSEarepresentedinaseparatereport.ThereforethissectionisfairlybriefandonlycoversthemainpointshavingtodowiththeSchool’sinvolvementinresearch.
Particular StrengthsTheinformationpresentedtothecommitteeclearlyshowsthatSENSEhasbecomewellrec-ognizedasamajorinternationalplayerinenvironmentalscienceandinidentifyingemergingresearchneedsinthefieldsofenvironmentalsciencesandglobalchange.
TheCommitteefindsthattheoverallresearchgoalsoftheSchoolarehighlyrelevant,namely,“To excel in scientific researchof environmental changes, bothwith regard todisciplinaryunderstandingoftherelevantissuesandwithregardtomulti-disciplinaryunderstandinginthecontextofsociety.”
ThecommitteenotesthatSENSErecognisestheneedforbridgingthegapbetweenscientificknowledgeontheonehand,andsocietyandenvironmentalgovernanceontheother.Withtheseambitiousaims,SENSEtransgressestheboundariesofregularuniversityresearch.Suchaimsarebeyond the reachof individual researchprogrammes,because they require ahighdegreeofexchange,integrationandtranslationofknowledge,andahighdegreeofinterac-tionbetweenscienceandsocietyinordertofindtherightfocusoftheresearchandtocreateadequateconditionsfortheinterpretationofthefindingsatdifferentlevels.SENSEhascre-atedauniqueplatformfortheseinteractionsbyincorporatingabroadrangeofscientistsinadedicatednetwork.
TheCommitteeapprovesofthecurrentSENSEcorethemes(seeAppendixC)andalsothedevelopmentofnewthemes.Thestructureandmanagementofthefourcorethemesaretheresponsibilityof theSENSEBoardofDirectorsandGeneralBoard.Foreachcore,aman-agerisappointedwhofosterscollaborationandexchangeofexpertise,insightsandnewideaswithin the theme but also between the themes.This is achieved through workshops, coremeetingsanddiscussiongroups.Thecommitteefindsthecurrentlydiscussedideasfornew
1e.g.“ResearchschoolssuchasSENSEseemtoplayapositiveroleinincreasingthecoherenceoftheresearchprogrammesoftheparticipatinguniversities…”(Evaluation,�000).“…thecoherenceoftheresearch…isnotverystrong”(Evaluation,�004),“Importantweaknessesarelackofdiscretionaryresearchfundsandlackoftop-downinfluenceontheresearchprogramme.”(Evaluation,�004)
17QANU/ResearchEvaluationEnvironmentalSciences�007
themestobepromisingandtheyshouldbedevelopedfurther.Wesuggest,however,thatthecorethemescanbebettercommunicatedwithinSENSE,andtotheoutsideworld,iftheyarere-formulatedaschallenging“researchquestions.”
Becauseofitsmanypublicoutreachactivities,SENSEalsoplaysavaluableroleincommuni-catingfindingsfromecologyandenvironmentalsciencestoabroadaudience.
Suggested Improvement
Fostering More CollaborationNetworksasorganizationalstructureshavelimits,andtheseshouldberecognizedinthecaseofSENSE.Anetworkneedsaneffectivehierarchyorasharedbottom-upcoherentperspec-tiveinordertoachieveahighlevelofcoherenceinitsresearchprogramme,andinthepresentsituationtheautonomyandcompetitiveforceoftheparticipatinguniversitiesdonotfosterthis.Inamultidisciplinarydomain,anetworkcandelivermorecoherencethananyformofdisciplinaryhierarchy.SinceSENSEharboursbothdisciplinaryandmultidisciplinarygroups,thisisyetanotherreasonwhyaverycoherentresearchprogrammemaynotbepossiblenordesirableinSENSE.Indeed,someamountofoverlapandperhapsgapsinresearchareasareinevitable.
Nevertheless,theCommitteebelievesthatitispossibletocontinuetoimprovethecollabora-tionbetweenitsresearchinstitutes.Thiscollaborationwouldencourageresearchsynergiesnototherwisepossible.ArewardsystemisnowneededtoencouragetightercooperationwithintheSENSEcommunity.Forexample,theallocationofresourceswithintheSENSEfamilycouldbeatleastpartlytiedtothelevelofcooperationbetweeninstitutes.
Strengthening Multi-Disciplinary ResearchAsnotedinSection�.1,oneofthekeyaimsoftheSchoolistofurther“multi-disciplinaryunderstanding”ofenvironmentalchangesbyencouragingandinitiatingmoremulti-discipli-naryresearchbetweennaturalandsocialsciences(includingeconomics).Thereforecollabo-rationbetween institutes (seepreviouspoint) should especially focusonmulti-disciplinaryresearch.TheCommitteerecommendsthatprogressindevelopingmulti-disciplinaryresearchshouldbemonitoredandmeasured.TheSENSESelfEvaluationReportdidnotsufficientlydocumentwhichgroupsandinstituteswereinvolvedinjointandinmulti-disciplinaryprojects.Financialandotherincentivesshouldalsobeofferedtoencouragethistypeofresearch.
Making the Procedure for Selecting Themes More TransparentWhile approving of the School’s core themes, the procedure for selecting these themes isunclear.It isrecommendedthatSENSEexaminesandevaluatesthisprocesstoensurethatimportantemergingissuesarecoveredandthatallmembersoftheSENSEcommunityareinvolved.
18 QANU/ResearchEvaluationEnvironmentalSciences�007
19QANU/ResearchEvaluationEnvironmentalSciences�007
3. Evaluation of SENSE Research Institutes
3.1. The Institutes
FouroftheseveninstitutesinthisreviewhaveproducedselfassessmentreportsaccordingtotheStandardEvaluationProtocol(SEP),providingalltheinformationthatSEPrequires.TheinstitutesICIS-UM,IVEM-RUGandtheRadboudUniversitydepartmentofEnvironmentalSciences (RU/ES)andtheEnvironmentalBiologygroup(RU/EB) thatarepartof theRUInstituteofWaterandWetlandResearch(IWWR)didnotproduceaseparateselfassessmentreportontheleveloftheinstitute.(Ithasbeenarguedthattheself-evaluationsoftheresearchgroupsofICISandIVEMshouldbetakenastheself-evaluationsoftheresearchinstitutessincetheleveloftheresearchgroupisthesameastheleveloftheinstitutes.RegardingIWWRofRadboudUniversity,itwasnotedthatonly�outof8ofitsinstitutesparticipateinSENSE.Therefore,theorganizersofthereviewdidnotrequestaself-evaluationfromIWWR.Finally,it was noted that two other institutes participate in SENSE – IBED of the University ofAmsterdamandCMLofLeidenUniversity.Both instituteswerereportedtoreceiveaverypositiveassessmentin�006.)
Theevaluationoftheinstitute-levelaccordingtoSEPshouldcover:
1. Leadership, strategy and policy• Whatisthequalityoftheleadership,management,strategyandpolicyoftheinstitute,
andhowcantheybeimproved?• To what extent has the institute achieved its mission and goals formulated for the
periodunderreview?• Aretheoverallmissionandgoalsoftheinstitute/researchprogrammewellchosenand
phrasedinviewoftheactualdevelopmentsintherelevantresearchfield(s)?• Whatarethescientificqualitiesandrelevanceoftheinstitute’sresearchplansandto
whatextentaretheseplansinlinewiththeoverallmissionoftheinstitute;i.e.istheresufficientcoherenceintheresearchportfoliooftheinstitute?
2. Resources, funding policies and facilities Whatisthequalityofthe(human)resources,organisationandinfrastructureandhowcan
theybeimproved?3. Academic reputation and societal relevance4. Reflection on the strengths and weaknesses the institute has formulated.
ThecommitteeheldinterviewswiththemanagementoftheinstitutesonWednesday,June�0,�007, in the sameweek inwhich theprogramme reviewcommitteeshadheld theirinterviewswiththeprogrammedirectors.InthecaseofWIMEK-WUR,RU/ESandRU/EB,IVM-VUandIES-VUtheprogrammecommitteesvisitedthe institutesandmadeatourofthefacilities.
�0 QANU/ResearchEvaluationEnvironmentalSciences�007
The size of the institutes in terms of research input in 2006 is as follows:
Institute Tenured staff Non-tenured staff
PhD-students Total research input (fte)
WIMEK-WU 18,9 16,6 64,7 100,�Copernicus-UU 10,3 7,9 �8,3 46,4IVM-VU 10,6 3,3 16,8 30,7IES-VU 3,8 4,6 13,1 �1,5ICIS-UM 1 5,3 3,9 10,3IVEM-RUG � 0,4 3,3 5,6RU/ES �,5 0,1 9,3 11,9RU/EB 1,5 3,4 5,� 10,1Total 50,5 41,6 144,6 236,6
3.2. Wageningen Institute for Environment and Climate Research (WIMEK, Wage-ningen University)
leadership, strategy and policyTheWageningenInstituteforEnvironmentandClimateResearch(WIMEK)aimstodevelopanintegratedunderstandingofenvironmentalchangeanditsimpactonthequalityoflifeandsustainability,by
(i) conductinginnovativescientificresearch,(ii) offeringPhDtrainingandeducationand(iii)disseminationofemerginginsightsandrecentresearchresults.
WIMEKhasadirector,asecretaryandonetechnicalstaffmember.Intheinterviewwiththecommittee,thedirectordescribedWIMEKasa‘programmingunit’,avirtualorganisation(nobricks),andagraduateschool.WIMEKwasfoundedin1993andexecutesabroadmulti-dis-ciplinaryfundamentalandstrategicenvironmentalresearchprogrammeatWageningenUni-versity,whichencompassesabout100ftestaff,includingthePhD’s.
WIMEK’sresearchiscarriedoutby‘chairgroups’.Theselfassessmentreportshowsalistof�0 chair groups that participate inWIMEK. In each chair group a fullProfessor, tenuredstaff,post-docsandPhDstudentsworktogetherinwell-definedresearchprojects,withintheoverallscopeofWIMEK’sresearchprogramme.MScstudentsarestimulatedtoparticipateintheseresearchprojectsbydoingresearchfortheirMScthesis.Theyareregardedaspartofthescientificcommunityandactivelyinvolvedincolloquiumseriesatchairgrouplevel.TheWUchairgroupsthatparticipateinWIMEKarehierarchicallyembeddedinoneoftheWUDepartmentsandparticipateinoneormoreGraduateSchools.Thechairgroupscontributeteachingcapacitytoanumberofbachelorandmasterprogrammes.TheEnvironmentalSci-encescluster,forinstance,consistsof5bachelorand11masterprogrammes.
ThemandateofWIMEKis:
• qualityassessmentofresearchproposalsofPhD’s(withexternalreviewers)• qualityassessmentofgroups• organisationalreviews
�1QANU/ResearchEvaluationEnvironmentalSciences�007
• adviceonappointmentofprofessors• allocatingresearchgrants(300K€peryear).
ThecommitteeremarksthatWIMEK’sbottom-upapproachtoresearchplanningiscreativebutmakesitdifficulttodevelopacomprehensiveresearchstrategyandhastheriskthatcriticalresearchquestionsareoverlooked.However,giventhelimitedresourcesofWIMEKandtheautonomyofthechairgroups,thecommitteeagreesthatbottom-upresearchplanningisper-hapsthemostfeasibleapproachforWIMEK.Infacttheapproachhasresultedinveryrelevantandimportantresults.IngeneralWIMEKhassuccessfullyconsolidatedexpertiseatWURintheenvironmentalresearcharea,andhasengagedininnovativeresearchbothwithinparticulardisciplinesandacrossthedisciplines.
Resources, funding policy and facilitiesIntheWageningen-URStrategicPlan�007–�010,theWURExecutiveBoardhasdefinedresearchprioritiesforthecomingyearsinconsultationwiththegraduateschoolsandthesci-encegroups.Theseprioritiesaimat:
• strengthening theknowledgebaseof the specializedresearch institutesbyallocationofstrategicresearchfundsfinancedbythenationalgovernment(especiallyMin.LNV)andenhancingthesynergybetweenthespecializedresearchinstitutesandtheuniversity
• identifying upcoming and fast developing research themes, which need extra financialinvestmentsindecomingyears.
For WIMEK, the following high priority research themes are of particular importance:
• Sustainabledevelopmentandadaptationofecosystemsandlandscapesinametropolitancontext(co-ordinator:Prof.Opdam,WIMEK)
• Climatechange(co-ordinator:Prof.Kabat,WIMEK)• Bio-basedeconomy• Climateresistantcoastalzones• Integrationofscalelevelsandgovernance.
WIMEKreceivesayearlybudgetofapproximately350k€fromtheWURExecutiveBoardtosupportstrategicresearchdevelopmentsbyfinancingorco-financingPhDandpost-docprojects.Thisbudgetisusedtosupportandstimulate:
• theinterdisciplinaryco-operationbetweenWIMEKchairgroups;• thesynergywithWageningen-URstrategicresearchprioritiesand• theparticipationofWIMEKchairgroupsinnationalandinternationalcollaborativere-
searchprogrammeswithintheWIMEKdomain.
Withthisbudget,WIMEKcanfund�PhD’speryear.AccordingtotheWIMEKdirectorthislimitsthenumberofnewcuriositydrivenresearchprogrammes.
ThepercentageofuniversitymoneyfortheresearchinWIMEKis�0%,thepercentageofEUandotherfundsis80%.Theteamsareflexible;groupleadersobtaintheirownmoneytodotheresearch.Thecombinationofnaturalsciencesandsocialsciencesallowstheintegrationofresearchcontributions,whichisconsideredessentialtoanalyzecomplexenvironmentalissuesandtodevelopappropriatesolutions.
�� QANU/ResearchEvaluationEnvironmentalSciences�007
IntheopinionoftheCommittee,thestrategicprioritiessetbytheWURExecutiveBoardforthecomingyearsareanexcellentcomplementtothebottom-upresearchstrategyofthechairgroups.Itisappreciatedthatabudgetof�M€peryearisavailableforpromotingthesynergybetweennatural science and social science.The themes identifiedby theuniversity rightlyplacemuchemphasisonmodel-basedopportunitiestostrengthenthelinkbetweenknowledgeandpolicy(onscalesrangingfromlocaltoglobal).
RegardingthePhDpolicy,thecommitteenotespositivelythatWIMEKhasawellthought-outPhDprogrammewhichtracksstudentsfromarrivaltograduationandcontributestoahighsuccessrateforDutchandforeignstudents.ItisnoteworthythatallWUPhDstudentswith anapprovedTSPget abudgetof€�.500 to (partly) cover the costsofPhDcourses(coursefees)andparticipationininternationalsymposiaandcongresses.ThecommitteewasinformedthatthisfinancialpolicyisuniqueforuniversitiesintheNetherlands.
Academic reputation and societal relevanceThecommitteefindsthatWIMEKhasmadegreatprogressincombiningfundamentalandappliedresearch,withparticipatoryelementsandstrategicperspective.Theinstitutehasmadeamajorcontributiontoraisingtheawarenessofthegeneralpublicandpolicymakersabouttheimportanceofglobalchange.
The WIMEK-programmes that were evaluated in this review and their scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V) are as follows:
Nr. Programme Q P R V�3 EnvironmentalSystemsAnalysisGroup 5 5 5 57 AquaticEcologyandWaterQualityManagementgroup 5 4 5 51 EnvironmentalPolicyGroup 5 4 5 4�0 SoilChemistryandChemicalSoilQualityGroup 5 4 5 3,518 MicrobiologyGroup(onlyEnvironmentalMicrobiologypart) 5 4 4 3,58 NatureConservationandPlantEcologyGroup 4 5 5 419 EnvironmentalTechnologyGroup 4 5 5 415 EarthSystemScienceGroup 4 4 4,5 4,517 SoilPhysics,EcohydrologyandGroundWaterQualityGroup 4 4 4 416 HydrologyandQuantitativeWaterManagementGroup 3,5 3 3 4,5� EnvironmentalEconomicsandNaturalResourcesGroup 3 3 4 3
Theprogrammereviewsshowthatthequality,productivity,relevanceandviabilityoftheworkisgoodtoexcellent.Theresearchcoversawiderangeofdisciplinesandshowsvariousdegreesofmulti-disciplinarity.Mostgroupsalsotranslatetheirfindingsintopolicyandpractice.Somegroupshaveexcellentconnectionswithindustry.
The stage of development differs strongly between the groups; some groups were recentlyreorganised, some show an uneven profile, understaffing or an overload of commitments.OverallexcellentscoresarerewardedtotheEnvironmentalSystemsAnalysisgroup(ESA).TheEnvironmentalPolicyGroup(ENP)alsoreceivedveryhighgrades,andhaspotentialformorecollaborativeresearchinfieldsrelatedtonaturalscience.
In thecaseof thehydrologyresearch itwasnotclear to theprogrammereviewcommitteewhytheresearchwasorganisedinthreeseparategroups.Onthenationallevelofhydrology
�3QANU/ResearchEvaluationEnvironmentalSciences�007
researchitwasnotcleartotheprogrammereviewcommitteewhatdeterminescollaborationinSENSEand/orintheBoussinesqCentre�.
Ageneralrecommendationofthecommitteeistoorganisestructuralinteractionswithgradu-atesfromthePhDtrainingtoassesstheirexperienceafteranumberofyears.
Reflection on the strengths and weaknessesTheSWOTanalysisintheselfassessmentreportgivesagoodcomprehensiveanalysis.Thecommittee agrees that WIMEK has a unique research niche by combining fundamental,appliedandparticipatoryresearch innaturalandsocial sciences.ThiscombinationenablesWIMEKresearcherstointegratecontributionsfromnaturalandsocialscienceresearch,whichisconsideredessentialtoanalyzecomplexenvironmentalissuesanddevelopappropriatesolu-tions.Theprogramme reviews confirm thatWIMEKhas a strong scientificbasis, both indisciplinaryresearchandininterdisciplinaryresearch.Thescientificquality,productivityandrelativeimpactoftheWIMEKchairgroupsisgoodtoexcellent.
WithintheorganizationalstructureofWUR,withrelativelyautonomouschairgroupsandwith strategicplanning initiatives fromtheuniversity level,WIMEKhas significantlycon-tributedtothedevelopmentofanintegrativeapproachtoenvironmentalresearch(combiningfundamentalandappliedresearch)andtoprospectiveandassessmentstudiesofenvironmental&globalchange.
3.3. Copernicus Institute for Sustainable Development and Innovation (Utrecht Uni-
versity)
leadership, strategy and policyThe Copernicus Institute for Sustainable Development and Innovation was established inMarch�001,basedonajointdecisionoftheGoverningBoardofUtrechtUniversity,thefac-ultyofGeographicalSciences(nowintegratedinthefacultyofGeosciences)andthefacultyofChemistry(nowintegratedinthefacultyofScience).Themissionoftheinstituteistoinves-tigateanddevelopprocessesandopportunitiesforinnovativechangetowardssustainability.Theinstituteseekstocontributetothedevelopmentofknowledgeandtechniquesaswellasmethodsandinstrumentsinthefieldofsustainabledevelopment,takingnoteofrelatedsocialdebatesandpolicyprocesses.
Theinstituteisamulti-disciplinarynaturalscience–socialscience(β-γ) institutewithaverybroadrangeofexpertise:
• sustainableenergy• landuse,theenvironmentandbiodiversity
�TheBoussinesqCenterforHydrologyisascientificcentrededicatedtofocussingandstrengtheninghydrologi-calresearchinTheNetherlands.Itwillalsostrivetocreatefavourableconditionsforanefficientmulti-discipli-naryresearchenvironment.TheBoussinesqCenterwillbetheumbrellaoftheuniversityhydrologygroupsofDelftUniversityofTechnology(WaterResourcesSection),UtrechtUniversity(EarthSurfaceHydrologyGroupand Hydrogeology Group), Vrije Universiteit (Department of Hydrology and Geo-environmental Sciences),WageningenUniversity(SoilPhysics,EcohydrologyandGroundwaterManagementGroupandHydrologyandQuantitativeWaterManagementGroup)andthehydrologygroupsofthetechnologicalinstitutesUNESCO-IHE(InstituteforWaterEducation,Delft)andITC-Enschede.
�4 QANU/ResearchEvaluationEnvironmentalSciences�007
• science,technologyandsociety• innovationprocessesandsystems• governancetowardssustainabledevelopment.
Fourgroupsparticipateintheinstitute:
• Science,TechnologyandSociety(STS),FacultyofScience• EnvironmentalSciences(ESc),FacultyofGeosciences• InnovationStudies(IS),FacultyofGeosciences• EnvironmentalStudiesandPolicy(ESP),FacultyofGeosciences.
TheboardoftheinstituteconsistsoftheleadersofthesegroupsandarepresentativeofthePh.D. students.Theboard is responsible for theannualbudgetand for thepreparationofthefive-yearresearchprogrammeinlinewiththefocalareasofUtrechtUniversityandthefacultiesinvolved.Thechairoftheboardisalsothescientificdirectoroftheinstitute,chargedwiththedailyleadershipoftheinstitute.Amanagingdirector,whointurnisassistedbyamanagementassistant,assiststhescientificdirector.Theinstitutehasinstalledacommitteeofcoordinatorsoftheresearchtopics.TheinstituteisinvolvedinfourMScprogrammesthatarestronglylinkedtotheresearch.
Thecommitteeregardstheorganizationalstructureandcontextoftheinstituteasverycom-plex.Majordecisions involve several faculties,departmentsandgroups. It iscommendablethat Copernicus has developed a communication plan in �00� to strengthen the internalandexternalcommunicationprocesses.Thishasledtoaseriesofactivities,suchastheyearlyCopernicussymposium.Locatingtheinstituteinasinglebuildingin�004wasalsoanimpor-tantmove.
In�006,UtrechtUniversity formulated focal researchareas.TheCopernicusInstitutepar-ticipatesinthefocalresearcharea“EarthandSustainability”.Thecommitteeappreciatesthatstrategicplanningattheinstitutehasledtoanespeciallycoherentsetofresearchthemesthatpromotethestudyofcriticalquestionsregardingsustainability.Thecommitteeishappytoseethattheuniversityisencouragingandsupportingthisstrategicplanning.
Thecommitteesupportstheconclusionofthemid-termreview�004thattheinstitutelivesuptoitsmissionandhasachievedthegoalssetforthepastyears.
Resources, funding policy and facilitiesThetotalfundingfortheresearchintheinstituteincreasedfrom�4.40ftein�001to46.09ftein�006.Theexternalfundingincreasedfrom39%in�001to61%in�006.Intheperiodunderreview,onaverage48%camefromtheuniversity,38%fromresearchfundsand14%fromcontracts.
Thepercentagesofexternalfundsforthesub-programmesintheperiod�001-�006are:
64.5%forEnergyforSustainableDevelopment61%forGovernanceforSustainableDevelopment47%forLanduse,BiodiversityandEcosystemfunctioning37.5%forDynamicsandGovernanceofInnovationsystems.
�5QANU/ResearchEvaluationEnvironmentalSciences�007
Thecommitteerecognizesthesuccessfulacquisitionofnewfunds,allowingtheappointmentofalargenumberofnewPhDstudents.SinceApril�004allgroupsarelocatedinthesamebuildingofUtrechtUniversitywhichwebelievewillenhancetocollaborationbetweengroups.Intheinterviews,thePhDstudentshaveindicatedthattherestructuringandrelocationoftheinstitutehavecreatedastimulatingacademicenvironment.
TheintroductionofanewallocationmodelwithintheFacultyofScienceofUtrechtUniver-sity,basedonfundsfrominternalandexternalsources,willprobablycreatenewopportunitiesfortenuredstaffpositions.
Academic reputation and societal relevance Theresearchprogrammeoftheinstituteiscalled‘ExploringaSustainableWorld’.Thestartingpointoftheresearchprogrammeisthelinkbetweeneconomicactivitiesandecologicalquali-ties.Theinstitutebelievesthathighqualitydisciplinaryresearchisneededtounderstandprob-lemsandissuesinthefieldofsustainabledevelopmentandtoformulatepotentialanswerstotheseissues.Theselfassessmentreportcontainsanimpressivelistofprojectsinwhichdifferentgroupsorsub-programmesoftheinstitutecooperatedintheperiodunderreview(p.8).
TheReviewCommitteerecognizesthattheinstitutehasrecentlygreatlyimproveditsrecordofpublishingscientificarticlesinkeyjournals.Thenumberofacademicpublicationsinjour-nalsandbookchaptershasdoubledbetween�001and�006,andthenumberofpublicationsinscientificjournalsincludedinthecitationindexhasalmosttripled,reflectingthepolicyoftheinstitutetofocusespeciallyonscientificjournals.Thecommitteeapplaudstheinstitute’sintentiontomaintainthislevelbyattractinghighqualitynewprofessors,employeesandvisit-ingguestsandbymakingthepublicationsmoreeasilydownloadablefromthewebsites.
The Copernicus-programmes that were evaluated in this review and their scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V) are as follows:
Nr. Programme Q P R V�5 Science,TechnologyandSocietyGroup 5 4 5 514 EnvironmentalSciencesGroup 4 3 4 46 InnovationStudiesGroup(NotSENSE) 3 3 4 45 EnvironmentalStudiesandPolicyGroup 3 3 3 �
Theprogrammereviewsshowthatthequality,productivityandrelevanceoftheworkisgoodtoexcellent.Theviabilityisverygoodtoexcellent,withoneexception.Thegroupsare,orhavethepotentialtobecome,internationalleaders.Aparticularstrengthisthebuildingofpartner-shipsandcollaboratingwithresearchersfromotherinstitutesandprivateandpublicsectorsindevelopingknowledgeandstrategiesonrelevantissues.Thecombinationofnaturalsciencesandsocialsciences,bothinteachingandinresearch,hashighpotentialbutalsoneedsadegreeofintellectualconsolidationtocounteractfragmentingforces.
Reflection on the strengths and weaknesses the institute has formulatedThecommitteeregardstheSWOT-analysisprovidedintheselfassessmentreportaverygoodoverviewoftheinstitute’sdevelopmentandresponses.Theinstitutehasmadegooduseofthe�000and�004reviews.Developmentsinsociety,inresearchandineducationhavebeenfavo-rabletothemulti-disciplinaryapproachandtheinstitutehasnotonlygreatlyprofitedfromthistrend,buthasalsomadetherightpolicydecisionsinapro-activeandresponsiveway.
�6 QANU/ResearchEvaluationEnvironmentalSciences�007
Avery importantaspect for thefurtherdevelopmentof the institute is that therearethreevacantchairs tobe filled. Thevacantchairsare forEnvironmentalSciences,DynamicsofInnovationSystems,andEnergy,MaterialsandtheEnvironment.
Thefavorableclimateformulti-disciplinaryenvironmentalresearchandeducation,withitswiderangeofsubjectsanddisciplines,haspresentedgreatopportunitiesforCopernicus,anditwillbeacontinuouschallengetomaintaincriticalmass,avoidfragmentationandincreasecoherence.
Theoverridingconclusionofthecommitteeisthattheinstitute’sintegrationofnaturalandsocialscienceswithtechnologicalresearch(spanningfundamental,strategic,andparticipatoryapproaches)makesauniquecontributiontointernationalglobalchangeandenergyresearch.
ThecommitteeagreeswiththestrategicstatementintheSWOTanalysis(p.�9)thatthecoop-erationbetweenlocalGraduateSchoolsandnationalResearchSchoolsshouldbestrengthenedfurtherinordertoimprovethequalityofthePhDeducationandtrainingprogramme.
3.4. Institute for Environmental Studies (IVM, Vrije Universiteit Amsterdam)
leadership, strategy and policyTheInstituteforEnvironmentalStudieswasestablishedin1971asthefirstacademicinstituteformulti-disciplinary researchofenvironmentalproblems in theNetherlands,originallyasanindependentinstitutewithintheVU.In�001IVMwasintegratedintothenewly-createdFacultyofEarthandLifeSciences(FALW).Aspartofthismergerprocess,IVMwasreorgan-izedintofourdepartments,eachwith�0-�5researchers:
• ChemistryandBiology(C&B)• EnvironmentalPolicyAnalysis(EPA)• EconomicsandTechnology(E&T)• SpatialAnalysisandDecisionSupport(SPACE).
Thedepartmentshavedevelopedaroundasetofcoredisciplines,methodsanddatasets.Thedepartmentsplayacriticalroleinmanagementandresearchcoordinationwithintheinstitute.EachIVMresearcherisalsoamemberofoneormoreresearchclusters,eachledbyacoordi-nator.Theseclusterswerecreatedin�005asforatodiscussscientificissues,togeneratenewideasforresearchandpublication,andtodevelopnewcompetences.Theclustersaredesignedtoencouragecross-departmentalinteraction.Currentlythereare1�clusters;anevaluationisplannedevery�years.TheresearchstrategyofIVMasawholeemergesinlargepartoutoftheresearchclusters.
Merger intothefacultyhasencouragedagreaterfocusonscientificqualityandprovidedabasisforagrowthingraduateteaching.In�005aGraduateStudiesProgrammewascreatedatIVMaspartofanewGraduateSchoolforEarth,EnvironmentandEcology(TripleE)intheFaculty.IVMrunsaone-yearMastersprogramme-Environment and Resource Management(ERM,launchedin�003)–whichattracts55-60students,overhalfofthemfromoutsidetheNetherlandsandaboutathirdfromoutsidetheEU.Theinstitutealsoteachesonanumberofbachelorscourses.
�7QANU/ResearchEvaluationEnvironmentalSciences�007
ThemanagementteamofIVMconsistsofthedirectorandtheheadsofthefourdepartments.Thedirector’sroleistoencourageastimulatingintellectualclimateintheinstitute,toleadthemanagementteam,torepresenttheinstitutetothefacultyboardandtoactasanambassadorfortheinstitutenationallyandinternationally.
ThemissionoftheInstituteforEnvironmentStudies is to contribute to sustainable develop-ment and management of the environment through scientific research and teaching. IVMaimstodoexcellentsciencethatisproblem-orientedandisusefultoawiderangeofaudiencesinscience,government, industryandcivilsociety,withintheNetherlandsandinternationally.IVM believes that curiosity-driven research is stimulated by confrontation with real-worldproblems, and that complex environmental and sustainability problems are best addressedthroughappropriatecombinationsofdisciplinaryexpertise.AfeatureofIVM’sresearchisthecapacitytoconductenvironmentalstudiesintheirsocietalandeconomiccontext.IVMaimstoreinforceitspositionasamajorEuropeancentreforenvironmentalresearch,measuredintermsofscientificandsocietalimpact.IVM’spolicyistostrengthenaresearchculturethatstimulatesinterchangebetweenresearchersandstakeholdersfromdiversebackgrounds,withintheinstituteandoutsideit.
In the interview with the committee, IVM stated that the research strategy develops as aresultof strengths,objectives, competences anddemands.Projectsneed tobe scientificallyworthwhile and contribute to sustainable development. There are bi-weekly managementteammeetingsanddiscussionsinthedepartmentsandclusters.Projectsareoftencooperativebetweenteams.Theinstrumenttosubstantiatethecollaborationisusuallyabook.
IVMisproject-basedorganization.In�00619%oftheresearchwasuniversityfunded,8%NWO,73%externalfunds.
TheReviewCommitteerecognizesthatIVMisadjustingitsactivitiessoastoplaceagreateremphasisontheoreticalresearchandpost-graduateteachinganddevelopment.TheReviewCommitteesupportsthistransitionbecauseitwillallowIVMtomakealargercontributiontothetrainingofyoungresearchersandenabletheinstitutetodevelopalonger-termstrategicplanforresearch.
The committee concludes that IVM fulfils its mission well because it makes a significantcontributiontoappliedresearchinsupportofstrategydevelopmentandidentifyingemergingissues.Itcontinuestobeapioneerinmulti-disciplinaryapproaches,especiallyregardingthehumandimensionsofglobalchange.
Resources, funding policy and facilitiesAtanyonetime,IVMresearchersareengagedinover100projects.Eachprojecthasaleaderwhoisresponsibleforthescientificandfinancialmanagementoftheproject.Projectshaveseparatebudgets;thecoordinationoftheworkflowattheinstituteishandledbydepartmentalprojectleadermeetings.Mostprojectsarelarge,butIVMregardssmallprojectsasusefulfortheflowofknowledgetoscientificandotheraudiences.Thecommitteebelievesthatthetac-ticofusingflexibleresearchclustershelpstheinstitutetoeffectivelyrespondtonewresearchopportunities.
Theproportionofdirectfundingrosefrom11%in�000to19%in�006.Thestrategyoftheinstituteistoincreasetheproportionofdirectfundingtoabout30%,primarilybyincreas-
�8 QANU/ResearchEvaluationEnvironmentalSciences�007
ingitsteachingactivities.Theaimistomovetowardsapositionwhereaboutone-thirdoftheincomeiscorefunding.Thecommitteeagreesthatthiswillprovideforabetterbalancebetweenfundamentalandappliedresearch,enablesynergiesbetweenresearchandteaching,andmaketheinstitutelessvulnerabletochangesinresearchprioritiessetbyoutsidefundingorganizations.
Academic reputation and societal relevance IVM’s researchprojects are typically carriedout in teams, frequently in collaborationwithresearchersinotherinstitutions,withinandoutsidetheNetherlands.ThecommitteeapplaudstheeffortsofIVMtorecruittalentedscientistsfromoutsidetheNetherlands.
Teamwork,collaboration,multi-disciplinarityandproblem-orientationleadingtointeractiveresearchdesignareallkeyaspectsofresearchpracticeatIVM.
Intheareaofsocio-ecologicalinteractions,thefocusoftheresearchisonchemicalcontami-nantsandwaterquality.Intheareaoftheanalysisofhumanresponses,theresearchcoversa broader range of economic valuation and incentive structures, analysis of environmentalgovernanceandpolicy inseveraldomains,andthestudyof socialbehaviors inresponse toenvironmentalchange.
ThecommitteeconsidersitawisedecisionthatIVMworksonanumberofintegrating research themesinwhichtheinstituteregardsitselfasleadingatthenationalandinternationallevel,andwheretheinstituteexpectstomakemajorcontributions.Forthecomingperiodtheinte-gratingresearchthemesare:
• Managing climate and adaptation (theroleoftechnologicalchangeonmitigationstrate-gies;thedevelopmentoflong-termmitigationandadaptationpoliciesintheinternationalcontext;theassessmentofclimateadaptationstrategiesfortheNetherlandsandinterna-tionally)
• Governing water resources (theapplicationofspatialanalysistosupportdecisionsonwaterresources; the use of economic analysis and policy instruments in water management;theevolutionofnewapproachesforadaptivewatergovernancetakingaccountofuncer-tainty)
• Assessing emerging pollutants (thedevelopmentandtestingofnewmeasurementandana-lyticaltechniques,onrisk-basedtoxicityprofilingofnewpollutants,andondevelopingalternativestoanimaltesting)
• Shaping sustainability transitions (understanding of social and technological change inprocessesoflong-runtransitionstowardssustainability;policiestowardssustainablesys-teminnovations).
AnotherwisechoiceisthatIVMaimstodevelopspecificandintegratedmethodsforanalyz-ingenvironmentalproblems.ThesemethodsaredeployedacrossthefullportfolioofresearchcarriedoutatIVM.Afocusformethodologicaldevelopmentinthecomingyearswillbe:
• Environmental measurement and assessment techniques• Decision-making processes and tools• Models and approaches for valuing environmental change and management options• Methods for analyzing policies and strategies to govern environmental resources and services.
�9QANU/ResearchEvaluationEnvironmentalSciences�007
Thecommitteeregardsthemissionandgoalsoftheinstituteaswellchoseninviewofthedevelopmentsinthefield.ThisisalsoevidencedbythebibliometricanalysiswhichshowsthatIVM’sfourdepartmentsallachievehighscores.
The IVM-programmes that were evaluated in this review and their scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V) are as follows:
Nr. Programme Q P R V4 EnvironmentalPolicyAnalysisGroup(EPA) 5 4 4 5�1 ChemistryandBiologyGroup(C&B) 5 4 4 43 EconomicsandTechnologyGroup(E&T) 4 5 4 3�4 SpatialAnalysisandDecisionSupportGroup(SPACE) 4 4 4 4
Theprogrammereviewsshowthatthequality,productivityandrelevanceoftheworkisverygood to excellent.The viability is good to excellent.Thework is relevant to the scientificcommunityandtocivilsocietyorganizations,andnationalandinternationalenvironmentalpolicy.Intheareaofchemicalandbiologicalexposureandeffectsmeasurement,theresearchisconsideredtobeamongthebestinternationally.Theworkonspatialanalysisanddecisionsupportplacesastrongemphasisonnaturalsystemsmodelingandhydrology/climate,andtheprogrammereviewcommitteerecommendsplacingmoreemphasisonriskanalysisinordertobettersupportthemissionofscienceandpolicyintegration.
Reflection on the strengths and weaknesses the institute has formulatedThe SWOT-analysis in the IVM self evaluation report shows an ambitious attitude and aclearappreciationofopportunitiesandthreats.Theadjustedstrategytowardsabetterbalancebetweenfundamentalandappliedresearch,andtowardsgreatersynergybetweenresearchandteaching,isfullysupported.ThestructureandleadershipofIVMareinexcellentshapeforthechallengesthatthetransitionposes.Theinstitutemakesasignificantcontributiontoappliedresearchinsupportofstrategydevelopmentandidentifyingemergingissues.Itcontinuestobeapioneerinmulti-disciplinaryapproaches,especiallyregardingthehumandimensionsofglobalchange.
Inlinewiththemulti-disciplinaryobjectivesofIVM,theDepartmentofChemistryandBiol-ogyshouldworkmorecloselywiththeIVMdepartmentsconcernedwiththehumandimen-sionsofglobalchange.AnalternativewouldbetoconcentratenaturalscienceexpertiseinthefieldofenvironmentalsciencesintheInstituteofEcologicalScience(IES-VU).
3.5. Institute of Ecological Science (IES, Vrije Universiteit Amsterdam)
leadership, strategy and policyTheInstituteofEcologicalScienceoftheFacultyofEarthandLifeScienceswasestablishedin�001.Atthattimeitconsistedoffourdepartments:AnimalEcology,SystemsEcology,Ecol-ogyandPhysiologyofPlants,andTheoreticalBiology,whichcooperatedinaveryloosestruc-ture.Afterre-organizationin�003,onlytwogroupsarenowpresentwithintheIES:AnimalEcologyandSystemsEcology.Theresearchisorganizedalongfourlines,inwhichmembersofbothdepartmentsareinvolved:
30 QANU/ResearchEvaluationEnvironmentalSciences�007
• climatechange• plant-soilinteractions• stressecology• ecologicalgenomics.
Thesethemesaretackledatlevelsrangingfromthemolecular-toecosystem-.Themissionoftheinstituteistoachieveandmaintainaninternationallyrecognizedpositioninthesefourfields.Thefundamentalecologicalquestionsthattheinstitutetacklesarefurtherspecifiedinthreecategories:
• therelationshipbetweenbiodiversityandthestructureofecologicalcommunities,payingspecialattentiontoevolutionary adaptationtoenvironmentalchange;
• theecologicaleffectsof stress factors in theenvironmentandthemechanismsbywhichanimalsrespondandadapttothesefactors;
• howglobalchangefactorsaffectbiodiversityandecosystemfunctioningandmakingpro-jectionsoffuture ecosystem behaviorbasedontheresultsobtainedtodayandfromthepastbothbyexperimentationandmodeling.
IESemploys5�persons,�5fteresearchinput.Thetenuredstaffis8.8fte,ofwhichis3.4researchfte(theirothertaskisteaching).Theoutputpertenuredstaffis19publicationsperyear.
TheorganizationalstructureofIESisrelativelylight.Theorganizationwithinthefacultyissuchthattheinstitutedirectorsdonotcontroltheallocationofbudgetstothedepartments.Theheadsofthedepartmentshavearelativelyhighlevelofautonomy.BothdepartmentsinIEShaveasimilarorganizationalstructurewithaheadofdepartmentandweeklymeetingsofthedepartmentandofthestaff.Theresponsibilityforthequalityandinnovationoftheresearchthemesoftheinstituteliesprimarilywiththeprogrammeleaders.Accordingtotheselfevaluationreportthishasproventobeasuccessfulapproach.Themaintaskoftheinstituteistoidentifycommonthemesandpossibilitiesforfunding.
Duringtheevaluationperiod,theresearchstrategyoftheinstitutehasconsiderablychangedinordertoincreasethestrengthandtheviabilityoftheinstitute.Thecommitteefindstherecentre-organizationanddevelopmentsatIEStobeverypositive.
ThecommitteenotesthatIEShasanexcellentPhDpolicy,providingintensivepersonalsuper-visionandastimulatingacademicatmosphere.Thepolicyinvolvesregularmeetings,intensivepersonalsupervisionbythedailysupervisorandregularfeed-backbytheheadofdepartment.Since1985allPhDstudentsfinishedtheirstudieswithaPhDdegree,exceptintwocases.Inmostcasesthemanuscriptforthethesisisdeliveredbytheendofthefour-yearcontractandthedefenseisscheduledinthefifthyearafterthebeginningoftheproject.ThePhDstudentsfollowtheSENSEtrainingprogramandoftentakeadditionalcoursesfromFunctionalEcol-ogyorfromtheVU.Forpracticalandstatisticalskillstheyarefurthertrainedbylabtechni-ciansandstaff.
Resources, funding policy and facilitiesOnaverage43%oftheIESresearchstaffisfundedbyNWOand33%bytheuniversity.Theremainderisfinancedbycontractresearch.TheinstituteaimstomaintainthishighlevelofexternalfinancingbyfocusingonNWOfunds.
31QANU/ResearchEvaluationEnvironmentalSciences�007
Theinstitutehaswell-equippedlaboratories,buttheselfassessmentreportstatesthatfinancesfromtheuniversityareundersuchpressurethatinthelong-termIESmightnotbeabletoreplaceexistingequipmentorinvestinnewtypesofequipment.Atpresentthefacilitiesandequipmentareofthehighestquality.ThemolecularlaboratoriesareequippedforDNAfin-gerprinting,quantitativePCRandaccesstoasharedgeneticanalyzerforsequencing.Equip-mentforchemicalanalysisincludesanAtomicAbsorptionSpectrophotometerfortracemetaldetermination,ahighperformanceliquidchromatographysystemforhydrocarbonanalysisandequipmentforsubstance-specificisotoperatioanalysis.FortheexperimentalworkIEShasgreenhouses,climateroomsandanexperimentalgarden.FieldworkisperformedinLapland,Spitsbergen,Antarctica,andtheNetherlands.
ThecommitteebelievesthattheuniversityshouldprovidemoresupportforIES,especiallymorespaceandfundstomaintainanadequateinfrastructure.
Academic reputation and societal relevance Thescientificpublicationoutputoftheinstituteperunittenuredstaffishighintermsofqual-ityandquantity.ThenumberofPhDthesesfrom�001hasincreasedsignificantly.
ThesocietalrelevanceoftheworkwashighlightedbyintensediscussionswithorthodoxIslamicstudentsinthecourseonHumanEvolution,followedbymediacontributionsonevolutionandIntelligentDesignin�005.IESalsoorganizedmeetingswithnaturemanagementorgani-zationstopresenttheresultsofthebiodiversityresearchandtoshowtheimplicationsarefortheirmanagementactivities.
The IES-programmes that were evaluated in this review and their scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V) are as follows:
Nr. Programme Q P R V10 SystemsEcologyGroup 5 5 4 5�� AnimalEcologyGroup�:EcotoxicologyandEcogenomics 4 5 4 59 AnimalEcologyGroup1:CommunityandEvolutionary
Ecology4 3 4 4
11 TheoreticalBiologyGroup 4 3 3 3
Theprogrammereviewsshowthatthequality,productivity,relevanceandviabilityoftheworkisgoodtoexcellent.Someinterestingcombinationsofscientificapproachesofferexcellentperspec-tivesforthefuture.Intheviewoftheevaluators,thepotentialtowardspolicyandmanagementhasnotbeenfullyrealized,butdevelopmentsaremovingintherightdirection.Thepotentialofsomeofthetheoreticalworkforawideracademicaudiencewouldmeritanextraeffort.
Reflection on the strengths and weaknesses the institute has formulatedThecommitteeobservesthattheinstitutehasshownconsiderableinnovationoverthelastsixyears.Newstaffhavebeenappointedandlargeresearchgrantshavebeenattractedfrompres-tigiousfunds.Theinvestmentsinmolecularfacilitiesandinmassspectrometryhaveprovento be fruitful.The choice of themes and the strategic adjustments are very good and theinternationalreputationhasincreasedasaresultofparticipationininternationalresearchnet-worksandvisitingguestresearchers.TheresearchprogrammereviewsshowthatIESismakingimportantcontributionstoanumberoffieldsofecologicalscienceincludingground-breakingworkinenvironmentalgenomics.
3� QANU/ResearchEvaluationEnvironmentalSciences�007
WhileIEShasachievedmuch,thecommitteerecommendsthatIESincreaseitscontributionstoSENSE.InparticularIESshouldcontributeitsexpertiseinfundamentalecologicalsciencetojointmulti-disciplinaryprojectswithinSENSE.
3.6. Centre for Energy and Environmental Studies (IVEM, Rijksuniversiteit Gro-ningen)
leadership, strategy and policyThegeneralcommitteedidnotinterviewtheIVEMmanagement.AseparateselfassessmentontheinstitutelevelalongthelinesofSEPwasnotprovided.
TheCentre forEnergy andEnvironmental Studies IVEM is an independent research andeducationcentrewithintheFacultyofMathematicsandNaturalSciences(FMNS)oftheUni-versityofGroningen.IVEMoriginatesfromtwopredecessorgroupsworkingonenergyandenvironmentalissuessince1973.IVEMaimstoanalyze,design,andassesstransitionroutestowardsamoresustainableandenvironmentallycompatiblesocietaluseoftheearth’snaturalresources.TheIVEMresearchisinterdisciplinaryandrootedinnaturalsciencesandtoalesserextentinsocialsciences.
TheCentrehasathreememberdirectorate(electedsemi-annually)underthechairmanshipoftheprofessorofenvironmentalsciences.Thedirectoratemeetsonaregularbasis.ThefullCentreboardmeetsfourtimesayear.TheCentreconductsregularstaffmeetingsinwhichrelevantresearchandeducationissuesarediscussedandappropriateplansandstrategyareproposedoradjusted.Decisionsonscientificstrategy,educationalprogrammesandbudgetplansaremadebythedirectorateincloseconsultationwiththestaffmembersconcerned.FormalappointmentsofpersonnelfinancedbytheUniversityofGroningenaremadebytheBoardofFMNSuponproposalsforappointmentbytheIVEMdirectorate.DecisionsonspecificprojectsaremadebythestaffmembersconcernedandincaseofPhDprojectsbytheco-promoterinclosecooperationwiththepromoter.ThecompactsizeofIVEMisreflectedinitsinformalstyleofmanagementaimedatfacilitatingandstimulatingresearchandeducation.
IVEMandtheRUGCentreforIsotopeResearch(CIO)jointlyofferatwoyearEnglish-lan-guagebasedMScdegreeprogrammeinEnergyandEnvironmentalSciences.IVEMisakeyparticipantintheEnergyDeltaResearchCentre(EDReC)oftheUniversityofGroningen.
Since�000 IVEMmanages theuniversity-wide sustainabilityproject and it is increasinglyinvolvedinsustainability-relevantteachingandresearchactivitiesbothwithinandoutsidetheuniversity.
Resources, funding policy and facilitiesTheinstituteisverysmall,butrelativetoitssizeithasaconsiderablenumberofPhDstudents.Theinstituteisstronglysupportedbyuniversityfunding.
Academic reputation and societal relevance ThetransitionprocesstowardsanequitableandsustainableworldisatthecoreoftheIVEMresearchprogrammeentitled:‘Transitiontowardssustainabilityandenvironmentalquality’.
33QANU/ResearchEvaluationEnvironmentalSciences�007
Theprogrammeismainlydirectedatthedevelopmentofbasicscientificmethodologiessuchaslifecycleanalysis,energy-basedinput-outputanalysis,processanalysis,computermodeling,integratedassessment,scenariobuildingandgaming.Appliedstudiesexplorespecific issuessuchasfoodandenergyconsumptioninhouseholds.Thefocusisonbasicresearch;secondaryattentionisgiventomoreappliedresearchissuesthataimtoachievebothscientificcredibilityandtransferofknowledgetosocietalgroups.ThenumberofpublicationsinA-categoryjour-nalshasincreasedconsiderablyinthelastyear.
In the programme review the IVEM-programme received the following scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V):
Nr. Programme Q P R V�6 IVEM:CenterforEnergyandEnvironmentalStudies 3 4 4 3
Theprogrammereviewshowsthatthequality,productivity,relevanceandviabilityoftheworkisgoodtoverygood.Thestrategicchoiceofthisgrouptofocusontheroleofcustomersisregardedasoriginalandinnovative.Thesocietalrelevanceofthegroupisdemonstratedbyitsregionalfunctionincommentingoncurrentdevelopments.
Reflection on the strengths and weaknesses the institute has formulatedTheSWOTanalysisstatesthatIVEMisacompactandvitalcentrewithacoherentandstrongsenseofmission.IVEMproducedasubstantialnumberofgoodqualityPhDthesesandpeerreviewedpapersandhastheambitiontocontinuealongtheselines.IVEMisstronglysup-portedby its faculty and theUniversityofGroningenaswell asby itsmembershipof theEnergyResearchCenter(EDReC)andtheCentreforDevelopmentStudies(CDS).AstrongpointisalsothatIVEMandtheCentreforIsotopeStudiesoffertheinternationalMScpro-grammeEnergyandEnvironmentalSciences.
The non-central geographic location in the Netherlands gives the institute a particularsocietalandscientificpositionintheSENSESchool.Theprogrammereviewcommitteeremarkedthatthegroupseemssomewhatisolatedandcouldbenefitfrommorenationalcooperation.
3.7. International Centre for Integrated Assessment and Sustainable Development (ICIS, Universiteit Maastricht)
leadership, strategy and policyTheInternationalCentreforIntegratedAssessmentandSustainableDevelopmentICISisaresearchinstitutewithinMaastrichtUniversity.Itisaself-supportingbusinessunitreportingtotheDeanoftheFacultyofHumanitiesandSciences.
ThegeneralcommitteedidnothaveaninterviewwiththeICISmanagement.AseparateselfassessmentontheinstitutelevelalongthelinesofSEPwasnotprovided.
ICISstartedin1998anddevelopedintoaninternationalexpertisecentrefortheintegratedassessmentofsustainabledevelopment.ICISstartedwithateamof5people,andexpandedto35ftearound�001.Thecurrentsizeoftheresearchstaffisabout�1people.Since�004theinstitutehasfocusedondevelopingintegratedassessmentmethodsandtoolstoaddresskey
34 QANU/ResearchEvaluationEnvironmentalSciences�007
sustainabilityissues.Fromitsinception,ICIShasalsocontributedtoeducationalprogrammesinanumberoffacultiesofMaastrichtUniversity.
ThemissionofICISistostimulateintegrationinsustainablethinkingandpracticeatdiffer-entlevelsofsocietybyresearch,educationandtheinformingofpolicy.Inordertoachievethis,ICISdevelopsandappliesinnovativeintegrateddecisionsupportandresearchtoolsthataddressandenhanceunderstandingofissuesofsustainability.
ICISidentifiesitsstrengthasitsconcretefocusonsustainabilityproblems.Coreactivitiesarethedevelopmentandimprovementofintegratedassessment(IA)methods,toolsandproce-duresinsupportofsustainabledevelopmentpractice.Currentmethodologiesareparticipatorymethods, scenarios, indicatoranalysis andIAmodeling techniques.The selectionof topicsreflectstheprioritiesandresearchagendasofnationalandinternationalresearchprogrammes,butthefocusoftheresearchgroupiswideandlackssomecoherence.Thenumberofprioritythemeslistedishighforsuchasmallgroup.
ICIShasaflatorganizationalstructurewithacoregroupof11multi-disciplinaryresearchers/PhDsand10affiliatedstaff-researchers.Emphasisisplacedonpersonalresponsibility,astrongcommitment,atransparentmanagementandmonitoringstructure.
ICIScollaboratescloselywithotherresearchgroupsintheuniversity.StrongcollaborationalsoexistswithotherSENSE-partnersinthefieldofintegratedassessmentandsustainabledevel-opment.Theinstitutegeneratesaround�0researchproposalsannually.
Resources, funding policy and facilitiesThesix-yearaveragepercentageofuniversityfundedfteinresearchwas13%,NWO-funds�4%,contracts63%.Theinstitutefollowsastrategyofincreasingtheproportionofuniversityfunding,primarilyby increasing its teachingactivitiesandbydeveloping theirownmasterSustainableDevelopmentin�007.Thiswillprovideabetterbalancebetweenfundamentalandappliedresearch,andenabletheinstitutetoexploitsynergiesbetweenresearchandteach-ing,whilemakingitlessvulnerabletothecyclicbehaviorofresearchfunding.
Academic reputation and societal relevanceTheselfassessmentreportstatesthatthescientificandsocietalvalueofICISresearchisreflectedinfrequentlyrequestedadvicebypolicymakersandprofessionalorganizations,reportstomin-istriesandNGOs,andinterviewsfornewspapers,radioandtelevision.
In the programme review the ICIS-programme received the following scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V):
Nr. Programme Q P R V�7 ICIS:InternationalCentreforIntegratedAssessment
andSustainableDevelopment3 4
4 3
The programme review shows that the quality, productivity, relevance and viability of theresearchisgoodtoverygood.
35QANU/ResearchEvaluationEnvironmentalSciences�007
Reflection on the strengths and weaknesses the institute has formulatedTheSWOTanalysismentionsasapotentialweaknessthedangerthatitsresearchprogramcouldbecometoobroadorvague.ICIStriestoovercomethisbyfocusingonspecificprob-lems,toolsandmethodologies,butregardsthecurrentinstitutionalsupportasinsufficienttodealadequatelywiththerapidlychangingfieldofintegratedassessmentofsustainabledevel-opment.
AlthoughICIShasgoodcontactswithotherresearchgroupswithinSENSE,theprogrammereviewcommitteestronglyrecommendsthatthiscooperationbefurtherintensified.
3.8. Radboud University: Environmental Sciences and Environmental Biology
Thetworesearchgroupsevaluatedinthisreview,aresub-groupsintheInstituteforWaterandWetlandResearch(IWWR),whichisoneofthefiveresearchinstitutesintheFacultyofSci-enceofRadboudUniversity,Nijmegen.
Ontheinstitutelevel,noselfassessmentreportwasprovided.Thegeneralcommitteedidnothaveaninterviewwiththeinstituteorgroupmanagement.
TheDepartmentofEnvironmentalSciences(RU/ES)participatessince�004inIWWR.Cur-rently,RU/ESemploys5ftetenuredand1�.6ftetemporarystaff,includingPhDs.Theten-uredstaffspendsabouthalfofitstimeonteaching,i.e.6coursesintheBSc-Biologyand8coursesintheMSc-EnvironmentalSciences.TheMScprogrammeiscoordinatedbyRU/ES.
TheresearchgroupEnvironmentalBiology(RU/EB)isanintegralpartoftheInstituteforWetlandandWaterResearch(IWWR).Thegrouphas1.5fteresearchinputfromtenuredstaff,3.38ftenon-tenuredand5.17ftePhDstudents.Accordingtotheselfevaluation,sinceFebruary�007thenumberofPhDstudentshas increased to17,and thenumberofMScstudentsto15.
In the programme review the RU/ES and RU/EB groups received the following scores for Quality (Q), Productivity (P), Relevance (R) and Viability (V):
Nr. Programme Q P R V13 EnvironmentalBiologyGroup 4 3 4 41� EnvironmentalSciencesGroup 3 3 4 4
The programme review shows that the quality, productivity, relevance and viability of theresearchisgoodtoverygood.
BecausenoinformationontheleveloftheresearchinstituteIWWRwasprovided,noseparateassessmentoftheinstitutewasmade.Fortheassessmentsoftheprogrammes,werefertothereportoftheprogrammereviewcommitteeonEnvironmentalBiologyandEcology(EBE).
36 QANU/ResearchEvaluationEnvironmentalSciences�007
3.9. Overview of programme scores per review committee
cee nr. code programme institute Q P R V
ESEP
1 WU-ENP EnvironmentalPolicyGroup WIMEK 5 4 5 4� WU-ENR EnvironmentalEconomicsandNatural
ResourcesGroupWIMEK 3 3 4 3
3 VU-E&T EconomicsandTechnologyGroup IVM 4 5 4 34 VU-EPA EnvironmentalPolicyAnalysisGroup IVM 5 4 4 55 UU-ESP EnvironmentalStudiesandPolicy
GroupCOPERNICUS 3 3 3 �
6 UU-ISG InnovationStudiesGroup(NotSENSE)
COPERNICUS 3 3 4 4
EBE 7 WU-AEW AquaticEcologyandWaterQuality
ManagementgroupWIMEK 5 4 5 5
8 WU-NCP NatureConservationandPlantEcologyGroup
WIMEK 4 5 5 4
9 VU-AE1 AnimalEcologyGroup1:CommunityandEvolutionaryEcology
IES 4 3 4 4
10 VU-SE SystemsEcologyGroup IES 5 5 4 511 VU-TB TheoreticalBiologyGroup IES 4 3 3 31� RU-ES EnvironmentalSciencesGroup RU 3 3 4 413 RU-EB EnvironmentalBiologyGroup RU 4 3 4 414 UU-ES EnvironmentalSciencesGroup COPERNICUS 4 3 4 4
EES 15 WU-ESS EarthSystemScienceGroup WIMEK 4 4 4,5 4,5
16 WU–HWM HydrologyandQuantitativeWaterManagementGroup
WIMEK 3,5 3 3 4,5
17 WU-SEG SoilPhysics,EcohydrologyandGroundWaterQualityGroup
WIMEK 4 4 4 4
ECM
EB
18 WU-MIB MicrobiologyGroup(onlyEnvironmentalMicrobiologypart)
WIMEK 5 4 4 3,5
19 WU-ETE EnvironmentalTechnologyGroup WIMEK 4 5 5 4�0 WU-SOQ SoilChemistryandChemicalSoil
QualityGroupWIMEK 5 4 5 3,5
�1 VU-C&B ChemistryandBiologyGroup IVM 5 4 4 4�� VU-AE� AnimalEcologyGroup�:
EcotoxicologyandEcogenomicsIES 4 5 4 5
ISS �3 WU-ESA EnvironmentalSystemsAnalysisGroup WIMEK 5 5 5 5
�4 VU-SPACE SpatialAnalysisandDecisionSupportGroup
IVM 4 4 4 4
�5 UU-STS Science,TechnologyandSocietyGroup COPERNICUS 5 4 5 5�6 RUG-IVEM IVEM:CenterforEnergyand
EnvironmentalStudiesIVEM 3 4 4 3
�7 MU-ICIS ICIS:InternationalCentreforIntegratedAssessmentandSustainableDevelopment
ICIS 3 4 4 3
Q = Quality ESEP = Environmental Sociology, Economics and Policy StudiesP = Productivity EBE = Environmental Biology and EcologyR = Relevance EES = Environmental Earth SciencesV = Viability ECMEB = Env. Chemistry, Microbiology, Ecotoxicology and Biotechnology
ISS = Integrated Assessment, Sustainable Systems Analysis and Spatial Management
37QANU/ResearchEvaluationEnvironmentalSciences�007
3.10. Overview of scores per institute
nr. code WIMEK Q P R V�3 ESA EnvironmentalSystemsAnalysisGroup 5 5 5 51 ENP EnvironmentalPolicyGroup 5 4 5 47 AEW Aquatic Ecology and Water Quality Management
group5 4 5 5
�0 SOQ SoilChemistryandChemicalSoilQualityGroup 5 4 5 3,518 MIB MicrobiologyGroup(onlyEnvironmentalMicrobiology
part)5 4 4 3,5
8 NCP NatureConservationandPlantEcologyGroup 4 5 5 419 ETE EnvironmentalTechnologyGroup 4 5 5 415 ESS EarthSystemScienceGroup 4 4 4,5 4,517 SEG SoilPhysics,EcohydrologyandGroundWaterQuality
Group4 4 4 4
16 HWM Hydrology and Quantitative Water ManagementGroup
3,5 3 3 4,5
� ENR Environmental Economics and Natural ResourcesGroup
3 3 4 3
nr. code Copernicus Q P R V�5 STS Science,TechnologyandSocietyGroup 5 4 5 514 ES EnvironmentalSciencesGroup 4 3 4 46 ISG InnovationStudiesGroup(NotSENSE) 3 3 4 45 ESP EnvironmentalStudiesandPolicyGroup 3 3 3 �
nr. code IVM Q P R V4 EPA EnvironmentalPolicyAnalysisGroup(EPA) 5 4 4 5
�1 C&B ChemistryandBiologyGroup(C&B) 5 4 4 43 E&T EconomicsandTechnologyGroup(E&T) 4 5 4 3
�4 SPACE SpatialAnalysisandDecisionSupportGroup(SPACE) 4 4 4 4
nr. code IES Q P R V10 SE SystemsEcologyGroup 5 5 4 5�� AE� AnimalEcologyGroup�:Ecotoxicologyand
Ecogenomics4 5 4 5
9 AE1 AnimalEcologyGroup1:CommunityandEvolutionaryEcology
4 3 4 4
11 TB TheoreticalBiologyGroup 4 3 3 3
nr. code ICIS Q P R V�7 ICIS International Centre for Integrated Assessment and
SustainableDevelopment3 4 4 3
nr. code IVEM Q P R V�6 IVEM CenterforEnergyandEnvironmentalStudies 3 4 4 3
nr. code Radboud Q P R V13 EB EnvironmentalBiologyGroup 4 3 4 41� ES EnvironmentalSciencesGroup 3 3 4 4
38 QANU/ResearchEvaluationEnvironmentalSciences�007
39QANU/ResearchEvaluationEnvironmentalSciences�007
APPENDICES
40 QANU/ResearchEvaluationEnvironmentalSciences�007
41QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix A: Evaluation of the SENSE Research School According to ECOS Criteria
ThisreportpresentsanevaluationoftheSENSESchoolbasedoninterviewswiththemanage-mentofSENSEanditsconstituentinstitutes,aswellasself-evaluationsandotherinformationprovidedtothecommittee,andreviewsoftheresearchprogrammeswithinSENSE.
TheSENSEResearchSchoolforSocio-Economic and Natural Sciences of the Environment wasestablishedin1994andaccreditedbytheKNAWin1997forthefirsttimefora5-yearperiod1997-�001.In�00�,theSENSEResearchSchoolwasaccreditedforanotherfive-yearperiodonthebasisofapositiveassessment.TheresultsoftheMidtermReview�004andthepresentpeerreviewevaluationofEnvironmental Sciences 2007 willaccompanytherequestforrenewalofaccreditationthatSENSEwillsubmittotheKNAWinDecember�007.
General conclusion regarding re-accreditationIntheopinionofthecommittee,SENSEfulfilsthecriteriaforre-accreditationoftheresearchschool.Theconsiderationsforthisconclusionaredescribedinthefollowingparagraphs.
ECOS 1: Structured Training
ThecommitteehasdeterminedthatSENSEprovidesitsPhDstudentswithathoroughtrainingforbecomingindependentresearchers(inclosecooperationwithitsinstitutes).AllSENSEPhDstudentsparticipateinaSENSE-organizededucationalprogrammewhichenablesstudentsto:
• conductresearchinasystematicandproductiveway,• workeffectivelyinaninternationalarena,• contributetoanimprovedunderstandingofthecausesandeffectsofenvironmentalpro-
blemsandofpossiblesolutions,• positiontheirownresearchinamulti-disciplinarycontextand• translateenvironmentalproblemsintorelevantsoundresearchproposals.
DuringtheirtrainingtherightsandobligationsofthePhDstudentsandSENSEstaffareclear.EachPhDstudentparticipatinginSENSEformulatesatailor-made“IndividualTrainingandSupervisionPlan”(ITSP),incloseconsultationwithhisorhersupervisor.TheITSPisineffectanagreementoneducationandsupervisionreachedbythePhDstudentandSENSE,stipulat-ingthetasksofthePhDstudentandtheaccompanyingsupervision.
ThePhDcoursesincludeanintroductorycourseEnvironmentalResearchinContext,anumberof specialized and broadening PhD courses, and general skills courses. Most elements areoptional,butsomearemandatory.EachPhDcandidatewhohasfulfilledtheSENSEtrainingrequirements (equivalent to30ECTS;where1ECTS=�8hourswork load), including thePhD-thesis,receivestheSENSE CertificateissuedbytheBoardoftheResearchSchool.SENSEnowalsooffersthepossibilitytopublishPhDthesesinaSENSESeries.ThepercentageofPhDstudentsgraduatingwithaSENSECertificate(indicatingthattheyfollowedthefulleducationalprogramme),hasmorethandoubledto34%ofthePhDstudentswhostartedin�001orlater.
Thecommitteehasseenalistof34titlesofcoursescurrentlyorganizedbySENSE(oftenincooperationwithotherresearchschools).ThebackgroundCDcontainedtheinformationfly-ersofthreeofthesecourses.Aspecificationofthelearningobjectivesofthecourseswasnot
4� QANU/ResearchEvaluationEnvironmentalSciences�007
provided.Asecondlistshowedthetitlesofabout50externalcoursesacceptedbySENSEasspecializedPhDcourses.Theseexternalcoursesareofferedbyotherresearchschools,graduateschoolsandinstitutes.
ThecommitteenotesthatitwouldbeintheinterestofthestudentsandofSENSEtogivewiderpublicitytotheopportunitiesthatthetrainingprogramprovides.
ECOS 2: Scientific Mission
Thecommitteebelieves thatSENSEhasaclearde facto scientificmission,namelytotrainyoungenvironmentalscientistsandtoadvanceenvironmentalresearchthroughnetworking.SENSEincorporatesseveralhighqualityresearchgroupswhoareactiveparticipantsinmanynationalandinternationalnetworks,andissuccessfulinacquiringoutsidefunding.(seepara-graphonResearchComponent)
ECOS 3: Independent Organization
Thiscriterionconcernstheformal/legalstructureoftheResearchSchool.Theseaspectswerenotevaluatedbythecommittee.
ECOS 4: Cooperation within Nl
The committee has ascertained that SENSE is active in developing cooperation with keyorganizationsintheNetherlandsandabroad.Theresearchgroupscontributetoimplementa-tionofknowledgeinsocietybycooperatingwithpartnersingovernmental,non-governmentalandindustrialorganizations,rangingfromlocalwaterboardstoglobalpanels.Theyareactiveinpolicyconsultancyandpublicdebates.Therearenumerousmembershipsofadvisorycom-mitteesandmanagementboardsonenvironmentalandsustainabledevelopmentissues.
Intermsofinter-andintra-universitycooperation,SENSEorganizessymposiaandmeetingstoexchangeinformationonnewresearchactivitiesandresearchlinesinordertostimulatemutualcontactsandcooperationbetweentheSENSEresearchersandtoavoidunnecessaryoverlapinresearch.Thecooperationbetweenthegroupsischaracterizedasinformalandself-organ-izing.SENSEstimulatescooperationbetweensocio-economicandnaturalsciences,investinginanewgenerationofyoungscientistscapableofbridgingthedisciplinaryapproachesandofinteractingeffectivelywithsocietalbodies.
ECOS 5: Critical Mass
Thecommitteeregardsthetrainingcapacityasadequateforitsmissionandsize.TheSENSEResearchSchoolisnowhosttomorethan300PhDstudentsandalmost�00seniorresearch-ers.Thefundingofthecoursesispartlybasedonstudentfeesandpartlyoncoursesubsidiesfromtheuniversities.
ECOS 6: Project Portfolio
SENSEhasdelegatedtheresponsibilityfortheadmissionofPhDcandidatestothepartnerinstitutes.For example, tobe accepted as aWIMEKPhD student at theSENSE researchschoolrequiresthefollowingsteps:
43QANU/ResearchEvaluationEnvironmentalSciences�007
• FormaladmissionofthePhDcandidatetotheWUPhDprogramme,basedon(i)pre-viousacademictraining(atleastMSclevel);(ii)proficiencyinEnglishlanguageand(iii)sufficientfinancialsupport;
• SubmissionofafullPhDproposaltotheWIMEKdeskforapproval,atleast6monthsafterthestartdateofthePhDstudent;
• AssessmentofthefullPhDprojectproposalbytwoindependentexternalexpertson(i)scientificquality,(ii)scientificandsocietalrelevanceand(iii)feasibility;
• Drawingup an IndividualTraining andSupervisionPlan (ITSP) and submission to theSENSEeducationdeskforapproval,withinsixmonthsafterthestartofthePhDstudent.
ThecommitteeconsiderstheprocedureusedbytheSchoolanditsconstituentinstitutesforselectingPhDstudentsandtheirprojectstobeverygood.
ECOS 7: Collective Training
TheSchoolprovidestrainingprogrammeswithbothcollectiveandindividualelements.Toobtaintherequired30ECTS,PhDstudentsfollowtheirowntailor-madeprogramme,withaminimumof14ECTSofcompulsoryelements.
Many(international)guestresearchers/lecturersareinvolvedintheSENSEcoursesandsum-merschools.
Thequalityassuranceformembership,trainingandsupervisioninSENSEishigh.Thecom-mitteeespeciallyappreciatesthepolicydecisiontopayattentiontoimprovingsupervision.
ECOS 8: Post Doc Policy
Thecommitteehasnotseparatelyassessedthiselement.
ECOS 9: links with Graduate Programmes
Thecommitteehasseenpositiveexamplesoflinkswiththegraduateprogrammesinthepar-ticipatinguniversities,butthesituationwasnotfullydocumentedfortheentireschool.Theincreasinglycloserelationsbetweenlocalgraduateprogrammes(especiallyresearchmasters)andthe localPhDtrainingwilloffernewopportunitiesandchallengesforSENSE.Strongcooperation on the issues of multi-disciplinarity and the environmental perspective areexpectedtoremainanaddedvalueoftheSENSEnetwork.
ECOS 10: Accountability
ThecommitteehasascertainedthatSENSEproducesannualaccountsofpolicyandresults.The very adequate informationprovided for the current 6-year evaluation, shows that theSENSEnetwork is capableof self-critical evaluationson thebasisof good internalqualityassuranceandimprovementprocedures.
44 QANU/ResearchEvaluationEnvironmentalSciences�007
45QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix B: ECOS-criteria for (re)accreditation of research schools
Thefollowingelementsarederivedfromtheprotocolfortheaccreditationofresearchschools,developedbytheResearchSchoolAccreditationCommittee(ECOS)oftheRoyalAcademyofArtsandSciences(KNAW).
1. Structured trainingThe research school provides a thorough and institutionalized training for independentresearchers,withclearlydefinedrightsandobligations.
b. Isthetrainingandthecoachingclearlystructured,bothinthecollectiveandintheindi-vidualcomponents?
c. Aretheobjectivesofthetrainingandcoachingclearlydefined?d. Istheobjectiveofthetrainingprogrammedescribedintermsoftheprofessionalareasin
whichthetraineeswillbeemployed?e. Aretherightsandobligationsoftrainersandtraineesclearlydescribed?
2. Scientific missionTheresearchschoolhasaclearscientificmission.Theresearchdomainiswelldefinedandcontainsoneormorespecificcentralresearchquestions.Theschoolaccommodatesoneormoreresearchgroupsofprovenhighqualityatnationalandinternational level.Theschoolcooperatesactivelywithresearchgroups in thecountryandabroad.
b. Isthescientificmissionclearlydefinedandconvincinglyexplained?c. Does the schoolhold a sufficiently strongposition in the relevant researchdomain in
termsofthenationalandinternationalscientificcommunity?d. Istheresearchportfoliocoherentanddoesitdemonstrateadequateplanning,implemen-
tationandconcretescientificproduction?e. Does the schoolactivelycooperatewithresearchgroups in thecountryandabroad,as
evidencedbyjointpublicationsorprojects?f. Doestheschoolaccommodateresearchgroupswithahighperformancelevelintermsof
internationalqualitystandards,asevidencedbypublicationsoftheparticipatingstaffintheprecedingfiveyears?Dothesestaffmembersspendanadequateproportionoftheirappointmentontheirparticipationinthetrainingandresearchoftheschool?
g. Intheprecedingfouryears,towhatextenthavetheresearchgroupssucceededinobtai-ning funds from national funding councils, international funding organizations, otherexternalfundsandfromcontractresearch?
3. Independent organizationTheresearchschoolfunctionsasanindependentorganizationalunitwithbudgetandmanage-mentresponsibilities,andtheuniversityoruniversitiesconcernedguaranteesufficientfundingfortheplannedcapacityforaperiodofatleastfouryears.
Theresearchschoolisestablishedinaccordancewiththerelevantlegalarticles(WHW9.�0,9.�1,9.��,or9.�3).
46 QANU/ResearchEvaluationEnvironmentalSciences�007
ThetasksandresponsibilitieswithintheSchoolareclearlydelegatedtobodiesoftheSchool.
a. DoestheSchoolfulfillthelegalrequirementsoftheWHWregardingtheresearchschoolofoneormorefacultiesoruniversities?
b. Havethefacultydeanordeansdefinedaresearchprogrammeforatleastfouryearsanddoestheboardoftheresearchschoolhavetheresponsibilitytodefinetheannualresearchprogramme?
c. Havesufficientresponsibilitiesforpersonnelandmaterialmanagementbeentransferredtotheboardoftheresearchschool?
d. Havetheuniversityoruniversitiesconcernedguaranteedsufficientfundingfortheplannedcapacityforaperiodofatleastfouryears?
e. Aremanagementandorganizationoftheschoolwellestablished?
4. Intra- and interuniversity cooperationResearchgroupswithsimilarorcomplementarymissionswithinthesameuniversityorfromseveraluniversitiescancooperateinaresearchschool.Theschoolcanalsomakemulti-annualagreementsforcooperationwithresearchinstitutesfromNWO,TNO,DLO,KNAW,large-scaletechnologicalinstitutes(GTI’s),andotherresearchinstitutes.Thegovernmentalandfinancialresponsibilitiesoftheschoolarebornebyoneuniversityorseveraluniversities;inthelattercasetheprimaryresponsibilityfortheschoolisbornebyoneoftheparticipatinguniversities.
b. Havethepossibilitiesforintra-andinteruniversitycooperationbeensufficientlyexplored?c. Inthecaseofparticipationfromseveraluniversities,aretheresponsibilitiesofthecom-
missioninguniversityadequatelydescribed?d. Hassufficientattentionbeenpaidtoopportunitiesforcooperationwithpara-university
ornon-universityinstitutes?
5. Critical massTheoptimalsizeoftheresearchschoolisdeterminedbyprogrammaticconsiderations,per-sonnel,organizationalstructure,fundingsources,thepotentialsupplyofPhDstudents,thelabormarketforPhDgraduates.Aguidelinefortheminimumsizeofaschoolisaresearchand training capacity for at least 40 research trainees, which is equivalent to an annualintakeof10persons.Inexceptionalcasesasmallersizeispermissible,ifpropermotivationisprovided.
b. Isthefundingguaranteedfortrainingtherequirednumberofpersons?c. Hasevidencebeenpresentedthatthereisadequatecapacityfortheteachingandsupervi-
sionofthetrainees?d. HassufficientattentionbeenpaidtothelabormarketperspectivesofthePhDgraduates
oftheschool?
6. Project portfolio Theresearchschoolhasaprogressivemulti-annualprojectportfolio,basedoncarefulselec-tion,prioritizationandapprovalofresearchprojects,withanestablishedprocedureforselect-ingPhDstudents.
b. Isthereaproperprocedureforselecting,prioritizingandapprovingprojectproposalsforPhDstudents?
47QANU/ResearchEvaluationEnvironmentalSciences�007
c. DotheproceduresandcriteriaforselectingPhDstudentsensureagoodqualityoftheresearchtrainees?
7. Collective and individual trainingTheresearchschoolprovidesbothcollectiveandindividualtrainingprogrammesandsupervi-sion,withintheframeworkoffouryears.
a. Doestheselectionofsenior-researcherschargedwithtrainingandresearchsupervision,ensurehighqualityperformance?
b. Doestheschoolhavesufficientfundingforattractingguestresearchersandguestlecturersandhavesuchpersonsactuallybeenemployedintheprecedingfouryears?
c. Is there an adequate internal quality assurance for the training and supervision?
8. Post doc policyTheschoolhassufficientpossibilitiesforappointingnationalandinternationalresearchersinthepostdoctoratephase.
Doestheschoolhaveanadequatepolicyandsufficientfinancialmeansforappointingnationalandinternationalpost-docsandisthereanadequatebalancebetweentheteachingandresearchtasksofthepost-docs?
9. links with graduate programmes Theacademicstaffoftheresearchschoolalsoperformstasksintheuniversitygraduatepro-grammes.
a. Isevidencepresentedof interactionbetweentheresearchschoolandthegraduatepro-grammes?
10. Accountability Theresearchschoolprovidesanannualaccountofthepolicyandtheresults.Theschoolpro-videsadequateinformationforevaluatingitsperformanceaftersixyears.
48 QANU/ResearchEvaluationEnvironmentalSciences�007
49QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix C: SENSE Disciplinary fields and Core Themes
TheSENSEResearchProgramme�001–�006isstructuredwithdisciplinaryfieldsandcorethemes.Thedisciplinesprovidethelong-termresearchbasis,thecorethemesreflecttheshortertermscientificcollaborations.
Thethreedisciplinary fieldsinSENSEare:
1. Natural sciences at the smaller scales (molecular and microscopic processes, and sin-gle organism in well defined soil or water samples)
Disciplinesinthisfieldincludeenvironmentalchemistry,physics,microbiology,biotechnol-ogy,physiology,ecogenomics, ecotoxicologyandsoil chemistry.The researchconducted inthis fieldoften involvesseveralof thesedisciplines.Also,relativelywell-definedsystemsarestudied.The research leads to, for example,newpathways for soil remediation, innovativewaste-watertreatmentplantsandsettingenvironmentalstandards.
2. Natural sciences at larger scales (from species, communities, plot and fields, land-scape, ecosystem, watershed to the whole biosphere)
Disciplines include terrestrial,aquaticandsystemsecology,hydrology, soil science,geologyandatmosphericsciences.Processesatthelocaltoregionallevelarestudiedandofteninte-gratedacrossdifferentenvironmentalcompartments,suchassoils,slopesandriversorspeciesinteractingwiththeirenvironment.
3. Regional and global change, especially climate changeThesedisciplines focus at integrating thehuman activities andbehavior into environmen-talscience.Thedisciplinesincludeearthsystemscience,systemsanalysis,economics,sociol-ogy,politicalanddecisionsciences.Inviewoftheir integrativenature,alsomethodologicalapproachessuchasgeographicinformationsystems,spatialenvironmentalmodelingandpar-ticipatoryintegratedassessmentsaredevelopedandappliedinthisfield.
Thefourcore themesinSENSEare:
1. MicropollutantsStudiesontheeffectsofmicropollutantsincreasinglyfocusonthebiologicalresponsestotoxi-cantstressatthemolecular(ecologicalgenomics),organismandpopulationlevelecotoxicol-ogy,biodiversity).Thedevelopmentofnewanalyticalorbiological-basedmethodstomeasureexposureandeffectsofmicropollutantsisanimportantnewgoal.Integrativemodelsarenowalsodevelopedtopredictmicropollutantbehaviorincomplexenvironmentalsettings.Allthisshouldcontributetothedevelopmentofbetterenvironmentaltechnologiesandtherestora-tionofrenewablecyclesofmatterandenergy.Emergingandfuturefociofresearchincludepolarorganiccompounds,ecologicalgenomics,integrativemodelingandsustainablelandandwateruse.
2. Environmental Change and Ecosystem DynamicsThe research focuses on fluxes of energy, water, carbon, nutrients and toxicants as well aschangesinpopulations,ecosystems,landscapeandbiomes.Theissuesarestudiedbylabora-toryexperiments,fieldobservationsandmodeling.Thebalancebetweenecology,hydrologyandatmosphericscienceswillshifttowardsmoreaquaticsystems.Inthefieldofhydrology,thereisanincreasingawarenessthatspecificfunctions,especiallyirrigation,
50 QANU/ResearchEvaluationEnvironmentalSciences�007
have to be considered in the context ofwater resourcemanagement.The sequestration ofCO�requiresenhancedunderstandingofcarbonflowsanddynamics.Thisallrelatestowaterstorage,biomassproductionandbio-geochemicalcyclingresearchinthisthemebutalsotoresearchgroupsinotherCorethemes.
3. Global Change: Climate, land Use and Biogeochemical CyclesThemulti-andtransdisciplinaryresearchaimstoaddresstheneedsofmanagersofecosystemservices,local,regionalandnationalgovernmentsandinternationalbodiesandtheinterna-tionalassessmentprocesses.Majortoolswillbeintegratedassessmentmodels,combinedwithGISandtheemerginglargedatabasesofspatialpatternsandtemporaltrends.Thefocuswillshiftawayfromjustunderstandingthecausesandconsequencesofclimatechangetowardsthesustainablemanagementofglobalandregionalenvironmentalchange.Newregionaladapta-tionstudieswill focusonwatermanagementandnature.Extremeevents,suchasexcessiveprecipitation,droughtsandtheirconsequenceswillbeaddressed.
4. Industrial Transformation: Towards Sustainable Use of Energy and MaterialsTheresearchemphasisismoreandmoreonstrategiesthatcanhelpindevelopingandadopt-ingsustainablewaysofproductionandconsumption.Thethemewillincludesocialchangeandsustainabledevelopment,methodologicaldevelopmentandintegration,andnewgovern-ancearrangementsforsustainabledevelopment.Achallengeistocombinerigorousscientificresearchwithotherstakeholders’tacitknowledge,perceptions,andvalues.
The self-evaluation states that initiatives are mounting to add a new core theme “spatial analysis and modeling”.Itsemphasiswillbetomeasurepropertiesandrelationships,takingintoaccountthespatiallocalizationofthephenomenonandusethistoimproveunderstand-ingofthesystemicdynamicsofthestudiedsystems.Spatiallyexplicitphenomenaarekeyfea-turesofmanyenvironmentalissuesandsustainabledevelopment(multi-scale,multi-domain,intergenerational)andthismakesitarealchallengetomodel.Itrequiresawayofmodelingthattakestheessentialrolesofspatialandtemporaldistributionintoaccount.ThisthemeiscurrentlyexpandingrapidlyandseveralSENSEresearchgroupshaveengagedindevelopinginnovativetoolsandmethods.Thisisalsothefirstcorethemethatfocusesontoolsthatareusefulforalldisciplinaryandinterdisciplinaryfields.Theunderlyingstatistics,largedatabasesandtheirexploration,andspecificmodelingapproachesareuniqueenoughtopromptadedi-catedcoremanagerandactivities.Thisthememayprobablybecomeoperationallate�007.
Anothermethodologicalthemethatcouldemergeinthenearfutureisstakeholder involve-ment and participatory integrated assessment.Theseapproacheshaverecentlybecomemorepracticalandareurgentlyrequiredinapplyingenvironmentalknowledgebecauseofthepressingpolicyneeds.
ThestructureandmanagementofthefourcorethemesaretheresponsibilityoftheSENSEBoardofDirectorsandGeneralBoard.Foreachcore,amanagerisappointedwhofosterscol-laborationandexchangeofexpertise,insightsandnewideaswithinthethemebutalsobetweenthethemes.Thisisachievedthroughworkshops,coremeetingsanddiscussiongroups.
51QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix D: Schedule of the General Review Committee (actual program varied from what is shown)
WUR �8. WageningenInstituteforEnvironmentandClimateResearch(WIMEK)VUVU
�9. InstituteforEnvironmentalStudies(IVM)30. InstituteofEcologicalSciences(IES)
UU 31. CopernicusInstituteforSustainableDevelopmentandInnovationAll 3�. SENSEResearchSchool
SUNDAY 17-06-2007 Utrecht�0.00–��.00 Meetingchairs
WEDNESDAY 20-06-2007
Utrecht
09.00–10.00 Meetingchairs(withoutBengtsson)10.00–11.00 PresentationCvB-WU+WageningenInstituteforEnvironment
andClimateResearch(WIMEK/WU)11.00–1�.00 PresentationCvB/FB-UU+CopernicusInstituteforSustainable
DevelopmentandInnovation(Copernicus/UU)nr.311�.00–13.00 Lunchbreak13.00–14.00 Meetingchairs14.00–15.00 PresentationFB-ALW+InstituteforEnvironmentalStudies
(IVM-VU)nr.�915.00–16.00 Presentation(InstituteofEcologicalSciences(IES-VU)nr.3016.00–17.00 PresentationsInstituteofEnvironmentalSciences(CML-LU)and
InstituteforBiodiversityandEcosystemsDynamics(IBED-UvA)17.00–18.00 Meetingchairs18.00–�0.00 Dinner
ThURSDAY 21-06-2007
Utrecht
09.00–10.00 MeetingChairs10.30–1�.00 PresentationanddiscussionSENSEResearchSchool,including
CoreThemes1�.00–13.00 Lunchbreak13.00–14.00 PresentationPhDeducationandtrainingprogramme14.00–15.00 MeetingwithSENSEPhDcouncil15.00–17.30 Meetingchairs18.00–�0.00 Diner
FRIDAY 22-06-2007
Utrecht
09.00–10.30 MeetingwithSENSEDirectorsandBoard10.30–1�.00 Meetingchairs1�.00–13.00 Lunch13.00–15.00 Presentationpreliminaryconclusionsperchairgroup15.00–15.15 Coffee&Teabreak15.15–16.15 PresentationpreliminaryconclusionsonSENSEinstitutesand
SENSEResearchSchool16.15–17.30 Drinksandclosure18.00–�0.00 Diner
5� QANU/ResearchEvaluationEnvironmentalSciences�007
Programme review committees:1. Environmental Sociology, Economics and Policy (Prof.AvielVerbruggen,Prof.KenGreen,Prof.MichaelRedclift) 2. Environmental Biology and Ecology (Prof.JanneBengtsson,Prof.LucdeMeester,Prof.SteveOrmerod) 3. Environmental Earth Sciences(Prof.AndreaRinaldo,Prof.HannesFlühler,Prof.RolandSchulze) 4. Environmental Chemistry, Microbiology, Ecotoxicology and Technology (Prof.WillyVerstraete,Prof.ColinJanssen,Prof.LaurentCharlet)5. Integrated Assessment, Sustainable Systems Analysis & Spatial Management(Prof.LeaKauppi,Prof.ThomasJohansson,Prof.WilliamLafferty)
53QANU/ResearchEvaluationEnvironmentalSciences�007
PART II: REPORTS OF ThE PROGRAMME REVIEW COMMITTEES
54 QANU/ResearchEvaluationEnvironmentalSciences�007
55QANU/ResearchEvaluationEnvironmentalSciences�007
General remarks about the programme review procedures
Harmonisation of scoresDuringthesitevisitsandduringthefinalisationofthereports,theprogrammereviewcom-mitteeshavepaid specific attention to thecriteriaused for the scores for scientificquality,productivity,relevanceandviability,andtothepossibilityofanunwanteddegreeofvariabilityinthescoresbetweenthereviewersorthecommittees.AllcommitteeshaveusedthecriteriaoftheSEP-scaleandinallcasesthescoresweresettledbythecommitteeasawhole.Duringthesitevisit,alistofallscoreswasprovidedtothechairpersonsofthecommitteeswiththespecificpurposeofcheckingwhethertherewereanyindicationsforanunwanteddegreeofvariabilityinthescores.Itwasdecidedthattherewerenoobvioussignsofunfoundeddiversity.Alsointhecourseoffinalisingthegeneralreport,thecommitteechairshavepaidattentiontothescoresforallprogrammesinordertosafeguardasmuchaspossiblethatthemeaningofthescoresofonecommitteedidnotdivergefromthoseofanothercommitteeinthisreview.
However, assessing the quality of research is not an exact science.The assessments of theresearchprogrammesareexpressedintextandinscores.Thescoresbythemselvesarenotagoodbasisforpolicydecisions;theymustbeinterpretedinrelationwiththetextandinthecontextofthereview.
Criteria used for the scores on Quality and ProductivityThecommitteeshaveusedthecriteriaspecifiedinSEP:
“Qualityistobeseenasameasureofexcellenceandexcitement.Itreferstotheeminenceofagroup’sresearchactivities,itsabilitiestoperformatthehighestlevelanditsachieve-mentsintheinternationalscientificcommunity.Itrestsontheproficiencyandrigourofresearchconceptsandconduct; itshowsinthesuccessofthegroupattheforefrontofscientificdevelopment.
Productivityreferstothetotaloutputofthegroup;thatis,thevariegatedwaysinwhichresultsof researchandknowledgedevelopmentarepublicised.Theoutputneeds tobereviewedinrelationtotheinputintermsofhumanresources.”
Indicators for Quality specified by SEP are the originality of the approach and ideas, sig-nificanceofthecontributiontothefield,coherenceoftheprogramme,publicationstrategy,prominenceof theprogrammedirector,prominenceof theothermembersof the researchgroup,qualityofscientificpublications(scientificimpact),qualityofotherresults.
IndicatorsforProductivityspecifiedinSEParethenumberofstaff,numberofPhD-theses,numberofscientificpublications,numberofprofessionalpublications,otherresults(ifappli-cable),distributionofpublishedoutputwithinthegroup.
Theweightassignedtoeachcriterionisnotafixedentity,andtheproductivityscoresarenotbasedonapurelynumericalcalculationofthenumberofpublicationsperf.t.e.inresearchorontherelativeimpactofthejournalarticles.Factorstakenintoaccountaretheprominenceofthepublicationmedium,theinternationalrecognitionandinnovativepotential.Ultimately,theassessmentsarebasedontheexpertiseandexperienceofthereviewersandthecommitteeasawhole,withinthecontextofthisreview.
56 QANU/ResearchEvaluationEnvironmentalSciences�007
Variability in the groupsThecommitteeshaveconsideredvariabilityinoutputamongthestaffmembersasoneoftheaspectsintheassessmentofqualityandproductivity,inaccordancewithSEP.Thecommitteesareawarethatsomestaffmemberswillbemoreinvolvedinresearchandothersineducation,managementoracquisition.Agooddivisionoftaskscontributestothequalityofteachingandresearch.Itisinevitable,however,thattherecanbequalitydifferencesbetweengroupsinwhichseveralexcellentresearcherssucceedinproducinghighoutputandgroupswithmorevariability.
Stage of development of a groupThecommitteesagreethatitisimportanttotakeintoaccountifagroupwasrecentlyestab-lishedorhasbeenoperativeformanyyears.Generallyspeaking,thecommitteeshaveattachedmoreimportancetotherecentperformanceofagroupandtotheirpotentialforthefuture,thantothe‘average’performanceoverthewholeperiodunderreview.
External reviewersThecommitteeshavereceivedadvicefromanumberofexternalreviewersthatwerecontactedbySENSEtocomplementtheexpertiseinthecommittees.Thecommitteeshavetakentheiradviceintoaccount.Withinthecontextofthereview,thefinalresponsibilityfortheassess-mentsrestswiththereviewcommittees.Specificremarksareincludedintheresponseofthecommittees.
Thechairpersonsoftheprogrammereviewcommittees,
Prof.AvielVerbruggenEnvironmentalSociology,EconomicsandPolicy(ESEP) Prof.JanBengtssonEnvironmentalBiologyandEcology(EBE) Prof.AndreaRinaldoEnvironmentalEarthSciences(EES) Prof.WillyVerstraeteEnvironmentalChemistry,Microbiology,EcotoxicologyandBiotechnology(ECMEB)Prof.LeaKauppiIntegratedAssessment,SustainableSystemsAnalysis&SpatialManagement(ISS)
57QANU/ResearchEvaluationEnvironmentalSciences�007
Committee Environmental Sociology, Economics and Policy Studies (ESEP)
58 QANU/ResearchEvaluationEnvironmentalSciences�007
59QANU/ResearchEvaluationEnvironmentalSciences�007
1. The review committee and the review procedures
Scope of the assessment and structure of this reportTheReviewCommitteewasaskedtoperformanassessmentofsixresearchprogrammesinEnvironmentalSociology,EconomicsandPolicyStudies.Thisassessmentcoverstheactivitiesandtheresearchintheperiod�001-�006.Theassessmentispartofthe�007reviewoftheNetherlandsResearchSchoolforSocio-EconomicandNaturalSciencesoftheEnvironment(SENSE).Institute ProgrammeWIMEK-WUR 1. EnvironmentalPolicyGroup(ENP)
�. EnvironmentalEconomicsandNaturalResourcesGroup(ENR)IVM-VU 3. DepartmentofEconomicsandTechnology(E&T)
4. DepartmentofEnvironmentalPolicyAnalysis(EPA)Copernicus-UU 5. EnvironmentalStudiesandPolicyGroup(ESP)
6. InnovationStudiesGroup(ISG;notinSENSE)
TheCommittee'stasksweretoassessthequalityoftheresearchprogrammesonthebasisoftheinformationprovidedbytheInstitutesandthroughinterviewswiththeresearchleaders,andtoadvisehowthisqualitymightbeimproved.
PartI,chapter1describesthecompositionoftheCommittee,itsactivitiesandtheproceduresfollowedbytheCommittee.PartI,chapter�containsgeneralremarksaboutthestateoftheartinEnvironmentalSociol-ogy,EconomicsandPolicyStudies.PartIIcontainstheassessmentoftheprogrammes.
Composition of the CommitteeThecompositionoftheCommitteewasasfollows:
• Prof.AvielVerbruggen,UniversityofAntwerp,chairofthecommittee• Prof.KennethGreen,ManchesterBusinessSchool • Prof.MichaelRedclift,King’sCollegeLondon.
Roel Bennink of the Bureau of QANU (Quality Assurance Netherlands Universities) wasappointedsecretarytotheCommittee.
AshortcurriculumvitaeoftheCommitteemembersisincludedinAppendix1.
IndependenceAllmembersof theCommittee signeda statementof independence to safeguard that theywouldassessthequalityoftheInstituteandresearchprogrammesinanunbiasedandinde-pendentway.Anyexistingpersonalorprofessionalrelationshipsbetweencommitteemembersandprogrammesunderreviewwerereportedanddiscussedinthecommitteemeeting.TheCommitteeconcludedthattherewerenocloserelationsordependenciesandthattherewasnoriskintermsofbiasorundueinfluence.
Data provided to the CommitteeTheCommitteehasreceiveddetaileddocumentationconsistingofthefollowingparts:
60 QANU/ResearchEvaluationEnvironmentalSciences�007
6. Selfevaluationreportsperinstituteandperprogramme7. Copiesofthreekeypublicationsperprogramme8. BibliometricstudySENSE1996-�0059. Self-evaluationandbackgroundmaterialaboutSENSE,includingaCDwithallevalua-
tiondocumentsforthe�007review.
ThedocumentationincludedalltheinformationrequiredbytheStandardEvaluationProto-col(SEP).
Procedures followed by the CommitteeThe Committee proceeded according to the standard Evaluation Protocol (SEP). Prior totheCommitteemeeting,eachprogrammewasassignedtoafirstandasecondreviewer,whoformulatedapreliminaryassessment.ThefinalassessmentsarebasedonthedocumentationprovidedbytheInstitutes,thekeypublications,theinterviewswiththeprogrammeleadersandthePhDpostersessions.TheinterviewstookplaceonJune17,18and19,�007(seethescheduleinAppendix3).
Precedingthe interviews, theCommitteewasbriefedbyQANUaboutresearchassessmentaccording toSEP.TheSENSEmanagementgaveapresentationabout theSchool.Onthesame day, June 17, �007, the Committee discussed the preliminary assessments. For eachprogrammeanumberofcommentsandquestionsweredecidedupon.TheCommitteealsoagreeduponproceduralmattersandaspectsoftheassessment.Sitevisitswerenotheld.AllinterviewstookplaceinUtrecht.AftertheinterviewstheCommitteediscussedthescoresandcommentsandmadedrafttexts.Thetextswerefinalisedthroughemailexchanges.ThefinalversionwaspresentedtotheInsti-tutesandSENSEonAugust1,�007.ThecommentsoftheInstitutesandSENSEweredis-cussedintheCommitteeandledtochangesinthereportonanumberofpoints.Thefinalreportwaspresented toBoardsof theparticipatinguniversities andwasprintedafter theirformalacceptanceofthereport.TheCommitteeusedtheratingsystemoftheStandardEvaluationProtocol(SEP).Themean-ingofthescoresisdescribedinAppendix�.TheCommitteeadheredstrictlytotheassessmentelementsprescribedinSEPwithreferencetothescores.
61QANU/ResearchEvaluationEnvironmentalSciences�007
2. General remarks
ThemissionofSENSEistopromoteanintegratedunderstandingofenvironmentalchangeintermsofmechanismsthatcauseitandtheconsequencesthatresultfromit.FromtheSENSEperspective,thecommondenominatoroftheresearchprogrammesinthisreviewisthattheyareaimedatthedevelopmentandfurtherimprovementofscientificconceptsandmethodsthatarerequiredforsuchanintegratedunderstanding.
InSENSEterms,thedisciplinaryfieldfortheseprogrammesis‘Regionalandglobalchange,especially climate change’.These disciplines focus at integrating the human activities andbehaviourintoenvironmentalscience.TheCorethemetowhichtheprogrammesrelatemostis‘IndustrialTransformation―TowardsSustainableUseofEnergyandMaterials’.Theresearchemphasisinthisthemeisonstrategiesthatcanhelpindevelopingandadoptingsustainablewaysofproductionandconsumption.Thisincludessocialchangeandsustainabledevelop-ment,methodologicaldevelopmentand integration,andnewgovernancearrangements forsustainabledevelopment.AccordingtoSENSE,achallengeinthisfieldistocombinerigorousscientificresearchwithotherstakeholders’tacitknowledge,perceptions,andvalues.
InthesixprogrammesinEnvironmentalSociology,EconomicsandPolicyStudiesevaluatedby this committee, the scientific concepts and methods include ecological modernisation,appliedeconomics,governanceandpolicyanalysis,newsocietalarrangementsandtheanalysisof(technological)innovation.
Thecommitteehasassessedtheresearchprogrammesontheirownindividualmissionandmerit,notonlybecausethatiswhattheStandardEvaluationProtocol(SEP)requires,butalsobecausetheinformationprovidedtothecommitteedidnotprovideabasisforahigherlevelassessmentofthe(potential)contributionoftheseprogrammestoanintegratedunderstand-ingofthecausesandresultsofenvironmentalchange.Theprogrammesarenot‘just’partofSENSE,butinthefirstinstancetheyareuniversityresearchprogrammeswithcloselinkstoadiversityofuniversityteachingprogrammes.Inspiteofthediversecontextsandtheautonomyofthegroups,thecommitteebelievesthatitisaverygoodinitiativeofSENSEtoorganiseasimultaneousreviewofalltheresearchintheSchool.
ThecommitteefoundthequalityoftheresearchinEnvironmentalSociology,EconomicsandPolicyStudiestobegoodtoexcellentbyinternationalacademicstandards.Thegroupsper-formatahighlevelofproductivityandtheacademiccommunityintheNetherlandsclearlypunchesmorethanitsweightinthisfield.
Cooperationandcollaborationdoesexist,butisnotmoreimportantasanorganisingprinciplethandebateandcompetition.SENSEprovidesausefulnetworkforallthesefunctions.
Thegroupsdifferinthebalancebetweenfundamentalresearchandmoreapplied(contract-based)research,andintheirdegreeofparticipationintheinternationalacademicorpolicydebates.Inmostcasesthetendencyistostrengthentheacademicqualitybyincreasingthenumberofarticlesinhighimpactinternationaljournals,butnotallgroupshaveshownanequallyfeasiblestrategyinthatrespect.
6� QANU/ResearchEvaluationEnvironmentalSciences�007
63QANU/ResearchEvaluationEnvironmentalSciences�007
3. Wageningen University, Institute WIMEK
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityEnvironmentalPolicyGroup Excellent Verygood Excellent VerygoodEnvironmentalEconomicsandNaturalResourcesGroup
Good Good Verygood Good
64 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 1: Environmental Policy Group (WIMEK-ENP)Programmedirector: Prof.dr.ir.A.P.J.MolResearchstaff�006: tenured�.70fte,total11.�4Assessments: Quality: Excellent
Productivity: VerygoodRelevance: ExcellentViability: Verygood
Thisisafairlyyounggroupcomprisingtwelvetenuredstaff,fouruntenuredstaffplusresearchstudents.TheENPGroupisunusualinthatitispartofarelativelysmallnumberofsocialscien-tistswithinalargeagriculturaluniversity,withstrongaffiliationsintheLifeSciencesandanexcel-lentinternationalreputation.TheENPGroup,ledbyMolandSpaargarenisverywellknownininternationalsocialsciencecircles,andwellrepresentedininternationalbodiessuchastheInter-nationalSociologicalAssociation(wheretheyhavebeenleadersofRC�4ontheEnvironment).AlthoughmostoftheestablishedstaffareDutch,thelistofresearchstudents,visitorsandothersattachedtothegroupisveryinternational,aswellasbeingyouthful.Theimpressionwegainedwasofamotivated,enthusiasticgroupledbytwointernational‘stars’.Thisimpressionofvitalitywasborneoutbyconversationswiththeresearchstudentsduringthe‘posters’sessions.
TheENPhasdevelopeditsresearcharoundapremise–thatenvironmentalconsiderationscan(todifferentdegrees)beincorporatedinmodernisationandglobalisationprocesses.TheypioneeredtheinvestigationofEcologicalModernisationasaconceptwhichcouldbeanalysedempiricallyaswell as theoretically, andhave taken theapproach into some interestingandnewareas–indeedmakingitacomprehensive,ratherthanpartial,typeofanalysis.Theyhavehadsignificantsuccessinrecentyears,notablysincethelastassessmentin�001,particularlyinfosteringconnectionswithAsia,wheretheyseenotableexamplesofecological‘modernity’,andhaveenteredintosubstantiallinkswithAsianresearchbodies,oftenvia‘sandwich’PhDstudents.Their work demonstrates how demanding analytical approaches can, if properlyemployed,helptogiveintellectualcohesion,andtodirectthekindofempiricalevidencethatsocialscience(anduniversities)rightlyexpecttoobtain.
Thegroupfacestwokindsoforganisationalproblem.Ontheonehandtheycurrentlyhavearather‘flat’managementprofile,inthatthereislittlehierarchy.Staffaregivenconsiderablefreedomtodevelop theirown research interests andnewresearch is assessedon itsmerits,ratherthanwiththeexplicitintentionofenlargingthegrouporgainingadditionalfunding(mostisprovidedfromtheUniversity,andlittlethoughincreasingthroughNWO).UndertheverycapableleadershipofMolandSpaargarenthisdoesnotseem,asyet,tohaveprovokedtoomanyproblems,butitmightdosoifoneofthemwastoleaveandnotbereplaced.Asthegroupgrowsinsizeitwillneedtoconsideralternativestrategiesformanagingwhatisbecom-ingasubstantialbodyofpeopleandresearchprojects.
ThesecondkindofproblemisrelatedtothelinkswithWageningen.Wehadtheimpressionthat,althoughlinkswiththenaturalsciencesinWageningenarereasonablygood,moremightbedonetoactivelydevelopresearchinrelatedfields.Thegroupprovidedalistofpossibleareasofcollaborationinitsself-assessmentreport.Itisnotedthatcollaborationswithnaturalscien-tistsinAsiaandelsewhere,infieldsituations,arecarriedoutwithnaturalsciencecolleaguesWageningen.Thecommitteeconsiderssuchcollaborationsasveryvaluable.Thepublicationpolicyofthegrouphasbeentoconcentrateonbigmonographswithexcellent(heavilyrefereed)internationalpresses,suchasMIT.Thishashelpedthemsecuretheirinter-
65QANU/ResearchEvaluationEnvironmentalSciences�007
national reputation,particularlywithinenvironmental sociology,butwillbemoredifficultforyounger,emerging,stafftoundertake.Infacttheythemselvesdiscerneda‘generational’dimensiontothis:youngerstaffoftenfavouringjournalsoverbooksandmid-careerstaffcom-ingsomewhereinbetween.Thereisaneedtoexpandtheiralreadycreditableshowingingoodacademicjournals.ItisindicativeoftheENPgroupthattheyhavediscussedjournalrankingswithinthegroupandarekeentodevelopastrategyonthisfront.
ThechallengefortheENPgroupishowtomanagetheir‘vitality’,anditdoespresentsomedifficult(ifnotimpossible)choices: iftheyexpandtheywillprobablyneedtodevelopinamorestreamlined,less‘collegial’direction,withmoredevolutionbeyondthetopstrata.Theymightthenbeseenas“thecuckoointhenest”atWageningen,andapossiblethreattootherresearchteamswhich,althoughnotsocial-sciencebased,havestrongpresenceindevelopingcountries.Toremainastheyare,however,willbedifficult,iftheyaretocontinuetoactentre-preneuriallyandsuccessfullydriveuptheirinternationalcollaborationsandhighlyregardedoutputs.
Overallthisisagroupwhoseworkisattheforefrontinternationallyinmostrespects,andcanbeconsideredaninternationalleaderinseveralareas,andaninternationalplayerinothers.Theyaredefinitelyaresearchgrouptowatch.
66 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 2: Environmental Economics and Natural Resources Group (WIMEK-ENR)Programmedirector: Prof.dr.E.C.vanIerlandResearchstaff�006: tenured1.94fte,total6.18fteAssessments: Quality: Good
Productivity: GoodRelevance: VerygoodViability: Good
ThesubmittedSelfEvaluationReportprovidedthebasicinformationwithintheprescribedtemplate.Whiletheinformationwasuseful,thereportdoesnotfullytransmitthespiritofa researchgroupconfrontedbynewchallenges andhorizons.On someoccasions (e.g. theconcludingsectionon“Adjustedstrategy”,p.8)thetextissosuccinctthatthereadercannotfullyunderstandwhat is reallymeant.At themeeting,ENRwas representedby thegroupleaderonly,whileitbecameobviousthatinthenearfuturemoreresponsibilitywillbecarriedbythetwoassociateprofessorsofthegroup,inter aliabecausethegroupleaderwilltakeupa40%directorpositionattheWUMansholtGraduateSchool,fromJuly�007.Thesevariouselementstogetherinduceddoubtinthereviewcommitteeastowhetherthegroupwasgivingsufficientattentiontoitsfuturedevelopment.
TheRCappreciatedthequalitativelyandquantitativelyrobustworkthatthegrouphascarriedout,specializedasitisinthethoroughstudyofimportantenvironmentalissues,applyingeco-nomicconceptsandmodels.Themescoveredincludeclimatechange,energy,pollutionandwaste,resourcesandbiodiversity,watermanagementandbiotechnology.Thefivethemesareledbyfiveprofessors,onefull,twoassociateandtwoassistant.Thegroupobservesthat“therangeoftopicsseemstobewideforamiddlesizedresearchgroup”(p.�)andthat“weneedtosucceedinobtaininglargerprogrammefundingwhichallows(us)toimplementamorecoher-entresearchstrategy…”(p.8).Fromthis,theRCconcludesthatthegroupiswellawareoftheadvantagesofreducingtherangeoftopicscovered;indeedthismaybeaprerequisiteforstrengtheningthegroup’sper-formanceinselectedfieldssoastoattainhigherscoresonthestandardacademiccriteria.Themainbarriertomovingforwardswouldseemtobe,ontheonehand,theattitudeofthegroupintakinga“servingattitude”towardstheneedsandrequestsofother(naturalsciences)groupsandofsocietalclientsaskingforassistanceineconomicanalysisandmodeling.Ontheotherhand,therearebarriersrelatedtopoliciesforpersonnelrecruitment:thereisachoicetobemadebetweencandidateswithaprofilethatcomplementsandstrengthenstheexistingthemesandcandidateswithabetteracademicandscientificrecordbutwhoareinterestedinotherthemes;thegrouphasapreferenceforthelatter,butthisweakensthegroup’sfocus.Itisrec-ommendedthatthegroupreflectsondevisinganexplicitstrategyforitsfuturedevelopment,anddoesthisinconsultationwithcolleaguesinSENSE.Dependingontheoutcomeofthesereflections, the future evaluation of the research group’s performance on particular criteriacouldbescaledaccordingly.
Externalvalidationandrelevanceforsocietyarestrongpointsoftheresearchgroupandexten-sivelydocumentedintheselfevaluationreport(p.4).Assuch,thegrouprealizesitsgoalofbeing “involved and linked to real life policy issues in the Netherlands” (p. �).The �001VSNUreviewstatedthat“theconnectionwiththepolicycommunityisnotclear”(p.4;p.7;annex4);thepresentreviewcommitteewantedamoreexplicitdescriptionoftheinteractionbetween thegroupandpolicymakers, althoughdetailed examplesof such interactions are
67QANU/ResearchEvaluationEnvironmentalSciences�007
suppliedintheselfevaluationreport(p.4).Inthereviewperiod,thegrouphasprovidedproofofanactiveinvolvementincapacity-buildingindevelopingcountries,andofsupplyingPhDtraining.
ThenumberofPhDstudentsiscommensuratetotheavailabletenuredstaffofthegroup(per-hapsatthehighend)whenthemanyotherresponsibilitiesandengagementsareconsidered.
Becausethegroup’sbibliometricscoreisnotoutstanding,itisplannedtoput“strongerfocusonmorefundamentalresearch”(p.8)torealizemorecategoryApublications.Thisplanhastobeweighedagainstthestrengthsofthegroupinapplicationsandinvolvementinreallifepolicy-making[seeabove].
Thegroup,inparticularthegroupleader,haveplayedakeyroleinthedevelopmentofthefunctionsofSENSEas a school, anetwork and abridge to society.Themainpart of thegroup’sworkismultidisciplinaryinnatureanddirectedtosocietalrelevanceforadvancingthetransitiontoamoresustainablesociety,butareviewofitsstrategyisurgentifitistoimproveitsinternationalprofile.
68 QANU/ResearchEvaluationEnvironmentalSciences�007
69QANU/ResearchEvaluationEnvironmentalSciences�007
4. Vrije Universiteit Amsterdam, Institute IVM
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityDepartmentofEconomicsandTechnology
Verygood Excellent Verygood Good
DepartmentofEnvironmentalPolicyAnalysis
Excellent Verygood Verygood Excellent
70 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 3: Department of Economics and Technology (VU-E&T)Programmedirector: Prof.dr.M.W.HofkesResearchstaff�006: tenured�.64fte,total6.84fteAssessments: Quality: Verygood
Productivity: ExcellentRelevance: VerygoodViability: Good
TheSelfEvaluationReportprovidesgoodinsightintothemission,fieldsofworkandoutputsofE&T,butthereisnotasmuchinformationanddetailonhowthedepartmentisorganizedandhowtheworkisproduced.WhentheSERoftheE&TresearchgroupisreadwiththeSERoftheIVMInstitute,morequestionscouldbeanswered(inparticulartheroleofthe‘clusters’).TheE&Tresearchgroupexcelsinacquiringexternalfunding(89%ofitstotalincome)whileobtaininghighscoresinitspublicationrecord:48%ofthejournalarticlesareinAjournals;therelativeimpactamountsto1.60inthe�001-�006period(wellaboveworldaverage).Thisisaverygoodresultgiventhatthegroupisspecializedinappliedeconomicsresearch.Theworkisinternationallycompetitiveandleadingatthenationallevel.
TheveryhighdependencyonexternalfundingischaracteristicofIVMasaninstitute.Ontheonehand,itisseenasaproprietaryattribute,aspartofIVM’smission.Ontheotherhand,changingcriteriaforassessingthegroup’sacademicperformancepushtowardsamorestand-ard academicposition, including the acquisitionof resources for staffing and research (i.e.beinglessreliantonexternalfunding).Thismayleadtosomelossinadministrativeautonomy,butgiventhelargedegreeofacademicautonomythatresearchgroupsenjoyintheSENSEnetwork,academicagenda-settingislikelytostayalmostexclusivelywiththegroup.Addingmoretheoreticalresearchtotheportfoliomayfollowinseekinginternationalresearchleader-ship.However,thismaycomeataprice,byareductioninthegroup’sshortandmedium-termrelevanceforDutchsocietyandpolicymakers.
Theproductivityof thegroupishighaccordingtothestatisticsprovided intheSER.It ishowevernotalwaysevidentfortheRCwhattheimpactisofthepart-timeandnewly-engagedstaffmembersontheproductivitydata.Theinterviewwiththegroup’sprofessorsonTuesday19thJunerevealedaverydedicatedstaffthatprocessedmanylargeprojectsofhighrelevance,leadingtomanypublicationsinjournalsandinothermedia.
Analmostnaturalcorollaryofthehighrateofexternalresearchcontractsisahighexternalvalidation/relevanceforsociety.TheCommitteewouldhavelikedtoseemorespecificinformationaboutthistocomplementthemainlyquantitativemetaindicesprovidedintheSER.
TheSWOT-analysisintheSERisratherbriefandgeneral,butdoesbringoutsomeinterestingthingswithrespecttostaffing,i.e.thattheIVMgroupmaynothaveacriticalmassinsomekeyareasandthatitisverydifficulttoattracthighlyqualifiedpersonnel(becausetheacademicandcareerpay-offforacademicsinmono-disciplinaryresearchcanbehigher).
Ontheonehand,E&Tfacessomeproblemsinkeepingoutstandingacademicsin-house;ontheotherhand,E&TandIVMhaveattractedoutstandingacademicsfromtheinternational
71QANU/ResearchEvaluationEnvironmentalSciences�007
academiclabourmarket.Itisdifficulttoassessthebalanceofthiscompetitionontheperform-anceandfutureofE&T.
Because analogousdiscussions arose in theWIMEK-ENRgroup (whichworks in a rathersimilarwaytoE&T,butismoreembeddedinandfundedbytheuniversityitself ),itmayhelptodeliberateinSENSEonhowthisissueshouldbeaddressed.Assigninghighprioritytothepersonnelissue,andfindingcreativesolutionsforit,isveryimportantforE&T’sfuture.ItisalsowhytheRCwasreluctantinscoringtheViabilitycriteriahigherthanGood(3),eventhoughthedynamismandengagementofthegrouparegreatandnewthemessuchaspovertyandenvironmentarebeingdevelopedwithenthusiasm.
Regardingthestrategyforthefuture,theCommitteerecommendsnottorefrainfromconsid-eringadjustmentsinstrategythatarenecessaryandfeasible.
7� QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 4: Department of Environmental Policy Analysis (VU-EPA)Programmedirector: Prof.dr.F.BiermannResearchstaff�006: tenured�.37fte,total1�.49fteAssessments: Quality: Excellent
Productivity: VerygoodRelevance: VerygoodViability: Excellent
Thisgroupconsistsofthreefullprofessorsandtwelveothertenuredstaff,aswellasfourteenunten-uredstaff.Almosthalftheirfundingforresearchisfromopen,competitivecontractsandmostoftherestisearnedcompetitivelyfromtheNWO.Forsuchalargeandimportantgroupofresearch-ers,withinapremierDutchinstitution,thiskindofprofiledependsheavilyonahighdegreeofvitalityandveryeffectivemanagement.Since�003theyhavegrownfromfifteenstaff(total)tothirtyfive,averylargeincreaseinashortspaceoftime.Wewereparticularlyimpressedbythesen-iormanagementwhichincludessomeoutstandingyoungscholars,notablyBiermannandGupta.Thisisayounggroup,whoseleadersarebarelyintheirfortiesandwhichisgrowingveryrapidly.
Thegrouphaveused‘governance’asanoverarchingconcept,whichenablesthemtodistin-guishbetweentheirvariousthematicareas,underpinnedbyanemphasisonpolitics,publicmanagement and international relations.Their work is interdisciplinary, as befits a groupworkingoninternationalenvironmentalproblemsandintegratedenvironmentalassessment.Theirfundingprofilehasforcedthemtolookoutwards,butthisisafeasiblestrategygiventhestrongcontextualpresenceofIVM,withasolidinternationalreputation,andtheirparticular‘niche’ininternationalstudiesandpolitics.Theyobtainjustover10%oftheirincomefromtheuniversity.Althoughtheydependheavilyongeneratingexternalresearchincome,mostofthisisnot‘soft’money,butintheformofEUprojectfundsandNWOfunding.Itistotheircreditthattheyhavedebated,andcontinuetodebate,themeritsofdifferentstrategiesformanagingandfinancingtheirresearchactivities.Thereisthesuggestionthatyoungerstaff,inparticular,mightberecruitedonthebackofconsultancy,butthatanemphasisonmorecorefundingandgreaterattentiontolong-durationfundedprojects,whileithasadvantagesintermsofacademicquality,canonlybepursuedwithinalongertime-frame.Thegroupgaveeveryindicationofbeingawareoftheseconstraintsandabletocalculatewithinthem,acon-siderablefeatforsuchayoungandevolvingteam.
We gained the impression that the publication strategy, like the funding strategy, is wellinformed.Atthemomenttheyareseekinga‘mix’ofISIpublications,ingoodinternationaljournals,aswellasbookchapters–thenormalmediumformuchworkininternationalrela-tionsandpolitics.
ThesupervisionofPhDstudentsinthemainappearstobesuccessful;theCommitteeappreci-atesthatthesupervisionispartlyundertakenwithcolleagueselsewhereinIVM.MoneyneedstoberaisedforPhDs,andthegroupisalwaysonthelook-outfornewprojects.
Theirpublicationsstrategytargetsthepolicycommunityasmuchasacademicsinthefield,andthismeansthattheyareheavilyinvolvedin‘grey’literature,writingreportsand‘in-house’documentsforinternationalnegotiations,aswellasinthemore‘public’literaturerepresentedbypolicyjournals.OneexampleistheSciencePlanthatmembersofEPAhavebeeninvitedtodevelopfortheInternationalHumanDimensionsProgrammeonGlobalEnvironmentalChange(IHDP)aroundtheirkeyorganisingprincipleof‘governance’.
73QANU/ResearchEvaluationEnvironmentalSciences�007
Theyhaveaclearandunremittingpolicyprofile,whichisconsistentwiththeirmissionandtheirstrengths.Theirworkisrelevanttothescientificcommunity,butevenmoremarkedlytothecivilsocietyorganisationsandgovernmentinterestsinvolvedininternationalenviron-mentalpolicy.
Weconcludedthatthiswasayoung,dynamicgroup,whichhadstilltoreachitsfullpoten-tial,butwhichshouldcertainlybeviewedasat the forefront internationally inmostareas,andmakingasignificantcontributioninternationallywhereitwasnotattheleadingedgeofresearch.
74 QANU/ResearchEvaluationEnvironmentalSciences�007
75QANU/ResearchEvaluationEnvironmentalSciences�007
5. Utrecht University, Copernicus Institute
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityEnvironmentalStudiesandPolicyGroup
Good Good Good Satisfactory
InnovationStudiesGroup(NotinSENSE)
Good Good Verygood Verygood
76 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 5: Environmental Studies and Policy Group (UU-ESP)Programmedirector: Prof.dr.P.GlasbergenResearchstaff�006: tenured1,81fte,total7.3�fteAssessments: Quality: Good
Productivity: GoodRelevance: GoodViability: Satisfactory
Thisisarelativelysmallgroupconsistingofsixtenuredstaff,withvaryingcommitmentsoftimetothegroup,andasizablenumberofaffiliatedresearchstudents.Thegroup’smissionstatement, like thatofotherswereviewed,demonstratesaparticular ‘position’onenviron-mentalissues:inthiscase,theideaisthatsustainabledevelopmentcanbe‘induced’insocie-ties,notablythrough‘newsocietalarrangements’whichinfluenceitsdevelopment.Thegrouphavea‘model’representinganabstractwayoflookingatsociety(intermsofthesectorsState,MarketandCivilsocietyandtheirinterrelationships)inconnectionwiththephysicalsystem.Theyhaveconcludedfrommanyoftheirstudies,thatgovernmentsoftenplayareactiverole,whileinnovativewaysofgovernanceforsustainabledevelopmentparticularlydevelopininter-sectoralarrangements.
Thereareanumberofreasonswhythisconceptualapproachismuchweakerthansomeoftheothergroupswithasimilar,ifnotidentical,disciplinarycomposition.Firstitisneverclearwhether‘societalarrangements’areresponsibleforachievingsustainabledevelopment,orvice versa.Indeed,therelationshipbetweenthetwolookssuspiciouslylikeatautology,sincesocie-tiesareoftenlookeduponasmore‘sustainable’themoretheyincorporatecivilsocietygroupsintotheirdeliberations.Theteamclaimtohavedevelopedthis‘model’fifteenyearsago,butthescopeandinvolvementindeliberativedemocracyandsimilarapproachesseemstohaveoutdistanced them.When asked where they had sought to develop their theoretical ideas,withintheacademicliterature,theyrepliedclearlythattheysawtheseideasasinformingwhattheydid.Theydidnotappeartothinkthatthedevelopmentoftheseideasmightitself(likeecologicalmodernisation,orgovernance)benefitfromarobustdiscussionwithinthepagesofacademicjournals.Theirapproachisaxiomaticratherthananalytical.
Similarly,giventheir involvement inDutchcivil life,andthegreatmajorityof their fundscomefromtheUniversityandtheNWO,itisreasonabletoaskhowtheymightdemonstratethattheirinteractionwithpolicymakingworks.Infacttheyarguethattheyarenotprincipallyconcernedwithpolicymakingassuch,butratherwiththeapplicationoftheirideas(orcoda)tospecificpolicyareas.TheyhavereviewedvariousaspectsofDutchpolicy,andtheoutputsalthoughnotpublishedintheverybestacademicjournals,haveneverthelessbeenpublishedinternationally,andnotsimplyintheNetherlands.However,fromclosequestioningitwasdifficulttoappreciatehowthiscasematerialmightinformlargerinternationaldebates,ratherthansimplyrepresentinterestingDutchevidence.Theyacknowledgethatmethodologiesforpolicyanalysisneedtobegivenmoreattention,butareunclearastowhatthismightimplyfortheiracademicworkinfuture.Theydidnotseemtohaveastrategyforconveyingtheirideaswithinthesocialsciencesinternationally,orwithinhigh-levelpolicycircles.Theyinsistthatthisapproachisviableandconcludetheirself-assessmentbysayingthattheyare“wellpreparedtocontinuetheirmission”.
Inasense,ifthisgroupistoremainsmallandfocusedlargely(althoughnotexclusively)onDutchpolicyareas,thenitssmallandinformalmanagementisnotaproblem.Ifitwereto
77QANU/ResearchEvaluationEnvironmentalSciences�007
expand,orhaditssightsonhigherinternationalprofile,thenthismightbeanissueinthefuture.Clearly at themoment the validation it gains is fromwithin theNetherlands, andalthoughthisisacknowledgedasapotentialproblem,thegroupdonotseemaltogetherclearhowtoaddressit.ItissuggestedthatcloselinkswiththeDutchgovernmentalstructurecanbringinacertainamountof‘commissioned’research–whichatleastkeepsthegroupalive.Thisisa‘businessasusual’scenario,andonethat,althoughunderstandablegiventhediffi-cultyinsecuringcompetitivefundinginternationally,demonstratesthatthegroupisnotofaninternationalcalibre.Thepreviousevaluationhadmentionedthatthisgroupprobably‘under-represented’itsworkinternationally.Theproblem,however,israthermorecomplex–howcanworkthatisnational,notanalyticallyrigorous,andatthemarginsofthemostinnovativesocial sciences,becommunicated internationally ingood journaloutputsandwith leadingpublishers?
Thegrouphaveorganisedthe‘InternationalSustainableDevelopmentResearchConference’intheNetherlands.Itisindicativeoftheircurrentpositionthatinanattempttoraisetheirprofileinternationallytheyhavechosenjournalsfocusedonenvironmentalissues,ratherthanputtingtheirideastothetestinmoretestinginternationalforaofmainstreamsocialscience.Thisisaresearchgroupthathasundertakensomeworthy,ifunexacting,researchwithaclearnationallyusefulaim,buthasthusfarfailedtoinitiateorcontributesignificantlytointerna-tionaldebatesatahighlevelinthesocialsciences.Muchoftheoutputisnationally visible (2) and solid. Insomerespectstheoutputsaremaking a valuable contribution at the international level (3)andarecompetitive at the national level.Thereisthusa‘mixed’pictureofpersonalcommitmenttotheideaofsustainabledevelopmentbut,asyet,alackofclearinternationalpurpose.
78 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 6: Innovation Studies Group (UU-ISG, not in SENSE)Programmedirector Prof.dr.ir.R.E.H.M.SmitsResearchstaff�006 3.5�fte,14.3�fteAssessments: Quality: Good
Productivity: GoodRelevance: VerygoodViability: Verygood
TheInnovationStudiesGroup(ISG),whichpursuesaresearchprogrammeon“DynamicsandGovernanceofInnovationSystems”,isoneofthefourgroupsthatmakeupUtrechtUni-versity’sCopernicusInstitute.TheISGisnotamemberoftheSENSENetwork.However,whilstitsprincipalintellectualfocusisonthesocial,politicalandeconomicanalysisofinnova-tionandtechnologicalchangeinitsbroadestsense,ithasinevitablybecomeconcernedwiththeenvironmental/sustainabilityaspectsofinnovation,thoughbyafocusonenergy/materi-als/nano/bio/transporttechnologies.Inthisrespect,itissimilartoasetofresearchcentresoninnovationstudiesactiveinotherEuropeancountries(suchasPRESTandSPRUintheUK,ChalmersinSweden),asetwhichthegrouphassetitssightsonrivalling.
Thegroupisarelativelynewone,establishedin�00�;ithasspentthelastfiveyearsbuildingupitscapacityanddevelopingitsresearchthemesanddoctoralprogramme.By�006,ithadgatheredtogether1�tenuredand11non-tenuredstafftocontributetoitsresearchactivities,with13PhDstudentsand5Postdocs.TheexternalfundingforPhD’sandPostdocshasshotupfrom�00�to�006(BsikandNWO)andtheyexpecttoappoint6newexternallyfundedPhD’sandPostdocsinthenextsixmonths.Theintellectualframeworkswhichunderpinthegroup’sresearcharetypicalofalmostallinno-vationstudiesresearchcentresinEurope–namelyinnovation systemsandpath-dependency/co-evolutionary economics.However,becauseofitspositionwithinCopernicus(thegroupisapartofUtrecht’sFacultyofGeosciences),thegrouphasaspecialconnectiontothenaturalsciences.Itsclaimtomulti-disciplinarityisthusbasedonthelinksithaswiththenaturalsciencesthatarebehindthetechnologicalinnovationsitisanalysingandsocio-economicallyassessing.Thereisnodoubtthatthegrouphasmadeconsiderableprogressoverthelast5yearsinboththeoutputandqualityofitspapersandreports.ThecitationanalysesthatthePanelwaspre-sentedwithshowevidenceofsomeinternationalquality,andinthediscussionswehadwiththegroupwewereassuredthatmorepublicationswouldbeappearingin�007,withafocusonmoreprestigiousinternationaljournals.Thegroupwastakingseriouslytheadviceithadbeenreceivingregardingimprovingitspublicationsprofilebyreviewingthejournals itwastargeting;itexpectedthatthiswouldbeclearwithinacoupleofyears.Prof.Smitsdescribedthecurrentstrategyofthegroupas“creativeconsolidation”;thePanel’viewwasthatthegroupwasdefinitelyonanupwardtrajectory,butthatwhilstthepublicationsoutputwasrising,itwasstillinthe‘Good’category,withthegroupbeing“internationallyvisibleandanationalplayer”.ThePhDprogrammeisclearlydevelopingapace–thePanelwasimpressedbythePhDpresentations.However,asoftheendof�006,fewdoctoralstudentshadcompletedtheirthesis,thoughitisclearthat�007and�008willseearapidriseincompletions.Onceagain,anupwardtrajectory.
Theresearchprogrammehasmademuchuseofintheteachingthatthegrouptakespartin–througha‘ScienceandInnovationManagement’programmeattracting100Bachelorand
79QANU/ResearchEvaluationEnvironmentalSciences�007
40 Master students; this strong connection between research and (especially) postgraduateteachingistobecommended.Asmentionedabove,thegrouphasactivelinkswithnaturalscientists, both as ‘subjects’ of their research and in collaborations.The group considers thisnaturalscience-socialsciencecombinationtobetheir“uniqueniche”.Ifthisisthecase,thenthegroupneedstothinkabouthowitcangivethe‘combination’someintellectualforce,byseekingtotheorisehowsuchcombinationscanbemorethanjustpartofthemethodologyofinnovationresearchers(i.e.closeconnectionstoactualinnovatorsandtheirscientificassociates).Theyneedtoshowthatthecombinationmakesadifferencetotheinnovationprocessitself.
ThePanelwasimpressedbythevitality(intellectualliveliness)ofthetenured/post-docstaffandPhDstudents.Theplansforthenextphaseofthegroup’sdevelopment–onresearchtopics,publicationstrategyandstaff/doctoralstudentdevelopment–arewellexpressedandcredible.Thegroupdefinitely shows signsofbeinga significant researchgroupon innovation studiesinternationally;thoughitneedstodevelopitsinternationalconnectionsasadeliberatetactic.Butmostimportantly,itneedstoreflectfurtheronwhatitsmainintellectualcontributionwillbe(probablyinexpositionofimportanceofsocialscience–naturalscienceresearchcollaboration);i.e.needstoclarifyhowitcanbe“unique”.Thegroup–isonthe‘cusp’ofbeinginternationallysignificant;continuedstrongsupportfromCopernicus/UUwillbearfruit.
80 QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 1: Curricula Vitae of committee members
Prof. Aviel Verbruggen, Dept.Milieu&Technologiemanagement,UniversiteitAntwerpen.TrainedinengineeringandappliedeconomicsatLouvain,AntwerpandStanfordUniversity,hispresentresearchcoverselectricityeconomics(cogeneration,planning,costingandpricingin power systems, distributed generation and grid access) and energy efficiency. He is co-founderofresearchandconsultantunits ‹STEM,CENERGIEandFINES›.Heconceived,supervisedandeditedtheStateoftheEnvironmentReportsinFlanders(1993-98)andwasthefirstpresidentoftheEnvironmentalAdvisoryCouncil(1991-95)andprincipaladvisortotheMinisteroftheEnvironment(1999-01).HecontributestotheIPCCThirdandFourthAssessmentReports(WGIII:MitigationandAdaptation).
Prof. Ken Green, ManchesterBusinessSchool,UniversityofManchester.ProfessorGreen'scurrent research interests are in the socio-economic analysis of technological development,especiallywith regard to environmental influences on innovation, and strategies for devel-opment of biotechnology. Current research contracts are with theTyndall Centre, on theinfluenceoflong-termtechnologicalchangeongreenhousegasemissions,andtheESRC,onsustainability in Food Systems. A recently completed research contract was an EU-fundedfive-countrystudyon'StrategiesforSustainableHouseholds'.Hehasalsoundertakenconsul-tanciesonenvironmentalpurchasingmanagement,thelinksbetweenenvironmentalstrategiesandR&DactivitiesandthefutureofbiotechnologyintheUK.
Prof. Michael Redclift,ProfessorofInternationalEnvironmentalPolicyintheDepartmentofGeographyatKing’sCollege,London.Researchinterestsincludesustainabledevelopment,globalenvironmentalchange,environmentalsecurityandthemodernfoodsystem.HehasundertakenresearchinSpain,Ecuador,Peru,MexicoandtheUnitedKingdom.HisresearchontheproductionandconsumptionrelationsundertheESRC/AHRCProgramme‘Culturesof Consumption’, was published in �004byTaylor and Francis in NewYork as ChewingGum:thefortunesoftaste.Hehasjustcompleted(�006)amajorcomparativestudyoffron-tiersocietiesandtheirrelationswiththenaturalenvironmentforMITPress:Frontiers:his-tories of civil societies andnature.Hewas the firstDirectorof theGlobalEnvironmentalChangeprogrammeoftheESRCbetween1990and1995.Between1973and1997hewasatImperialCollegeatWye,ultimatelyasProfessorofEnvironmentalSociology.Hehascoor-dinatedresearchgrantsfortheEuropeanCommission(FMIVandV)andhelpedinitiatetheTERMprogrammeof theEuropeanScienceFoundation. Inadditionhehasevaluated theresearchprogrammesoftheNorwegianResearchCouncil(RCN),theNetherlandsResearchCouncil(NRP),andotherEuropeanresearchinitiatives,includingtheTyndallCentreintheUK.In�006hewasthefirstrecipientofthe‘FrederickButtelAward’,fromtheInternationalSociologicalAssociation,for“anoutstandingcontributiontointernationalscholarshipinenvi-ronmentalsociology”.
81QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 2: Overview of Scores
Table 1: Overview of scores
Quality Productivity Relevance ViabilityWIMEK:EnvironmentalPolicyGroup
Excellent Verygood Excellent Verygood
WIMEK:EnvironmentalEconomicsandNaturalResourcesGroup
Good Good Verygood Good
IVM:DepartmentofEconomicsandTechnology
Verygood Excellent Verygood Good
IVM:DepartmentofEnvironmentalPolicyAnalysis
Excellent Verygood Verygood Excellent
Copernicus:EnvironmentalStudiesandPolicyGroup
Good Good Good Satisfactory
Copernicus:InnovationStudiesGroup(NotinSENSE)
Good Good Verygood Verygood
Table 2: SEP-scale; the meaning of the scores
Work that is at the forefront internationally, and which most likelywillhaveanimportantandsubstantialimpactinthefield.Instituteisconsideredaninternationalleader.
Excellent (5)
Work that is internationally competitive and is expected to make asignificant contribution; nationally speaking at the forefront in thefield.Instituteisconsideredinternationalplayer,nationalleader.
Very good (4)
Workthatiscompetitiveatthenationallevelandwillprobablymakeavaluablecontributionintheinternationalfield.Instituteisconsideredinternationallyvisibleandanationalplayer.
Good (3)
Workthatissolidbutnotexciting,willaddtoourunderstandingandisinprincipleworthyofsupport.Itisconsideredoflessprioritythanworkintheabovecategories.Instituteisnationallyvisible.
Satisfactory (2)
Workthatisneithersolidnorexcitingflawedinthescientificandortechnicalapproach,repetitionsofotherwork,etc.Worknotworthyofpursuing.
Unsatisfactory (1)
8� QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 3: Schedule
Research Assessment SENSE, ESEP
SUNDAY 17-06-200715.00–15.30 WELCOME15.30–16.00 QANU:Generalintroductionontheassessmentandthereview
programme16.00–16.30 SENSE:GeneralintroductionSENSE,withemphasisonthe3
different assessment levels: research groups; SENSE institutesandSENSEResearchSchool
16.45–18.30 InternalRCmeeting19.00–�1.00 Dinner�1.00–��.00 (meetingchairs)
MONDAY 18-06-200709.00–10.30 InternalRCmeeting10.30–11.30 PresentationanddiscussionEnvironmentalPolicyGroup(ENP-
WIMEK/WU)nr.111.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 Presentation and discussion Department of Environmental
PolicyAnalysis(EPA-IVM/VU)nr.414.00–15.00 Presentation and discussion Environmental Economics and
NaturalResourcesGroup(ENR-WIMEK/WU)nr.�15.15–16.45 PhDposterpresentations(ENP,EPAandENR)anddiscussion17.00–18.00 InternalRCmeeting18.00–�0.00 Dinner
TUESDAY 19-06-200709.00–10.30 InternalRCmeeting10.30–11.30 Presentation and discussion Innovation Studies Group (ISG-
Copernicus/UU)nr.611.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 Presentation and discussion Department of Economics and
Technology(E&T-IVM/VU)nr.314.00–15.00 Presentation anddiscussionEnvironmental Studies andPolicy
Group(ESP-Copernicus/UU)nr.515.15–16.45 PhDposterpresentationsISG,E&TandESPanddiscussion17.00–18.00 InternalRCmeeting
(chairsmeetinGeneralCommittee,Wednesday9:00hrs)
83QANU/ResearchEvaluationEnvironmentalSciences�007
Committee Environmental Biology and Ecology (EBE)
84 QANU/ResearchEvaluationEnvironmentalSciences�007
85QANU/ResearchEvaluationEnvironmentalSciences�007
1. The review committee and the review procedures
Scope of the assessmentThecommitteewasaskedtoassesstheEnvironmentalBiologyandEcologyresearchatIES-VU(Amsterdam),WIMEK-WU(Wageningen),RU(Nijmegen)andCOPERNICUS(Utrecht).Theassessmentcoversactivitiesoverthewholeperiod�001-�006,andispartof the�007reviewoftheSENSEresearchschool.
Composition of the committeeThecommitteememberswere:
• Prof.JanBengtsson,professorinecologyandenvironmentalsciencesatthedepartmentofecology,SwedishUniversityofAgriculturalSciences,Uppsala,Sweden(chairman).
• Prof.SteveOrmerod,professorinecologyintheCardiffSchoolofBiosciences,CardiffUniversity,Wales,UK.
• Prof.LucdeMeester,professorinecologyandevolutionarybiology,KatholiekeUniversi-teitLeuven,Leuven,Belgium.
Three external reviewers assessed individual departments, and their views were taken intoaccountinthefinalassessmentoftheprograms.
SietzeLooijengaoftheBureauofQANU(QualityAssuranceNetherlandsUniversities)wasappointedsecretarytotheCommittee.
AshortcurriculumvitaeofthecommitteemembersisincludedinAppendix1.
IndependenceAll members of the Committee signed a statement to indicate that they would assess thequalityoftheInstituteandresearchprogrammesinanunbiasedandindependentway.Anyexistingpersonalorprofessionalrelationshipsbetweencommitteemembersandprogrammesunderreviewwerereportedanddiscussedinthecommitteemeeting.TheCommitteecon-cludedthattherewerenocloserelationsordependenciesandthattherewasnoriskintermsofbiasorundueinfluence.Oneoftheexternalreviewersoftheindividualprogramshadrecentlypublishedwiththegrouphewasreviewing,butthecommitteedecidedhisreportcouldbeusedintheassessment.
Data provided to the CommitteeTheCommitteereceivedthefollowingdetaileddocumentation:
1. Selfevaluationsattheleveloftheprogrammes,theinstitutesandtheresearchschool�. Copiesofthreekeypublicationsperprogramme3. Bibliometricstudy1996-�0044. ACD-ROMwithallSENSEbackgroundmaterial.
ThedocumentationincludedalltheinformationrequiredbytheStandardEvaluationProto-col(SEP).
TheStandardEvaluationProtocol(SEP)providesguidelinestoevaluateuniversityresearchinstitutesandtheirresearchprogrammes.Theself-evaluationsprovidedbySENSEwereade-
86 QANU/ResearchEvaluationEnvironmentalSciences�007
quatelydocumentedandtransparent.Incombinationwiththesitevisits,consistingofinter-views with group leaders and senior staff, and meetings with PhD students, they allowedobjectiveevaluationsofthegroups.
Procedures followed by the CommitteeTheCommitteeproceededaccordingtotheSEP.PriortotheCommitteemeeting,eachpro-grammewasassignedtoafirstreviewer,whoformulatedapreliminaryassessment.ThefinalassessmentsarebasedonthedocumentationprovidedbytheInstitutes,thekeypublicationsandtheinterviewswiththemanagementandwiththeleadersoftheprogrammes,aswellasmeetingswithPhDstudents.SitevisitsandinterviewstookplaceovertheperiodJune17,�007-June�0,�007(seethescheduleinAppendix3).
Precedingthe interviews, theCommitteewasbriefedbyQANUaboutresearchassessmentaccordingtoSEP.Onthesameday,June17,�007,theCommitteeplannedtheinterviewsandproceduralmattersandaspectsoftheassessment.
AftertheinterviewstheCommitteediscussedthescoresandcommentsandmadedrafttexts.Thetextswerefinalisedthroughemailexchanges.ThefinalversionwaspresentedtotheInstitutesandSENSEonAugust1,�007.Thecom-mentsoftheInstitutesandSENSEwerediscussedintheCommitteeandledtochangesinthereportonanumberofpoints.ThefinalreportwaspresentedtoBoardsoftheparticipatinguniversitiesandwasprintedaftertheirformalacceptanceofthereport.
TheCommitteeusedtheratingsystemoftheStandardEvaluationProtocol(SEP).Themean-ingofthescoresisdescribedinAppendix�.
87QANU/ResearchEvaluationEnvironmentalSciences�007
2. General remarks
The committee found the quality of the research in Environmental Biology and EcologywithinSENSEtobegenerallyhigh.Severalgroupsshowoutstandinginternationalleadershipintheirrespectiveareas.Thehighstandardssetbytheresearchschoolforgroupsandindi-vidualresearchershasresultedinthefactthatallgroupsareperformingatlevelsclearlybetterthan“satisfactory”(comparedtointernationalstandards),viz.goodorbetterinallaspects.
Hence,therestructuringofresearchinassociationwithformationofresearchschoolsintheNetherlandshasbeensuccessful.ThequalityofDutchresearchintheareasassessedisclearlyinternationallycompetitive,andthegroups inSENSEplay importantroles inmaintainingandfurtherenhancingthisreputation.
Thecommitteenotesthatthedegreeofcollaborationwithinandbetweendisciplinesdiffersbetweenthegroupsassessed.Weacknowledgethenecessitytomaintainthehighestdiscipli-narystandardsinresearch,butwealsowanttoemphasisethepossibilitiesofSENSEinthatitprovidesanarenafordevelopinginnovativemulti-disciplinaryworkinthefieldofenviron-mentalsciences.TherearedifferencesbetweenthegroupsintheextenttowhichtheyhavebeenabletouseSENSEtodothis.Collaborationdependsnotonlyonthegroupsthemselvesbutalsoonwhether the respectiveuniversitiesprovideadequate facilitiesand incentives toincreasecooperationwith,forexample,othernaturalorsocialsciences.
Anothergeneralobservationisthatseveralgroupsclearlyneedmoresupportfromtheiruni-versitiesintermsoftenure-fundedstaff,infrastructure,spaceorotherkindsofsupport.Someuniversitieshavebeenmoresuccessful thanothers in locatingthegroups inenvironmentalbiologyandecologyinwaysthatincreasetheirpotentialtoperformcross-cuttingresearchtothehighestinternationallevel.Itisnotablethatdespiteseveralgroupshavinggonethroughaperiodofrestructuringanddecreasesinuniversityfunding,thegroupshavetoalargeextentbeenabletoincreaseexternalfundingandbothresearchproductivityandquality.Thisindi-catesthestrongcapacityofthegroupsandshouldnotbeinterpretedasasignthatfundscanfurtherbereduced,asthereisalimittotheworkloadandstressresearchgroupsandindividu-alscancopewith.Withtheenvironmentnowrisingrapidlyonthepolitical,legalandsocialagendaworldwide,weurgeuniversitiesintheNetherlandstobettersupportecologyandenvi-ronmentalbiology.
Thegroupsinenvironmentalbiologyandecologyhaveoverallbeensuccessfulinimplementa-tionandcommunicatingtheirresearchtosociety.Nonetheless,wefindthatthereispotentialforimprovementinthisarea.Someexamplesarecommunicatingscientificknowledgeonglo-balchangeandecologytothepublic,andinfluencingpolicynationallyandinternationally.
88 QANU/ResearchEvaluationEnvironmentalSciences�007
89QANU/ResearchEvaluationEnvironmentalSciences�007
3. Wageningen University, Institute WIMEK
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityAquaticEcologyandWaterQualityManagementGroup
Excellent Verygood Excellent Excellent
NatureConservationandPlantEcologyGroup
Verygood Excellent Excellent Verygood
90 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 7: Aquatic Ecology and Water Quality Management Group (WU-AEW)Programmedirector Prof.dr.M.SchefferResearchstaff�006 6.9fteAssessments: Quality: 5
Productivity: 4Relevance: 5Viability: 5
Thisresearchgroup,headedbyM.SchefferandA.Koelmans,takesabroadmultidisciplinaryapproachtogeneratenovelinsightsinthefunctioningofecosystemsandtodevelopeffectivestrategiesformanagingandrestoringaquaticecosystems.Researchonbiodiversity,ecosystemfunctioning,multiplestresses,andprocessesall figurestronglythroughcombinedexpertiseinecology,environmentalchemistryandecotoxicology.Leadership isveryeffective,withaveryopenstyle,reflectingvisionwhileallowingfreedomfor individualdevelopmentoftheindividualresearchersandPhDstudents.Theresearch isexplicitlymultidisciplinary,as thegroupcombinesexpertise inecology,environmentalchemistryandecotoxicology.Methodsvaryfromlarge-scalefieldmonitoringtoexperimentalmanipulationandmathematicalmod-elling.Thelatterhasbeencentraltothestudyofstabilityincomplexsystems,wherethisgrouphasworld-leadingexpertise.Importantly,thereisastrongdrivetovalidatemodeloutcomeswithrealdata.
Thescientificqualityofthegroupisexcellent.Schefferisrecognisedasaworldleaderandevidencefromcitationsandpublicationsshowsthathisworkhasabroadimpactonecosystemecologyandfreshwaterecology.Koelmans’researchonenvironmentalassessmentandenviron-mentalchemistryisalsoexcellent,andispublishedinthehighestrankingjournalsinthefieldofecotoxicology.Othergroupmembersarerapidlyincreasingtheirownimpact,andtrendsoverthepasttenyearshavebeenspectacular.
ProductivityishighonbothpublicationsandPhDtheses.Thereisacalculatedandhighlybeneficialstrategytofocusonqualityratherthanonquantity.Althoughthereviewpanelfullyendorsedthisapproach,productivityoftheteamasawholewasjudged“verygood”ratherthan“excellent”sincethereismoderatevariabilityinoutputsamongstaffmembersfromexcel-lenttomoremodest.
Relevanceisexcellentonscientificvisibility(i.e.academicdissemination,asillustratedbypub-licationsinScience,Nature,PNAS,andtopjournalswithinthefieldofexpertise)andwithrespecttothetranslationofscientificfindingsintopolicy(e.g.managementofwetlands)andpracticalapplications(e.g.absorptionoforganicpollutantsbyblackcarbon).Arecentlarge-scalesurveyof80floodplainlakesinSouthAmerica(SALGAproject)exemplifiesperfectlyhowintrinsicscientificvalue,localtraining,capacitybuilding,localawarenessandtranslationinsustainablemanagementcanbecombined.
Asavibrantgroupwithgreatperspicacityinleadership,theprospectsofthisgroupareexcel-lent.Thereisabroadarrayofpotentialresourcesavailableandagoodmixtureofestablishedandupcomingtalent.However,successstilldependscriticallyonafewkeyindividuals,espe-ciallyMartenScheffer.Itisrecommendedthateffortsarecontinuedtoincreasetheimpactofallstaffmembers.Theteamiscurrentlymovingtoanewbuilding,wherethefacilitieswillbeexcellent.Thenewlocationhasalsostrongaddedvalueinbeingclosetothewell-equippedlaboratoriesofotherteamsandAlterra.
91QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 8: Nature Conservation and Plant Ecology Group (WU-NCP)Programmedirector Prof.dr.F.BerendseResearchstaff�006 9.�fteAssessments: Quality: 4
Productivity: 5Relevance: 5Viability: 4
Thisgroupoflong-standingeminencehasasitsmaingoalthegenerationofnewscientificinsightsthatcontributetothedevelopmentofeffectivestrategiestomaintainandrestorethebiodiversityandfunctioningofnaturalecosystems.Aboveall,thegroupemphasisesinteractionsbetweenplants,plantsandsoil,andbetweenplantsandtheatmosphere.Theyblendmodelswithexperimentsandobservations,forexampletoexaminetheconsequencesofchangesinnitrogendeposition,climateandCO�concentrationtovegetationsystemsandtheirassociatedecosystemgoodsandservices.Theworkischaracterisedbystronginter-dependencebetweenresearchqualityandmajorvaluetomanagementandpolicy.
Onresearchquality, the leadershipof thisgroup isclear fromcontributions toverystrongpublicationsinNature,Science,andPNAS,withconsistentlyhighqualityoutputsalsointhetopranksofecologicaljournals.ThetoweringinternationalfigureofFrankBerendseiscentraltonearlyallofthisperformance,andthereisnodoubtthathisownprofileandpositionmakehimaworldleader.Significantly,however,thereissomeasymmetryinresearchperformanceacrossthislargegroup.WefullyexpectsomeofthegiftedyoungerresearchersaroundBer-endsetocontributeincreasinglytoresearchqualityinfutureyears.
Inthecurrentperiod,andoveritshistory,thishasbeenahugelyproductivegroup,withper-capitapublicationsamongtheveryhighestinSENSE.Forhighqualitypapers,proceedings,reports, book chapters, reports and a rangeofprofessionalpublications, outputs reflect anunwaveringethicofcommitmentandproductivity.PhDtraininghasbeenconsistentlyhigh.Asamajorcontributorinsheernumericalterms,thegroupisfaultless.
Inadditiontoitsexcellentproductivity,thisgroupscoresveryhighlyfortherelevanceofitswork to solvingmajorproblems in environmentalmanagement. Notonlyhas therebeenmajor contribution to theadvancementofknowledgewith respect tograsslandsandagro-ecosystems,indisseminatingthefindingsandinfluencingimplementationbyend-users,thisgroupisaEuropeanrolemodel.
Prospectsforthisgroupinthemediumtermareextremelygoodgiventhecontinuedimpor-tanceofagro-ecological themesandthegroup’s relevance toglobalchangeresearch. In thelongerterm,vitalitywilldependontheprogressivedevelopmentofotherresearcherswhocanapproachtheproductivity,profileandenergyofthecurrentleader.
9� QANU/ResearchEvaluationEnvironmentalSciences�007
93QANU/ResearchEvaluationEnvironmentalSciences�007
4. Vrije Universiteit Amsterdam, Institute IES
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityAnimalEcologyGroup1:CommunityandEvolutionaryEcology
Verygood good Verygood Verygood
SystemsEcologyGroup Excellent Excellent Verygood ExcellentTheoreticalBiologyGroup Verygood Good Good Good
94 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 9: Animal Ecology Group 1: Community and Evolutionary Ecology(VU-AE1)Programmedirector Prof.dr.H.VerhoefResearchstaff�006 6.7fteAssessments: Quality: 4
Productivity: 3Relevance: 4Viability: 4
Followingarecentperiodoftransitionandtherecruitmentofseveralyoungandpromisingscientists,thisgrouphasdevelopedamorefocussedmissionandresearchprogram.Thishasplacedparticularemphasisontheresearchinterestsoftheseyoungerscientists.ThegroupworkscloselywithAnimalEcology�atVU,andinmanyrespectsthetwogroupscanberegardedasone.Thenewresearchfocusisontwothemes:communityecologywithanemphasisonsoilorganismsandbiodiversity,andevolutionaryecology,especiallyfocusingonphenotypicplas-ticity.Manygroupsworldwideareworkinginoneoftheseareas,butthelinkingofcommu-nityandevolutionaryecologyisnovelandmarksthegroupasdevelopinganinternationallydistinctandquiteuniquemission.Ifsuccessfulinthisendeavour,thegrouphasthepotentialtobecomeaninternationalleaderinthisarea.Theresearchprogramisverygood,withinnova-tiveideasandaleaderawareofthelongtermimportanceofencouragingtheyoungerscientistsinthegroupintoleadingroles.Thegroup’sstrengthisintheoreticallymotivatedexperimentsandempiricalstudies,andthegroupisanimportantmemberofcollaborativeprojectsnation-allyandinternationally.
Thequalityoftheresearchisverygood.ThegrouphasproducedseveralveryimportantpapersonbiodiversityandecosystemfunctioninginhighprofilejournalssuchasNatureandScience.Thegroupislikelytobecomeanationalleaderandaninternationallycompetitiveplayerinevolutionarycommunityecology.
Basedonquantitativemeasurestheproductivityofthegroupisgood,althoughreorganisationandtherecruitmentofnewmembershasresultedinasomewhatlowerproductivityinrecentyears.Thegroupissmall,especiallyintermsoftenuredstaff,whichimpliesfewerpapersinabsoluteterms,whileitsrelativeimpactispresentlyonthelowersideoftheSENSEgroups.Incontrast,productionofPhDshasbeenverygoodtakingintoaccountthesmallnessofthegroup.
Therelevanceofthegroup’sworkisverygood.Severalmajorpapershavehadalargescientificimpact.However,thepotentialofthegroupwithrespecttomoreappliedaspectsinpolicyandmanagementhasnotbeenfullyrealised.Thegroupcanimproveinthisareagivenrecentconsolidationandchanges incomposition.All signsare thatdevelopmentsare intherightdirection.
Inthemediumandlonger-term,viabilityofthegroupisverygood.Itispromisingtohaveasituationwiththreeyoungandhighlyqualifiedscientistsworkingtogetherinajointprogramthat is both exciting and promising.There are small uncertainties associated with a likelychangeingroupleaderinthenextfewyears.Thereviewcommitteefeelsthatthefocusontherelationshipbetweenecologicalcommunitytheoryandevolutionarytheorycouldhelpfullyrealisethegroup’spotential.
95QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 10: Systems Ecology Group (VU-SE) Programmedirector Prof.dr.M.A.P.A.AertsResearchstaff�006 6.5fteAssessments: Quality: 5
Productivity: 5Relevance: 4Viability: 5
Thisgrouphasaclearlyarticulatedandfocussedmissiontoanalysehowglobalchange,inarangeofforms,affectsbiodiversityandecosystemfunction,andtoprojectfutureecosystemeffectsfromcurrentandpastresults.AlthoughsomeoftheirworkiscarriedoutintheNeth-erlands, they have significant interests in Arctic, sub-Arctic and Antarctic locations wherechangingUV-B,warmingandincreasingCO�concentrationshavemajorecologicaleffects.Thegrouphasastatedintentiontoperformtheirtasksataninternationallyrecognizedlevelasevidencedbyhigh-impactpublication,prominenceinrelevantinternationalnetworksandsubstantialexternalfunding.Inalltheserespects,thisisahighlysuccessfulgroupcarryingoutresearchthatisbothscientificallyexcellentandhighlyvisibleinternationally.
Onquality,theCommitteejudgedthistobeaninternationallyleadinggrouponthebasisoftheirpublicationrecordinScienceandNature,aswellastheirconsistentlystrongrecordofpapersintheveryhighestranksofEcologyandEnvironmentalSciencejournals.Significantly,high-qualityperformanceisapparentnotonlyfromthegroupleader,butalsoindependentlyfromotherleadingmembers.Thegrouphassufficientlycriticalmassofeffectiveresearcherstodeliverasinternationalleadersacrossawell-integratedprogramme.Whilebibliometricanaly-sessupportthesuggestionthatthisisagroupofextremelyhighquality,finallyitistheintrinsicstrengthoftheirsciencethatplacestheminsuchaleadingposition.
Agradingof5forproductivityreflectsaper-capitarateofpublicationinthisgroupthatwasamongthehighestofallthoseexamined.Significantly,thishasbeenachievedwithahighdegreeof consistency in leading journals anddespite themajor logisticaldemandsof fieldresearchinhighlychallenginglocations.PhDcompletion,althoughslowerintheearlyperiodofassessmentafterthegroup’sformationin1997,isnowconsistentlyhigh.Onrelevance,thereviewcommitteeconsideredthattheworkinthisgroupwastopical,visibleandgloballyvaluableinscientificterms.Nevertheless,morecouldbedonetodisseminatethegroup’sfindingsoutsidetheresearchdomaintherebyincreasingtheirimpact.Thereisaneedforallecologicalandenvironmentalresearcherstodemonstratethewidervalueoftheirwork,andintheglobal-changedomaintheopportunitiesareparticularlylarge.
Theresearchfieldinwhichthisgroupoperatesisalreadyhighlytopical,andlikelytobecomeevenmorepressinginfuture. Giventheagestructure,blendofestablishedandpromisingyoungresearchers,andcurrentlevelofexcellence,prospectsforthisgroupcouldnotbebetter.Onviability,therefore,wejudgethistobearesearchgroupinitsprimeandwithanexcellentfuture.
96 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 11: Theoretical Biology Group (VU-TB)Programmedirector Prof.dr.S.A.L.M.KooijmanResearchstaff�006 9.7fteAssessments: Quality: 4
Productivity: 3Relevance: 3Viability: 3
ThemissionofthegroupistodevelopandapplytheDynamicEnergyBudget(DEB)theo-reticalframeworktoquestionsrangingfrommolecularbiologytoglobalecosystemscience,alsodescribedtothereviewcommitteeasdevelopinga“theoreticalphysicsforbiology”basedon firstprinciples.Thegrouphas a stronganddynamic leader, andhisprogramhasbeenfairlysuccessfulduringits�5years,andhasprovidedafreshperspectiveontheoreticalaspectsof biology.Beingbasedon energy andmassbalance in individuals, successful applicationshavebeeninecotoxicologyandpopulationdynamics.Anexternalreviewerwaspositiveinhisevaluationofthegroup.Wehavetakenthisintoaccountinourassessment.
Thegrouphasfocussedontheoreticaldevelopment,usingempiricaldataobtainedincollabora-tionsforapplicationsindifferentfields.Thecoreofthegroupissmall.Withonlytwouniversity-fundedandoneexternallyfundedresearcher,itlackscriticalmass.Themanagementbythegroupleaderseemedunclear,butthiswasclearlynotaproblemfortheinterviewedPhDstudents,whowerehappywithsupervisionandthegroupenvironment.ThegrouphasenrolledalargenumberofPhDstudentsinrecentyears,ofwhichlessthan50%arepartofSENSE.
Aproblemhighlightedbypreviousevaluationswasthatthegroupneedsamorepluralisticapproach,becausethenarrowtheoretical focusmight jeopardise its longtermviability.Noactionhasbeentakentoredressthisperceivedimbalance,whichreflectstheparticularanddistinctinterestofthegroupleader.Currentsuccessisthereforelikelytocomeatthecostofreducedlonger-termviabilityandlowlikelihoodofanynewleaderemergingtotakechargeofthisresearchtheme.
ThespecificresearchprogramonDEBisinterestingandinnovative.Thegroupleaderiscon-fidentthattheconceptswillbeprogressivelymoreacceptedanddisseminatedacrossbiology.Thesupportingevidenceforitswideapplicationfromgeneraltextbooksandcitationsisnotyetclear,althoughacurrenttextbookauthoredbythegroupleaderiswidelyavailable.Thegroupleaderwaspessimisticaboutthefutureofthegroupattheuniversity.Thecommitteefeelsthelackofothertheoreticalperspectivesinthegrouptobeapotentialproblemforitslong-termviability.
In its specificniche, the scientificqualityof thegroup’swork is verygood.Thequalityofpublishingisgoodwithseveralhigh-rankedjournalpapers.Thetheoryhasbeenpresentedinawell-receivedbookbythegroupleader.TheproductivityofthegroupisgoodwhenjudgedagainstSENSEasawholewithrespecttopapersandPhDcompletion.
The relevance of the DEB program is high, with the training of students in quantitative,mathematicalskillsandtheirapplicationstobiologyasamajorstrength.Atthesametime,interactionswithotherstudentsintheresearchschoolcouldbeimproved.AcceptanceofDEBtheoryhasbeenslowinacademyandthisdecreasesthescientificrelevanceofthegroup’sworkintermsofdisseminationofknowledge.
97QANU/ResearchEvaluationEnvironmentalSciences�007
Althoughtheshorttermviabilityoverthecoming5-7yearsisgood,thelongtermprospectsarelowerforreasonsoutlinedabove.This,coupledwithsmallcoregroupsize,affectviabilityofboththegroupandtheDEBtheory.
Thegroupisstronglyrecommendedtoemphasisetwothingsinfuture:Firstly,trainingthenextgenerationstudentsandscientistsinquantitativemathematicalandformalisedanalysisofbiologicalphenomenaisofstrategicimportanceforSENSEandDutchscienceasawhole.Secondly,thegroupshouldgivehigherprioritytoensuringthattheDEBtheory,whichhaslargepotentialconceptually,gainswideracceptanceandapplication.Thiscanbeachievedbytranslatingitmoreeffectivelytoacademiathatarenotnecessarilymath-ematicallygifted.
98 QANU/ResearchEvaluationEnvironmentalSciences�007
99QANU/ResearchEvaluationEnvironmentalSciences�007
5. Radboud University
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityEnvironmentalSciencesGroup Good Good Verygood VerygoodEnvironmentalBiologyGroup Verygood Good Verygood Verygood
100 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 12: Environmental Sciences Group (RU-ES) Programmedirector Prof.dr.A.J.HendriksResearchstaff�006 7.6fteAssessments: Quality: 3
Productivity: 3Relevance: 4Viability: 4
Thisgroup’sdistinctnicheisinunderstandingphysicalandchemicalpressuresonplant,ani-malandhumancommunities, inparticular intheRhine-Meuse-Scheldtdelta. Theyuseablendofconceptualandmathematicalmodelsdevelopedininteractionwithlaboratoryexper-imentsandfieldsurveys.Combiningresearchwithstrongend-userrelevance,theyalsotrainPhDandMScstudentstoahighprofessionalstandardforentryintoresearch,managementandconsultancy.
ThegrouphasgonethroughsignificantchangesinleadershipoverthereviewperiodasProfNienhuisretiredin�003,DrRobLeuevenheldacaretakerrolein�003-�004,andProfJanHendriks joined thegroupas leader in�004.Therehavebeenmajor advances in researchqualitysincethattime,withexternalresearchfunding,publicationsnumberandpublicationsquality all rising. Core staff in the group are increasingly publishing a significant propor-tionofpapersinhighrankingjournalsintheenvironmentaltoxicologyandchemistryfields,withotherscontributingeffectivelyinfreshwaterandfloodplainecology.Thereisnodoubtthatresearchqualityisnowbecomingincreasinglycompetitiveinternationally,andthisisevi-dencedbystronggrowthintherelativeimpactofthegroup’spapers.However,judgedacrosstheentirereviewperiodandtakingintoaccountsomevariabilityinperformanceacrossthegroup,onqualitythisgroupisgradedasagoodnationalcompetitorwithinternationalvis-ibility.Thereviewpanelstronglyencouragesthegroupmemberstomaintaintheirnewfoundconfidenceinpublishing,andtoseektoplaceseminaloutputsintheverybestjournalsthatintegrateacrossitsecotoxicologicalandecologicalresearch.Effectivedesignandincreasedsci-enceexcellenceinPhDprojectswillalsohelptobuildquality.
Thetransitionsofthelast5yearshavemeantsomevariabilityinresearchproductivity,andonbibliometricindicators(e.g.percapitapublications),theirperformancehasbeengoodwhenseenacrossthewholereviewperiod.Theincreasesince�004islikelytoaugmentproductivityinfuture,andwillclearlyhavebeneficialeffectsonvisibilitywhenlinkedwiththeincreasingqualitynotedabove.TherehasbeenasteadystreamofPhDstudentsthroughoutallyears.
Theclearinterfacebetweenresearchinthisgroupandmajorproblemsinecotoxicologyandenvironmentalmanagementmeansthatrelevanceinthisgroupishighandratedverygood.Strongemphasisonrelevanttraining,end-usercontact,strongcontractfunding,effectivedis-seminationandgoodoutreachallcombinetorevealthegroup’sstrengthsinthisrespect.On vitality, the review panel scored this group highly. Current upward trajectory across arangeofperformanceindicators,theimportanceofthegroup’sresearchthemes,thegroup’sage-structureandincreasinglyimprovedbalancebetweenresearchandteachingallbodewellfordevelopmentinthecomingyears.
101QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 13: Environmental Biology Group (RU-EB)Programmedirector Prof.dr.J.RoelofsResearchstaff�006 10.0fteAssessments: Quality: 4
Productivity: 3Relevance: 4Viability: 4
Thisresearchgroupfocusesonbiogeochemicalandecophysiologicalstudiesofawidearrayofwetlandecosystems.Thegroupaimsatamutuallysynergisticinteractionbetweenfunda-mentalscienceandappliedissues,withastronginvolvementinmanagementandrestorationofwetlandecosystems.
Qualityisveryhighandreflectsthehigh-qualityworkofagroupthatiswellknowninterna-tionallyinitsfield.Asignificantpartoftheworkispublishedinthetopecologicaljournals,andtherehavealsobeentwoverytimelycontributionstoNature.Aproportionofpapersarealsoinmoremid-rankingjournals,andthereisscopeforsomeimprovement.Withintheirresearchfield,thisresearchgroupisclearlyanationalleaderandaninternationallycompeti-tiveplayer.Adeclineintherelativeimpactofpublicationsoverthepasttenyearsreflectssomechangeintherelativeimportanceofsomeofthegroup’sworkoverthelast10yearsratherthananychangeinintrinsicquality.Nevertheless,thereissomevarianceinthequalityandquantityof researchoutputamong teammembers.The recentpublicationof twopapers inNatureshowsthattheteamgraspsopportunitiestoincreasetheimpactoftheirresults.
Productivityisrankedasgood.ThenumberofPhDtheseswasrelativelylowinthefirstpartoftheevaluationperiod,butisnowincreasing.ThenumberofA-publicationsismoderate,buthasincreasedstronglyin�006.Publicationoutputdifferssubstantiallyamongteammem-bers.
Therelevanceoftheworkisveryhigh.Thereisanexcellentdisseminationofknowledgetowatermanagementauthoritiesandorganizationsinvolvedinnaturerestoration.Dissemina-tionofadvancementsofscientificknowledgecouldbeimproved.Thecommitteerecommendsthattheteamshoulddesignastrategytopresenttheirapproachandresearchinawaythatgeneratesstrongenthusiasm.Giventheintrinsicallyveryattractiveresearchthemes,improve-mentisclearlypossible.
Thisisasolidgroupwithverygoodprospectsintermsofresourcesandresearchthemes.Thereispromisingyoungtalent,andhenceaneedtoconsiderstrategiesforthefuture.Suggestionsmaybetomakeyoungpromisingstaffexplicitlyresponsibleforspecificresearchthemes,toincreasevisibilityoftheintrinsicvalueoftheresearchquestionsandtheirscopetogeneratehighqualityknowledge,andgrowtocombinehigheroutputandoutstandingquality.
Thegrouptacklessomehighlyrelevantandintriguingquestions,andhasadistinctapproachthatshouldleadtoinnovativeinsights.Thecommitteebelievesthatthereisscopeforimprove-mentindesigningavisiontoincreasethevisibilityofthegroupandinemphasizingthespe-cificityofthemissionandthedistinctnessoftheresearchgroupatanationalandinternationallevel.
10� QANU/ResearchEvaluationEnvironmentalSciences�007
103QANU/ResearchEvaluationEnvironmentalSciences�007
6. Utrecht University, Copernicus Institute
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityLandUse,BiodiversityandEcosystemFunctioning
Verygood Good Verygood Verygood
104 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 14: land Use, Biodiversity and Ecosystem Functioning (UU-ES)Programmedirector Prof.dr.M.Wassen,Dr.P.VerweijResearchstaff�006 10.0fteAssessments: Quality: 4
Productivity: 3Relevance: 4Viability: 4
Thegroup is currentlygoing througha restructuringphase following thedepartureof theformergroupleaderPeterdeRuiter.Anewseniormemberwasbeingrecruitedatthetimeofthereview,buthis/heridentitywasnotknowntothereviewcommittee.Thegroupwillcon-tinuetoworkinthreecloselyrelatedthemes:1.Globalchangeandecosystems,�.Biodiversityandbiogeochemicalcycling,and3.Naturalresourcemanagementandbiodiversityconserva-tion.Eachofthesethemesisimportantataninternationallevel,andtheyprovideforaninte-grated,coherenttrainingandresearchprogram.Eachthemewillbescientificallycoordinatedbythethreeseniorscientists(Rietkerk,WassenandVerweijrespectively),whilethenewchairwillberesponsibleforlinkswithpolicyandsociety.Theneworganizationseemswellplannedandthechoiceswerewellexplainedtothecommitteeattheinterview.ThePhDstudentshadapositiveviewoftherestructuringandrelocationoftheCopernicusinstitute,indicatinganactiveandscientificallystimulatingenvironmentforthegroup.
Theresearchprogrammeofthegroupispromising,withaverygoodvisionandindicationsofgoodleadership.Theprogrammeisevolvingthroughstaffchanges,andthedevelopinglinksbetweenscienceandpolicyare likely tobe fruitful.Thequalityof thegroup isverygood,withseveralexcellentpapersinworld-leadingjournals,especiallyfromresearchthemes1and�, showing international excellence.However there is somevariation inqualitywithin thegroup,andthereisaneedforgreaterandmoreevenvisibilityinleadingpeer-reviewedjournalsamonggroupmembers.
Althoughproductivityisratedasgood,ithasalsobeenvariableandunbalancedamonggroupmembers.Giventhelargepotentialinallthreeresearchthemes,itislikelythatproductivitywillincreaseinfutureacrossallresearchfronts.
Therelevanceoftheworkisveryhigh.End-usercontactsareexcellent,andthesocietalimpactofsomeoftheworkisvery.Scientifically,theimpactofthegroupishighreflectingainterna-tionallycompetitiveperformancecoupledwithaleadingroleintheNetherlands.
Thegrouphasrespondedwelltocommentsfrompreviousreviews.Staffchangeshavebeenusedpositivelytoameliorateweaknessesregardingsocietalimpact.Theagestructureofthegroupiswellbalanced,addingfurthertofuturepotential.Thecommitteenoted,however,thefactthatmostPhDstudentstendedtoworkonappliedaspects.Thepotentialtointegratebasicandappliedscientificthemes,forexamplebybringingbasictheoryintoappliedecology,wasseenasastrength,butonethatwasnotyetbeingfullyrealised.Gapsbetweenthemes1,�and3couldbebridgedbetter,andtheme3needstoimproveinproductivityandprofile.Toachieve this, itmightbenecessary topaymoreattention to thedesignandconceptualframeworkofthestudiescarriedoutundertheme3.Theprospectsforlonger-termviabilityareverygood,andthegroupwillmostlikelybecomeinternationalleaderstogetherwiththeothergroupsattheCopernicusinstitute.
105QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 1: Curricula Vitae of committee members
Prof. Jan Bengtsson,Dept.ofEcologyandEnvironmentalResearch,SwedishUniversityofAgriculturalSciences,Uppsala.Researchfocusedoncommunityecology inspatially subdi-videdhabitats,andonthelinkagesbetweenpopulationandecosystemecology.StudyofthedynamicsandspeciesinteractionsinDaphniametapopulationsinrockpoolssincetheearly1980-ies.Morerecently,heusedsoilorganismstostudyhowfoodwebstructureinfluencesecosystemprocesses,bothintheoryandinanappliedcontext.Thishasledtoaninterestintheimportanceofbiodiversityforecosystemfunctioning,andmanagementoflandscapesforbiodiversityconservation.Heisalso interested inthe longtermdynamicsofcommunities,andheisinvolvedinstudiesofdiversityandecosystemservices(mainlybiologicalcontrol)inagriculturallandscapes.
Prof. luc De Meester,DepartementBiologie,KULeuven,LaboAquatischeEcologie&Evo-lutiebiologie.Researchtopics:Evolutionaryecology,usingzooplankton(Daphnia)asmodelorganisms;Micro-evolutionaryresponsestonatural(e.g.predatorsandparasites)andhuman-inducedstress(e.g.pollution,globalwarming,habitatfragmentation);Aquaticecologyofshal-lowlakesandponds;Biodiversityandnatureconservation(aquatichabitats;shallowlakes);RestorationecologyandBiomanipulationofshallowlakesandponds;Ecologyofrestingeggbanks in aquatic organisms; Community ecology of zooplankton; community assemblage;metacommunitystructure;Populationgeneticsofzooplankton;metapopulationbiology.
Prof. Steve Ormerod,CardiffUniversity,SchoolofBiosciences.Researchinterestsintherela-tionshipbetweencatchmentcharacteristicsandtheecologyofrunningwatersandwetlandsthrough theapplicationof experiments, surveys andmathematicalmodels.He is currentlyreaderinEcologyandHeadofCatchmentResearchatCardiffUniversity,andalsoeditoroftheJournalofAppliedEcology.Dr.OrmerodwasamemberoftheAcidWatersReviewGroupandtheCriticalLoadsAdvisoryGroup.
106 QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 2: Overview of Scores
Table 1: Overview of scores
Quality Productivity Relevance ViabilityProgramme7:AquaticEcologyandWaterQualityManagementGroup
Excellent Verygood Excellent Excellent
Programme8:NatureConservationandPlantEcologyGroup
Verygood Excellent Excellent Verygood
Programme9:AnimalEcologyGroup1:CommunityandEvolutionaryEcology
Verygood Good Verygood Verygood
Programme10:SystemsEcologyGroup
Excellent Excellent Verygood Excellent
Programme11:TheoreticalBiologyGroup
Verygood Good Good Good
Programme1�:EnvironmentalSciencesGroup
Good Good Verygood Verygood
Programme13:EnvironmentalBiologyGroup
Verygood Good Verygood Verygood
Programme14:EnvironmentalSciencesGroup
Verygood Good Verygood Verygood
Table 2: SEP-scale; the meaning of the scores
Workthatisattheforefrontinternationally,andwhichmostlikelywillhaveanimportantandsubstantialimpactinthefield.Instituteisconsideredaninternationalleader.
Excellent (5)
Workthatisinternationallycompetitiveandisexpectedtomakeasignificantcontribution;nationallyspeakingattheforefrontinthefield.Instituteisconsideredinternationalplayer,nationalleader.
Very good (4)
Workthatiscompetitiveatthenationallevelandwillprobablymakeavaluablecontributionintheinternationalfield.Instituteisconsideredinternationallyvisibleandanationalplayer.
Good (3)
Workthatissolidbutnotexciting,willaddtoourunderstandingandisinprincipleworthyofsupport.Itisconsideredoflessprioritythanworkintheabovecategories.Instituteisnationallyvisible.
Satisfactory (2)
Workthatisneithersolidnorexcitingflawedinthescientificandortechnicalapproach,repetitionsofotherwork,etc.Worknotworthyofpursuing.
Unsatisfactory (1)
107QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 3: Schedule
Environmental Biology and Ecology Review Committee (EBE)
SUNDAY 17-06-2007
Utrecht
xx.xx–15.00 ARRIVALNHCentreUtrecht,Janskerkhof10,Utrecht,Tel.+31.30.�313169
15.00–15.30 WELCOME15.30–16.00 QANU:Generalintroductionontheassessmentandthereview
programme16.00–16.30 SENSE:GeneralintroductionSENSE,withemphasisonthe3different
assessmentlevels:researchgroups;SENSEinstitutesandSENSEResearchSchool
16.45–18.30 InternalRCmeeting19.00–�1.00 DINNER�1.00–��.00 (meetingchairs)
MONDAY 18-06-2007
Amsterdam
09.30–10.30 InternalRCmeeting10.30–11.30 PresentationanddiscussionTheoreticalBiologyGroup(TB-ICM/VU)
nr.1111.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 PresentationanddiscussionAnimalEcology1:Communityand
EvolutionaryEcologyGroup(AE1-IES/VU)nr.914.00–15.00 PresentationanddiscussionSystemsEcologyGroup(SE-IES/VU)nr.1015.15–16.45 Sitevisit+PhD(poster)presentationsTB,AE1,SE)anddiscussion17.00–18.00 InternalRCmeeting18.00–�0.00 Dinner/TraveltoUtrecht
TUESDAY 19-06-2007
Utrecht
09.30–10.30 PresentationanddiscussionEnvironmentalSciencesGroup(ESG-Copernicus/UU)nr.14
10.30–11.30 Sitevisit+PhD(poster)presentationsESGanddiscussion¾hourWageningen
13.00–14.00 PresentationanddiscussionAquaticEcologyandWaterQualityManagementGroup(AEW-WIMEK/WU)nr.7
14.00–15.00 PresentationanddiscussionNatureConservationandPlantEcologyGroup(NCP-WIMEK/WU)nr.8
15.15–16.45 Sitevisit+PhD(poster)presentations(AEW,NCP)anddiscussion17.00–18.00 InternalRCmeeting18.00–�0.00 Dinner
WEDNESDAY 20-06-2007
Nijmegen
10.00–11.00 PresentationanddiscussionEnvironmentalSciencesGroup(ES-RU)nr.1�11.00–1�.00 PresentationanddiscussionEnvironmentalBiologyGroup(EB-RU)nr.13
108 QANU/ResearchEvaluationEnvironmentalSciences�007
1�.00–13.00 Lunchbreak13.00–14.00 InternalRCmeeting14.00–15.00 Sitevisit+PhD(poster)presentations(ES,EB)anddiscussion15.00–16.00 InternalRCmeeting16.00–17.00 InternalRCmeeting/closure17.00–18.0018.00–�0.00 Dinner
109QANU/ResearchEvaluationEnvironmentalSciences�007
Committee Environmental Earth Sciences (EES)
110 QANU/ResearchEvaluationEnvironmentalSciences�007
111QANU/ResearchEvaluationEnvironmentalSciences�007
1. The review committee and the review procedures
Scope of the assessment and structure of this reportTheReviewCommitteewasaskedtoperformaresearchassessmentofthefollowingresearchprogrammesoftheWageningenInstituteforEnvironmentandClimateResearch(WIMEK):
• EarthSystemScience–ClimateChangeGroup(WU-ESS)• HydrologyandQuantitativeWaterManagementGroup(WU-HWM);• SoilPhysics,EcohydrologyandGroundWaterManagementGroup(WU-SEG).
Thisassessmentcoverstheactivitiesandtheresearchintheperiod�001-�006.Theassessmentispartofthe�007reviewoftheNetherlandsResearchSchoolforSocio-EconomicandNatu-ralSciencesoftheEnvironment(SENSE).
TheCommittee'stasksweretoassessthequalityofthenamedWIMEKresearchprogrammeson thebasisof the informationprovidedby the Instituteand through interviewswith themanagementandtheresearchleaders,andtoadvisehowthisqualitymightbeimproved.
PartI,chapter1describesthecompositionoftheCommittee,itsactivitiesandtheproceduresfollowedbytheCommittee.PartI,chapter�containsgeneralremarksaboutthestateoftheartinthefieldofEnviron-mentalEarthSciences.PartIIcontainstheassessmentoftheprogrammes.
Composition of the CommitteeThecompositionoftheCommitteewasasfollows:
• AndreaRinaldo,professorofHydrogeomorphologyandtransportphenomenainthehy-drologicalcycle-IMAGEDepartmentoftheUniversityofPadova(chair);
• HannesFlühler,professorofSoilPhysics-InstituteofTerrestrialEcology(ITÖ)ofETHZürich;
• RolandSchulze,professorofHydrology-DepartmentofAgriculturalEngineeringoftheUniversityofNatal.
PetervanHoltenwasappointedsecretarytotheCommittee,onbehalfofQANU(QualityAssuranceNetherlandsUniversities)
AshortcurriculumvitaeoftheCommitteemembersisincludedinAppendix1.
IndependenceAllmembersof theCommittee signeda statementof independence to safeguard that theywouldassessthequalityoftheInstituteandresearchprogrammesinanunbiasedandinde-pendentway.Anyexistingpersonalorprofessionalrelationshipsbetweencommitteemembersandprogrammesunderreviewwerereportedanddiscussedinthecommitteemeeting.TheCommitteeconcludedthattherewerenocloserelationsordependenciesandthattherewasnoriskintermsofbiasorundueinfluence.
11� QANU/ResearchEvaluationEnvironmentalSciences�007
Data provided to the CommitteeTheCommitteehasreceiveddetaileddocumentationconsistingofthefollowingparts:
1. TheSelfEvaluationReportsoftheresearchgroupsnamedbefore;�. Copiesofthreekeypublicationsperresearchgroup;3. Bibliometricstudy1996-�004;4. TheSelfEvaluationreportoftheWIMEKinstitute(forinformation);5. TheSelfevaluationreportoftheSENSEResearchschool(forinformation).
ThedocumentationincludedalltheinformationrequiredbytheStandardEvaluationPro-tocol(SEP).
ThethreeEnvironmentalEarthScienceresearchgroupsevaluatedaccordingtothisprotocolareallinatransitionphaseandareintheprocessofbuildingupnewworkinggroups(profes-sorships).ThishasbeentakenintoaccountbytheCommitteeintheassessmentoftheper-formanceandpotentialofthegroupsvisited.
Theevaluationprocesswascarefullyorganizedandprofessionallystructured.
Procedures followed by the CommitteeThe Committee proceeded according to the Standard Evaluation Protocol (SEP). Prior totheCommitteemeeting,eachprogrammewasassignedtoafirstandasecondreviewer,whoformulatedapreliminaryassessment.ThefinalassessmentsarebasedonthedocumentationprovidedbytheInstitutes,thekeypublicationsandtheinterviewswiththemanagementandwiththe leadersof theprogrammes).The interviewstookplaceonJune18,�007(see thescheduleinAppendix3).
Precedingthe interviews, theCommitteewasbriefedbyQANUaboutresearchassessmentaccordingtoSEP.Onthesameday,June17,�007,theCommitteediscussedthepreliminaryassessments.Foreachprogrammeanumberofcommentsandquestionsweredecidedupon.TheCommitteealsoagreeduponproceduralmattersinrelationwiththepresentationby,anddiscussionwitheachresearchgroup.Eachresearchgroupdeliveredinashortpresentationthehighlightsoftheirprogramme,followedbyadiscussionwiththereviewcommittee.Finallyeachresearchgrouppresenteditsfacilities.Ratherthanatourtodemonstratethesefacilities,locatedinadifferentbuilding,postersandvideopresentationswereused.AttheendofthevisitprogrammethePhDstudentsoftheresearchgroupspresentedtheirresearchinapostersession.AftertheinterviewstheCommitteediscussedthescoresandcommentsandmadedrafttextsonJune18,thedayafterthevisit.Thetextswerefinalisedthroughemailexchanges.ThefinalversionwaspresentedtotheInstitutesandSENSEonAugust1,�007.ThecommentsoftheInstitutesandSENSEwerediscussedintheCommitteeandledtochangesinthereportonanumberofpoints.ThefinalreportwaspresentedtoBoardoftheparticipatinguniversityandwasprintedaftertheirformalacceptanceofthereport.TheCommitteeusedtheratingsystemoftheStandardEvaluationProtocol(SEP).Themean-ingofthescoresisdescribedinAppendix�.
113QANU/ResearchEvaluationEnvironmentalSciences�007
2. General remarks
The Earth System Science and Climate Change(WU-ESS)groupaddressesEarthSystemsresearchin5interlinkedandinteractivethematicresearchclusterscoveringfundamentalandappliedclimate-landrelatedissues.ESSisanewlyestablishedchairgroupingatWageningenUR,sinceApril�006only.TheESSgrouphasexceptionallystrongleadership,ambitiousgoalsandexcellentfunding.Thestrategyandpolicyofresearchappearsoundandincludeamajoreffortinnewinitiativesinteachingandrevisitingprevioussyllabi,withaparticularemphasisonIntegratedWaterResourceManagement.ThegroupiswellrepresentedinWURaswellasinnationalandinternationalcollaborationsandnetworks,withmembersofthegroupofteninleadershiproles.The group displays numerous strengths, perhaps above all the thrust into climate changeresearch.Ifweaknessesaretobehighlighted,theserevolvearoundhavingtocopewithtwoadministrativesystems,largelyalegacyofare-alignmentoftwopreviouslyexistinggroups.
The hydrology and Quantitative Water management(WU-HWM)programmehastobeseeninperspective.TheformerChairholderleftrecentlyandanewChairhasbeenappointedonlyinApril�007.OveralltheCommitteehasgreatconfidencethatthecurrentleadershipwillultimatelysucceedinprovidingvision,academicreputationandscientificresearchattheforefront,internationally.Theresearchworkhasbeenwidelyvisibleandtheoverallinternationalreputationofthegroupisundeniable.ThegrouphasbeensuccessfulinobtainingnationalandEUfunding.TheCommitteenotedplentyofscopefortheevolutionoftheprogrammeandanimpressivemomentumtodoso.Management and organization seem somewhat in need of reinforcement.The Committeehastheimpressionthatthegroupisunderstaffed.TheManagementstyleofthenewChairisappreciated
TheSoil Physics, Ecohydrology and Groundwater Management(WU-SEG)groupisinastateoftransition,gearinguptowardnewgoalsinadrasticallytransformedconstellationofpersonnel.Fromthe1�tenuredacademicsjustfourwillcontinueasfullyactivemembersofSEG.Thegroupisclearlyunderstaffedandunder-resourced.Themainthemeofthegroupisprocessunderstandingandquantificationofwaterandele-mentfluxesinfieldsoils(unsaturatedzone).Theecohydrologyclaimedbytheabovemen-tionedHWMgrouprelatestothescaleofentirecatchmentswithafocusonthearealwaterfluxesbetweenbiosphereandatmospherewhereastheSEGgroupintegratestheprocessesthatcontrol thewater regimebetweensubsoilup intoandthroughtheplantcanopy, the latterbeingprimarilybasedonfieldscaleexperimentationandmodellingandtheformeroncatch-ment-scaleobservationsandmodelling.Thepublicationrecordofthegroupisverygoodandinternationallywellvisible.Thenewmeasuringtechniquesforthemonitoringofsolutefluxesareascientificbreakthrough.Thegrouphasahighprobabilityofbecomingaprominentunitinsoilphysicalresearch.TheCommitteeratestheperformanceofthegroup‘Verygood’inallaspects,i.e.quality,productivity,relevanceandprospects.Thepersonnelcapacityhowever,iscriticallylimitingitspotential.
In general the Committee had a strong positive impression from the presentations of thegroupsofPhDstudents,whosescholarshipanddrivewereassumedasasignofgreatvitalityoftheprogram.
114 QANU/ResearchEvaluationEnvironmentalSciences�007
115QANU/ResearchEvaluationEnvironmentalSciences�007
3. Wageningen University, Institute WIMEK
3.1. Assessment per institute
WIMEKaimstodevelopanintegratedunderstandingofenvironmentalchangeanditsimpacton the quality of life and sustainability, by i) conducting innovative scientific research, ii)offeringPhDtrainingandeducation,andiii)disseminationofemerginginsightsandrecentresults.
ThepolicyofWIMEKistocontributetothedevelopmentofhighqualitynationalandinter-nationalscientificresearch,focusedonthemultidisciplinaryandinterdisciplinaryunderstand-ingofenvironmentalchangeanditsimpactonthequalityoflifeandsustainability.
WIMEKresearchleadershavedevelopedastronginternationalnetworkandparticipatesuc-cessfully in national and international research programmes. WIMEK researchers are alsoactivelyinvolvedininternationalpolicyassessments,suchasIPCCandtheMillenniumEco-systemAssessmentandinnationalresearchprogrammeslikeBsik‘Climatechangeandspatialplanning’and‘Geoinformation’.
TheWURExecutiveBoardhasdefinedseveralresearchprioritiesfortheyearstocomeincon-sultationwiththegraduateschoolsandthesciencegroups.Theseprioritiesarei)strengthen-ingtheknowledgebaseofthespecialisedresearchinstitutesbyallocationofstrategicresearchfunds financedbythenationalgovernmentandenhancingsynergybetweenthespecialisedresearchinstitutesandtheuniversity,andii)identifyingupcomingandfastdevelopingresearchthemes,whichneedextrafinancialinvestmentsinthecomingyears.
Thedevelopmentofinnovativefundamentalresearchandstrategicresearchrequiresastimu-latingacademicenvironmentinwhichresearchershaveamplefreedomtodevelopandpursuetheiroriginal ideas.Therefore, theWIMEKchairgroupsareautonomous inchoosinganddevelopingtheirownresearchtopics.
Fundingof thenationaland international researchprogrammes isbyNWO,EU,nationalandforeigngovernments,industriesandotherparties.TheWURExecutiveBoarddeterminesthegeneralpolicyontheallocationofbudgetsamongtheresearchgroups.ThebudgetforeducationisbasedtherealteachingandsupervisingeffortsincludingthesupervisionofPhDstudents.Onaverage40–45%ofthetenuredstafftimeisavailableforresearch.ExtraresearchfundsaregrantedforhavingattractedNWOfundedpost-docsorPhDstu-dents.Thisbudgetmaybeusedtoemployadditionalstaff.TheExecutiveBoardgrants, inadditionresearchbonusesbasedon the scientific researchperformance.Furthermore,extraresearchfundsmaybegeneratedfromexternallyfundedresearchprojects.
Thequalityassessmentofall tenuredstaffmembers isbasedoncriteriadeterminedbytheSENSEResearchSchool.
WIMEKhasastrongpositioninenvironmentalandclimateresearch.Thescientificquality,productivityandrelativeimpactoftheWIMEKchairgroupsvariesfromgoodtoexcellent.The internationaldimensionof environmental issues requires activeparticipation in inter-national scientific research networks and intensive co-operation with foreign high qualityresearchgroups.TheverylimitedresearchbudgetperchairgroupobtainedfromWUR,limits
116 QANU/ResearchEvaluationEnvironmentalSciences�007
theinitiationofcuriosity-drivenresearchprojects.ThequalityoftheWIMEK/SENSEPhDeducationcanbefurtherimproved.
3.2. Asssessment per programme
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityEarthSystemScience-ClimateChange(WU-ESS)
Verygood Verygood Verygood/Excellent
Verygood/Excellent
HydrologyandQuantitativeWaterManagement(WU-HWM)
Good/Verygood
Good Good Verygood/Excellent
SoilPhysics,EcohydrologyandGroundwaterManagement(WU-SEG)
Verygood Verygood Verygood Verygood
117QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 15: Earth System Science-Climate Change (WU-ESSProgrammedirector Prof.dr.P.KabatResearchstaff�006 8.54fteAssessments: Quality: Verygood
Productivity: VerygoodRelevance: VerygoodtoExcellentProspects: VerygoodtoExcellent
AnewlyestablishedChairgroupingatWageningenUR,commencingonlyinApril�006(i.e.inthelastyearoftheperiodunderreview),theESSgroupaddressesEarthSystemsresearchin5interlinkedandinteractivethematicresearchclusterscoveringfundamentalandappliedclimate-landrelatedissuesacrosstherangeofscalesfrompointtoglobalandwithbothstrongdisciplinaryandtrans-disciplinaryapproaches.
Thisholisticandall-encompassingapproachis,ontheonehand,alegacyoftheindividualresearchersmakinguptheESSgroupandtheirformeraffiliations,whilesimultaneouslyitisaninnovativeone.
TheESSgrouphasexceptionallystrongleadershipthroughProf.Kabat,hasambitiousgoalsandexcellentfundingoftheorderof3.5milEuro/annum(withmoreinthepipeline),madeupof90%fromlargeandlong-termexternalfunds.Thestrategyandpolicyofresearchappearsoundandincludeamajoreffortinnewinitiativesinteachingandrevisitingprevioussyllabi,withaparticularemphasisonIntegratedWaterResourceManagement.
Witheachofthe5thematicresearchclusters,thereissimultaneouslyrelativelyhighprofilein-houseexpertisewhilethereisstronginteractionbetweenclusters,witheachappearingtobeadequatelyfunded.ThegroupiswellrepresentedinWURaswellasinnationalandinterna-tionalcollaborationsandnetworks,withmembersofthegroupofteninleadershiproles.
Theacademicreputationofthegroupasawholeissound,butisperceivedtoleanheavilyonthenewprogrammeleader’spre-�006prominenceininternationalandnationalforumsandinthemembers’historicalpublicationsrecord.
GiventhevulnerabilityoftheNetherlandstocertainimpactsofclimatechange,thenationallevelresearchandcoordinationundertakenbythegroupishighlyrelevantaswellashavingbeenmadehighlyvisibletodecisionmakersandthepublicatlarge.
The group displays numerous strengths, perhaps above all the thrust into climate changeresearchacrossarangeofscales,afocusonstate-of-the-artobservationsandthetrans-disci-plinarynatureofitswork.Ifweaknessesaretobehighlighted,theserevolvearoundhavingtocopewithtwoadministrativesystems(largelyalegacyofare-alignmentoftwopreviouslyexistinggroups), aperceived inadequacyof in-houseadministrativeback-up (although thishas recentlybeenpartiallyaddressed),anoverloadofcommitmentsandaperceivedstrongdependenceonthereputationanddriveoftheprogrammeleader(althoughthelatterisatthesametimeamajorstrength).
Finally,theCommitteehashadastrongpositiveimpressionfromthepresentationsofthegroupofPhDstudents,whosescholarshipanddrivewereassumedasasignofgreatvitalityoftheprogram.
118 QANU/ResearchEvaluationEnvironmentalSciences�007
Theoverallqualityofthegroupis‘VeryGood’(i.e.4ontheSEP-scale),withsomecrystal-lizationpossiblystillbeingrequiredinthecoherenceoftheprogramme(3)andallowingmoremembersofthegrouptocomemoretothefore,butwiththebenefitofahighlyprominentprogrammeleader(5).
Inrelationtoproductivitytheoverallratingis‘VeryGood’(4),withtheoutputofprofessionalpapersbeingexcellent,whiletodatethenumberofPhDthesescompletedisonthelowside.Theaverageisonly1.5peryearfortheperiodunderreview,butwithasignificantnumberofnewcandidatesregistered,anannualoutputof3-4PhDsisexpectedinyearstocome.
Consideringthestatedmissionofthegroup,theoverallrelevanceoftheprogrammeisrated‘VeryGoodtoExcellent(4-5),inparticulartheeffortsinrelationwiththedisseminationofknowledgeand,asfarasaresearchgroupcango,theimplementationofknowledge.ThedirectsocietalrelevanceoftheresearchoutputfortheperiodunderreviewismoresoinaDutchcontext,althoughthroughcontributionstoandleadershipof,inter alia,theInternationalDia-logueonWaterandClimate,theInternationalGeosphere-BiosphereProgramme,theMillen-niumEcosystemAssessmentandtheIntergovernmentalPanelonClimateChange,membersofthegrouphavemadesomesignificantcontributionstotheadvancementofknowledgeanditsdissemination.
Withitsenthusiasm,dynamicleadership,overallageprofile,goodmixofexperiencedandnewstaffandhighnationalandinternationalprofile,theprospectsforthisgroupareconsidered‘VeryGoodtoExcellent(4-5)’,withtheprovisothatthegroupcankeepupwithitscommit-mentsandnotconstantlyplacesitselfundertimepressure.
119QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 16: hydrology and Quantitative Water Management (WU-hWM) Programmedirector Prof.dr.ir.R.UijlenhoetResearchstaff�006 8.�3fteAssessments: Quality: GoodtoVeryGood
Productivity: GoodRelevance: GoodProspects VeryGoodtoExcellent
Theprogrammehastobeseeninperspective.Theformerchairholderleftrecently(andmuchoftheevaluationhingesofachievementsdirectlyorindirectlyrelatedtothepastChair’sman-agement),andanewChairhasbeenappointedonlyinApril�007.Thetransientcharacterof themissions isobviouslyreflected inthis fact, jointlywithacomplex legacyof thepastintermsofachievementsanddirections.Overall, theCommitteehasgreatconfidencethatthecurrent leadershipwillultimatelysucceedinprovidingvision,academicreputationandscientificresearchattheforefront,internationally.TheCommittee’sjudgementhasthereforetobeseenasawholeandreadsomewhatindetail,wepresume,becausenormativeindicatorsofquality,productivity,relevanceandprospectsarenecessarilyareflectionofthepastandthefuturemergedtogether.
Innovativework is apparent fromtheprogramme, especially concerning themeasurement,assimilationandmodellingofhydrologicfluxesonawiderangeofscalesinspaceandtime.Whereasonecannotlooksolelyatthesteadyproductionoftheresearchoutputintheprevi-ousreviewperiod,giventherathersharpdiscontinuitiesinscientificmanagementtheoverallproductivityisjudgedfavourably.Theprogrammehasproducedsteadyresultsonhigh-impactjournals(clearlyrankedatthetopofthehydrologicalandwaterresourcesliterature)overmostoftheperiodwhichcouldbeexamined(�006),withvariabledistributionwithinthegroup.Theresearchworkhasbeenwidelyvisibleandtheoverallinternationalreputationofthegroupisundeniable,althoughwithdifferentattributionstotheoldandthenewleadership.InthissensethedifficultiesoftheCommitteeindistinguishingpastandprospectiveachievements(arguablythematterofforemostinteresttoSENSE)havetobeacknowledged.
Thegrouphasbeen successful inobtainingnational andEU funding, receivedprestigiousscholarshipsandseemschannelledthroughasustainableacademicpathway.Thestriveforfun-damentalcatchmentscienceandhydrologytoovercomethequantitativewatermanagementisapparent,andthisislaudedbytheCommittee.Onenotes,however,thatonaproperbal-ancesuchdiversityisnotseenasharmful,andthecurrentleadershipstyle,whichisrespectfulofotherexistingcapabilitiesandobjectivesintheacademicenvironment,isappropriateandfruitful.TheCommitteenotedplentyofscopefortheevolutionoftheprogrammeandanimpressivemomentumtodoso.
Incidentally,theCommitteespeculatedwithkeeninterestaboutpossiblesuggestionsaboutsuchevolution.Specifically,theresearchprogrammeisdeemedinterestingbutinneedofsomecriticaldecisions.Indeedcatchmenthydrology,themaintheme,isanimportantissuebothsci-entificallyandforsocietyatlarge.ItiscleartotheCommittee,however,thattheforemostsci-entificchallengesaheadinthisareawilllieratherattheinterfacewithotherdisciplines,withinthesamescalesandprocesses–specifically,atmosphericsciencesononesideandecologyontheother.Inthissensetheresearchavenueofthedevelopment,testingandinterpretationofadvancedobservationmethodsforhydrologicalfluxesandstatesismuchencouragedwithinthedefiningcatchmentsciencefieldchosen(orinherited).InthisrespecttheCommitteewel-
1�0 QANU/ResearchEvaluationEnvironmentalSciences�007
comesthedirectionssuggestedbythenewChair,whoseenergyanddrivedeeplyimpressedtheCommittee.Indeedtheadvancedobservationtechniquesfornaturalphenomenaandhydro-logicalfluxesinparticularareasoundandimportantareaofresearch.
TheCommitteealsomadeclearduringthepresentationthatperhapsadefiniteaimateco-hydrology(inthesenseofwater-controlledecologicalprocessesoccurringwithinthecatchmentandatrelatedspatialandtemporalscales)couldbeanimportantandsuitablecollectiveobjec-tiveforthegroup,giventheimportanceoftheresearchatstakeandtheuniqueopportunitiescurrentlywaitinginWIMEKandinthisprogramme.Academicproblemsnotwithstanding(whichwedonotunderestimate),weobservethateco-hydrologicalprocessesatthescaleofthecatchmentwillbeimportantandgloballyvisible,andnaturallysuitedtotheexperimentalfacilities,previousinsight,scholarshipandvocationofthegroup.The Committeenotes that this process, epitomizedby the conversionofmany importantHydraulicLaboratories toGeophysicalFluidDynamicsLaboratories, is likely tobe slowerintheNetherlandswherebythenatureoftheirdrainageproblemsthehydraulictraditionisstrongandprominent–yetperhapsitisanecessarytransitionwhichmightbefruitfultowardsimprovedrelevanceoftheresearchgiventhenewdirections.
Abriefnoteofotherfacts:
• Managementandorganizationseemsomewhatinneedofreinforcement.Whileindeedtheoverallcountoffteseemsinlinewithothergroups,theCommitteehashadtheim-pressionofunderstaffing.TheManagementstyleofthenewChairisappreciated;
• TheCommitteehashadastrongpositiveimpressionfromthepresentationsofthegroupofPhDstudents,whosescholarshipanddrivewerereadasasignofthegreatvitalityoftheprogram;
• ItissomewhatuncleartotheCommittee(yetnotnecessarilyinexplicable)howthediffe-rentlayersofcoordinationoperateintheNetherlandsacademicenvironment.Specifically,theCommitteewonderswhatactualmechanismsfavourtheinterrelationsandscientificcollaborationamongthedifferentgroupsactiveinHydrology(namelythegroupsnum-ber15,16and17belongingtodifferentChairs)withinSENSEand/ortheBoussinesqCentreforHydrology.Furthermore,themeritwhichtheInstitutionsaregainingfromthespreadingofhydrologicresearchwithinthreedifferentGroups/Chairs,seemssomewhatunclear.
• Drybibliometric indicators cannotproperlygive the right impressionof theacademicqualityofthisgroupandofitsscientificoutputifnotproperlyconsidered.Whatmat-tersinthiscaseinparticular,isthepotentialratherthanthecurrentintegralofthepastachievements,perseaby-productofageandhistoryofmanagementwhennotdirectlyattributabletoFacultyjustrecentlyleft.
Thescientificqualityoftheproductionisoverallrated‘GoodtoVeryGood’(3-4).Nationalprominenceand internationalvisibilityareundoubtedlyachieved,bothunder thepreviousandthenewmanagement.Todate,thisgroupcannotbedefinedasaworldleadinggroupasawhole,althoughthisCommitteehashighexpectationsthatthismighthappeninthenearfutureowingtoalloftheabove.
1�1QANU/ResearchEvaluationEnvironmentalSciences�007
Theoverallpercapitaproductivityis‘Good’(3),andthedrivetodirectmuchofthescientificproduction (oncedirected tounrefereed sources) to refereed sources is visible andappreci-ated.
Thescientificandsocietal relevanceof thehydrologic issuespursuedherein isperceivedas‘Good’(3),aswellastheprospectivefocusoftheincomingactivities.TheCommitteenotesthatadramaticturnaroundintherelevancecouldoccur,shouldthegroupdecidetoaimatthecuttingedgeofinterdisciplinaryresearchcentredaroundcatchmentscalesandprocesses.
Forallthereasonsdiscussedabove,theCommitteeisoftheopinionthattheperspectivesaretobeseenasVeryGoodtoExcellent(4-5),inparticulartrustingthenewlyacquiredleadershiptowardsthecreationofaninternationalpowerhouseofresearchandextensioninthegeneralareaofcatchmentscience.
1�� QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 17: Soil Physics, Ecohydrology and Groundwater Management (WU-SEG)Programmedirector Prof.dr.ir.S.E.A.T.M.VanderZeeResearchstaff�006 7.09fteAssessments: Quality: VeryGood
Productivity: VeryGoodRelevance: VeryGoodViability: VeryGood
Thisunitisinastateoftransition,gearinguptowardnewgoalsinadrasticallytransformedconstellationofpersonnel.Fromthe1�tenuredacademicslistedinAnnex1oftheSelfevalu-ationReport,justfourofthemwillcontinueasfullyactivemembersofSEG.Themajorityofthestafflisted,isintheprocessofleavingorwentonretirement.Tworetiredcolleagueswillcertainlybepartially available for adviceand scientific supportbutunavailable tonucleatenewprograms.Hencethegroupisclearlyunderstaffedandunder-resourced,aproblemthathastobetakencareof.Theassessmenttheprofessionalperformanceofthisgroupisdifficult,becausethescientificproductspresentedintheself-evaluationreportandduringtheinter-viewshavebeengeneratedbyagroupthatonlypartiallycontinuestoexistandtherecordofthenewlyformedgroupcoversaveryshortperiodofproductiontime.
Themainthemeofthisgroupisprocessunderstandingandquantificationofwaterandele-ment fluxes in fieldsoils (unsaturatedzone).Thegroupfollows threealleysof research: (i)including the dominant role of heterogeneity on the water flow field and solute fluxes instochastic models, (ii) developing new concepts for implementing the role of roots in themodelled system, and (iii) making use of the scientific treasure of the previous Chair bysupportingtheworldwideuseoftheintegratedSWAPModelandshiftthefocusfromagro-hydrologytothepedohydrologyofnaturalecosystems.HereweusethetermpedohydrologyinlieuofecohydrologytoclarifythedifferentperspectiveandobservationscaleoftheSEGandthe‘HydrologyandQuantitativeWaterManagement’(HWM)groups.Theecohydrol-ogyclaimedbyHWMrelatestothescaleofentirecatchmentswithafocusonthearealwaterfluxesbetweenbiosphereandatmospherewhereasSEGintegratestheprocessesthatcontrolthewaterregimebetweensubsoilupintoandthroughtheplantcanopy,thelatterbeingpri-marilybasedonfieldscaleexperimentationandmodellingandtheformeroncatchment-scaleobservationsandmodelling.
Finally,theCommitteehadastrongpositiveimpressionfromthepresentationsofthegroupofPhDstudents,whosescholarshipanddrivewereassumedasasignofthegreatvitalityoftheprogram.
ProfessorvanderZeeisoneofthescientistsinternationallyleadingthestochasticmodellingofreactivesolutetransportintheUnsaturatedZone.Hehasaprofoundunderstandingofallfacetsoftransporttheoryinsoils.Heisoneoftheveryfewwhohavedonepioneeringworkattheinterfacebetweensoilphysicsandsoilchemistry.Dr.deRooijisahighlyinnovativeexperimentalist(withaprovenexperienceintransportandgeostatisticalmodelling).Thenewmeasuringtechniquesformonitoringsolutefluxesinfieldsoilsandforexpandingthemeasuringrangeoftensiometersarebothascientificbreakthroughwhichhewillbeabletocapitalizeonintheplannedresearchprograms.Dr.Metselaar isanewcomerinrootresearch,butexcellentlyqualifiedtodigintothefieldofmodellingrootmorphologyinthecontextofrootsbeingasinkforwaterandelementsinstructuredsoils.Hecombinessolidexperienceinsoilphysics,mathematicsandplantphysiol-
1�3QANU/ResearchEvaluationEnvironmentalSciences�007
ogywhichmakeshimfittocarryoutoriginalworktoovercomeoneoftherealgapsinsoilphysicalresearch.Dr.VanDamwarrantscontinuitytoexploittheexpertiseaccumulatedundertheguidanceofProfessorFeddes(SWAPmodelsupportcentre).Hecomplementstheprofileoftheotherthreetenuredacademicsbyhisabilitytoapplymodernpedohydrologyinoperationaldeci-sions.OveralltheCommitteeratesthequalityofresearchas‘VeryGood’(4).
GiventhetransitionalconstellationoftheSEGpersonnelthenumberofcompleteddisserta-tions (3.7�peryear) is substantial and significantly aboveaverage.ThenumberofA- andB-papersresultingfromthe19dissertationsislimited(≈0.6perdissertation).However,thepublicationrecordofSEGisdeemed‘VeryGood(4)’andinternationallywellvisibledespitetherelativeimpactratiobeingonlyslightlyaboveone.Thereasonforthisisthefactthatmem-bersofthesoilphysicscommunitytraditionallypublishinA-journalswhichraisestheworldaveragelevelofcitations.ThevariouspublicationcategoriesarewellbalancedwithclassA-andB-papersbeingthedominantoutlet.ThesignificantnumberofbooksandbookchaptersarepartlyalegacyofthepreviousChair(ProfessorFeddes).Thesecontributionsarewellvisibleinthecommunity.ProfessorVanderZee,Dr.deRooijandProfessorFeddesprovidednumeroushighlyappreci-atedservicestothenationalandinternationalcommunity.TheachievementofDr.deRooijasanEGUoffical(EuropeanGeosciencesUnion)needstobeemphasizedbecauseheestablishedthe European platform ‘Unsaturated Zone’ sciences which now attracts many experts fromoverseas.Funding:ThepercentageofNWOfunding(fundamentalscience)isquitehighandfavour-ablyratesthescientificreputationofthisgroup.
Theinstrumentalinnovationforfielduseisahighlightofthepastsixyears(multicompart-mentsamplerandosmotictensiometer).Thesameappliestothecontributioninthefieldoftransporttheory.TheSWAPmodelconceptualizedandimplementedbytheFeddesgroupisoneoftheclassicsandusedbyhundredsofresearchunitsaroundtheglobe.Hencethegroupmaintained,andstilldoes,ausersupportonahighlevel.Theinputofthisgroupspansfromfundamental insights,over technical innovations, toactualuseof theproducts inpractice.Hencetheyserveawidespectrumofcustomers.OveralltheCommitteeratestherelevanceas‘VeryGood’(4).
ThescientificconceptofthisgroupisawellconceivedreorientationwhichmakesoptimaluseoftheknowledgeimportfromSOQ,ofavalorisationofFeddes’legacy,andofanewfocusonrootsasthesinkforwaterandsensitiveprocesscontrolinhydrologicalandglobalclimatemodels.This group has a high probability of becoming a prominent unit in soil physicalresearchwiththerarelabelofaconvincinglyintegratedapproach(soilphysicscomplementedwithsoilchemicalexpertiseandnewinputfromrootphysiologyandmorphology,ararecom-binationofdisciplines).Thepersonnelcapacityis,however,criticallylimitingthepotentialofthisgroupandthisCommitteewouldrecommendanextensionofitspermanentstaff.Over-all,theCommitteeratestheprospectsofthisgroupas‘VeryGood’(4).
1�4 QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 1: Curricula Vitae of committee members
Prof. Andrea Rinaldo, DipartimentoIMAGE,UniversityofPadova.Transportphenomenainthehydrologicalcycle.Hydrogeomorphology.Transport inheterogeneousporousforma-tions.Fluvialhydraulics.Fractalsingeomorphology.Stochasticmodellingofnaturalphenom-ena.Computationalspectralmethods.StochasticModelingofNaturalPhenomena.NetworksinNature.EcologicalSizeSpectraandScalinginEcosystems.
Prof. hannes Flühler, ETHZürich,InstituteofTerrestrialEcology(ITÖ),SoilPhysics.BasicIssues:Transportofwater,solutes,gasandheatin(real)soils;strongemphasisonconductingcontrolledfieldexperimentsthatarebasedonclearlydefinedresearchquestions;adaptinganddevelopingmodelsthataresuitablefordescribingthosefeaturesthatgovernfield-scaletrans-portprocesses;keyisthedynamicsofsoilandrockstructuresandtheirinfluenceontransportinthosemedia;EnvironmentalIssues:managementpractisesandphysicalsoilstatus,mobil-ityofchemicalsinthevadose(unsaturated)zone;transportphenomenainfracturedrockasrelatedtonuclearrepositories;MethodologicalIssues:highresolutionTDR-technology;imageanalysisandquantificationofdyetracerdistributionsinsoils.
Prof. Roland Schulze, DepartmentofAgriculturalEngineering,UniversityofNatal.ResearchInterests:
• Hydrologicalprocessesandscaleissues• Hydrologicalmodelling(developerofACRUmodel)• Integratedcatchmentsmodelling• Designhydrology• Hydrologicaleducation• Climatechangeimpacts• GuestProfessorinhydrologicalmodellingatIHE,Delft(Netherlands)
1�5QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 2: Overview of Scores
Table 1: Overview of scores
Quality Productivity Relevance ViabilityEarthSystemScience-ClimateChange(ESS-CC)
Verygood Verygood Verygood/Excellent
Verygood/Excellent
HydrologyandQuantitativeWaterManagement(HWM)
Good/Verygood
Good Good Verygood/Excellent
SoilPhysics,EcohydrologyandGroundwaterManagement(SEG)
Verygood Verygood Verygood Verygood
Table 2: SEP-scale; the meaning of the scores
Work that is at the forefront internationally, andwhichmost likelywillhaveanimportantandsubstantialimpactinthefield.Instituteisconsideredaninternationalleader.
Excellent (5)
Work that is internationally competitive and is expected to make asignificant contribution; nationally speaking at the forefront in thefield.Instituteisconsideredinternationalplayer,nationalleader.
Very good (4)
Workthatiscompetitiveatthenationallevelandwillprobablymakeavaluablecontributionintheinternationalfield.Instituteisconsideredinternationallyvisibleandanationalplayer.
Good (3)
Workthatissolidbutnotexciting,willaddtoourunderstandingandisinprincipleworthyofsupport.Itisconsideredoflessprioritythanworkintheabovecategories.Instituteisnationallyvisible.
Satisfactory (2)
Workthatisneithersolidnorexcitingflawedinthescientificandortechnicalapproach,repetitionsofotherwork,etc.Worknotworthyofpursuing.
Unsatisfactory (1)
1�6 QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 3: Schedule
Environmental Earth Sciences Review Committee (EES)
SUNDAY 17-06-2007xx.xx–15.00 ARRIVALNHCentreUtrecht,Janskerkhof10,Utrecht,
Tel.+31.30.�31316915.00–15.30 WELCOME15.30–16.00 QANU:Generalintroductionontheassessmentandthereview
programme16.00–16.30 SENSE:GeneralintroductionSENSE,withemphasisonthe3different
assessmentlevels:researchgroups;SENSEinstitutesandSENSEResearchSchool
16.45–18.30 InternalRCmeeting19.00–�1.00 DINNER�1.00–��.00 (meetingchairs)�0.00–��.00
MONDAY 18-06-2007xx.xx–09.30 TraveltoWageningen09.30–10.30 InternalRCmeetinginWageningen10.30–11.30 PresentationanddiscussionEarthSystemScienceGroup(ESS-WIMEK/
WU)nr.1511.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 PresentationanddiscussionHydrologyandQuantitativeWater
ManagementGroup(HWM-WIMEK/WU)nr.1614.00–15.00 PresentationanddiscussionSoilPhysics,EcohydrologyandGround
WaterQualityGroup(SEG-WIMEK/WU)nr.1715.15–16.45 Sitevisit;PhD(poster)presentations(ESS,HWM,SEG)anddiscussion17.00–18.00 InternalRCmeeting18.00–�0.00 Dinner/TraveltoUtrecht
TUESDAY 19-06-2007xx.xx–09.30 Utrecht09.30–10.30 InternalRCmeeting/closure10.30–11.3011.15–1�.0011.30–1�.00
(chairsmeetinGeneralCommittee,Wednesday9:00hrs)
1�7QANU/ResearchEvaluationEnvironmentalSciences�007
Committee Environmental Chemistry, Microbiology, Ecotoxicology and Biotechnology (ECMEB)
1�8 QANU/ResearchEvaluationEnvironmentalSciences�007
1�9QANU/ResearchEvaluationEnvironmentalSciences�007
1. The review committee and the review procedures
Scope of the assessment and structure of this reportTheReviewCommitteewas asked toperforma researchassessmentof theEnvironmentalChemistry,Microbiology,EcotoxicologyandBiotechnologyresearchattheWageningenInsti-tuteforEnvironmentandClimateResearch(WIMEK),at theInstituteforEnvironmentalstudies(IVM-VU)andattheInstituteofEcologicalScience(IES-VU).Thisassessmentcoverstheactivitiesandtheresearchintheperiod�001-�006.Theassessmentispartofthe�007reviewoftheNetherlandsResearchSchoolforSocio-EconomicandNaturalSciencesoftheEnvironment(SENSE).
WIMEK-WUR 18. MicrobiologyGroup(onlyEnvironmentalMicrobiologypart)19. EnvironmentalTechnologyGroup�0. SoilChemistryandChemicalSoilQualityGroup
IVM-VU �1. DepartmentofChemistryandBiologyIES-VU ��. AnimalEcologyGroup�:EcotoxicologyandEcogenomicsGroup
TheCommittee'stasksweretoassessthequalityoftheresearchprogrammesonthebasisoftheinformationprovidedbytheInstitutesandthroughinterviewswiththemanagementandtheresearchleaders,andtoadvisehowthisqualitymightbeimproved.
PartI,chapter1describesthecompositionoftheCommittee,itsactivitiesandtheproceduresfollowedbytheCommittee.Part I, chapter� containsgeneral remarks about the stateof theart in theEnvironmentalChemistry,Microbiology,EcotoxicologyandBiotechnologyfields.PartIIcontainstheassessmentoftheInstitutesandprogrammes.
Composition of the CommitteeThecompositionoftheCommitteewasasfollows:
• Prof.WillyVerstraete,professorofMicrobiologyandTechnologyatGhentUniversity,Belgium
• Prof.ColinJanssen,professorofEcotoxicologyatGhentUniversity,Belgium• Prof.LaurentCharlet, professor of Earth andPlanetarySciences at theUniversiteéde
Grenoble-I,France.3
AshortcurriculumvitaeoftheCommitteemembersisincludedinAppendix1.
Inordertostrengthenthesoilchemistryexpertiseofthecommittee,prof.HannesFlühler,professor in terrestrial ecology of the ETH Zürich, member of the review committee forEnvironmentalEarthSciences,participatedintheevaluationoftheSoilChemistrygroupofWIMEK(prof.VanRiemsdijk).Furthermore,prof.AndreaRinaldo,DipartimentoIMAGE,UniversityofPadova,chairofthereviewcommitteeforEnvironmentalEarthSciences,pro-videdapreliminaryassessmentofthisgroup.
3ProfessorCharletwasunfortunatelyabsentduetoillnessduringthereviewbutprovidedapreliminaryassess-mentoftheSoilchemistrygroupofWIMEK.
130 QANU/ResearchEvaluationEnvironmentalSciences�007
GeertvanderVeenwasappointedsecretarytotheCommittee,onbehalfofQANU(QualityAssuranceNetherlandsUniversities).
IndependenceAllmembersof theCommittee signeda statementof independence to safeguard that theywouldassessthequalityoftheInstituteandresearchprogrammesinanunbiasedandinde-pendentway.Anyexistingpersonalorprofessionalrelationshipsbetweencommitteemembersandprogrammesunderreviewwerereportedanddiscussedinthecommitteemeeting.TheCommitteeconcludedthattherewerenocloserelationsordependenciesandthattherewasnoriskintermsofbiasorundueinfluence.
Data provided to the CommitteeTheCommitteehasreceiveddetaileddocumentationconsistingofthefollowingparts:
1. Selfevaluationsatprogramme/researchgroup level (5),at institute level (3)andat theleveloftheresearchschool
�. Copiesofthreekeypublicationsperprogramme;3. Bibliometricstudy1996-�0044. ADVDwithallSENSEbackgroundmaterial
ThedocumentationincludedalltheinformationrequiredbytheStandardEvaluationPro-tocol(SEP).
The self-evaluations provided by SENSE were well documented and highly transparent.Althoughthereweresomemethodologicaldifferencesbetweentheself-assessmentofthevari-ousgroups,theassessmentsincombinationwiththediscussionsofthecommitteewiththeresearchleadersallowedanobjectiveevaluationoftheresearchgroups.
Procedures followed by the CommitteeTheCommitteeproceededaccordingtotheSEP.PriortotheCommitteemeeting,eachpro-grammewasassignedtoafirstandasecondreviewer,whoformulatedapreliminaryassess-ment.ThefinalassessmentsarebasedonthedocumentationprovidedbytheInstitutes,thekeypublicationsandtheinterviewswiththemanagementandwiththe leadersofthepro-grammes).TheinterviewstookplaceonJune17,�007tillJune19,�007(seethescheduleinAppendix3).Asitevisitwasorganisedtothedepartmentsofenvironmentaltechnologyandsoil chemistryandchemical soilquality.Thecommitteewas impressedby themagnificentfacilities,infrastructureandstate-of-theartequipmentandthewayitismanaged.Thedepart-mentofmicrobiologycouldnotbevisitedbecauseitisintheprocessofmovingtonewfacili-ties.Therewasaverypositiveandopeninteractionwith5PhDstudentsfromeachofthesegroupsinanpostersession,Thequality,knowledge,motivationandeagernesstosucceedwasverywellappreciatedbythecommittee.
Precedingthe interviews, theCommitteewasbriefedbyQANUaboutresearchassessmentaccordingtoSEP.Onthesameday,June17,�007,theCommitteediscussedthepreliminaryassessments.Foreachprogrammeanumberofcommentsandquestionsweredecidedupon.TheCommitteealsoagreeduponproceduralmattersandaspectsoftheassessment.AftertheinterviewstheCommitteediscussedthescoresandcommentsandmadedrafttexts.Thetextswerefinalisedthroughemailexchanges.ThefinalversionwaspresentedtotheInsti-tutesandSENSEonAugust1,�007.ThecommentsoftheInstitutesandSENSEweredis-
131QANU/ResearchEvaluationEnvironmentalSciences�007
cussedintheCommitteeandledtochangesinthereportonanumberofpoints.Thefinalreportwaspresented toBoardsof theparticipatinguniversities andwasprintedafter theirformalacceptanceofthereport.
TheCommitteeusedtheratingsystemoftheStandardEvaluationProtocol(SEP).Themean-ingofthescoresisdescribedinAppendix�.
Fortheassessmentofthequalityoftheresearchthegroupswerecomparedattheinternationallevelwiththeirpeers.Publicationandcitationrecordswereexamined,majorachievementsweretakenintoaccount,theirselectedtop-publicationswereevaluatedandtheircapacitytoattracthighlyqualifiedstudentsandcollaboratorswasdiscussed.Intermsofproductivitythecriteriawerethenumberofpublications,thenumbersofMscandPhDstudents,thepatentsandspin-offs.Thesevalueswerejudgedinabsolutevaluesandinrelationtothenumberofstaff.Therelevanceofthegroupsinrelationtoenvironmentalscienceswasjudgedattheinterna-tionalandlocallevel.Furthermorerelevanceforscienceatsuchandsocietyasawholeweretakenintoaccount.Elementssuchasrecognitionasaknowledgecentre,participationinexpertgroups,editorialboardsandprofessionalsocietiesareindicatorsfortheformer.Servicesandexpertiserenderedtoindustryandpracticalapplicationsofscientificdevelopmentsconstitutedtheweightingforthelatterpart.
Theprospectsandviabilityweremainlybasedontheirstrategicvisionwithregardtotheirgroupandthesurroundings.Moreovertheconcreteandpracticalmeansattheirdisposalforachievingormaintainingleadershipwereassessed.Thisincludespersonnel,infrastructureandpolicyissuesatgroup,instituteanduniversitylevel.
13� QANU/ResearchEvaluationEnvironmentalSciences�007
133QANU/ResearchEvaluationEnvironmentalSciences�007
2. General remarks
InthedomainofEnvironmentalChemistry,Microbiology,EcotoxicologyandBiotechnologyanumberofrapidscientificdevelopmentsandevolvingsocialdemandscanbeobserved.Inthescientificdomaintheyparticularlyrelatetogenomics.Inthesocietaldomainglobalwarm-ing,biodiversityandpollutionaremajordrivers,alreadyleadingtoincreasingpublicaware-nessandmorestringent(EU)regulations.Inordertosolvetheproblems,newknowledgeisnecessarytodeterminemechanismsofenvironmentaldecayandinthiswaybebetterabletodeveloptechnologytoincreasesustainabledevelopmentanduseofrenewableresources.Thisnecessitatesdevelopmentintheabovenamedfields.Thestateoftheartinthedomainofsoilchemistryandchemicalsoilqualityistheunderstand-ingofthemolecularbasisofcrucialsoilprocessessuchastheinteractionsofmetalhydroxidesandorganicmatter.The translationofbasicchemicalunderstandingof soilphenomenatomajorenvironmentalmanagementissuesintheframeworkofsoilqualityandsoilhealthandsoilpolicy(e.g.waterframeworkdirective)ismostvaluableandchallenging.Thefocalpointofcurrentenvironmentalmicrobiologyistheunderstandingofmicro-organ-ismsandparticularlymicrobialcommunitiesinrelationtothefunctioningofnaturalenviron-mentsandenvironmentalbiotechnologicalprocesses.Thecombinationoftheintegrationofinnovativecultivationbasedandfunctionalgenomicstudiesisageneraltrend.Recentdevelopmentsinthefieldofenvironmentalhealthfocusonimprovingourunderstand-ingoftheoccurrenceandimpactofnaturalandanthropogenicstressorsinecosystems.Thedevelopmentandapplicationofnoveltoolsfordetectingeffectsofandexposuretostressorsareessentialtofurtherenhanceourcapacitytoprotecttheenvironment.Theuseofnewtech-nologiessuchasecologicalgenomics,advancedchemicalanalyticsanddedicatedinvitroandinvivotestsystemsforelucidatingimpactsofenvironmentalstressesarecurrently–frombothanacademicandaregulatoryperspective-majorresearchthemesinthisfield.Thelargestchallengeforenvironmentaltechnologyisthetransferofscientificknowledgetosolutionsforproblemsinsociety.Technologyismoreandmore,becauseofeconomiccostsand environmental effects, moving from end-of-pipe solutions towards process integratedsolutions.Reuseofwaterandmaterialsanduseofrenewableresourcesareimportantpartsofthisapproachbecausetheyaddressbasicsocietalneeds.Theresearchofthegroupsvisitedisalltunedtothesetrends,andcertainlyisgearedtocontrib-ute,bothinthedomainofbasicscienceandpracticalapplications,toprogresstheseresearchfields.AstheassessmentoftheindividualgroupsinthisreportwillshowSENSEplaysacompetitivetoleadingroleinthisareaintheworld.Nomajorshortcomingswereidentified.However,inviewofthecurrentlowinterestofstudentsforbeta-sciencesitisrecommendedtostronglyadvertisetheempowermenttoimprovethelivingconditionsofthisplanetthatexistswithinthedomainsofsciencecoveredbythiscommittee.
134 QANU/ResearchEvaluationEnvironmentalSciences�007
135QANU/ResearchEvaluationEnvironmentalSciences�007
3. Wageningen University, Institute WIMEK
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityEnvironmentalResearchattheLaboratoryofMicrobiology
Excellent Verygood Verygood GoodtoVerygood
EnvironmentalTechnologyGroup Verygood Excellent Excellent VerygoodSoilChemistryandSoilQualityGroup
Excellent Verygood Excellent VerygoodtoGood
136 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 18: Environmental Research at the laboratory of Microbiology (WU-MIB)Programmedirector prof.dr.W.M.deVos,prof.dr.ir.A.J.M.Stams,dr.H.SmidtResearchstaff�006 11.55fte(�006,withinSENSE)Assessments: Quality: Excellent
Productivity: VerygoodRelevance: VerygoodViability: GoodtoVerygood
The laboratory is a centre excellence in the field of anaerobic microbiology. It explores anumberofnewaspectsinthatdomain,e.g.theelucidationofmicrobialfunctionandinterac-tionatthesinglecelllevel,thedevelopmentofmolecularmarkerstointerpretmetagenomics.Thisopensavarietyofperspectivesforacquiringnewinsightsanddevelopingnewpotentialsinthedomainofenvironmentalmicrobiology.
Thequalityofthegroupcaninternationallyberatedamongthebestinthedomainofmicro-bialecophysiology,particularlytheaspectsofsyntrophyqualifyasexcellent.WeacknowledgethefactthatDeVoshasaveryhighH-factor,buttheworkofStamsandSchraa, which particularly relates to the environmental research, also has an applaudableimpact.Theproductivityintermsofpublicationsasverygood,butthenumberofMSc-thesesandPhD-thesesisratedasgood.
Therelevanceofthestaffasmeasuredthroughtheirinvitedlectures,theirkey-notespeechesatinternationalconferencesandtheirpresenceininternationalcommitteesisverygood.Thesocio-economicrelevanceoftheirresearchparticularlyrelatestotheirinteractionswiththeenvironmentaltechnologygroupwithenvironmentalindustrieswhichareprominentontheinternationalscene.
Theprospectsofthegrouprelatetoitsneworientationintermsofsystemsbiology.Thefactthattheyhavedelineatedthepossibilitytofurtherpromotetheecophysiologyofsyntrophicbacteriathroughmetagenomicsishighlyvaluableandwillensurethesustainabilityofongoinghigh-levelresearch.ThefocusofthedirectorwithrespecttoSENSEandtheenvironmentalresearchersinhisgrouprequiresattention.
137QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 19: Environmental Technology Group (WU-ETE)Programmedirector Prof.dr.ir.W.H.Rulkens,prof.dr.ir.C.J.N.BuismanResearchstaff�006 ��.3�fteAssessments: Quality: Verygood
Productivity: ExcellentRelevance: ExcellentViability: Verygood
The group is involved to create new breakthrough technologies to establish new resourcecycles.Ithasupfrontabiotechnologicalcomponent,whichitcombineswithphysics,chem-istryandalsosocialsciences.Itisawell-structuredorganisationwithgoodmanagementinwhichconceptssuchasbio-crystallisation,bioavailability,bio-retentionandbio-electrochem-istrygeneratetechnologiesforproducingproductssuchasrecyclablemattersreusablewatersandrenewableenergies.Moreoverthegrouphasthespecialcharacteristicsthatit interfaceswiththespecialneedsofsocietyfornewsolutionsforenvironmentalproblems,bothindevel-opedanddevelopingcountries.
Thegroupisgainingstrengthandiscompetitiveattheinternationallevel.TheyexertastrongattractiontotopmasterstudentsandareattheprocessofdeliveringhighlyqualifiedPhDs.Theirscienceoutputcanasyetbequalifiedgood,andactionsaretakentoimproveit.
OnthebasisofthenumberofMScandPhDstudentsthisgroupcertainlydeservesthequali-ficationexcellent.Alsothegrouphasahighoutputof intellectualpropertywhich it inter-facesefficientlywithappropriate(industrial)technologydevelopers.ThenumberofpublishedpapersandthecalculatedH-indexindicateahighscientificproductivityandrankstheamongthebestofSENSEWIMEKgroups.
Intermsofkeynotelectures,editorialboardsandleadingrolesininternationalscientificcom-mitteesthestaffcertainlyscoresverygood.Moreovertheirinteractionswithindustryandsci-entificinstitutionslikeWetsus,BbasicandLeaFAssociatescanberegardedasbestpracticeinthefieldofappliedenvironmentaltechnology.Alargenumberofindustrialinstallations,basedontheresearchofthisgroup,hasbeenbuiltallovertheworld.Wealsowouldliketoapplaudtheirachievementsinlowincomecountrieswhereanumberoftechnologiesofthegroupareappliedandassociatedtrainingisprovided.
Theplannedchangesinstaffandintheprogrammewillcertainlyfurtherenhancetheirinter-nationalcompetitiveness.Thethreemaindomainsinwhichtheyinvestforthefuture(min-erals,waterandenergy)areinternationallyrapidlyevolvingresearchfieldsandconsequentlyworthwhiletopursue.ThefactthattheyhavereorientedtheirPhDintakewillalsoimprovetheirquantitativeandqualitativeoutput.
138 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 20: Soil Chemistry and Soil Quality Group (WU-SOQ)Programmedirector Prof.dr.W.H.vanRiemsdijk,prof.dr.S.E.A.T.M.vanderZeeResearchstaff�006 9.7�fteAssessments: Quality: Excellent
Productivity: VerygoodRelevance: ExcellentViability: VerygoodtoGood
The group is strongly focused on developing molecular based fundamental understandingof importantsoilchemicalprocesses thatcanalsoberelevant foraquaticenvironmentandprocessesoccurringinwastesystems.Theareasofexpertiserelatetotheinteractionbetweenionsandmetalhydroxides,theimportanceoforganicmatterandthebehaviourofionsinsoiland the interactionbetweenorganicmatterandminerals. Allof theseopennewhorizonsforpromisingresearchandapplications,moreoverthesensordevelopmentmadeitpossibletoadvancethefundamentalunderstandingoftransportprocessesofionsinthecomplexsoilmatrix.
Thegroupisaworldleaderonthefundamentalaspectsofelementbehaviourinsoils.Itcanbebenchmarkedagainstthebestlabsinthisfieldworldwide.Thepublicationrecordisexcel-lent.
Theoutputofscientificpublicationsisverygood,particularlyconsideringtheirtopquality.Thenumberofcompletedmaster-thesesisfair,thenumberofPhD-thesesisverygood.
Onthescientificleveltheexpertiseofthetenuredstaffisinternationallyhighlyappreciated.Moreovermajoreffortshavebeenmadetoimplementthefundamentalknowledgeintoappli-cationorienteddomains.TheeffectthatcommercialpartnershavebeenwillingtofullyfundPhDprojectsillustratestheirsuccessfulendeavoursalongthoselines.
Anumberofnewpromisingdevelopmentsinresearchareexplored,suchasinterfacingwithsoilbiology,andexploringthepotentialsofunderstandingelementbehaviourinnaturalsoilstructures.Thegroupisencouragedtofurtherstepupitseffortstoexploreandactivelyinvestinnewmultidisciplinaryscientificdevelopmentswithpotential,whicharerelevantforenvi-ronmentalchemistryandbiology.Thegroupisinvitedtoattractmorestudentsandtofurtherexpresstheirresearchstrategy.
139QANU/ResearchEvaluationEnvironmentalSciences�007
4. Vrije Universiteit Amsterdam, Institutes IVM and IES
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityDepartmentofChemistryandBiology(IVM)
Excellent Verygood Verygood Verygood
AnimalEcology�:EcotoxicologyandEcogenomicsGroup(IES)
Verygood Excellent Verygood Excellent
140 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 21: Department of Chemistry and Biology (VU-C&B)Programmedirector Prof.dr.J.DeBoerResearchstaff�006 4.6fteAssessments: Quality: Excellent
Productivity: VerygoodRelevance: VerygoodViability: Verygood
TheC&Bdepartmentaimstocontributetothefieldofenvironmentalhealthbydevelopinginnovativemethods in theareasofexposureandeffectsassessments.The fundamentalandappliedaspectsofthisresearchshouldbeconsideredasamongthebestinternationally.Theirresearchfocusesonidentifyingandevaluatingemergingchemicalsusingauniquecom-binationofchemicalandtoxicologicalmethods.
Intermsofqualitythegroupisinternationallycompetitiveandranksamongtheverygoodresearchteamsintheworld.Theyexhibitagoodpolicyanddynamicsconcerningattractinginternationalscientists.Theyareinternationallyrecognisedfortheiruniquestrategyofcom-biningmoleculartoxicologicaltools,withhighperformancechemicalanalysis.Theirpublica-tionsareveryhighranking.
Theproductivityperpersonofthisgroupisremarkablyhigh.Moreovertherehasbeenthecreationofaspin-offandthereistheoutlookforanumberofpatents,basedonthetoxicologi-calassaysdeveloped.HoweverthenumberofMSc-thesesandPhD-promotionsisratherlow.ThisisduetothefactthatthedepartmenthasverylimitedpossibilitiestoattractstudentsandtoenrolthemintheirR&D.Thegrouphastakenseveralactionstoimprovethesepotentiali-ties,forwhichtheyarecomplimented.Thecommitteerecommendsthatthestructuralposi-tioningofthedepartmentisexaminedatahigherlevel,withaviewtoimprovingtheaccessofthisgrouptoPhD-studentsandthusimprovingthiscomponentoftheproductivity.
Thetypeofresearchperformedbythegrouphasbothahighscientificandsocio-economicrelevance.Membersof thegroupare represented at thenational and international level inregulatoryandadvisoryorganisations.Thegroupalsohasaconsiderablenumberofinterac-tionswithmajorindustryorganisationsataEuropeanlevel.
Thedepartmenthasdevelopedastrategyinwhichchemistryandtoxicologyarecombinedtoprovideresultsonthepotentialrisksofchemicalsintheenvironmentinafasterandmorereli-ableway.Moreover,bytheirinnovativeapproachofEffectDirectedAnalysis,theyconstantlysearchforimportantemergingpollutants.ThislineofresearchwarrantscontinuationandisofmajorimportanceinthecontextofSENSE.Takingintoaccountthatthedirectorwasonlyrecentlyappointedandfivenewstaffmemberswereaddedtothegroup,combinedwiththeiralreadyexcellentperformance,thecommitteebelievesthattheprospectsofthisteamareexcel-lent.Intheopinionofthecommittee,theteamcouldwellbeextendedwithanadditionalhigh-levelstaffmember.Obviouslytheamountofuniversityfunding(only6.5%ofturnover)shouldbeincreasedinorderforthegrouptoreachtheirfullpotential.
141QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 22: Animal Ecology 2: Ecotoxicology and Ecogenomics Group (VU-AE2)Programmedirector Prof.dr.N.M.vanStraalen,dr.C.A.M.vanGestelResearchstaff�006 9.7fteAssessments: Quality: Verygood
Productivity: ExcellentRelevance: VerygoodViability: Excellent
Themainresearchareaofthisgroupistheexaminationofecologicaleffectsofstressfactorsintheenvironmentandthemechanismsbywhichanimals(soilinvertebrates)respondtothesestressors.The group has developed a hierarchical approach to environmental toxicologicalissuesbyexaminingstressoreffectsfromthemolecularleveluptopopulationandcommunitylevel.Althoughthisresearchisinthefirstinstantaddressingfundamentalquestionsitclearlyhasagoodapplicabilityandhighsocietalrelevance.
Thedepartmentpublisheshighqualitypapersandprovideshighlyappreciatedandfrequentlyusedtextbooks.Tofurtherimprovetheimpactoftheirpapersinthefieldthegroupleadershaveanalysedtheirpublicationstrategyandaredevelopinganimprovedapproach.
Intermsofoutputofnumberofpapersper tenuredstaffmember, thenumberofMastersgraduatingandPhD’sdefendingtheirthesesthisgroupisratedexcellent.SeveralIPproductsareintheprocessofbeingdeveloped.Thecommitteerecommendsthatthedepartmentcon-tinuesthishighlevelofvariousoutputs.
Thedepartmenthasa lotof influenceonthe internationalscenethroughparticipations invariouscommissions,editorialboardsandprofessionalorganisations.Alsoatthenationalleveltheir researchhasan impactonenvironmentalpolicy.Overall the relevance to scienceandsocietyisratedverygood.
The combination of their established expertise in terrestrial stress ecology combined withnewdevelopmentsinecologicalgenomicscertainlyoffersaverywidearrayofperspectivesforthecomingyears.Itisparticularlyappreciatedthattheyconsidergenomicsasatooltointer-pretecologicalphenomenasuchasbiologicalavailabilityofcontaminantsandfunctionalityofinvertebratecommunitiesinsoilecosystems.
14� QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 1: Curricula Vitae of committee members
Prof. Willy Verstraete,isprofessorofmicrobiologyatGhentUniversity,LabMET(Labora-toryofMicrobialEcologyandTechnology).HisR&Dhasacentraltheme:processesmedi-atedbymicrobialmixedcultures.Histeamdealswithmicrobialtransformationsinwatersandsoilsandthegastro-intestinaltract.Avarietyofbiotechnologicalprocesses,basedonmicrobialconsortia,aresubjecttoR&DatLabMET.W.Verstraetehasfieldexperiencewithrespecttodesignandoperationofdrinkingwaterproductionplants(slowsandfiltration),aerobicwaste-watertreatment(inparticularwithrespecttonitrification-denitrification),anaerobicdigestionofwastewatersandsludges,solidstatefermentationoforganicresiduesandbioremediationprocessesofsoilsandsediments.Hehasalsogainedexperienceinvariousaspectsofpre-andprobioticsusedinhumanandanimalnutrition.
Prof. Colin R. JanssenisprofessorofEcotoxicologyatGhentUniversity,BelgiumwherehedirectstheEnvironmentalToxicologyResearchGroup,DepartmentofAppliedEcologyandEnvironmentalBiologyat theFacultyofAppliedBiologicalandAgriculturalSciences. Heholds aMastersdegree in zoologyandobtainedhisPh.D. in environmental sciences fromthesameuniversity.Sincehisappointmentasresearchassociatein1987,C.Janssenandhisresearch team have been conducting fundamental and applied ecotoxicological research invariousareassuchasdevelopmentandapplicationofalternativetoxicitytests,sedimentandeffluenttoxicology,biomarkersandendocrinedisruptors,metaltoxicologyinaquaticandter-restrialsystemsandenvironmentalriskassessment.
Prof. laurent Charlet,professorofEarthandPlanetarySciences,UniversiteédeGrenoble-I,France,Department(LGIT-OSUG).Hisresearchinterestsare:
• Molecularmodeling:Reactionpathwaysatsolid/waterinterfaces;DFT,MUSICandDMmodelsvs.SANS,XAFS,LITRF,MössbauerandRPEdata.
• Contaminantimmobilizationinclay-richcarbonatedmedia:Cationexchangeandstruc-turallybasedsurfacecomplexationtheory;applicationtothesurfacechemistryofsulfides,clays,carbonatesandmixedmineralsystems.Pathwaysandratesofreactions;Integrationtoreactivetransportmodels.
• Anoxicmediaandemergenceoflife:chemistryofFeSproteinclustersandPrionprotein;earlyregulationoftracemetalconcentrationandhydrogenbreakdowncoupledtoaminoacidsynthesis;redox(Fe,Mn,S)andacid-basechemistry;transformationkineticsofin-organic(U,Se,Cr,AsandHg)andorganic(TCE,Nitrobenzene)contaminantsandtheirtransportinconfinedanoxicenvironments.
• Largefieldscaleexperiments:Contaminant(As,Se,Hg)cycleinsoils,surface-andground-waters;fieldintensivestudiesonArsenic(Bengale,Argentina,France),Selenium(Spain)andMercury(FrenchGuyana);paleoenvironmentalarchives.
143QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 2: Overview of Scores
Table 1: Overview of scores
Quality Productivity Relevance Viability18.WIMEKMicrobiology Excellent Verygood Verygood Goodto
Verygood19.WIMEKEnvironmentalTechnology
Verygood Excellent Excellent Verygood
�0.WIMEKSoilChemistryandSoilQuality
Excellent Verygood Excellent GoodtoVerygood
�1.IVMEnvironmentalChemistry&Biology
Excellent Verygood Verygood Verygood
��.IESEcotoxicologyandEcogenomics
Verygood Excellent Verygood Excellent
Table 2: SEP-scale; the meaning of the scores
Workthatisattheforefrontinternationally,andwhichmostlikelywillhaveanimportantandsubstantialimpactinthefield.Instituteisconsideredaninternationalleader.
Excellent (5)
Workthat is internationallycompetitiveandisexpectedtomakeasignificantcontribution;nationally speakingat the forefront in thefield.Instituteisconsideredinternationalplayer,nationalleader.
Very good (4)
Work that is competitive at the national level and will probablymakeavaluablecontribution in the international field. Institute isconsideredinternationallyvisibleandanationalplayer.
Good (3)
Workthatissolidbutnotexciting,willaddtoourunderstandingandisinprincipleworthyofsupport.Itisconsideredoflessprioritythanworkintheabovecategories.Instituteisnationallyvisible.
Satisfactory (2)
Workthatisneithersolidnorexcitingflawedinthescientificandortechnicalapproach,repetitionsofotherwork,etc.Worknotworthyofpursuing.
Unsatisfactory (1)
144 QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 3: Schedule
Environmental Chemistry, Microbiology, Ecotoxicology and Biotechnology committee (ECMEB)
SUNDAY 17-06-2007xx.xx–15.00 ARRIVALNHCentreUtrecht15.00–15.30 WELCOME15.30–16.00 QANU:Generalintroduction16.00–16.30 SENSE:Generalintroduction16.45–18.30 InternalRCmeeting19.00–�1.00 DINNER�1.00–��.00 (meetingchairs)
MONDAY 18-06-2007XXXX–09.30 TraveltoWageningen09.30–10.30 InternalRCmeetinginWageningen10.30–11.30 Presentation and discussion Laboratory of Microbiology - Molecular
EcologyandMicrobialPhysiologygroups(MIB-WIMEK/WU)nr.1811.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 Presentation and discussion Soil Chemistry and Chemical Soil Quality
Group(SOQ-WIMEK/WU)nr.�014.00–15.00 PresentationanddiscussionEnvironmentalTechnologyGroup
(ETE-WIMEK/WU)nr.1915.15–16.45 Sitevisit;PhD(poster)presentations(MIB,SOQ,ETE)anddiscussion17.00–18.00 InternalRCmeeting18.00–�0.00 Dinner/TraveltoUtrecht
TUESDAY 19-06-200709.30–10.30 InternalRCmeetinginAmsterdam10.30–11.30 PresentationanddiscussionDepartmentofChemistryandBiology
(C&B-IVM-VU)nr.�111.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 PresentationanddiscussionAnimalEcology�:Ecotoxicology
andEcogenomicsGroup(AE�-IES/VU)nr.��14.00–15.00 Sitevisit+PhDposterpresentations(C&B,AE�)anddiscussion15.15–16.45 InternalRCmeeting17.00–18.00 InternalRCmeeting/closure18.00–�0.00 Dinner/TraveltoUtrecht
(chairsmeetinGeneralCommittee,Wednesday9:00hrs)
145QANU/ResearchEvaluationEnvironmentalSciences�007
Committee Integrated Assessment, Sustainable Systems Analysis and Spatial Management (ISS)
146 QANU/ResearchEvaluationEnvironmentalSciences�007
147QANU/ResearchEvaluationEnvironmentalSciences�007
1. The review committee and the review procedures
Scope of the assessment and structure of this reportTheReviewCommitteewasaskedtoperformaresearchassessmentoftheWIMEK-WUREnvironmentalSystemsAnalysisGroup; the IVM-VUDepartmentofSpatialAnalysis andDecisionSupport;CopernicusInstituteUUScience,TechnologyandSocietyGroup;IVEM-RUGCentreforEnergyandEnvironmentalStudiesandICIS-UMInternationalCentreforIntegratedAssessmentandSustainableDevelopment.Thisassessmentcoverstheactivitiesandtheresearchintheperiod�001-�006.
Theassessmentispartofthe�007reviewoftheNetherlandsResearchSchoolforSocio-Eco-nomicandNaturalSciencesoftheEnvironment(SENSE).
Institute Programme WageningenInstituteforEnvironmentandClimateResearch(WIMEK-WU)
�3. EnvironmentalSystemsAnalysisGroup
InstituteforEnvironmentalStudies(IVM-VU) �4. DepartmentofSpatialAnalysisandDecisionSupport(SPACE)
CopernicusInstituteforSustainableDevelopmentandInnovation(CopernicusUU)
�5. Science,TechnologyandSocietyGroup
CentreforEnergyandEnvironmentalStudies(IVEM-RUG)
�6. CentreforEnergyandEnvironmentalStudies
InternationalCentreforIntegratedAssessmentandSustainableDevelopment(ICIS-UM)
�7. InternationalCentreforIntegratedAssessmentandSustainableDevelopment
Theevaluationoftheresearchprogrammeswasbasedontheself-evaluationreportsandothermaterialprovidedbytheInstitutesandoninterviewswiththemanagementandtheresearchleaders.Thecommitteealsohadthetasktoadvisehowthequalityoftheresearchprogrammesmightbeimproved.
PartI,chapter1describesthecompositionoftheCommittee,itsactivitiesandtheproceduresfollowedbytheCommittee.PartI,chapter�containsgeneralremarksaboutthestateoftheartinthefieldofIntegratedAssessment,SustainableSystemsAnalysisandSpatialManagement.PartIIcontainstheassessmentoftheprogrammes.
Composition of the CommitteeThecompositionoftheCommitteewasasfollows:
• Dr.LeaKauppi,DirectorGeneraloftheFinnishEnvironmentInstitute(SYKE)• Prof.ThomasB.Johansson,professorofenergysystemsanalysisandDirectoroftheIn-
ternationalInstituteforIndustrialEnvironmentalEconomics(IIIEE)attheUniversityofLund,Sweden
• Prof.WilliamLafferty,professorofpoliticalscienceandDirectoroftheresearchprogrammeProSusattheCentreforDevelopmentandtheEnvironment(SUM),UniversityofOslo.ProfessorofStrategicResearchforSustainableDevelopmentattheUniversityofTwente.4
4ProfessorWilliamM.LaffertywasnotabletoattendtheassessmentsessionsinUtrecht.Hiscom-mentsandpreliminaryassessmentwereforwardedtotheCommitteepriortothemeetinginUtrecht.
148 QANU/ResearchEvaluationEnvironmentalSciences�007
ExternalreferentforthecommitteewasHelenCouclelis,ProfessorofGeographyattheUni-versityofCalifornia,SantaBarbara,California,USA.
Dr. Barbara van Balen was appointed secretary to the Committee on behalf of QANU(QualityAssuranceNetherlandsUniversities)
AshortcurriculumvitaeoftheCommitteemembersisincludedinAppendix1.
IndependenceAllmembersof theCommittee signeda statementof independence to safeguard that theywouldassessthequalityoftheInstituteandresearchprogrammesinanunbiasedandinde-pendentway.Anyexistingpersonalorprofessionalrelationshipsbetweencommitteemembersandprogrammesunderreviewwerereportedanddiscussedinthecommitteemeeting.TheCommitteeconcludedthattherewerenocloserelationsordependenciesandthattherewasnoriskintermsofbiasorundueinfluence.
Material provided to the CommitteeTheCommitteehasreceiveddetaileddocumentationconsistingofthefollowingparts:
1. Selfevaluationsattheleveloftheprogrammes,theinstitutesandtheresearchschool�. Copiesofthreekeypublicationsperprogramme3. Bibliometricstudy1996-�0044. ADVDwithallSENSEbackgroundmaterial.
ThedocumentationincludedalltheinformationrequiredbytheStandardEvaluationProto-col(SEP).
Remark about the Standard Evaluation ProtocolThe Standard Evaluation Protocol (SEP, see www.qanu.nl) provides guidelines to evaluateuniversity research institutes and their research programmes.This report is limited to theresearch programmes concerning Integrated Assessment, Sustainable Systems Analysis andSpatialManagement.Thedistinctionbetweeninstituteandprogrammewashowevernotveryclearforeverygroupthecommitteeassessed.Intwocasestheprogrammeandinstitutewerefullyoverlapping.ThepartoftheSEPprotocolthatdescribestheassessmentofresearchwasapplicableforthisevaluation.Thecommitteecouldgetagoodpictureofthequalityandpro-ductivityofeachofthegroups.
Theself-assessmentreportsthecommitteehadreceivedweretransparentandcomprehensive,theinterviewswiththegroupleaderscompletedthepicture.
TheSEPprotocolguidedthecommitteethroughtheprocessofassessment.Theprescribedratingofthegroupsaccordingtothefourcriteria:quality,productivity,relevanceandviabilitywas,however,verydifficult.Thevalueoftheresearchprogrammescannotbedescribedinsimpleratings.Thecommitteetriedtoexpressthedifferencesbetweentheassessedgroupsinthefinalratingsbutthecommitteeitselfregardstheargumentationthataccompaniestherat-ingsasthemorevaluablepartoftheassessment.
149QANU/ResearchEvaluationEnvironmentalSciences�007
Procedures followed by the CommitteePriortotheCommitteemeeting,eachprogrammewasassignedtoafirstandasecondreviewer,whoformulatedapreliminaryassessment.Thefinalassessmentsarebasedonthedocumenta-tionprovidedbytheInstitutes,thekeypublicationsandtheinterviewswiththemanagementandwiththeleadersoftheprogrammes.TheinterviewstookplaceonJune18,�007tillJune19,�007(seethescheduleinAppendix3).Duetoreasonsofhealth,ProfessorWilliamM.LaffertywasnotabletoattendtheassessmentsessionsinUtrecht.Hiscommentsandprelimi-naryassessmentwereforwardedtotheCommitteepriortothemeetinginUtrecht.
Precedingthe interviews, theCommitteewasbriefedbyQANUaboutresearchassessmentaccordingtoSEP.Onthesameday,June17,�007,theCommitteediscussedthepreliminaryassessments.Foreachprogrammeanumberofcommentsandquestionsweredecidedupon.TheCommitteealsoagreeduponproceduralmattersandaspectsoftheassessment.AftertheinterviewstheCommitteediscussedthescoresandcommentsandmadedrafttexts.Thetextswerefinalisedthroughemailexchanges.ThefinalversionwaspresentedtotheInsti-tutesandSENSEonAugust1,�007.ThecommentsoftheInstitutesandSENSEweredis-cussedintheCommitteeandledtochangesinthereportonanumberofpoints.Thefinalreportwaspresented toBoardsof theparticipatinguniversities andwasprintedafter theirformalacceptanceofthereport.
Thereportoftheexternalreferentforthecommitteeconcerningprogramme�4wasreceivedafterthesitevisit.
TheCommitteeusedtheratingsystemoftheStandardEvaluationProtocol(SEP).Themean-ingofthescoresisdescribedinAppendix�.
150 QANU/ResearchEvaluationEnvironmentalSciences�007
151QANU/ResearchEvaluationEnvironmentalSciences�007
2. General remarks
Todaytheworldisfacingincreasinglycomplexproblemswhichrequireresponsesbasedoninterdisciplinaryinsightsandresearchfrombothsocialandnaturalsciences.Thegroupswork-inginthisfieldacknowledgethattheirresearchnotonlyhastobescientificallyvalidandrele-vanttothepolicydebate,butalsohastobeacceptedbystakeholders.Thisplacessomespecificdemandsonthemethodologydevelopment,whichisoneofthecoreissuesinthisfield.Thechallengefortheresearchgroupsistocombinerigorousscientificresearchwithstakeholders’tacitknowledge,perceptionsandvalues.Theydeal,amongothers,withuncertainty issues,risksanalysis,andmethodsthatexplicitlyaimateffectivelyintegratingstakeholders’knowl-edgeintomodellingfordecision-making(i.e.participatoryapproach).Anothercoresubjectinthisfieldisthestudyanddesignofnewgovernancearrangementsforsustainabledevelopmentandmulti-level,multi-actor,andmulti-sectorsocietalarrangementsforsustainableissues.Researchisfocusedonthechangingrolesofgovernments,marketsandthecivilsocietyingovernance.Otherresearchfociwithinthisfieldarethechangingrelation-shipbetweenpublicandprivateresponsibilitiesforsustainabledevelopmentandtheinnova-tiveandpotentiallyinfluentialnewtypesofgovernanceonthelocal,regionalandgloballevelintheprocessofglobalization.Thefivegroupsthatwereevaluatedbythiscommitteewereverydiverse.Theydifferedinsize,inlevelandkindoffunding,insubjectandinmethods.Thepositionofthegroupsinuni-versityvariedevenmore.Someofthegroupsareaninstitutethemselves,othersarepartofalargerandmoreestablishedinstitute.Someofthegroupstotallydependonexternalfunding,whileothersreceivealmostalltheirfundingfromtheuniversity.Itwasthereforenoteasyforthecommitteetocomparethegroupsandgiveabalancedassessmentforeachofthem.
Ingeneral the societal and scientific relevanceof the researchof thesegroups ishigh.Theresearchgroupsareproductiveandallscoreabovetheworldaveragewhenusingcriterialikeimpactfactor,citationindexesandH-index.
Thequalityoftheresearchisgenerallygoodtoverygoodandsometimesexcellent.
Consideringthechallengesandproblemsraisedbytheglobalchange,researchinthisfieldwillremainhighlyrelevantforseveraldecades.Theneedforinsights,answersandsolutionswillgrowenormouslyinthenextyears.Thustheviabilityofthegroupsisgenerallygoodtoexcel-lent,althoughthesizeofthegroupandtheirpositionintheuniversitymakessomegroupsmorevulnerablethanothers.
15� QANU/ResearchEvaluationEnvironmentalSciences�007
153QANU/ResearchEvaluationEnvironmentalSciences�007
3. Wageningen Universiteit, Institute WIMEK
TheWageningenInstituteforEnvironmentandClimateResearch(WIMEK)aimstodevelopanintegratedunderstandingofenvironmentalchangeanditsimpactonthequalityoflifeandsustainability,by
(i) conductinginnovativescientificresearch,(ii) offeringPhDtrainingandeducation(iii)disseminationofemerginginsightsandrecentresearchresults.
TheWUchairgroupsthatparticipateinWIMEKarehierarchicallyembeddedinoneoftheWUDepartmentsandparticipateinoneormoreGraduateSchools.TheScienceGroupsandWIMEKhavedifferenttasksandresponsibilities.
The Environmental systemsAnalysisGroup (ESA) is one the research groups ofWIMEKparticipatinginSENSE.
ThemissionofESAisthedevelopmentandimprovementofinnovativeintegratedresearchtoolsthataddressandenhanceunderstandingofenvironmentalchangeandsustainability,andtheapplicationofthesecutting-edgetools toadvancescientificunderstandingandsupportdecisionmakinglocally,nationallyandinternationally.
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityEnvironmentalSystemsAnalysisgroup Excellent Excellent Excellent Excellent
154 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 23: Environmental Systems Analysis group (WU-ESA)Programmedirector Prof.dr.L.Hordijk,Dr.C.Kroeze,Prof.dr.R.LeemansResearchstaff�006 5.7fteAssessments: Quality: Excellent
Productivity: ExcellentRelevance: ExcellentViability: Excellent
ESAstudiescomplexenvironmentalproblemsatanaggregatedregional,continentalandglo-ballevelbyidentifyingandanalyzingcauses,mechanisms,processes,impactsof,andpotentialsolutions.ESAresearchisfurthertypifiedbyitsinnovativeintegrativemultidisciplinary,inter-disciplinaryandtransdisciplinaryapproaches.Theseapproachesexplicitlyaddresstheneedofpolicymakersandotherstakeholders.Theissuesthatareaddressedarepollution(e.g.causesandimpactsofpollution,nitrogenfluxes,uncertaintyanalysisandscaleissuesinmodelling),climatechange(e.g.emissioninventories,biogeochemicalprocesses,impactassessments,miti-gationandadaptationstrategies)andchangesinecosystems;quantificationandvaluationofecosystemfunctionsandservices.
Theresearchapproachesandtoolsinclude:
1. modelsintegratingdifferentcomponents,dimensionsandscales,�. appraisaltoolsforecosystemfunctions,servicesandtheirvaluation,3. integratedenvironmentalassessmentswithspecialemphasisonparticipatorymethods,4. methodsforanalyzingandcommunicatinguncertainty,and5. decisionsupportsystemsforintegratedpollutionand/orecosystemmanagement.
ESAstronglyfocusesonunderstandingenvironmentalchangeincludingtwospecificresearchlines:‘Pollutionmanagement’and‘Ecosystemmanagement’.
Thisgrouphasestablishedastrongprogramme,well-linkedtopolicymakers.Themissionof thegroup is tomaintain thedialoguewithpolicymakers toguarantee the applicabilityoftheresearchresults,toevaluatethepotentialofsolutionsanddeveloppossiblesolutions.Beforethepreviousresearchassessmentin�000thegroupwassubstantiallysmallerwithonlyapart-timeprofessorasdirector.Inthelastsixyearstherehavebeenseveralpersonnelchangesbutthishasnotaffectedthecoherenceintheprogrammenorintheresearchgroup.Onthecontrary the committee was impressed by the results of this group, the strong vision, theseniorityoftheinvolvedresearchers,theproductivityandqualityoftheresearch.ThegroupisalsohighlycommittedtofurtherdevelopmentoftheSENSEResearchSchool.Ithasbeensuccessfulinattainingresearchmoney,butisalsosupportedbyitsownuniversity.Thegroupisstronglypositionedinternationallyandnationallyaswellasintheownuniversityandhasverygoodcooperationwithotherprominentinternationalresearchgroups.Theprogrammehasagoodbalancebetweenscientificqualityandrelevanceandiswellfocused.
Theresearchprogrammeisverycoherent.Ithasanoriginalapproachandcontributessignifi-cantlytotheoveralldevelopmentoftheresearchfield.Boththeprogrammedirectorandtheothermembersofthegroupareprominentinthefield.Thegrouphasaverygoodpublicationstrategyandthequalityofthescientificpublicationsisexcellent.Thecommitteehasseenapositivetrendinthequalityofthepublicationsaswellasinthecoherenceoftheprogrammeoverthelastsixyears.Citationindexesindicatethatthegroupscoresaboveworldaverage.
155QANU/ResearchEvaluationEnvironmentalSciences�007
Thegroupisveryproductive.IthasdeliveredanumberofPhDtheses,professionalpublica-tionsandpublicorientedpublicationsaswellaspolicyreportsandcontributionstodocumen-tariesandprogramsonradioandtelevision.Thepublicationlistdemonstratesthesuccessofinternationalcollaborationandinterdiscipli-naryresearch.ESAresearchersarehighlycitedandfrequentlyinvitedtogivekeynotelecturesatinternationalconferences.
Therelevanceoftheresearchbythisgroupisveryhigh.Itcontributestotheadvancementofknowledge in the fieldof integrated assessment, sustainable systems analysis and spatialmanagement.Theknowledgeisverywelldisseminatedandimplemented.Thegrouphasbeensuccessfulindisseminatingtheresearchresultstothevariousstakeholders.Thescientificandsocietalvalueoftheresearchisreflectedinthefrequentlyaskedadvicebypolicymakersandprofessionalorganizations,reportstoministriesandNGO’s.AniceexampleofaninnovativeproductwithahighimpactistheNatuurkalenderthatiscoordinatedbyIr.VanVliet.Thisprojectaimstomonitor,analyze,predictandcommunicateclimatechangeinducedchangesin phenology.The project involves over 6000 volunteers and hundreds of schoolchildren.Theresultsarecommunicatedtothegeneralpublicthroughaweekly,verypopularradioVprogramme.
Thelongtermviabilityofthisprogrammeisexcellent.Therelevanceofthiskindofresearchwillevenincreaseinthefuture.ThegrouphasasolidpositionintheWageningenUniversityaswellasnationallyandinternationally.IthasabasicfundingfromWUandgoodpossibilitiestogainotherfunds.Thecorestaffisrelativelyyoungandhasgoodprospects.Thefutureofthegrouplooksverypromising,ithasseveralexcellentscientistsandacoherentprogramme.
156 QANU/ResearchEvaluationEnvironmentalSciences�007
157QANU/ResearchEvaluationEnvironmentalSciences�007
4. Vrije Universiteit Amsterdam, Institute IVM
TheInstituteforEnvironmentalStudies(Instituut voor Milieuvraagstukken,IVM)wasestab-lishedat theVrijeUniversiteitAmsterdam(VU)in1971as the firstacademic institute formulti-disciplinaryresearchintoenvironmentalproblemsintheNetherlands.Overthelast35yearsIVMhasbuiltstrengthsacrossthesocialandnaturalsciences,shapingandrespondingtoenvironmentalresearchandgovernanceissues.
OriginallyanindependentinstitutewithintheVU,IVMwasintegratedintothenewly-cre-atedFacultyofEarth andLifeSciences (FALW)at theuniversity in�001.Aspartof thismergerprocess,IVMwasreorganisedintofourdepartments:ChemistryandBiology(C&B);EnvironmentalPolicyAnalysis(EPA);EconomicsandTechnology(E&T);andSpatialAnaly-sisandDecisionSupport(SPACE),noweachwith�0-�5researchers.Mergerintothefacultyhasencouragedagreaterfocusonscientificqualityandprovidedabasisforagrowthingradu-ateteaching.In�005aGraduateStudiesProgrammewascreatedatIVMaspartofanewGraduateSchoolforEarth,EnvironmentandEcology(TripleE)inFALW.
Organisationally,IVMretainsalargemeasureofautonomywithitsownmanagementteam,researchstrategy,budgetandpersonnelpolicy.ThemanagementteamreportstotheFacultyBoardontheinstitute’sfinancialandscientificperformance.Some80%ofIVM’sactivitiesarerelatedtoresearch,mostofitfundedexternally.Theneedtoraiseprojectfinance,tomanageprojectseffectivelyandtocommunicatewithawiderangeofaudiences–scientificandsoci-etal–imposesspecificdisciplineontheinstitute’sactivities.Researchersareexpectedtoshowscientificquality,whilealsobeingsociallyrelevant.
Multidisciplinarityisafeaturewithindepartments.IVMincludesresearcherswithdisciplinarybackgroundsstretchingfromtoxicologytointernationallaw.Beyondthis,IVMcollaboratesinresearchwithotherinstitutesandwithstakeholders,broadeningstillfurthertherangeofknowledgeintegratedintotheresearchmethods,analysisandoutputs.
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityDepartmentofSpatialAnalysisandDecisionSupport
Verygood Verygood Verygood Verygood
158 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 24: Department of Spatial Analysis and Decision Support (VU-SPACE)Programmedirector Dr.R.JanssenResearchstaff�006 6.76fteAssessments: Quality: Verygood
Productivity: VerygoodRelevance: VerygoodViability: Verygood
TheSpatialAnalysisandDecisionSupportdepartmentSPACEwasestablishedin�001.Thedepartmentbringstogetherresearchersworkingonspatialaspectsoftheenvironment.Thedepartmentaimstodeveloptoolsforunderstandingandvisualisingthepatternanddynamicsinenvironmentalfunctionandvalues.Thesemethodsandinsightsshouldservesocietaldeci-sion-makingonthespatialorganisationofenvironmentfunctionsandvalues.Thedepartmentseesitasitschallengetoadoptpowerfulnewanalyticaltoolsthatfacilitatemoreparticipativespatial decision-making, using often-disparate layers of information about land use, waterresources and water quality. SPACE has three research themes linking research tools withdomainsofapplication:
1. Spatialmodelling�. Spatialassessment,and3. Spatialdecisionsupport
This is an excitingdepartmentwhose researchprogrammes aredesigned to serve a criticalsocietalmission,whileatthesametimecontributingsignificantscientificresearchandmeth-odologicalinnovations.Thedepartment’sresearchseekstobuildbridgesbetweenthenaturalandsocialsciences(especiallythedecisionsciences),betweenacademia,decisionmakersandstakeholders,andbetweennationalandinternationalresearchandapplicationinterestsinthegeneralareasofappliedecologyandspatialdecisionmaking.Thespatialfocusprovidedbyspatialanalysisandassociatedgeo-informationtechniqueshelpsintegratethesediverseinter-estsandperspectives.Anotablestrengthistheintegrationofnaturalandsocialscience/plan-ningskillsnotjustwithinthegroupbutoftenwithinthesameindividualresearcher.
Onthebasisoftheselfevaluationreportandtheinterviewwithrepresentativesofthedepart-mentthecommitteeconcludedthattheSPACEgrouphassucceededincombiningtopicsandtoolsintheirresearchthemes.Thereseems,however,beadisproportionatelystrongfocusonnaturalsystemsmodellingandhydrology/climate.Moreemphasisonthe'softer'dimensionofthedepartmentsresearchinterests(riskanalysis,adaptation,valuationofenvironmentalserv-icesetc)wouldprovidebettersupporttothemissionofscienceandpolicyintegration..
Thegroupdependsforalargepartoncontractmoneyandhassofarbeensuccessfulinobtain-ingfunding.
Accesstodataisacrucialquestionforthisgroup.Mostlythedatahasbeenprovidedbythecustomeronacasebycasebasis.Tosafeguardthecontinuityofitsactivitiesthecommitteerec-ommendsthegrouptoestablishpermanentcooperationwithorganisationsthatcanprovidethenecessarydataonamoreindependentbasis.
159QANU/ResearchEvaluationEnvironmentalSciences�007
CooperationinresearchintheNetherlandsisforIVM-VUalsopossibleoutsideofSENSE.SomePhDstudentsofthisgroupdocoursesinSENSEbutnotallSENSEcoursesarerelevantfortheirPhDstudents.
Ourgeneralimpressionisthatthisresearchgrouphasgreatpotentialandishighlyproductive.Theresearchisofgoodquality,ofhighrelevanceanditcansupportalsotheworkofotherresearchgroupsinSENSE.
Thequalityofthetenuredpersonnelappearstobeveryhigh,andtheresearchoutputissolidinbothquantityandquality(judgingfromtheimpactfactor,whichhasincreasedmarkedlyduring the current review period). Similarly, the professional service (editorships etc.) andnationalandinternationalcollaborationsarestrongoverall.Theresearchofthisdepartmenthasanoriginalapproach.Itcontributessignificantlytothefield.Thedepartmenthasagoodpublicationstrategy.Thequalityofthescientificpublicationsisverygoodandtheyhaveagoodscientificimpact.Itappearsfromacursoryexaminationofthematerialprovidedthatthegroup’smajorpubli-cationsaredisproportionatelyintheareasofnaturalsystemmodelingandhydrology/climatescience.Alittlemoreemphasisonthe‘softer’dimensionsofthedepartment’sresearchinterests(riskanalysis,adaptation,valuationofenvironmentalservices,spatialdecisionsupport,spatialplanningandmanagement,etc.)wouldprovidebettersupporttoitsstatedmissionofscienceandpolicyintegration.
Thegrouphasmadeseveralsignificantcontributionstopracticaltoolsandmethodologyinthearea.Thenumberofprofessionalpublicationsissignificantlyhigh.ThenumberofPhDthesesseemsquitesmall.
Thereisanincreasingneedforthetypeofexpertisethatthegrouprepresents.Togetherwithmorethematicallyorientedgroupstheyformastrongcombination.Althoughtheentireinsti-tutelacksastrongandcoherentdisseminationstrategy,thecontactsofthisgroupwiththefieldandstakeholdersseemtobestrongandguaranteethedisseminationofresults.
Thefinancialbasisofthedepartmentisgood.Thegrouphastofinditsfundingmainlyincontractsandprojectswiththirdpartiesandithasbeensuccessfulinthataspect.Theheadofthedepartmentisverythinlystretchedacrossnumerousimportantanddemandingposts.Severalmembersofthedepartmentattheassociateandassistantleveldemonstrateconsider-abletalentandpotential.
Thepercentageofcontract-fundedresearchishoweververyhigh(80.5%)comparedwithuni-versity-fundedandNWO-fundedresearch.Oftheexamplesofprojectslistedintheself-evalu-ation,only four continue into�008andbeyond. Informationabout strategydevelopmentandfutureplansisminimalintheself-evaluation.Thissuggestsanopportunisticstrategyofshort-termadaptationtofundingconditionsthatpragmaticallymaymakesense,butwhichmayconflictwiththecriticalmissionofthedepartment,whichistohelpbridgethediversegapsbetweenacademicresearchontheonehandandpolicyandplanningapplicationsontheother.
AstrategicresearchplanfortheSPACEdepartmentwouldhelptheunitmaintainitsidentitywithinthebroadercontextofIVM.
160 QANU/ResearchEvaluationEnvironmentalSciences�007
161QANU/ResearchEvaluationEnvironmentalSciences�007
5. Utrecht University , Copernicus Institute
TheCopernicusInstituteforSustainableDevelopmentandInnovationwascreatedinMarch�001,basedonajointdecisionoftheGoverningBoardofUtrechtUniversity,thefacultyofGeographicalSciences(nowadaysintegratedinthefacultyofGeosciences)andthefacultyofChemistry(nowadaysintegratedinthefacultyofScience).Thefollowinggoalsweresetwiththeestablishmentoftheinstitute:
• toincreasethevisibilityoftheresearchatUtrechtUniversityofthegroupsinvolved,intheNetherlandsandabroad;
• toestablishanorganisationthatfacilitatesthemutualco-operationwithinUtrechtUni-versityintheareaofsustainabledevelopmentandinnovationandcreatessynergy;
• toadvancethecoherentexecutionofresearchactivitieswithinUtrechtUniversityintheareaofsustainabledevelopment;
• enlargementandwideningofthescientificandsocietalforumregardingcurrentandfu-tureresearch;
• toallowabettertuningbetweeneducationandresearchandpossiblystimulatenewedu-cationintheareasNatureandEnvironment,EnergyandMaterials,LanduseandBiodi-versity,SteeringandInnovation,and‘Science,TechnologyandSociety’.
Fourgroupsparticipateintheinstitute:
1. Science,TechnologyandSociety(STS),FacultyofScience,DepartmentofChemistry�. Environmental Sciences (ES), Faculty of Geosciences, Department of Innovation and
EnvironmentalSciences3. EnvironmentalStudiesandPolicy(ESP),FacultyofGeosciences,DepartmentofInnova-
tionandEnvironmentalSciences4. InnovationStudies(IS),FacultyofGeosciences,DepartmentofInnovationandEnviron-
mentalSciences.
The evaluation in thispart of theSENSE reviewonly concerned the researchprogramme“EnergyforSustainableDevelopment”ofSTS,whichisapartofthetotalresearchoftheSTS-group.TheSTS-groupisalsoinvolvedintheresearchprogramme“LandUse,BiodiversityandEcosystemFunctioning”oftheES-groupofCopernicus.
ThemissionoftheCopernicusInstituteforSustainableDevelopmentandInnovationisfor-mulatedasfollows:“TheCopernicusInstituteinvestigatesanddevelopsprocessesandopportunitiesforinnova-tivechangetowardssustainability.Theinstitutethusseekstocontributetothedevelopmentofknowledgeandtechniquesaswellasmethodsandinstrumentsinthefieldofsustainabledevelopment,takingnoteofrelatedsocialdebatesandpolicyprocesses.Itistheambitionoftheinstitutetomakeadifference–inscienceandeducation,andinsoci-etyatlarge–intheexplorationofasustainableworld.”
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityScience,TechnologyandSociety:EnergyforSustainableDevelopment
Excellent Verygood Excellent Excellent
16� QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 25: Science, Technology and Society: Energy for Sustainable Development Programmedirector Prof.dr.W.C.TurkenburgResearchstaff�006 14.86fteAssessments: Quality: Excellent
Productivity: VerygoodRelevance: ExcellentViability: Excellent
Science,TechnologyandSocietyisoneofthefourresearchgroupsoftheCopernicusInstitute.Theresearchgroupperformsdisciplinaryandmulti-disciplinaryresearchandprovideseduca-tiononscienceandtechnologyforsustainabledevelopment,focusedonenergy,materialsandtheenvironment,landuseandbiodiversity,andmanagingenvironmentalrisksanduncertain-ties.Theambitionoftheresearchgroupistomakeadifferenceinachievinganewroleforscienceandtechnologycontributingtosustainabledevelopment.Theapproachofthisgroupistobuildpartnershipsandcollaboratewithresearchersandprivateandpublicsectorsinthedevelopmentofknowledgeandstrategiesintheindicatedfields,locally,nationallyandinter-nationally.Theresearchofthegroupisorganizedinfoursub-programmes:
1. EnergyandMaterialsDemandandEfficiency�. EnergySupplyandSystemStudies3. EnergyandGlobalChange:DealingwithRisksandUncertainties4. LandUseandBiodiversity.
Thesub-programmes1,�and3formtheresearchprogrammeEnergyforSustainableDevel-opment.Sub-programme4isintegratedinanotherresearchprogramme(LandUse,Biodiver-sityandEcosystemFunctioning).
Thecommitteefindstheachievementsofthisgroupimpressive.Thegrouphasastrongleaderwhohasbeenabletostimulateotherstoreachhighstandards.Thegroupisinternationallyleadinginthespecificsubjectsofitsfocus.Theresearchersarewellknownandareinvitedasvisitingprofessorsorkeylecturersinseveralcountriesanduniversities.Thepublicationrecordisverygoodandthereisapositivetrendinscientificimpact.Thegroupisveryproductive.Themembershaveaclearandcoherentvisiononthemissionofthegroupaswellasonthefutureperspectivesofresearch.
Theresearchofthisgroupisattheforefrontinternationallyandhasanimportantandsubstan-tialimpactinthefield.Theideasandapproachesadoptedareoriginal.Thepublicationrecordisverygood.Theprogrammedirectorandtheothermembersoftheresearchgrouphaveaprominentroleintheirfieldbothnationallyandinternationally.
The productivity of the group is, considering the number of staff, very good.The groupproducedanumberofexcellentscientificandprofessionalpublications.ThenumberofPhdthesesisreasonable.
Therelevanceoftheresearchbythisgroupisscientificallyandsociallyveryhigh.Thedissemi-nationandimpactoftheknowledgeisverygood.
Inviewofthepastscientificperformancethecommitteeevaluatesthelong-termviabilityoftheprogrammeasexcellent.Thegrouphasaclearandcoherentvisiononthefutureactivities.
163QANU/ResearchEvaluationEnvironmentalSciences�007
Thisgrouphasseveralexcellentyoungresearcherswhocantakeovertheleadandcanguaran-teeafruitfulfutureoftheresearchgroup.
164 QANU/ResearchEvaluationEnvironmentalSciences�007
165QANU/ResearchEvaluationEnvironmentalSciences�007
6. University of Groningen, Institute IVEM
TheCentre forEnergy andEnvironmental Studies IVEM is an independent research andeducationCentrewithintheFacultyofMathematicsandNaturalSciencesoftheUniversityofGroningen.IVEMoriginatesfromtwopredecessorgroupsworkingonenergyandenviron-mentalissues.
IVEMandtheRUGCentreforIsotopeResearch(CIO)jointlyofferatwoyearEnglish-lan-guagebasedMScdegreeprogrammeinEnergyandEnvironmentalSciences.
IVEMisakeyparticipantintheEnergyDeltaResearchCentre(EDReC)oftheUniversityofGroningen.
Since�000 IVEMmanages theuniversity-wide sustainabilityproject and it is increasinglyinvolvedinsustainability-relevantreachingandresearchactivitiesbothwithinandoutsidetheuniversity.
ThedualtransitionprocesstowardsanequitableandsustainableworldisatthecoreoftheIVEM research programme entitled: ‘Transition towards sustainability and environmentalquality’.
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityTransitiontosustainabilityandenvironmentalquality
Good Verygood Verygood Good
166 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 26: Transition to sustainability and environmental quality (RUG-IVEM)Programmedirector Prof.dr.A.J.M.SchootUiterkampResearchstaff�006 5.64fteAssessments: Quality: Good
Productivity: VerygoodRelevance: VerygoodViability: Good
The IVEM research programme onTransition to Sustainability and Environmental Qualitybuildsonthenotionthathumansocietiesusenaturalresourcestomeettheirneeds.Anyresourceusegeneratespressuresontheenvironment.Richwesternstyleconsumptionpatternsgenerallygiverisetoahigherenvironmentalimpact,thanthoseofpoordevelopmentsocieties.Theprogrammeis interdisciplinaryandrootedinnaturalsciencesandtoa lesserextent insocialsciences.Theprogrammeaimstoanalyze,design,implementandassesstransitionroutestowardsamoresustainableandenvironmentallycompatiblesocietaluseoftheearth’snaturalresources.Thefocusisonbasicenvironmentalresearchwithglobalandlongtermperspectiveandsecondaryattentiontoappliedenvironmentalresearch.
Thestrategicchoiceofthisgrouptofocusontheroleofconsumersisoriginalandinnovative,sinceverylittleresearchisdoneonthissideoftheproblem.ThegroupisregionallyorientedandwellknowninthenorthernpartoftheNetherlands.IthasaspecialpositionwithintheGroningenUniversityandisoftenaskedtopresenttheirvisiononactualities.TheprojectsofthePhDstudentsarenotlimitedtotheconsumerperspectiveanddonotreflectthemissionofthegroupinallaspects.CooperationinSENSEisveryvaluableforthisgroupnotonlyforthetrainingofthePhDstudentsbutalsoforthecontactswithotherresearchgroupsinthefieldofenvironmentalstudiesintheNetherlands.Thegroupseemssomewhatisolatedinthenorthofthecountryandcouldbenefitmorefromnationalcooperation.
Thequalityoftheresearchisgood.Thefocusontheconsumersisoriginal.Thegroupcontrib-utestoscientificdevelopmentinthefield,butismainlynationallyandregionallyfocused.ThenumberofpublicationsinA-categoryjournalshasincreasedconsiderablyinthelastyear.
Theproductivityof thegroup is verygood. In the interviewwith thecommittee thepro-grammedirectormentionedthatthegroupisoftenaskedtocommentandadviseonactualissues.ThatkindofproductivityisnotdescribedintheSEPprotocolbutisconsideredvalu-ablebythecommittee.
Thesocialandscientificrelevanceoftheresearchofthisgroupisveryhigh.Thisisalsodem-onstratedbytheregionalfunctionthisgroupseemstohaveincommentingonactualissuesanddevelopmentsinthefield.
Theinstituteisverysmall.Especiallythesmallnumberofseniorandtenuredstaffmakestheinstitutevulnerable.Ontheotherhandtheinstituteisstronglysupportedbytheuniversitythroughitsfunding.Thegrouphas,inviewofitssize,aconsiderablenumberofgoodandpromisingPhDstudents.ParticipationinSENSEisveryvaluableforthisgroup.Thecommit-teerecommendsextendingtheco-operationwithotherresearchgroupsinSENSE.
167QANU/ResearchEvaluationEnvironmentalSciences�007
7. Maastricht University , Institute ICIS
TheInternationalCentreforIntegratedAssessmentandSustainableDevelopmentICISisaresearchinstitutewithinMaastrichtUniversity.Itisaself-supportingbusinessunitreportingtotheDeanoftheFacultyofHumanitiesandSciences.
ICISstartedin1998anddevelopedintoaninternationalexpertisecentrefortheintegratedassessmentofsustainabledevelopment.ICISstartedwithateamof5people,andexpandedto35ftearound�001.ForthelastthreeyearsICIShasaresearchstaffof�1people.In�004thefounderofICIS,prof.Rotmansleftandwassucceededbyprof.Martens.SincethentheresearchfocusisondevelopingIntegratedAssessmentmethodsandtoolstoaddresskeysus-tainabilityissues.
TheprojectsarefundedbyavarietyoforganisationsforexampletheNetherlandsOrganisationforScientificResearch(NWO),theEuropeanCommission(EU)andprivatecompanies.
The institutehasnopermanent funding fromuniversity and is totally relyingon externalfunds,especiallycontractmoney.Allprojectsofthisgroupstartfromthepositionortheviewofthestakeholder.
Thecommitteeassessedthefollowingprogrammes:
Quality Productivity Relevance ViabilityIntegratedAssessmentandSustainableDevelopment
Good Verygood Verygood Good
168 QANU/ResearchEvaluationEnvironmentalSciences�007
Programme 27: Integrated Assessment and Sustainable Development (UM-ICIS)Programmedirector Prof.dr.P.MartensResearchstaff�006 10.�6fteAssessments: Quality: Good
Productivity: VerygoodRelevance: VerygoodViability: Good
ICIShasastrongmethodologicalfocus.Thecoreactivitiesarethedevelopmentandimprove-mentofintegratedassessment(IA)methods,toolsandproceduresinsupportofsustainabledevelopmentpractice.Currentmethodologies areparticipatorymethods, scenarios, indica-toranalysisandIAmodellingtechniques.Theselectionof topicsreflects theprioritiesandresearchagendasofnationalandinternationalresearchprogrammes.
The committee has the impression that theprogrammehas been strongbut suffered (notinoutputbutinsize)fromthedepartureoftwoofthethreeseniorresearchers.Thegroupconsistsatthismomentofyoungandmostlyjuniorresearcher.ThisgroupbenefitsalotfromtheSENSEResearchSchoolespeciallyforthePhDstudentsandtheirtraining.ThedirectorhasgoodcontactswithotherresearchgroupswithinSENSE.TheCommitteeevendiscussedtheoptionof thisgroup joining someothergroupwithinSENSEwitha similar focusonmethodologies.Ifthisisnotfeasible,atleaststrengtheningthecooperationfurtherisstronglyrecommended.
Duetothenecessitytofundtheresearchbyexternalcontractsthefocusoftheresearchgroupiswideandlackssomecoherence.Thenumberofprioritythemeslistedishighforsuchasmallgroup.Thegrouphas,however,beensuccessfulinattainingallthesecontractsandprojects.Thequalityoftheresearchisgoodbutnotexciting.Therelativeimpactofthepublica-tionsisaccordingtothecriteriausedfaraboveworldaverage.Theprominenceofthepro-grammedirectorisverygood.
Consideringthenumberofstafftheproductivityoftheresearchgroupisverygood,itisfaraboveworldaverage.ThenumberofdefendedPhDthesescanhoweverbeimproved.Publica-tionsrecordsseemtohaveadecliningtrendinquality,judgingfromtherelativeimpactandthenumberofA-categoryarticles.
Theresearchissociallyandscientificallyveryrelevant,butnotunique.
Thecommitteehastheimpressionthatthisgroupsdependstoomuchononeperson:thepro-grammedirector.Thecommitteedidnotgetaclearpictureoftheotherseniorresearchersinthisgroup.ThePhDstudents,however,whopresentedtheirprojectstothecommittee,madeagoodimpression.
Becauseofthedependenceonexternalfundingandoftherelianceontheprogrammedirector,theprogrammeasawholeseemsvulnerable.Therefore,thecommitteestronglyrecommendsstrengtheningthecontactswithotherresearchgroupsinSENSE.
169QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 1: Curricula Vitae of committee members
Dr. lea Kauppi, DirectorGeneraloftheFinnishEnvironmentInstitute(SYKE),Helsinki.Sustainabledevelopment,climatechange,transboundarywaterquestions, integratedassess-ments,sciencepolicy.
Prof. Thomas B. Johansson, ProfessorofenergysystemsanalysisandDirectoroftheInter-nationalInstituteforIndustrialEnvironmentalEconomics(IIIEE)attheUniversityofLund,Sweden. Dr. JohanssonobtainedhisPh.D. innuclearphysics from theLund InstituteofTechnology.From1994to�001,hewasDirectorofUNDP´sEnergyandAtmospherePro-gramme.HeservedontheEditorialBoardoftheWorldEnergyAssessment,1998-�000.In�000,hewasawardedtheVolvoEnvironmentPrize,alongwiththreeofhiscolleaguesforthebookEnergyforaSustainableWorld.
Prof. William lafferty, UniversityofOslo,CentreforDevelopmentandtheEnvironment.ResearchdirectorfortheprogrammeProSus.Heiscertifiedasprofessorinbothpoliticalsci-enceandsociology,andhasrecentlyfocusedhisresearchonproblemsrelatedtothestrategicimplementationofsustainabledevelopment.Hispublicationscoverthemesonthenatureofsustainabledevelopmentasconceptandgoal;democracyandtheenvironment; sustainablecommunities;governanceandsectoralpolicyintegration;andstrategiesfor“greeninnovation”inbusiness.Laffertyhasledseveralinternationalprojectsinthefieldofsustainabledevelop-mentresearch,includinga1�-nationprojecton“SustainableCommunitiesinEurope”(SUS-COM)fortheEuropeanCommission,anda9-nationprojecton“ImplementingSustainableDevelopmentinHigh-ConsumptionSocieties(COMPSUS)-withJamesMeadowcroft.HewasformanyyearsNorway’sdelegatetotheGoverningCounciloftheInternationalPoliticalScienceAssociation(IPSA),andservedasProgramChairfortheXVIIIWorldCongressofPoliticalScienceinQuebecintheyear�000.
170 QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 2: Overview of Scores
Table 1: Overview of scores
Quality Productivity Relevance Viability�3. EnvironmentalSystemsAnalysis
Group,WIMEK-WURExcellent Excellent Excellent Excellent
�4. DepartmentofSpatialAnalysisandDecisionSupport,IVM-VU
Verygood Verygood Verygood Verygood
�5. EnergyforSustainableDevelopment,CopernicusInstituteUU
Excellent Verygood Excellent Excellent
�6. CentreforEnergyandEnvironmentalstudies,IVEM–RUG
Good Verygood Verygood Good
�7. CentreforIntegratedAssessmentandSustainableDevelopment,ICIS-UM
Good Verygood Verygood Good
Table 2: SEP-scale; the meaning of the scores
Work that is at the forefront internationally, andwhichmost likelywillhaveanimportantandsubstantialimpactinthefield.Instituteisconsideredaninternationalleader.
Excellent (5)
Work that is internationally competitive and is expected to make asignificant contribution; nationally speaking at the forefront in thefield.Instituteisconsideredinternationalplayer,nationalleader.
Very good (4)
Workthatiscompetitiveatthenationallevelandwillprobablymakeavaluablecontributionintheinternationalfield.Instituteisconsideredinternationallyvisibleandanationalplayer.
Good (3)
Workthatissolidbutnotexciting,willaddtoourunderstandingandisinprincipleworthyofsupport.Itisconsideredoflessprioritythanworkintheabovecategories.Instituteisnationallyvisible.
Satisfactory (2)
Workthatisneithersolidnorexcitingflawedinthescientificandortechnicalapproach,repetitionsofotherwork,etc.Worknotworthyofpursuing.
Unsatisfactory (1)
171QANU/ResearchEvaluationEnvironmentalSciences�007
Appendix 3: Schedule
Integrated Assessment, Sustainable Systems Analysis and Spatial Management committee (ISS)
SUNDAY 17-06-2007xx.xx–15.00 ARRIVALNHCentreUtrecht,Janskerkhof10,Utrecht,
Tel.+31.30.�31316915.00–15.30 WELCOME15.30–16.00 QANU:Generalintroductionontheassessmentandthereview
programme16.00–16.30 SENSE:GeneralintroductionSENSE,withemphasisonthe3different
assessmentlevels:researchgroups;SENSEinstitutesandSENSEResearchSchool
16.45–18.30 InternalRCmeeting19.00–�1.00 DINNER�1.00–��.00 (meetingchairs)
MONDAY 18-06-2007XXXX–09.30 Utrecht09.30–10.30 InternalRCmeeting10.30–11.30 PresentationanddiscussionDepartmentofSpatialAnalysisandDecision
Support(SPACE-IVM/VU)nr.�411.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 PresentationanddiscussionScience,TechnologyandSocietyGroup(STS-
Copernicus/UU)nr.�514.00–15.00 PresentationanddiscussionCenterforEnergyandEnvironmentalStudies
(IVEM-RUG)nr.�615.15–16.45 PhDposterpresentations(SPACE,STS,IVEM)anddiscussion17.00–18.00 InternalRCmeeting18.00–�0.00 Dinner
TUESDAY 19-06-2007XXXX–09.30 Utrecht09.30–10.30 InternalRCmeeting10.30–11.30 PresentationanddiscussionInternationalCentreforIntegratedAssessment
andSustainableDevelopment(ICIS-MU)nr.�711.15–1�.0011.30–1�.00 InternalRCmeeting1�.00–13.00 Lunchbreak13.00–14.00 PresentationanddiscussionEnvironmentalSystemsAnalysisGroup
(ESA-WIMEK/WU)nr.�314.00–15.00 PhDposterpresentationsanddiscussion15.15–16.45 InternalRCmeeting17.00–18.00 InternalRCmeeting/closure18.00–�0.00 Dinner�0.30–�1.30
(chairsmeetinGeneralCommittee,Wednesday9:00hrs)