doctoral survey 2014
DESCRIPTION
ÂTRANSCRIPT
TU Delft Graduate School
Doctoral Candidate Survey 2014
Colophon Research, production and final editing Jasper Meeuwissen (Graduate School, TU Delft) Research Support Laurens van der Vuurst (Downsideup, Amsterdam)
Co-editor Stella van der Meulen (Graduate School, TU Delft) Editorial team Young Mi Poppema (Graduate School, TU Delft) Design and lay-out Dominique Meijer (Media Solutions, TU Delft) Photography Sam Rentmeester (photograph in foreword) © TU Delft 2014 A digital version of this report is also available on the website: graduateschool.tudelft.nl and on: issuu.com
1
Contents Management Summary ........................................................................................................................... 5
Research questions ............................................................................................................................. 6
Interventions ....................................................................................................................................... 6
1. Introduction and methods .............................................................................................................. 9
2. Response Group ............................................................................................................................ 13
2.1 Introduction ................................................................................................................................. 14
2.2 Response rate .............................................................................................................................. 14
2.3 Validity of response group .......................................................................................................... 15
2.4 Background information .............................................................................................................. 17
2.5 PhD project information .............................................................................................................. 20
3. Descriptive statistics: faculties and TU Delft ................................................................................. 27
3.1 Introduction ................................................................................................................................. 28
3.2 Project and Planning .................................................................................................................... 30
3.3 Professional Embedding .............................................................................................................. 38
3.4 Supervision .................................................................................................................................. 45
3.5 Doctoral Education ...................................................................................................................... 63
3.6 Working Environment, Facilities and Teaching ........................................................................... 72
3.7 Career Planning ........................................................................................................................... 87
3.8 Graduate School (organization and process) .............................................................................. 95
3.9 Online Education ....................................................................................................................... 102
3.10 Final grade of PhD programme ............................................................................................... 104
3.11 Faculty-related questions ........................................................................................................ 107
Aerospace Engineering ................................................................................................................ 107
Civil Engineering and Geosciences .............................................................................................. 108
Electrical Engineering, Mathematics and Computer Sciences .................................................... 109
Technology, Policy and Management ......................................................................................... 110
4. Subgroup Differences .................................................................................................................. 111
4.1 Introduction ............................................................................................................................... 112
4.2 Scale questions .......................................................................................................................... 113
4.3 Gender ....................................................................................................................................... 116
4.4 Nationality ................................................................................................................................. 119
4.5 VSNU category ........................................................................................................................... 126
4.6 Pre-GS/GS .................................................................................................................................. 131
2
4.7 Go/No Go ................................................................................................................................... 134
4.8 Research School......................................................................................................................... 135
4.9 Teaching .................................................................................................................................... 137
4.10 Peer group learning ................................................................................................................. 139
4.11 Meetings with supervisors ...................................................................................................... 141
4.12 Supervision satisfaction ........................................................................................................... 143
5. Cause and Effect .......................................................................................................................... 145
5.1 Introduction ............................................................................................................................... 146
5.2 Correlations ............................................................................................................................... 146
5.3 Regression ................................................................................................................................. 148
3
Foreword
Delft University of Technology, November 1, 2014
Dear Reader,
This report presents the results of a survey among all doctoral candidates at Delft University of Technology (TU Delft) – the PhD Survey 2014 – about their experience of various aspects of the doctorate graduation process and the Graduate School. In 2011 we held our first big “Doctoral Climate” Survey, followed by the implementation of the TU Delft Graduate School in 2012. The purpose of the PhD Survey 2014 is to see how doctoral candidates view their working environment, their research endeavours and the processes involved. By comparing the two surveys, we aim to assess the impact which the establishment of the Graduate School has had on our Doctoral candidates.
The results of the PhD Survey 2014 will be used by the Graduate School’s Dean and Board to continue to develop the Doctoral climate and key aspects such as the quality of doctoral education and doctorate supervision at the university.
The Graduate School (GS) is still ‘under construction’; we expect the first cohort of GS Doctoral candidates to defend their dissertation by the beginning of 2016. Therefore, we are glad that our Doctoral candidates already value the overall doctorate climate at TU Delft slightly more than in 2011, namely 7.34 out of 10 (to 7.20 in 2011).
It seems that many of the changes implemented by the TU Delft Graduate School have indeed improved the doctorate climate. An example is a comprehensive package of generic training courses as part of the Doctoral Education programme. The aim of this report is to define, in depth, how and where the Doctoral climate has been enhanced. It is our ambition that the Graduate School will continue to play an important role in improving the various areas of and the doctorate graduation process as a whole.
Stella van der Meulen MSc, Coördinator TU Delft Graduate School
Prof.dr.ir. Peter Wieringa, Dean TU Delft Graduate School
4
Management Summary
5
Research questions This report provides answers to the most important issues that lie at the heart of the doctorate climate at Delft University of Technology (TU Delft). These issues can be summarized in the following categories:
• Project and Planning
• Professional Embedding
• Supervision
• Doctoral Education
• Working Environment, Facilities and Teaching
• Career Planning Three research questions ran through the survey:
1. What are the characteristics of our current doctoral population in 2014?
(i.e. demographics, background information and satisfaction scores)
2. What are the differences between faculties, between 2011 and 2014 and between significant subgroups?
3. Which issues require the most attention? E.g.: Which aspects(s) of the doctoral process influence(s) doctoral candidates’ general satisfaction the most?
Over 100 questions have been presented to and answered by 667 respondents,. These answer have provided detailed insight into the doctoral climate at TU Delft.. The response group was tested for validity and all conclusions from this report can be extrapolated to the entire Doctoral population. The graphs and statistical tests visualise these questions and provide input for the Graduate School and the Board for Doctorates to make evidence-based policy decisions.
Overall grade
Doctoral candidates grade the doctoral climate with an average score of 7.34 regardless of the faculty they belong to. In 2011, the average overall score was 7.2.; i.e. there was a slight increase in overall satisfaction in 2014, when comparing to 2011 (the difference with 2014 is statistically significant).
Interventions To highlight which issues doctoral candidates perceive as ‘most pressing’, the overall grade is also used in a regression analysis. The following three categories with specific items have the strongest influence on the overall grade:
1. Project and Planning
• Items: Clear overview of PhD project, progress is in line with expectations, promotor and daily supervisor motivate the doctoral candidate to finish in 4 years
• Item where the largest difference can be made: 38% of doctoral candidates do not think that their progress is in line with their expectations.
2. Supervision
• Items: Own input is taken seriously, doctoral candidate receives help to expand professional network, it is clear what to expect from supervision, support/help with methodology
6
• Item where the largest difference can be made: 31% of doctoral candidates do not think that they receive enough help expanding their professional network.
3. Working Environment, Facilities and Teaching
• Items: Available facilities (e.g. laboratories, equipment, software), content of own work, social relationships at work, contact with the research group
• Item where the largest difference can be made: 18% of doctoral candidates is dissatisfied with their contact with other staff members of their research group.
It seems that working on the abovementioned items will positively influence the doctoral experience of a doctoral candidate and will thus have a significant impact on the overall grade. Furthermore, doctoral candidates will be more satisfied with their supervision and perform better when they are well-embedded in their working environment (professionally and socially). In a broader sense, it appears that all the items in the questionnaire dealing with data collection, data analysis and methodology are strong predictors of general satisfaction regarding the doctorate climate.
Subgroups
When looking at the 4 most important subgroups within the whole population, it can be said that:
• Male doctoral candidates are more satisfied than female doctoral candidates
• Dutch doctoral candidates are more satisfied than international Doctoral candidates
• Doctoral candidates that started from 2012 onwards (as a part of the Graduate School) are more satisfied than doctoral candidates before 2012
• The level of satisfaction is also dependent of a doctoral candidate’s VSNU category:
external doctoral candidates (VSNU 4) are most satisfied, followed by contract doctoral candidates (VSNU 3), then standard doctoral candidates (VSNU 1) and at lastly Internal Doctoral candidates (VSNU 2) who are least satisfied.
• Six other subgroups were studied as well. A surprising result was that passing the Go/No Go meeting seems to have no influence on how well a doctoral candidate oversees their whole PhD project.
Connection to TU Delft
The most notable change between 2011 and 2014 in the doctoral population is the way in which doctoral candidates are professionally connected to TU Delft. The results in the graph are for the whole population in 2011 and 2014.
With a single glance, it is obvious that the increase in the percentage of contract doctoral candidates is derives from a decrease in percentage of standard and external doctoral candidates. This is an
63%
53%
27%
39%
9%
6%
0% 25% 50% 75% 100%
2011
2014
VSNU 1
VSNU 2
VSNU 3
VSNU 4
7
interesting trend because contract doctoral candidates have a different relation to TU Delft (partner instead of employer) and this has consequences for e.g. financing, teaching capacity at TU Delft, etc.
8
1. Introduction and methods
9
1.1 The Graduate School of Delft University of Technology
This survey is the follow-up to a baseline survey performed in in the summer of 2011. In 2010 the Executive Board of Delft University of Technology (TU Delft) had expressed the wish to found a Graduate School (GS). In 2011, it was decided that there should be a University Graduate School for central affairs (intake, registration, Doctoral Education, monitoring) and a Faculty Graduate School at every faculty for local affairs (mentor, discipline-related courses, supervision). The implementation of the Graduate School started in 2011 with the formation of the University Graduate Office and as of January 1st 2012 all faculties had formed their Faculty Graduate School.
The main task of the Graduate School is to streamline the whole doctoral process and make it more transparent both for the doctoral candidate and the organization. The ultimate goal hereby is to raise the doctorate graduation quality and speed.. There are dedicated teams at the University Graduate School and Faculty Graduate School that are pursuing this goal every day and it can now be concluded that the Graduate School is fully embedded in the organisation.’
The other main task of the Graduate School is to facilitate the Doctoral Education programme (according to the third cycle of education as stated in the Bologna Agreements). Doctoral Education is a mandatory programme for doctoral candidates since the start of the GS. Doctoral Education aims to help doctoral candidate develop in terms of their research skills, discipline-related skills and skills related to personal and professional development. Ultimately, this will help them work towards becoming independent researchers that will thrive in their further career regardless of whether this is in industry or academia. The University Graduate School offers training for transferable (generic) skills. The training for research and discipline-related skills is coordinated at the faculty level.
1.2 Objective of this survey
The main objective of this survey is to monitor, report and evaluate the doctoral experience climate at TU Delft. This led us to formulate three questions:
1. What are the characteristics of our current doctoral population in 2014?
Demographics, background information and satisfaction scores
2. What are the differences?
Between faculties, between 2011 and 2014 and between significant subgroups
3. Which issues require the most attention? What/which part(s) of the doctoral process influence(s) the general satisfaction the most?
This survey is part of a broader objective to monitor, report and evaluate all the doctoral processes..
1.3 Data collection and products
All the doctoral candidates at TU Delft are registered in the Doctoral Monitoring Application (DMA). This is a web-based application where the key actors involved in the doctoral project can monitor progress: the doctoral candidate, the promotor(s) and the daily supervisor(s). The mailing list for the questionnaire was generated using DMA. This list contains the e-mail addresses of2334 doctoral candidates(see Appendix 1). During the whole month of April, it was possible for doctoral candidates to fill out the questionnaire using the online survey tool EvaSys. This tool is used throughout TU Delft to evaluate all the bachelor, master and doctoral education.
10
1.4 Data analysis (in SPSS)
All the analyses were carried out in close cooperation with Laurens van der Vuurst1.
Types of charts
For all the items (both Likert and non-Likert scale), a stack graph has been created by doing a cross tabulation of the different items with the respondents per faculty and for the whole population. It shows the percentages of the individual answers per category. All the data is from the 2014 questionnaire.
For all the Likert scale items, a differences chart has been made by doing an ANOVA-test, which means treating the categorical variables as continuous variables. It shows the mean scores of the Likert scale items of the 2011 and 2014 questionnaire, again for the whole doctoral community at TU Delft and also per faculty level.
Tests of significance
Two different tests of significance have been used. The Likert scale questions in the questionnaire of 2011 had only 4 categories. Since the 2014 questionnaire had to be compared to the questionnaire from 2011, the most statistically sound option was to also use a Likert scale with 4 categories for 2014. However, for a categorical variable, 4 categories are not enough to do variance analysis using an ANOVA-test (F) . This is why the a Pearson’s chi-squared test (χ2) was done in combination with cross tabulation. The result is a stack graph and a χ2-test of significance.
To compare the mean scores per Likert scale item for 2014 and 2011, it was necessary to create the differences chart by doing an ANOVA-test with a F-test of significance. For the presentation in this report, all scores have been lowered by 2.5 point to create a neutral value in the graph of 0. By doing this, the differences graph runs from -1.5 (strongly disagree) till +1.5 (strongly agree).
The elements in the formula of the two different tests mean the following (the numbers are random):
χ2(21, 612) = 16.74, p > .05 χ2(degrees of freedom, N of valid cases) = χ2-value, p > .05 F(7, 1424) = 1.87, p > .05 F(degrees of freedom, corrected total of cases) = F-value, p > .05
How to interpret the three different statistical tests
In this report, there are three types of statistical tests:
1. A χ2-test of statistical differences between faculties and TU Delft in 2014 2. A F- or χ2-test of statistical differences between 2011 and 2014 on the faculty level 3. A F- or χ2-test of statistical differences between 2011 and 2014 for the whole of TU Delft
For stack graphs the tests are always a χ2-test, for differences charts always a F-test.
The results of the three tests tell us different things:
1. If the χ2-test is significant it means that there are significant statistical differences in the way individual doctoral candidates score on a category (e.g. the number of appointments with a supervisor) or how they perceive a situation (e.g. how satisfied one is with the number of
1 Co-founder of Downsideup – [email protected] - 0645086958
11
appointments with a supervisor). Of course, if the test is not significant there are no significant statistical differences between individual candidates of the faculties.
2. If the F- or χ2-test is significant it means that there are statistical differences in the way doctoral candidates score on a category or how they perceive a situation, as a group in 2011 or as a group in 2014 .
3. If the F- or χ2-test is significant it means that there are significant statistical differences in the way the doctoral community at TU Delft perceived a situation in 2011 or in 2014. If the test is not significant, it means that the changes between the response groups of 2011 and 2014, if any, are not generalizable for the whole doctoral community.
A test is significant if p < .05 (confidence interval of 95%) or for some items even p < .01 (99%).
12
2. Response Group
13
2.1 Introduction Every research starts and ends with the population. (In the case of this survey, the population refers to all doctoral candidates at TU Delft.) Besides being the providers of the data, the population is also the initial reason for doing the research. Their input is needed to see what is going well and what can be improved. Not all members of the population will fill out the questionnaire. The members who do respond are referred to as the response group, or sample. Two aspects must be borne in mind when applying survey conclusions to an entire population:
1. Is the response group representative? 2. Is the response group valid?
The first question is expressed in the response rate, the second question in significance levels. Since this research compares the results of 2014 to the results of 2011, it is also important to look at the inter response group validity (i.e. the whole response group of 2014 compared to the whole response group of 2011.
2.2 Response rate The response rate is the result of dividing the number of doctoral candidates who were invited to participate by the total number of doctoral candidates at TU Delft. The response rate table is based on the numbers provided by EvaSys. Unfortunately, some respondents were mislabelled in the Doctoral Monitoring Application (DMA). This meant that in the dataset a couple of respondents had to be relabelled (see Appendix 1). However, since the need for relabeling was quite even amongst all the faculties, the response rates provided by EvaSys could be maintained. Only TPM had only 7 respondents instead of 33: 23 of the candidates turn out to belong to Architecture, 3 to Applied Sciences (AS). Below is a snapshot of the population and response rate per faculty on December 31st 2013. Faculty Number of respondents Number of responses Response rate
3mE 309 107 35% AE 165 47 28% Arch 205 69 34% AS 397 132 33% CEG 503 146 29% EEMCS 409 119 29% IDE 140 40 29% TPM 206 7 3% Total 2334 667 29% For an internal questionnaire the response rate is not very high, despite two reminders and intensive promotion in newsletters and with leaflets. However, when the response group is highly valid, conclusions from the response group are still applicable to the whole population.
14
2.3 Validity of response group In order to check the validity of the response group (face value), the following four indicators have been used:
1. Gender 2. Nationality 3. Faculty 4. VSNU category
This check gives enough ground to conclude that the response group is valid and that the conclusions of the research apply to the whole doctoral candidate population at TU Delft. Gender
Female Male Total
Response group 217 446 663 Population 724 1847 2571
4 respondents did not submit their gender.
Nationality
National International Total
Response group 195 465 660 Population 851 1720 2571
7 respondents did not submit their nationality.
33%
28%
67%
72%
0% 25% 50% 75% 100%
Response group
Population
female
male
30%
33%
70%
67%
0% 25% 50% 75% 100%
Response group
Population
National
International
15
Faculty
3mE AE Arch AS CEG EEMCS IDE TPM Total
Response group
107 47 71 127 148 120 40 7 667
Population 339 202 239 419 573 452 141 206 2571
VSNU category
VSNU 1 VSNU 2 VSNU 3 VSNU 4 Unknown Total
Response group
350 12 255 40 10 667
Population 1134 67 732 198 440 2571
Title Category Explanation
VSNU 1 Standard Full time PhD candidate (employed at TU Delft)
VSNU 2 Internal Part time PhD candidate (combined with another job profile at TU Delft) VSNU 3 Contract Full time PhD candidate funded by a third party
(e.g. fellowship, scholarship, industry, FOM, EU, M2i) VSNU 4 External Part time self-funded PhD candidate
16%
13%
7%
8%
11%
9%
19%
16%
22%
22%
18%
18%
6%
6% 8%
0% 25% 50% 75% 100%
Response group
Population
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
52%
44%
38%
28%
6%
8% 17%
0% 25% 50% 75% 100%
Response group
Population
VSNU 1: Standard
VSNU 2: Internal
VSNU 3: Contract
VSNU 4: External
Unknown
16
2.4 Background information The following information was asked about the background of the respondent:
• Gender
• Age
• Nationality
• Have you ever studied abroad, before starting your PhD Programme at TU Delft? 2.1 Gender Individual answers per faculty in 2011 and 2014
Test 2011 (faculties)
Test 2014 (faculties)
Test 2011 vs. 2014 (faculty)
χ2(7, 889) = 55.09, p < .01 χ2(7, 663) = 29.91, p < .01 χ2(7, 1552) = 76.55, p < .01 Total doctoral candidate population in 2011 and 2014
Test 2011 vs. 2014 (TUD) χ2 (1, 1552) = 1.29, p > .05
24% 15%
46% 30%
33% 22%
68% 40%
76% 85%
54% 70%
67% 78%
32% 60%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPM
female
male
23% 23%
46% 43%
31% 23%
51% 43%
77% 77%
54% 57%
69% 77%
49% 57%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPM
female
male
30%
33%
70%
67%
0% 25% 50% 75% 100%
2011
2014
female
male
17
2.2 Age
2011 2014
N 887 665 Mean 29,78 29,59 Standard Deviation 5,335 5,639 Range 48 44 Minimum 19 19 Maximum 67 63
Test 2011 vs. 2014 (TUD) F(1, 1551) = .43, p > .05 2.3 Nationality
195
111
40
34
32
21
14
14
12
10
0 20 40 60 80 100 120 140 160 180 200
Netherlands
China
Iran
India
Italy
Germany
Portugal
Spain
Turkey
Indonesia
Top 10 Nationalities 2014
18
It is striking that the top 10 of nationalities in 2014 contains 9 of the nationalities that were also in the top 10 in 2011. Apparently, TU Delft appeals to the same candidates in the same countries for a longer period.
2.4 Have you ever studied abroad, before starting your PhD Programme at TU Delft?2
Individual answers per faculty and over the whole TU Delft in 2014
Test 2014 (faculties) χ2(7, 667) = 10.54, p > .05
2 This question was only present in the 2014 questionnaire.
302
135
45
44
37
27
25
21
18
15
0 50 100 150 200 250 300
Netherlands
China
Italy
Iran
India
Germany
Turkey
Portugal
Indonesia
Romania
Top 10 Nationalities 2011
49% 51%
49% 53%
41% 40%
58% 71%
47%
51% 49%
51% 47%
60% 60%
43% 29%
53%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
19
2.5 PhD project information The following information was asked about the PhD research of the respondent:
• Faculty
• Starting year
• What type of doctoral candidate are you (full time, part time, employee, independent, etc)?
• PhD mentor: o Do you have a PhD mentor? o Have you ever met your PhD mentor? o I know for which matters I can contact my mentor o Who appointed your PhD mentor?
• Are you a member of a Research School?
• Have you submitted your Prom 1 and 2 at the Office of the Beadle (Pedel)?
3.1 At which faculty/faculties are you conducting your PhD research?3
TU Delft wide in 2011 and 2014
Test 2011 vs. 2014 (TUD) χ2(6, 1556) = 49.93, p < .01
It is likely that the significant difference has something to do with the mislabelling of doctoral candidates of TPM in DMA. At face value, the other faculties seem to have the same percentage of doctoral candidates in relation to the whole population in 2014 as they had in 2011. A statistical test without TPM has not been carried out and it is estimated that the χ2-test would not be significant in that case.
3 It is possible to carry out PhD research at two faculties. In the dataset, every respondent has only one faculty, corresponding to the faculty of the promotor (so, not the co-promotor or the daily supervisor).
15%
16%
9%
7%
7%
11%
19%
19%
18%
22%
20%
18%
4%
6%
8%
0% 25% 50% 75% 100%
2011
2014
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
20
3.2 What is the official starting year of your PhD at TU Delft?
655 respondents answered this question, 12 respondents are system missing.
TU Delft wide in 2011 and 2014
Test 2011 vs. 2014 (TUD) χ2(6, 1544) = 7.8, p > .05 Since the most recent starting year differed between the two response groups, a new variable was made that measured how many years ago someone started their PhD research. This also makes it possible to look for statistical differences and they are not significant. 3.3 How are you connected to TU Delft? Respondents were to choose 1 out of 7 options to express their professional connection to TU Delft. The below graph is a table that explains the different categories.
2
4
6
10
51
91
101
155
178
57
0 20 40 60 80 100 120 140 160 180 200
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
11%
9%
24%
27%
22%
24%
18%
15%
13%
14%
7%
8%
0% 25% 50% 75% 100%
2011
2014
this year
1 year
2 years
3 years
4 years
5 years
6 or more years
21
Individual answers per faculty and over the whole TU Delft in 2014
Test 2014 (faculties and TUD) χ2(42, 666) = 168.74, p < .01 Title Explanation
Full time 1 Full time PhD candidate (employed at TU Delft) Full time 2 Full time PhD candidate funded by a third party
(e.g. fellowship, scholarship, industry, FOM, EU, M2i) Part time 1 Part time PhD candidate funded by a third party
(e.g. fellowship, scholarship, industry, FOM, EU, M2i) Part time 2 Part time PhD candidate
(combined with another job profile at TU Delft) Full time 3 Full time self-funded PhD candidate Part time 3 Part time self-funded PhD candidate Other Other (e.g. pensioner) The categories in my questionnaire were derived from the original categorization by the VSNU (Association of universities in the Netherlands) but these were expended by making a division between full time and part time doctoral candidates. The research in 2011 used only the VSNU categorization. Therefore, in order to be able to compare the results of 2014 to those of 2011, it was necessary to recode the 7 categories into the 4 VSNU categories. TU Delft wide in 2011 and 2014
Test 2011 vs. 2014 (TUD) χ2(3, 1544) = 23.89, p < .01
61% 53%
28% 69%
45% 57%
35% 43%
41%
31% 39%
25% 29%
39% 36%
45% 43%
17%
10%
5%
12%
21%
14%
5%
13%
7%
9%
8% 14%
8%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
full time 1
full time 2
part time 1
part time 2
full time 3
part time 3
other
63%
53%
27%
39%
9%
6%
0% 25% 50% 75% 100%
2011
2014
VSNU 1
VSNU 2
VSNU 3
VSNU 4
Unknown
22
Title Category Explanation
VSNU 1 Standard Full time doctoral candidate (employed at TU Delft)
VSNU 2 Internal Part time doctoral candidate (combined with another job profile at TU Delft)
VSNU 3 Contract Full time doctoral candidate funded by a third party (e.g. fellowship, scholarship, industry, FOM, EU, M2i)
VSNU 4 External Part time self-funded doctoral candidate
At a single glance, it is obvious that the increase in the percentage of contract doctoral candidates derives from the group of standard and external doctoral candidates. This is an interesting trend because contract doctoral candidates have a different relation to TU Delft (partner instead of employer) and this has consequences for e.g. financing. Individual answers for all full time and part time categories over the whole TU Delft in 2011 and 2014
Test 2011 vs. 2014 (TUD) χ2(2, 1555) = 4.85, p > .05 Individual answers for all full time and part time categories per faculty 2014
Test 2014 (faculties and TUD) χ2(14, 666) = 82.19, p < .01
87%
90%
10%
9%
0% 25% 50% 75% 100%
2011
2014
full time
part time
other
94% 94%
66% 98%
88% 95%
80% 86%
32%
9% 5%
20% 14%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPM
full time
part time
other
23
3.4 Do you have a PhD mentor? Individual answers per faculty in 2014
Test 2014 (faculties) χ2(14, 667) = 49.27, p < .01
TU Delft wide in 2011 and 20144
Test 2011 vs. 2014 (TUD) χ2(2, 1544) = 155.17, p < .01 3.5
Have you ever met your PhD mentor?5
Individual answers per faculty and over the whole TU Delft in 2014
Test 2014 (faculties and TUD) χ2(7, 667) = 37.36, p < .01
4 In 2011 there were two options (yes and no), in 2014 three (yes, no and don’t know). 5 This question was only present in the 2014 questionnaire – 395 respondents have a mentor.
64% 55%
65% 40%
53% 68%
90% 100%
21% 26%
24% 38%
28% 18%
8%
16% 19%
11% 22%
19% 13%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPM
yes
no
don't know
74%
59%
26%
25% 16%
0% 25% 50% 75% 100%
2011
2014
yes
no
don't know
66% 77%
65% 67%
70% 95% 97%
86% 77%
34% 23%
35% 33%
30%
14% 23%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
24
3.6 I know for which matters I can contact my mentor6
Individual answers per faculty and over the whole TU Delft in 2014
Test 2014 (faculties and TUD) χ2(7, 667) = 37.36, p < .01 3.7 Who appointed your PhD mentor?7
Individual answers per faculty and over the whole TU Delft in 2014
Test 2014 (faculties and TUD) χ2(28, 395) = 62.86, p < .01 3.8
Are you a member of a Research School?
Individual answers per faculty in 2014
Test 2014 (faculties) χ2(14, 666) = 23.26, p > .05
6 This question was only present in the 2014 questionnaire. 7 This question was only present in the 2014 questionnaire.
87% 92% 91%
80% 75%
90% 97% 100%
86%
13% 8% 9%
20% 25%
10%
14%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
94% 58% 57% 59% 62%
79% 64%
57% 70%
12% 9%
10% 8%
14% 6%
6%
9%
8% 29%
23% 24% 26%
20% 17%
25%
18%
0% 25% 50% 75% 100%
3mE
Arch
CEG
IDE
TU Delft
staff of FGS
promotor
daily supervisor
other
don't know
40% 17%
38% 39%
26% 35%
23% 57%
44% 47%
39% 39%
45% 38%
45% 43%
16% 36%
23% 22%
28% 28%
33%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPM
yes
no
don't know
25
TU Delft wide in 2011 and 20148
Test 2011 vs. 2014 (TUD) χ2(2, 1555) = 261.58, p < .01
8 In 2011 there were two options (yes and no), in 2014 three (yes, no and don’t know).
34%
33%
66%
42% 25%
0% 25% 50% 75% 100%
2011
2014
yes
no
don't know
26
3. Descriptive statistics: faculties and TU Delft
27
3.1 Introduction This chapter gives the most complete and broad overview of the opinions of doctoral candidates at TU Delft. In the underlying graphs, tables and text information on all the items of the questionnaire are displayed (starting at the cluster Project and Planning). (Background and PhD project information are the subject of chapter 2.) All the items are grouped in separate coherent clusters. The data of every separate item has been grouped per faculty and for all of TU Delft, both for the respondents in 2011 and 2014. At the end of the chapter, there is a section with items that were only available to doctoral candidates of a specific faculty (in 2011 there were no faculty specific questions).
Cluster
No. of items in 2014
No. of items same as in 2011
No. of items on satisfaction
1 Project and Planning 9 9 6 2 Professional
Embedding 8 7 8
3 Supervision 23 23 17 4 Doctoral Education 12 6 10 5 Working Environment,
Facilities and Teaching 23 14 17
6 Career Planning 13 6 8 7 Graduate School
(organization and process)
12 Cluster not present in 2011
6
8 Online Education 4 Not present in 2011 0 104 65 72
Significant statistical differences between subgroups
As previously mentioned, this is the broadest overview and it shows that doctoral candidates agree more with almost every single item in comparison to 2011; both at the faculty level and for all of TU Delft. When looking at the final grade for the PhD programme, it can be seen that doctoral candidates from 5 faculties gave a higher grade in comparison to 2011 and the grade at TU Delft level went up from 7.2 to 7.34. Generally speaking, there is much to be proud of.
The broadness of the research makes it difficult to discern specific needs, if there are any. That is why chapter 4 zooms in on different subgroups of the doctoral candidate community (e.g. male/female, Dutch/international candidates, pre-Graduate School/belonging to the Graduate School). In this chapter, the different Likert scale items that cause for significant differences between subgroups will be pinpointed. Besides Graduate School and Online Education, all clusters were included in this analysis.
The following numbers correspond to the subgroups where there were significant differences on the items in this chapter. In the tables at the beginning of every cluster you will find these numbers.
1 Male/female
2 Dutch/ international 3 VSNU categories 4 Pre-Graduate School/belonging to the Graduate
School
28
The tables at the start of every cluster show the result of separate univariate analyses on every item for the subgroups in this table. So for these subgroups you can draw quite distinct conclusions about their mutual differences. In chapter 4, 7 more subgroups are defined but the above four are the most important ones.
Establishing correlations and cause-effect relationships
The main goal of the questionnaire is to measure satisfaction. The items are grouped so it’s possible to make statements about the satisfaction per cluster; between and within faculties and/or between 2011 and 2014. In chapter 4, it is also possible to see where there are significant statistical differences between subgroups on scale questions, certain items and the final grade of the PhD programme. However, all these analyses don’t give us information on the correlations between the items or the cause and effect relationships of items on satisfaction. For this reason, two final statistical tests will be the subject of chapter 5. Firstly, a correlation table will be presented that shows that all clusters are quite strongly interrelated: satisfaction on one cluster of items has a strong influence on another cluster of items. Secondly, regression analyses will be carried out to determine which items have the highest predictive value for the final grade of the PhD programme. The final grade is used as a general derivative of satisfaction. All Likert scale items of the clusters in this chapter were included in this analysis (with exception of those of Graduate School and Online Education). It appears that all the items in the questionnaire that deal with data collection, data analysis and methodology are strong predictors of general satisfaction about the PhD programme. In the tables at the beginning of every cluster, information has been added which items are the best predictors for a higher final grade.
29
3.2 Project and Planning Introduction The items in this cluster are related to the planning of the PhD project, which usually lasts 4 years but can differ under influence of several factors. There are 9 items in this cluster: 4.1 till 4.6 are Likert scale items that measure to what extent doctoral candidates agree or disagree with factors that are affecting the progress of their project. The rest are more factual items with different categories.
Especially items 4.8 and 4.9 are interesting because they cover the progress/status of the PhD project and any possible delays.
Item
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014
(TUD)
Subgroup*
Influence on general
satisfaction
4.1 X X 1 X 4.2 4 X 4.3 1, 4 X 4.4 2, 3, 4 4.5 2, 3, 4 4.6 1, 2, 3, 4 X 4.7 X 4.8 4.9 1, 2, 3
Separate statistical tests have been executed for all four subgroups.
Besides the four subgroups in the table, the subgroup ‘supervision satisfaction’ showed significant statistical differences when it came to items 4.5, 4.8 and 4.9 (see chapter 4 for the results). Summary The most striking conclusion in this cluster is that 6 of the 9 items have a significant p-level when 2011 and 2014 are compared on TU Delft level. The change on item 4.6 was negative: in 2014 doctoral candidates feel that their PhD project is less in line with their expectations than in 2011.
In the ideal situation no significant differences can be found between the different faculties when looking at the 2014 questionnaire. In this cluster only item 4.1 shows a significant difference between the faculties but this can partly be explained by the extreme score at TPM. However, TPM has only 7 respondents so the impact of TPM on the whole 2014 response group is not as strong as, for example, the impact of CEG with 146 respondents. When taking a closer look at the changes on items 4.8 and 4.9, it can be seen that there are no differences between faculties in 2014 and also not between 2011 and 2014 at faculty level. At TU Delft level, there are no differences between 2011 and 2014 on item 4.9 (reasons for delay). On item 4.8, there is a significant statistical difference and the change is negative: in 2011 58% of the respondents were on schedule and 32% behind schedule, in 2014 these groups were 52% and 43% respectively. The following can be concluded about the different subgroups:
• Females agree less on the items than males and have different reasons for delay;
• This also the case when comparing Dutch doctoral candidates and international doctoral candidates;
• Internal doctoral candidates are worst off, in terms of finishing tasks and progress/status;
• Pre-Graduate School doctoral candidates are less satisfied on most items than doctoral candidates that belong to the Graduate School
30
Questions
These are the TU Delft wide results for the Likert scale questions over 2014
4.1 I have a clear overview of the different phases of my PhD project (from intake to the
doctoral defence ceremony and everything in between)
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 663) = 38.89, p < .05 F(7, 1542) = 2.13, p < .05 F(1, 1542) = 11.74, p < .05
0,6
0,7
0,9
0,4
0,5
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
4.1
4.2
4.3
4.4
4.5
4.6
22% 19%
9% 9%
14% 10%
8%
13%
47% 51%
45% 57% 44%
50% 48%
14% 48%
30% 30%
44% 28%
35% 36%
43% 86%
35%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,5
0,6
0,5
0,5
0,4
0,7
0,6
0,5
0,6
0,6
0,8
0,6
0,6
0,7
0,8
1,4
0,6
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
31
4.2 My promotor motivates and supports me to finish my PhD project in 4 years
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 636) = 24.54, p > .05 F(7, 1467) = 1.72, p > .05 F(1, 1467) = 12.49, p < .01
4.3 My daily supervisor motivates and supports me to finish my PhD project in 4 years
16%
16% 14%
13% 10%
14% 12%
27% 33%
31% 37%
29% 27%
23% 14%
30%
50% 56%
60% 38%
48% 54%
62% 71%
50%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,5
0,6
0,6
0,6
0,5
0,7
0,7
0,6
0,7
0,9
1,0
0,5
0,6
0,8
0,9
1,1
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
10% 9%
5% 8% 6%
9% 8%
8%
29% 23%
20% 29%
29% 24%
22% 14%
26%
59% 61%
68% 54% 55%
64% 60%
86% 60%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
32
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 612) = 16.74, p > .05 F(7, 1424) = 1.87, p > .05 F(1, 1424) = 16.79, p < .01
4.4 Usually I can finish my tasks within the time allocated for them
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 648) = 28.46, p > .05 F(7, 1515) = .79, p > .05 F(1, 1515) = 14.71, p < .01
0,8
0,5
0,6
0,6
0,7
0,7
0,8
0,9
0,7
1,0
0,9
1,0
0,8
0,8
1,0
0,8
1,4
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
24% 24%
33% 18% 19%
20% 18%
14% 22%
53% 50%
26% 53%
43% 44%
46% 57%
46%
17% 22%
35% 21%
29% 30% 31%
14% 26%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,1
0,1
0,3
0,3
0,3
0,2
0,3
0,3
0,3
0,4
0,4
0,4
0,4
0,5
0,5
0,2
0,4
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
33
4.5 I believe I can finish my PhD within the time set
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 655) = 31.5, p > .05 F(7, 1500) = 1.4, p > .05 F(1, 1500) = 1.57, p > .05
4.6 The progress of my PhD project is in line with my expectations
14% 17% 27%
14% 18%
8% 10%
15%
42% 34%
19% 34%
33% 39% 44%
43% 35%
34% 34%
44% 40%
32% 42%
39% 57%
38%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,5
0,3
0,4
0,4
0,4
0,6
0,6
0,4
0,5
0,4
0,5
0,5
0,3
0,6
0,6
1,1
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
30% 26% 23%
26% 25%
20% 30%
14% 25%
42% 41%
40% 36% 37%
41% 43%
43% 39%
20% 24%
27% 22% 22%
25% 20%
43% 23%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
34
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 659) = 13.5, p > .05 F(7, 1534) = .56, p > .0 F(1, 1534) = 8.04, p < .01
4.7 Have you had a Go/No Go review meeting?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 666) = 18.39, p > .05 χ2(14, 1555) = 27.02, p < .05 χ2(2, 1555) = 5, p > .05
0,3
0,3
0,4
0,4
0,4
0,3
0,7
0,3
0,4
0,2
0,3
0,3
0,2
0,2
0,3
0,3
0,8
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
62% 55%
63% 59%
50% 55%
68% 57% 58%
13% 23%
18% 17%
28% 15%
10% 14%
19%
25% 21%
18% 24% 22%
30% 23%
29% 24%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
not yet
57%
58%
22%
18%
21%
24%
0% 25% 50% 75% 100%
2011
2014
yes
no
not yet
35
4.8 Please indicate your progress/status:
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 666) = 30.34, p > .05 χ2(21, 1555) = 20.96, p > .05 χ2 (3, 1554) = 24.6, p < .01
4.9 Which of these reasons has contributed the most to your delay?
51% 53% 55% 55%
45% 59%
38% 71%
52%
46% 43% 41%
34% 51%
36% 60%
29% 43%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
on schedule
behind schedule
time out or discontinue
finished
58%
52%
32%
43%
0% 25% 50% 75% 100%
2011
2014
on schedule
behind schedule
time out or discontinue
finished
47% 45%
41% 39%
41% 35%
38%
41%
8% 15%
18% 23%
28% 17%
17%
18% 20%
41% 21%
16% 16%
25% 100%
21%
5% 7%
7% 8%
5%
8% 15%
7% 5%
5% 13%
7%
14%
11% 8% 7%
8%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
36
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(42, 286) = 42.44, p > .05 χ2(42, 570) = 57.2, p > .05 χ2(6, 570) = 9.49, p > .05
46%
41%
13%
17%
18%
21% 5%
7%
7%
12%
8%
0% 25% 50% 75% 100%
2011
2014
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
37
3.3 Professional Embedding Introduction A total of 8 Likert scale items cover the topic of professional embedding. Professional embedding refers to certain aspects in the working environment of a doctoral candidate that give a feeling of embedding.
Especially item 5.8 (‘I receive good support during the collection of my data’) is interesting because regression analysis shows it is being a strong predictor for general satisfaction about the PhD programme, like all the items in the questionnaire that deal with data collection, data analysis and methodology.
Item
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
Influence on general
satisfaction
5.1 X 5.2 X X 5.3 5.4 X X
*5.5 X No data No data 5.6 X 5.7 X 5.8 X X
* This item was only present in the 2014 questionnaire.
Summary As in the cluster ‘Project and Planning’, almost all items in this cluster show significant differences at TU Delft level between 2011 and 2014. This pattern can also be seen in the following clusters. In this cluster, more items show a negative change. The changes are not great (.1 or .2 on a scale of 0 to 4) and it’s too simplistic to say that in 2014 doctoral candidates feel less professionally embedded.
Items 5.4 and 5.5 show significant differences between faculties (i.e. not every doctoral candidate at every faculty has the same level of awareness about who else is working on a topic closely related, anywhere). On the other hand, no significant differences on any level exist on item 5.3 (awareness of who in Delft works on a topic closely related). This means that the links between doctoral candidates in Delft are more solid than the links with other doctoral candidates in the Netherlands or elsewhere. Items 5.7 and 5.8 are still a concern. On item 5.7 no negative significant change took place but between 30 and 40% of the doctoral candidates at every faculty is not satisfied about the number of experts in their working environment to help them deal with typical issues in their projects. On item 5.8 around 30% disagrees that they receive enough support during data collection and the change with 2011 is negative and significant. One final notable item is 5.2. Apparently there is a very strict regime at Applied Sciences when it comes to research group meetings.
38
Questions
These are the TU Delft wide results for the Likert scale questions over 2014
5.1 I have regular (formal or informal) contact with fellow PhD candidates about my PhD
project
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 638) = 23.49, p > .05 F(7, 1506) = 2.9, p < .01. F(1, 1506) = 26.21, p < .01
0,6
0,5
0,3
0,1
0,5
0,1
0,3
0,4
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
5.1
5.2
5.3
5.4
5.5
5.6
5.7
5.8
14% 15%
25% 11%
15% 16% 15%
29% 16%
40% 40%
35% 40%
38% 33%
41% 14%
38%
39% 34%
26% 44%
34% 45%
36% 57%
38%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,3
0,3
0,5
0,2
0,4
0,2
0,2
0,3
0,6
0,5
0,2
0,7
0,4
0,7
0,6
0,8
0,6
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
39
5.2 My research group meets at least once every two weeks
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 622) = 119.57, p < .01 F(7, 1447) = 35.03, p < .01 F(1, 1506) = 83.8, p < .01
5.3 I am aware of who else at TU Delft is working on a topic closely related to mine
18% 27%
30% 7%
22% 12%
18% 14%
17%
28% 24%
15% 12%
23% 24%
31% 43%
22%
38% 36%
23% 80%
32% 54%
26% 29%
45%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
-0,2
-0,4
-0,4
0,6
-0,3
0,2
-0,4
-0,5
0,0
0,4
0,3
-0,2
1,2
0,1
0,7
0,1
0,4
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
27% 23%
21% 26%
20% 30%
20% 29%
25%
34% 40%
49% 30%
40% 37%
48% 29%
38%
30% 23% 22%
37% 26%
28% 20%
29% 28%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
40
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 649) = 23.86, p > .05 F(7, 1528) = 1.73, p > .05 F(1, 1528) = 2.68, p > .05
5.4 I am aware of who else in the Netherlands is working on a topic closely related to mine
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 654) = 45.39, p < .01 F(7, 1525) = 6.56, p < .01 F(1, 1525) = 15.45, p < .01
0,4
0,3
0,4
0,5
0,5
0,4
0,3
0,4
0,4
0,3
0,2
0,3
0,5
0,3
0,4
0,3
0,2
0,3
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
23% 37%
23% 26%
26% 27%
28%
26%
41% 13%
41% 34%
32% 43%
36% 57%
36%
17% 13%
25% 29% 26%
15% 10%
14% 21%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,1
0,2
0,5
0,3
0,2
0,1
0,3
0,3
0,0
-0,5
0,3
0,3
0,2
0,1
-0,2
0,1
0,1
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
41
5.5 I am aware of who else in the world is working on a topic closely related to mine
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 662) = 21.23, p > .05 No data from 2011 No data from 2011
5.6 I know several other PhD candidates who use the same research methods as I do
21% 15%
10% 17%
14% 14%
18%
16%
53% 45%
55% 44%
52% 48%
50% 71%
50%
19% 26% 26%
32% 30%
33% 25%
29% 28%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,3
0,5
0,5
0,6
0,6
0,4
0,8
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
21% 24%
33% 26%
28% 24%
30% 14%
26%
38% 35%
49% 38%
39% 43%
33% 29%
40%
21% 17%
5% 23%
15% 14%
18% 29%
17%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
42
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 636) = 21.15, p > .05 F(7, 1495) = 2.35, p < .05 F(1, 1495) = 4.38, p < .05
5.7 A sufficient number of experts are available in my working environment to help me deal with typical issues in my project
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 658) = 19.2, p > .05 F(7, 1528) = 1.86, p > .05 F(1, 1528) = .17, p > .05
0,0
0,1
0,1
0,3
0,1
0,1
0,2
0,3
0,2
0,1
0,0
-0,1
0,2
0,0
0,0
0,0
0,1
0,1
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
22% 17%
34% 19%
25% 26% 20%
14% 23%
40% 33%
42% 38%
35% 39% 43%
29% 38%
27% 30%
17% 32%
24% 25% 23%
43% 26%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,2
0,1
0,4
0,2
0,3
0,3
0,2
0,3
0,3
0,2
0,2
0,4
0,2
0,3
0,2
0,5
0,3
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
43
5.8 I receive good support during the collection of my data
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 588) = 18.09, p > .05 F(7, 1399) = 4.17, p < .01 F(1, 1399) = 4.96, p < .05
22% 19%
29% 19%
22% 14%
14%
20%
43% 36%
37% 36%
37% 44%
40% 60%
39%
28% 36%
19% 37%
28% 28%
34% 40%
30%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,4
0,1
0,6
0,5
0,6
0,5
0,3
0,5
0,4
0,5
0,1
0,5
0,3
0,4
0,5
0,9
0,4
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
44
3.4 Supervision Introduction This cluster has the most items as supervision is considered to be a very important topic for doctoral candidates. Correlation analysis shows that supervision correlates the strongest to all other clusters (especially for international doctoral candidates). This means that if a doctoral candidate is satisfied about supervision, they are more likely to be satisfied about other clusters as well. Regression analysis shows that satisfaction on certain items in this cluster are the strongest predictors for general satisfaction about the PhD programme (see chapter 5 for correlation and regression analyses).
Item
Test 2014
(faculties and TUD)
Test 2011 vs. 2014
(faculty)
Test 2011 vs. 2014 (TUD)
Subgroup*
Influence on general
satisfaction
6.1 6.2 X X 6.3 X X 6.4 X 6.5 X X 6.6 X X 6.7 2, 4 6.8 X 4 6.9 1, 4
6.10 X 1,4 6.11 X 1,4 X 6.12 2, 4 6.13 1, 4 6.14 1, 2, 4 6.15 X 4 6.16 X 1, 4 6.17 1, 2, 4 6.18 X X 1, 4 X 6.19 X 6.20 1, 2, 4 6.21 1, 4 X 6.22 6.23
* Separate statistical tests have been executed for three subgroups: female/male, VSNU category and pre-GS/GS.
Besides the four subgroups in the table, there are three more subgroups that show significant statistical differences on a number of items (see chapter 4 for full results). These are:
• ‘Peer group learning’ on items 6.2, 6.5 and 6.7 (higher peer group learning results in a higher score)
• ‘Meetings with supervisors’ on item 6.7 (more meetings results in higher supervision satisfaction)
• ‘Research school’ on item 6.21 (a member of a research school has better methodological support)
45
Summary
The changes at TU Delft level are all positive. Therefore, in general it can be concluded that the quality supervision is heading in the right direction. There are however statistically significant differences when looking at the first six items (6.1 to 6.6) and this may have an impact on general satisfaction about the PhD programme per faculty. Surprisingly, still not all doctoral candidates know who their promotor is (6.1). An even larger percentage of doctoral candidates – between 6 and 17% amongst the faculties – does not have a daily supervisor (or does not know if they have one).
Items 6.2, 6.3, 6.5 and 6.6 show statistical differences. This means that there are differences in:
• The way and how often meetings are organized with promotors (regular or on demand)
• The way and how often meetings are organized with daily supervisors (regular or on demand)
In general, the meetings are on demand. More than half of all doctoral candidates see their promotor every month and around 90% see their daily supervisor every month.
Subgroup analyses in chapter 4 on the number of meetings with supervisors show:
• A higher number of meetings with the promotor does not have a significant effect on
general satisfaction about the PhD programme
• A higher number of meetings with the daily supervisor does have a significant effect on
general satisfaction about the PhD programme
It can therefore be concluded that having a low number of meetings with the daily supervisor or having no daily supervisor at all, has a large effect. This can cause significant differences per faculty on general satisfaction about the PhD programme. Correlation analysis shows, dissatisfaction on supervision can spill over to other clusters.
General satisfaction on supervision has increased between 2011 and 2014, satisfaction on the numbers of meetings with the promotor and daily supervisor is high and has increased between 2011 and 2014. Doctoral candidates experience guidance as being available on short notice.
Items that also have improved between 2011 and 2014 but score a bit lower are:
6.12 At meetings my promotor is usually well prepared 6.18 My promotor and/or daily supervisor help(s) me to build a professional network 6.20 I receive sufficient theoretical support 6.21 I receive sufficient methodological support
Regression analysis (chapter 5) shows that items 6.18 and 6.21 are important predictors for general satisfaction about the PhD programme. For item 6.18, there are also minor statistical differences in 2014 between the faculties.
Furthermore, it must be said that for items 6.18 and 6.20, approximately one quarter of all doctoral candidates are not satisfied. Making a difference on these topics is not easy but could make a large difference.
46
Questions
These are the TU Delft wide results for the Likert scale questions in 2014
6.1 Do you know who your promotor is?
0,7
0,7
1,0
0,9
0,9
0,6
0,8
0,8
0,8
0,9
0,8
0,4
0,8
0,5
0,5
0,8
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
6.7
6.8
6.9
6.10
6.11
6.12
6.13
6.14
6.15
6.16
6.17
6.18
6.19
6.20
6.21
6.22
6.23
99% 98% 99%
97% 99%
97% 98% 100% 98%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
47
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 663) = 3, p > .05 χ2(7, 1552) = 9.58, p > .05 χ2(1, 1552) = 2.43, p > .05
6.2 How often do you have an appointment with your promotor? (indication)9
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(42, 652) = 69.55, p < .01 χ2(42, 1531) = 152.60, p < .01 χ2(6, 1531) = 30.58, p < .01
9 In the questionnaire used in2011, this item had 9 categories and in 2014 it had 7 categories. The 9 categories of 2011 have been computed into the 7 categories of 2014 (see appendix).
99%
98%
0% 25% 50% 75% 100%
2011
2014
yes
no
13% 9% 11% 9%
15% 15%
10%
21% 11%
10% 16% 21%
17% 28%
14% 18%
47% 28%
53% 36%
41% 31%
44% 29%
40%
18% 24%
24% 20%
19% 20%
10% 43%
20%
22%
7% 6%
6%
5%
9%
10%
14% 6%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
daily
once per week
once per two weeks
monthly
every half year
yearly
never
13%
10%
15%
18%
30%
40%
28%
20%
7%
6%
6%
6%
0% 25% 50% 75% 100%
2011
2014
daily
once per week
once per two weeks
monthly
every half year
yearly
never
48
6.3 How are the meetings organized?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 651) = 16.03, p < .05 χ2(7, 1482) = 29.65, p < .01 χ2(1, 1482) = 2.5, p > .05
6.4 Do you know who your daily supervisor is?
51% 48%
44% 57%
40% 35%
39% 29%
45%
50% 52%
56% 43%
60% 65%
62% 71%
55%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
regular basis
on demand
41%
45%
59%
55%
0% 25% 50% 75% 100%
2011
2014
regular basis
on demand
91% 89%
82% 93%
82% 93% 95%
100% 89%
9% 9%
17% 6%
17% 6%
10%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
no supervisor
49
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 666) = 22.32, p > .05 χ2(14, 1555) = 24.22, p < .05 χ2(2, 1552) = 30.04, p < .01
6.5 How often do you have an appointment with your supervisor? (indication)10
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(42, 594) = 78.97, p < .01 χ2(42, 1316) = 161.42, p < .01 χ2(6, 1316) = 31.99, p < .01
10 In the questionnaire used in2011,this item had 9 categories and in 2014 it had 7 categories. The 9 categories of 2011 have been computed into the 7 categories of 2014 (see appendix).
79%
89%
19%
10%
0% 25% 50% 75% 100%
2011
2014
yes
no
no supervisor
9% 7%
17% 6% 11%
9%
53% 38%
26% 48%
33% 59%
37% 29%
44%
29% 41%
40% 23%
40% 23%
34% 57%
32%
8% 12%
22% 9%
18%
21% 14%
13%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
daily
once per week
once per two weeks
monthly
every half year
yearly
never
37%
44%
25%
32%
18%
13%
6%
0% 25% 50% 75% 100%
2011
2014
daily
once per week
once per two weeks
monthly
every half year
yearly
never
50
6.6 How are the meetings organized?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 594) = 20.65, p < .01 χ2(7, 1311) = 18.74, p < .01 χ2(1, 1311) = 15.54, p < .01
6.7 I am satisfied with the way my supervision is organized
56% 52%
47% 47%
52% 64%
29% 86%
52%
44% 48%
53% 53%
48% 36%
71% 14%
48%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
regular basis
on demand
41%
52%
59%
48%
0% 25% 50% 75% 100%
2011
2014
regular basis
on demand
15% 9%
10% 17%
16% 10%
13%
13%
40% 36%
31% 35%
31% 36%
33% 43%
35%
43% 49%
54% 38%
44% 48% 46%
43% 45%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
51
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 662) = 17.85, p > .05 F(7, 1544) = 1.41, p > .05 F(1, 1544) = 18.13, p < .01
6.8 I am satisfied with the number of appointments I have with my promotor(s)
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 662) = 17.85, p > .05 F(7, 1512) = 2.89, p < .01 F(1, 1512) = 7.94, p < .01
0,5
0,3
0,5
0,5
0,5
0,5
0,7
0,6
0,5
0,7
0,8
0,9
0,5
0,6
0,8
0,7
0,6
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
17% 16%
10% 12%
14% 18%
15% 29%
15%
34% 36%
26% 35%
32% 26%
23% 14%
31%
42% 47%
61% 41%
46% 48%
56% 43%
47%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,2
0,5
0,6
0,5
0,6
0,9
0,7
0,6
0,6
0,8
1,0
0,6
0,6
0,7
0,8
0,4
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
52
6.9 I am satisfied with the number of appointments I have with my daily supervisor
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 589) = 23.27, p > .05 F(7, 1354) = 1.6, p > .05 F(1, 1354) = 39.68, p < .01 6.10 When I need guidance on short notice, my promotor or daily supervisor is available
6% 10% 11% 14%
9% 6%
13% 14% 10%
33% 24%
18% 25%
21% 21%
18% 29%
24%
59% 64%
70% 60%
63% 67%
61% 57%
63%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,5
0,7
0,8
0,5
0,7
0,9
0,9
0,7
1,0
1,0
1,1
0,9
0,9
1,0
0,8
0,9
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
10% 9%
9% 7%
11% 12%
8%
10%
27% 28%
31% 31% 22% 27%
40% 29%
28%
63% 53%
56% 57%
60% 58%
45% 71%
58%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
53
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 662) = 20.71, p > .05 F(7, 1535) = 2.1, p < .05 F(1, 1535) = 9.61, p < .01
6.11 I feel my contributions to my PhD project are taken seriously
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
F(1, 1534) = 2.55, p > .05 F(7, 1534) = 2.62, p < .05 F(1, 1534) = 2.55, p > .05
0,8
0,6
0,8
0,9
0,7
0,8
0,8
0,8
0,8
1,0
0,7
0,9
0,9
0,9
0,9
0,7
1,2
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
10% 7%
6% 7% 10% 5%
5%
8%
38% 28%
22% 31%
32% 31%
29% 29%
31%
51% 59%
70% 54% 52%
55% 63%
71% 56%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,8
0,7
0,8
0,9
0,8
0,7
1,2
0,9
0,8
0,9
0,9
1,1
0,8
0,8
0,8
1,0
1,2
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
54
6.12 At our meetings my promotor is usually well prepared
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 603) = 14.36, p > .05 F(7, 1480) = 1.51, p > .05 F(1, 1480) = 1.22, p > .05
6.13 At our meetings my daily supervisor is usually well prepared
19% 14%
13% 20% 19%
19% 18%
18%
34% 41%
35% 35%
32% 30%
45% 17%
34%
35% 41%
48% 37%
41% 42%
29% 67%
40%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,3
0,5
0,5
0,4
0,6
0,6
0,6
0,5
0,4
0,7
0,8
0,5
0,6
0,5
0,5
0,8
0,6
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
10% 10%
12% 12%
13% 14%
5%
11%
37% 29%
21% 35%
24% 31% 45%
29% 31%
52% 57%
67% 48%
55% 48%
42% 71%
52%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
55
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
: χ2(21, 586) = 26.09, p > .05 F(7, 1463) = 1.28, p > .05 F(1, 1463) = 51.75, p < .01
6.14 My promotor and/or daily supervisor provide(s) me with adequate feedback
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 658) = 18.78, p > .05 F(7, 1538) = 1.44, p > .05 F(1, 1538) = 8.29, p < .01
0,4
0,3
0,5
0,5
0,4
0,6
0,6
0,6
0,5
0,9
0,9
1,0
0,8
0,8
0,7
0,7
1,2
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
13% 9%
10% 10%
14% 9% 13%
14% 12%
30% 28%
25% 36%
23% 27%
31%
28%
53% 60%
64% 47%
54% 58%
51% 86%
55%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,6
0,9
0,7
0,7
0,7
0,8
0,7
0,7
0,8
0,9
1,0
0,7
0,7
0,9
0,8
1,2
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
56
6.15 My promotor and/or daily supervisor show(s) commitment to my project
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 658) = 30.8, p > .05 F(7, 1536) = 2.68, p < .01 F(1, 1536) = 6.98, p < .01
6.16 My promotor and/or daily supervisor encourage(s) me to present my work at conferences
10% 13%
7% 14%
9% 9%
5% 14%
10%
37% 36%
19% 33%
28% 36%
28%
31%
51% 47%
71% 47%
53% 49%
62% 86%
53%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,6
0,8
0,7
0,6
0,8
0,8
0,8
0,7
0,9
0,8
1,1
0,7
0,8
0,8
1,0
1,2
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
13%
10% 10%
7%
5%
8%
24% 40%
24% 28%
28% 27%
23% 14%
27%
58% 51%
63% 53%
60% 65% 64%
86% 60%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
57
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 633) = 20.65, p > .05 F(7, 1485) = 2.36, p < .05 F(1, 1485) = 4.09, p < .05
6.17 Generally speaking, my promotor and daily supervisor agree with each other on matters regarding my research
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 560) = 29.28, p > .05 F(7, 1355) = 1.77, p < .05 F(1, 1355) = 13.32, p < .01
0,8
0,7
0,5
0,8
0,9
0,9
1,0
0,9
0,8
0,9
0,9
1,0
0,8
0,9
1,0
0,9
1,4
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
12% 8%
19% 7% 14%
14%
11%
41% 33%
31% 36%
38% 37%
35% 17%
36%
44% 54%
62% 37%
50% 47% 46%
67% 48%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,5
0,4
0,6
0,7
0,7
0,8
0,6
0,6
0,8
0,9
1,0
0,5
0,9
0,8
0,7
0,8
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
58
6.18 My promotor and/or daily supervisor help(s) me to build a professional network
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 639) = 33.21, p < .05 F(7, 1478) = 2.5, p < .05 F(1, 1478) = 6.22, p < .05
6.19 I have a clear picture of what I can expect of my promotor and daily supervisor
27% 30%
19% 27%
12% 17% 26%
14% 21%
38% 23%
39% 33%
41% 29%
24% 14%
34%
24% 39% 35%
29% 34%
44% 45%
57% 35%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,2
0,1
0,2
0,4
0,4
0,5
0,3
0,3
0,3
0,4
0,5
0,3
0,5
0,6
0,6
0,6
0,4
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
16% 11%
13% 11%
8% 13%
8% 14%
11%
43% 36%
29% 35%
36% 32%
38% 29%
35%
36% 49%
59% 45%
51% 50%
55% 43%
48%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
59
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 655) = 25.59, p > .05 F(7, 1529) = 1.95, p > .05 F(1, 1529) = 29.05, p < .01
6.20 I receive sufficient theoretical support
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 663) = 29.43, p > .05 F(7, 1543) = 1.04, p > .05 F(1, 1543) = 3.38, p > .05
0,5
0,4
0,5
0,6
0,6
0,6
0,6
0,6
0,6
0,6
0,8
1,0
0,7
0,8
0,8
1,0
0,5
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
20% 15% 24%
20% 16%
21% 33%
29% 20%
44% 28%
23% 37%
38% 33%
23% 14%
34%
32% 47% 46%
30% 34%
38% 38%
57% 36%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,2
0,3
0,4
0,4
0,5
0,5
0,5
0,4
0,5
0,6
0,6
0,3
0,4
0,5
0,4
0,8
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
60
6.21 I receive sufficient methodological support
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 655) = 27.06, p > .05 F(7, 1533) = 1.41, p > .05 F(1, 1533) = 4.62, p < .05
6.22 I receive sufficient feedback on my writing skills
18% 21%
26% 21%
17% 19%
33%
20%
46% 26%
29% 38% 42%
33% 23%
43% 37%
31% 43%
33% 34% 31%
42% 36%
57% 35%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,3
0,2
0,5
0,4
0,5
0,5
0,4
0,4
0,5
0,5
0,3
0,5
0,4
0,6
0,4
1,1
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
11% 5%
7% 21%
10% 14%
11% 29%
13%
38% 38%
38% 30%
37% 27%
32% 14%
34%
48% 50%
46% 42%
47% 57%
49% 57%
49%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
61
Test 2014 (faculties and TUD) Test 2011 vs. 2014 (faculty) Test 2011 vs. 2014 (TUD)
χ2(21, 615) = 25.19, p > .05 F(7, 1455) = 2, p > .05 F(1, 1455) = 2.62, p > .05
6.23 I receive sufficient feedback on my presentation skills
Test 2014 (faculties and TUD) Test 2011 vs. 2014 (faculty) Test 2011 vs. 2014 (TUD)
χ2(21, 603) = 17.38, p > .05 F(7, 1438) = 1.83, p > .05 F(1, 1438) = 2.3, p > .05
0,8
0,5
0,5
0,7
0,6
0,8
0,7
0,8
0,7
0,8
0,8
0,7
0,6
0,8
0,9
0,7
0,8
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
17% 7%
20% 19%
13% 14%
9%
15%
48% 42%
42% 37%
45% 39% 42%
33% 42%
32% 44%
33% 37% 39%
45% 42%
67% 39%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,4
0,4
0,7
0,5
0,7
0,6
0,6
0,6
0,6
0,7
0,5
0,6
0,7
0,8
0,7
1,2
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mEAEArchASCEGEEMCSIDETPMTU Delft
2011
2014
62
3.5 Doctoral Education Introduction A lot has changed in the area of Doctoral Education between 2011 and 2014 and this is reflected in the cluster of items. Five items are new, so only 7 out of the 12 items can be compared to the results of 2011. The first two items are background information on the PhD agreement and a Doctoral Education plan, the rest are Likert scale items measuring satisfaction.
Item
Test 2014
(faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014
(TUD)
Subgroup**
Influence on general
satisfaction
*7.1 No data No data 7.2 No data No data 7.3 X 4 X 7.4 X 4
*7.5 No data No data 3, 4 7.6 4 X 7.7 X 3, 4 7.8 X X 3
*7.9 No data No data 3 7.10 X
*7.11 No data No data X *7.12 No data No data 3 X
* This item was only present in the 2014 questionnaire. ** Separate statistical tests have been executed for two subgroups: VSNU category and pre-GS/GS.
Besides the four subgroups in the table, the subgroup ‘Research school’ showed significant statistical differences when it came to items 7.4 to 7.9 and 7.12. Members of a research school score higher on every single item. Summary Item 7.6 is an important indicator of the importance attached to transferable skills by supervisors. The results tell us that less doctoral candidates feel motivated by their supervisors to take courses that are not directly related to their PhD project. Item 7.7 could tell us something about the degree of freedom a doctoral candidate has to shape their own doctoral education programme. Fewer doctoral candidates indicate that they have agreed on a personal budget and there are significant statistical differences between the faculties.
Doctoral candidates are more satisfied than in 2011 with regard to the range of courses provided by the Graduate School and the faculties. However, a critical assessment tells us four things.
1. Not every doctoral candidate at every faculty is equally satisfied about the range of research-related courses.
2. Overall scores on the number of discipline-related courses are not very high. 3. Doctoral candidates are pleased with the range of transferable courses offered by the
Graduate School. 4. 39% of the doctoral candidates do not agree that the PhD Start-Up training contributed to a
good start of their PhD project.
The analyses on the two subgroups tell us that in general:
• Pre-GS doctoral candidates are less satisfied about Doctoral Education
• Internal PhD candidates (category 2) are least satisfied about Doctoral Education
63
Questions
These are the TU Delft wide results for the Likert scale questions in 2014
7.1 I have a PhD agreement
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 592) = 17.68, p > .05 No data from 2011 No data from 2011
0,8
0,8
1,0
0,0
-0,3
0,2
0,0
0,8
0,5
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
7.3
7.4
7.5
7.6
7.7
7.8
7.9
7.10
7.11
7.12
65% 74%
58% 61%
57% 67% 66%
100% 63%
16% 14%
15% 21%
14% 15% 18%
16%
19% 12%
27% 18%
29% 18% 16%
21%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
don't know
64
7.2 I have a Doctoral Education plan as part of my PhD agreement11
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 377) = 22.18, p > .05 Not comparable to 2011 Not comparable to 2011
7.3 I have enough room for personal development within my PhD project
Test 2014 (faculties and TUD) Test 2011 vs. 2014 (faculty) Test 2011 vs. 2014 (TUD)
χ2(21, 657) = 23.25, p > .05 F(7, 1514) = 2.48, p < .05 F(1, 1514) = 154.9, p < .01
11 This item was present in both the 2011 and 2014 questionnaire but could not be compared because in 2011 a continuous variable was used (Likert scale) and in 2011 a categorical variable (see appendix).
73% 88%
74% 76%
70% 91%
80% 57%
78%
11% 9%
12% 11%
14% 7%
20% 29%
12%
16%
15% 13%
16%
14% 11%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
don't know
11%
6% 17%
10% 9%
5%
10%
36% 36% 34%
38% 32%
36% 38%
14% 35%
51% 57% 59%
40% 54%
50% 58%
86% 51%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,5
0,1
0,2
0,4
0,4
0,3
0,6
0,4
0,4
0,9
1,0
1,0
0,6
0,9
0,8
1,0
1,4
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
65
7.4
I know where I can find information on all available courses (research and discipline related, transferable)
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 646) = 23.69, p > .05 F(7, 1514) = 2.48, p < .05 F(1, 1514) = 154.9, p < .01
7.5 I know how to enrol for the courses offered by the Graduate School
10% 17%
8% 18%
9% 10%
20%
12%
34% 26%
45% 32%
41% 37% 23%
14% 35%
52% 54%
43% 47% 45%
48% 55%
71% 49%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,1
0,2
0,2
0,2
0,2
0,2
0,3
0,2
0,8
0,8
0,8
0,7
0,8
0,8
0,8
0,9
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
9% 6% 11% 9%
5%
7%
25% 13%
31% 23% 24%
25% 18%
24%
69% 76%
59% 64% 64%
66% 71%
86% 66%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
66
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 628) = 23.07, p > .05 No data from 2011 No data from 2011
7.6 My promotor and/or daily supervisor motivate(s) me to participate in additional courses not directly related to my PhD project
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 617) = 32.06, p > .05 F(7, 1460) = 1.98, p > .05 F(1, 1460) = 28.68, p < .01
1,1
1,1
0,9
1,0
1,0
1,0
1,1
1,1
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
25% 26%
35% 30%
27% 35%
19% 29%
29%
36% 35%
38% 28%
38% 28%
27% 14%
33%
24% 15% 16% 16% 13%
22% 24%
57% 19%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,3
0,1
-0,1
0,3
0,3
0,2
0,4
0,3
0,3
0,2
-0,1
0,1
-0,2
-0,1
0,1
0,0
0,8
0,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
67
7.7 I have agreed on a personal budget with my supervisors to do research and discipline related courses
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 517) = 42.09, p < .01 F(1, 1269) = 1.15, p > .05 F(1, 1269) = 10, p < .01
7.8 The range of research related courses available at TU Delft is satisfying
25% 14%
22% 18%
19% 25%
13%
20%
25% 20%
33% 15%
29% 16% 20%
20% 22%
13% 26%
22% 13% 14%
22% 20%
80% 18%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,1
-0,5
-0,4
0,0
-0,2
-0,1
-0,2
-0,2
-0,1
-0,4
-0,2
0,0
-0,6
-0,3
-0,3
-0,4
1,3
-0,3
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
24% 26%
41% 33%
17% 24% 19%
29% 26%
47% 36%
21% 38%
48% 36%
46% 43%
40%
18% 14%
26% 18%
22% 22%
14% 29%
20%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
68
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 587) = 33.65, p < .05 F(7, 1370) = 4.15, p < .01 F(1, 1370) = 4.86, p < .05
7.9 My faculty provides enough discipline-related courses
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 577) = 26.94, p > .05 No data from 2011 No data from 2011
0,1
-0,3
-0,3
0,2
0,1
0,2
-0,1
0,0
0,1
0,2
-0,1
0,1
0,1
0,3
0,1
0,0
0,5
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
26% 27%
34% 32% 22% 33%
29%
28%
36% 32%
20% 39%
35% 26%
34% 43%
33%
20% 22%
12% 12%
20% 22%
11% 43%
18%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,1
0,1
-0,4
0,0
0,0
0,0
-0,2
0,6
0,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
69
7.10 The Graduate School offers a sufficient range of transferable courses (e.g. writing and presentation courses, job application training)
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 567) = 16.51, p > .74 F(7, 1345) = 2.25, p < .05 F(1, 1370) = 140.26, p < .01 7.11
The Graduate School offers the right courses to further develop my transferable competences and skills
13% 17%
12% 9% 11%
8% 6%
10%
43% 32%
38% 46% 42%
42% 41%
14% 41%
42% 42%
47% 42%
45% 47%
50% 71%
45%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,1
0,3
0,3
0,4
0,3
0,3
0,3
0,3
0,7
0,6
0,8
0,8
0,8
0,8
0,9
0,9
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
13% 15%
24% 8% 16% 16%
13%
15%
52% 49%
36% 60% 48% 47%
50% 43%
50%
29% 21%
35% 24%
30% 30%
22% 43%
28%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
70
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 539) = 23.32, p > .05 No data from 2011 No data from 2011
7.12 The PhD Start-Up training contributed to a good start of my PhD project
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 440) = 24.61, p > .05 No data from 2011 No data from 2011
0,5
0,2
0,5
0,5
0,5
0,5
0,3
0,6
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mEAEArchASCEGEEMCSIDETPMTU Delft
20% 22%
27% 23% 27%
21% 42%
29% 25%
33% 44%
29% 30%
40% 40%
39% 43%
36%
25% 16%
32% 32%
19% 31%
10% 29%
25%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,1
0,1
0,3
0,3
0,2
0,4
0,0
0,5
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
71
3.6 Working Environment, Facilities and Teaching Introduction In this cluster a lot of items have been added to the questions of 2011 (8.15-8.23). The first 14 items are on a Likert scale (i.e. they all start with ‘I am satisfied with …’) and are mostly about practicalities such as IT, lab and library facilities or research budgets. Other items are on ‘social’ topics such as social relationships at work. The second section (8.15 to 8.18) covers the Graduate School student counsellor and the third section contains items about the teaching requirement for (some) doctoral candidates.
Item
Test 2014
(faculties and TUD)
Test 2011 vs. 2014
(faculty)
Test 2011 vs. 2014
(TUD)
Sub-
group**
Influence on general
satisfaction
8.1 X X 8.2 X X 8.3 X X 8.4 X 2 X 8.5 X 8.6 X 2 X 8.7 X X 2 8.8 X X 2 8.9 X X
8.10 8.11/8.12 X X 2
8.13 X 8.14 X
*8.15 No data No data *8.16 No data No data *8.17 No data No data *8.18 No data No data *8.19 X No data No data 2 *8.20 X No data No data *8.21 No data No data *8.22 No data No data 2 *8.23 X No data No data
* This item was only present in the 2014 questionnaire. ** Separate statistical tests have been executed for one subgroup: Dutch/international.
Summary
Looking from a distance, doctoral candidates are very satisfied with their working environment. Across nearly the entire spectrum, they are more satisfied than in 2011. On the individual level there are significant statistical differences between faculties when it comes to the access to information, the budget for research, training, traveling and conferences and the library. However, these items are not the strongest predictors for general satisfaction of the PhD programme.
The results about the student counsellor shows that about 50% of the doctoral candidates knows about this support service. Of this group, 16% of has consulted the student counsellor. The grades given for this support service differ strongly. This can be explained by the limited number of users (49).
The items on teaching expose the differences that exist across the faculties when it comes to the intensity of the teaching requirement.
72
It is noticeable that about 90% of the doctoral candidates is satisfied with the facilities in general (8.2) and with the content of their work (8.3). Especially the library facilities and activities score extremely well. More than 95% doctoral candidates are satisfied with the this aspect.( 8.11 and 8.12)
Subgroup analysis shows that if there is a significant statistical difference between Dutch and international PhD candidates; Dutch candidates are more satisfied than international candidates.
Questions
These are the TU Delft wide results for the Likert scale questions over 2014
8.1 I am satisfied with the access to information (e.g. journals, books) that is relevant to my research topic
1,1
0,9
0,9
0,8
0,8
0,7
0,7
0,7
0,8
0,8
1,0
0,8
0,8
0,6
1,0
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
8.1
8.2
8.3
8.4
8.5
8.6
8.7
8.8
8.9
8.10
8.11/8.12
8.13
8.14
8.18
8.22
8.23
6% 10%
5%
18% 14%
5%
32% 21%
34% 24%
26% 20%
40% 29%
27%
64% 68%
55% 73%
68% 75%
38% 57%
66%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
73
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 663) = 46.48, p < .01 : F(7, 1543) = 9.84, p < .01 F(1, 1543) = 49.75, p < .01
8.2 I am satisfied with the available facilities (e.g. laboratories, equipment, software, location)
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 646) = 24.52, p > .05 F(7, 1513) = 3.51, p < .01 F(1, 1513) = 43.42, p < .01
0,9
0,8
0,4
1,0
0,8
0,9
0,7
0,6
0,8
1,1
1,0
0,9
1,2
1,1
1,2
0,6
0,9
1,1
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
9% 7%
15% 8% 12%
6% 8%
9%
40% 26%
22% 27%
34% 39%
44% 29%
33%
49% 65%
56% 61%
51% 54%
46% 71%
55%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,8
0,3
0,7
0,6
0,8
0,5
0,5
0,6
0,9
1,0
0,8
1,0
0,8
1,0
0,8
1,2
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
74
8.3 I am satisfied with the content of my work
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 654) = 19.08, p > .05 F(7, 1537) = 2.07, p < .05 F(1, 1537) = 40.69, p < .01
8.4 I am satisfied with my social relationships at work
6% 7%
7% 6%
8%
17% 6%
44% 51%
44% 43%
38% 36%
41% 33%
41%
49% 38%
55% 46%
53% 51%
56% 50% 50%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,7
0,6
0,7
0,7
0,6
0,7
0,7
0,6
0,7
0,9
0,7
1,0
0,8
0,9
0,8
1,0
0,8
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
11% 16%
15% 8%
14% 14%
16% 17%
13%
35% 38%
41% 34%
35% 31% 26%
17% 34%
51% 36%
44% 53%
47% 52% 53%
67% 49%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
75
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 652) = 16.6, p > .05 F(7, 1521) = 3, p < .01 F(1, 1521) = 28.55, p < .01
8.5 I am satisfied with my contact with other PhD candidates
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 654) = 22.61, p > .05 F(7, 1528) = 4.25, p < .01 F(1, 1528) = 17.18, p < .01
0,5
0,4
0,6
0,7
0,6
0,6
0,5
0,6
0,6
0,8
0,5
0,8
0,9
0,7
0,8
0,8
1,0
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
12% 17%
17% 11%
14% 14%
13% 14%
14%
33% 38%
44% 32%
39% 34%
35% 29%
36%
53% 34% 33%
55% 43%
50% 48%
57% 47%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,5
0,5
0,8
0,6
0,7
0,4
0,5
0,6
0,9
0,5
0,6
0,9
0,7
0,8
0,8
0,9
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
76
8.6 I am satisfied with my contact with other staff members of the research group
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 647) = 14.21, p > .05 F(7, 1507) = 2.83, p < .01 F(1, 1507) = 27.01, p < .01
8.7 I am satisfied with my budget for my research
14% 15%
12% 13%
20% 13% 11%
14% 15%
44% 40%
39% 40%
40% 42% 45%
57% 41%
41% 36%
45% 46%
35% 42% 40%
29% 41%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,4
0,3
0,7
0,5
0,5
0,2
0,4
0,5
0,7
0,5
0,7
0,8
0,6
0,7
0,7
0,6
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
12%
12% 9%
17% 13%
11%
12%
40% 32%
29% 29%
34% 24%
29% 25%
31%
41% 57%
36% 55%
40% 56%
46% 75%
47%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
77
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 587) = 33.15, p < .05 F(7, 1388) = 8.66, p < .01 F(1, 1388) = 12.12, p < .01
8.8 I am satisfied with my training, travel and conference budget
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 600) = 53.02, p < .01 F(7, 1413) = 8.13, p < .01 F(1, 1413) = 22.47, p < .01
0,5
0,3
-0,2
0,7
0,5
0,6
0,3
0,5
0,5
0,7
0,9
0,3
0,8
0,5
0,8
0,6
1,3
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
14% 10%
30% 6% 18%
9% 8% 43%
14%
40% 21%
15% 27%
24% 23%
19% 29%
25%
40% 64%
44% 57%
53% 63%
57% 29%
53%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,4
-0,2
0,7
0,5
0,7
0,5
0,4
0,5
0,6
1,0
0,4
0,8
0,7
0,9
0,7
0,4
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
78
8.9 I am satisfied with my office
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 644) = 38.33, p < .05 F(7, 1501) = 3.56, p < .01 F(1, 1501) = 34.64, p < .01
8.10 I am satisfied with the IT facilities
7% 7%
13% 5%
12% 6%
8%
8%
42% 22%
19% 28%
35% 34% 24%
33% 31%
46% 58%
52% 64%
44% 55%
60% 67%
53%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,6
0,1
0,6
0,6
0,6
0,6
0,6
0,6
0,8
0,7
0,6
1,0
0,6
0,9
0,9
1,2
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mEAEArchASCEGEEMCSIDETPMTU Delft
2011
2014
14% 11%
11% 10%
15% 9% 8%
11%
43% 38% 31%
33% 41%
37% 45%
29% 38%
40% 47%
48% 57%
40% 51%
45% 71%
47%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
79
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 641) = 24.39, p > .05 F(7, 1513) = 1.52, p > .05 F(1, 1513) = 52.35, p < .01
8.11 and 8.12
I am satisfied with the online and offline library facilities/activities12
Test 2014
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
12 In 2011 there was one category (library facilities/activities), in 2014 there were two categories (online and offline libary facilities/activities). To be able to compare 2011 and 2014, the two different categories of 2014 have been computed to one category (online/offline library facilities/activities).
0,6
0,5
0,5
0,4
0,5
0,7
0,5
0,5
0,5
0,7
0,8
0,7
1,0
0,7
0,9
0,8
1,2
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
7%
6%
40% 20% 31%
30% 32% 33%
40% 29%
33%
58% 73%
66% 64% 64% 63%
55% 71%
63%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,8
0,7
0,5
0,6
0,7
0,7
0,4
0,4
0,7
1,0
1,1
1,0
1,0
1,0
1,0
0,8
1,2
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
80
(faculties and TUD)
: χ2(21, 623) = 66.39, p < .05 F(7, 1511) = 4.48, p < .01 F(1, 1511) = 105.34, p < .01
8.13 I am satisfied with my lab facilities
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 464) = 32.7, p > .05 F(7, 1107) = 5.9, p < .01 F(1, 1107) = 23.69, p < .01
8.14 I am satisfied with the field research facilities
11% 6%
14% 8% 14%
6% 8%
9%
39% 29%
27% 31%
46% 33%
42% 33%
36%
48% 66%
41% 56%
36% 58%
39% 67%
50%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,7
0,1
0,7
0,4
0,7
0,5
0,5
0,6
0,8
1,1
0,4
0,9
0,6
1,0
0,6
1,2
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
10% 9%
19% 7%
12%
13%
10%
51% 36%
32% 36%
48% 40%
37% 40%
42%
35% 52%
43% 55%
36% 51%
43% 60%
45%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
81
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 436) = 20.87, p > .05 F(7, 1056) = 3.05, p < .01 F(1, 1056) = 30.12, p < .01
8.15 Are you aware that there is a Psychologist exclusively available for PhD candidates?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 666) = 7.79, p > .05 No data from 2011 No data from 2011 8.16
Have you ever consulted the PhD Psychologist?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
: χ2(7, 308) = 5.71, p > .05 No data from 2011 No data from 2011
0,5
0,5
0,2
0,6
0,5
0,6
0,3
0,4
0,5
0,7
0,9
0,6
0,9
0,7
0,9
0,7
1,1
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
48% 38%
49% 40%
44% 53% 55% 57%
47%
52% 62%
51% 60%
56% 47% 45% 43%
54%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
16% 6%
9% 18%
22% 14%
18%
16%
84% 94%
91% 82%
78% 86%
82% 100%
84%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
82
8.15 How would you grade the support you received (1-10)?
Standard deviation is 2.38.
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
F(6, 49) = .79, p > .05 No data from 2011 No data from 2011
8.18 I feel that the support I received had a positive influence on the progress in my PhD project
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
6,9
6,0
8,7
7,1
6,3
8,0
7,8
7,1
0,0 2,0 4,0 6,0 8,0 10,0
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TU Delft
14% 57%
67% 75%
33% 44%
50% 49%
29%
33% 25%
33% 56%
50% 36%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
-1,5
0,8
0,8
0,2
1,1
1,0
0,0
0,6
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
83
χ2(18, 47) = 25.21, p > .05 No data from 2011 No data from 2011 8.19 Do you teach courses to bachelor and/or master students?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 665) = 26, p < .01 No data from 2011 No data from 2011 8.20
What percentage of your time do you spend on teaching?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(28, 318) = 71.79, p < .01 No data from 2011 No data from 2011
8.21 What do you think of the percentage of your time that you spend on teaching?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
46% 30%
48% 65%
44% 40%
53% 43%
48%
54% 70%
52% 35%
56% 60%
48% 57%
52%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
39% 43% 41%
37% 59%
48% 33%
67% 44%
47% 43%
12% 39%
29% 31%
38%
34%
14% 7%
12% 16%
13% 19%
33% 12%
7% 12%
8% 5% 6% 10%
6%
24%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
0 to 10 percent
10 to 20 percent
20 to 30 percent
30 to 40 percent
more than 40 percent
18% 7%
18% 21%
9% 17%
24%
16%
71% 71%
59% 75%
64% 73% 57%
100% 69%
10% 21%
21% 5%
8% 14%
13%
6%
5%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
spend less time
just the right amount
spend more time
rather not teach
84
χ2(21, 318) = 27.55, p > .05 No data from 2011 No data from 2011 8.22 I enjoy teaching
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 316) = 23.93, p > .05 No data from 2011 No data from 2011
8.23 Teaching is a great way to practice my transferable skills
12% 7%
11%
15%
8%
29% 21%
27% 36%
29% 27%
26%
29%
59% 71% 71%
48% 67%
56% 74%
100% 60%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
1,0
1,1
1,2
0,8
1,1
0,9
1,2
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
10% 14%
9% 6%
15%
8%
39% 7%
12% 45%
34% 23%
29%
32%
51% 79%
74% 46%
61% 63%
67% 100%
59%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
85
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 316) = 35, p < .05 No data from 2011 No data from 2011
0,9
1,1
1,0
0,8
1,1
1,0
1,1
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
86
3.7 Career Planning Introduction Like Doctoral Education, Career planning is another new service of the Graduate School that is offered since the kick-off in 2012. In 2011, the doctorate climate survey signalled there was a need for career advice. In the 2014 survey the activities of the Career Centre of the past 3 years have been evaluated. The first four items gather background information (e.g. are you aware that there is a career centre?) and the items 9.7 through 9.13 are on a Likert scale to measure satisfaction. Only item 9.13 was added to the existing questions from 2011. Items 9.2 and 9.4 are not displayed here (see appendix 1).
Item
Test 2014
(faculties and TUD)
Test 2011 vs. 2014
(faculty)
Test 2011 vs. 2014
(TUD)
Subgroup**
Influence on general
satisfaction
*9.1 X No data No data *9.3 No data No data *9.5 No data No data *9.6 No data No data 9.7 2, 4 9.8 4 9.9 2, 4 X
9.10 X X 2, 4 9.11 4 9.12
*9.13 No data No data 2 * This item was only present in the 2014 questionnaire. ** Separate statistical tests have been executed for two subgroups: national/international and pre-GS/GS.
Summary
Only 50% of the doctoral candidates know about the Career Centre and of those 335 respondents who know the Career Centre, only 60 (17.6%) actually made use of the services. This is not surprising, as the Graduate School only started developing this service for the doctoral candidates as of 2012. Fortunately, there has been a significant positive change between 2011 and 2014 across the different items. At item 9.6, it can be seen that as many as 54 (out of 58) respondents would recommend the Career Centre to other doctoral candidates. The career centre received an average score of 7.1 for its services.
Some other results:
• Only 80 % hopes to defend their thesis before accepting a job (9.7) . This is worrisome because once in a another job, a lot of doctoral candidates never finish. Fortunately, 90% is determined to submit their draft thesis before leaving TU Delft (9.8).
• On average about 55% sees job opportunities at TU Delft (9.11).
• Just under 60% feel that they are encouraged by their supervisors to start thinking about their career after their defence (9.12)
• Just under 60% think that they will continue to work in academia.
With regard to subgroup differences, the following can be said:
87
• International doctoral candidates are always less satisfied about the services of the Career Centre than the Dutch doctoral candidates.
• The same holds true for doctoral candidates that belong to the Graduate School; they are always more positive than their pre-Graduate School colleagues.
Questions
These are the TU Delft wide results for the Likert scale questions over 2014
9.1 Are you aware that TU Delft has a Career Centre (CC)?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 662) = 17.15, p < .05 No data from 2011 No data from 2011 9.3
Have you made use of the services of the Career Centre (CC)?
1,0
0,8
1,1
0,7
0,8
-0,1
0,0
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
9.6
9.7
9.8
9.9
9.10
9.11
9.12
9.13
53% 54%
61% 46%
49% 38%
67% 71%
50%
47% 46%
39% 54%
51% 62%
33% 29%
50%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
18% 15% 14%
22% 21%
17% 11%
18%
83% 85% 86%
78% 80%
83% 89%
100% 82%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
88
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(7, 335) = 3.7, p > .05 No data from 2011 No data from 2011 9.5 How would you grade the support you received (1-10)?
Standard deviation is 1.7.
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
F(6, 58) = .85, p > .05 No data from 2011 No data from 2011
9.6 I would recommend other PhD candidates to make use of the services of the Career Centre (CC)
7,5
7,0
7,0
7,7
6,7
6,4
8,0
7,1
0,0 2,0 4,0 6,0 8,0 10,0
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TU Delft
10%
17%
7%
5%
40% 75%
39% 67%
29%
41%
50% 25%
83% 62%
27% 71%
100% 53%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,9
0,8
1,2
1,1
0,7
1,2
1,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TU Delft
89
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(12, 58) = 16.33, p > .05 No data from 2011 No data from 2011 9.7 I hope to defend my thesis before accepting a full time job
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 575) = 30.24, p > .05 F(7, 1354) = .97, p > .05 F(1, 1354) = 21.12, p < .01
9.8 Before my contract or (external) funding ends, I am determined to at least have submitted my draft thesis
8% 2%
6% 15% 19%
15% 6%
12%
30% 32%
43% 23%
26% 28%
22%
28%
56% 66%
43% 54%
50% 52%
63% 100%
54%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,4
0,7
0,4
0,6
0,6
0,6
0,6
0,6
0,6
0,9
1,1
0,7
0,7
0,7
0,8
0,9
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
9%
17%
20% 14%
9% 18%
20% 19%
8%
17%
74% 81% 78% 76%
70% 75%
84% 83%
75%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
90
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 617) = 20.62, p > .05 F(7, 1425) = .85, p > .05 F(1, 1425) = 52.2, p < .01
9.9 Obtaining my doctorate degree will help me find a job
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 608) = 17.65, p > .05 F(7, 1396) = 1.77, p > .05 F(1, 1396) = 12.52, p < .01
0,9
0,9
0,7
0,8
0,8
0,8
1,1
1,0
0,9
1,2
1,2
1,1
1,2
1,1
1,2
1,2
1,2
1,1
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
16% 15%
11% 15%
12% 11%
14% 20%
14%
33% 33%
38% 37% 30% 32% 28%
20% 33%
42% 46% 47% 48%
52% 50% 50%
40% 48%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,5
0,8
0,4
0,6
0,6
0,6
0,5
0,4
0,6
0,6
0,7
0,8
0,8
0,8
0,7
0,7
0,3
0,7
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mEAEArchASCEGEEMCSIDETPMTU Delft
2011
2014
91
9.10 The content of my PhD project is useful for my future career
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 655) = 33.6, p < .05 F(7, 1455) = 3.3, p < .01 F(1, 1455) = 14.18, p < .01
9.11 I see enough job opportunities at TU Delft after completing my PhD project
14% 21%
14% 11%
11% 5%
11%
35% 40%
29% 41%
30% 37%
31% 14%
35%
49% 36%
67% 40%
58% 48%
62% 86%
51%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
0,7
0,8
0,6
0,7
0,7
0,9
0,7
0,7
0,8
0,6
1,1
0,7
0,9
0,8
1,0
1,4
0,8
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
33% 24%
20% 27% 33%
28% 24%
28%
30% 46%
25% 26%
25% 28%
33% 50%
29%
14% 12%
19% 19% 17% 18% 18% 17% 17%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
92
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 561) = 17.52, p > .05 F(7, 1209) = 1.79, p > .05 F(1, 1209) = 23, p < .01
9.12 My supervisors encourage me to start thinking about my career after my promotion
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 529) = 19.86, p > .05 F(7, 1296) = 1.9, p > .05 F(1, 1296) = .53, p > .05
-0,3
-0,6
-0,7
-0,5
-0,3
-0,3
-0,1
-0,6
-0,4
-0,2
0,0
-0,2
-0,2
-0,2
-0,1
0,0
0,0
-0,1
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
28% 24%
22% 25%
27% 25%
29% 33% 26%
29% 35%
28% 28%
28% 30%
32% 33%
29%
31% 14%
33% 17%
22% 22%
29% 17%
23%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,1
-0,2
-0,1
0,1
0,2
0,2
-0,2
0,0
0,1
0,3
-0,2
0,3
-0,2
0,0
0,0
0,3
0,0
0,0
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
93
9.13 I believe my future career will continue within academia (at TU Delft or somewhere else)
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 632) = 76.93, p < .01 No data from 2011 No data from 2011
34% 17%
13% 27%
27% 22%
10%
23%
26% 34%
39% 22%
32% 32%
46% 29%
31%
21% 26%
45% 19%
33% 31%
33% 29% 29%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,0
0,1
0,8
-0,2
0,4
0,3
0,5
-0,1
0,2
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
94
3.8 Graduate School (organization and process) Introduction A whole new category in this survey is about the Graduate School itself. Items 10.1 through 10.4 are background information items, items 10.5 through 10.10 are on a Likert scale to measure satisfaction. The questionnaire was designed in such a way that items 10.1 and 10.5 are linked, 10.2 and 10.6, 10.3 and 10.7 and lastly 10.4 and 10.8. This means that if a respondent answered ‘no’, ‘never’ or ‘didn’t know’ at items 10.1, 10.2, 10.3 or 10.4, she or he would not have to answer item 10.5, 10.6, 10.7 or 10.8. Items 10.11 and 10.12 are not displayed here (see appendix 1).
*Item
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
10.1 No data No data 10.2 No data No data 10.3 X No data No data 10.4 No data No data 10.5 No data No data 10.6 X No data No data 10.7 No data No data 10.8 No data No data 10.9 No data No data
10.10 No data No data * The items in this cluster were only present in the 2014 questionnaire.
Summary
With regard to the first 8 items, respondents who know about the websites and the Quick Reference Cards and read the ‘PhD and DE News’, are very enthusiastic about this. Well over half of all doctoral candidates slightly or strongly agree with the questions in items 10.5 through 10.8. The suggestion would be to communicate more actively (or effectively) about the websites of the (University) Graduate School and the Faculty Graduate Schools and the Quick Reference Cards.
Furthermore, it would also be advisable to communicate ‘PhD and DE News’ in multiple ways.
In item 10.9, it can be seen that 75% of doctoral candidates clearly state that the intake interview provided them with all the information they needed to get started in the Doctoral Monitoring Application (DMA). On the other hand, DMA is still a concern because less than half of doctoral candidates state that DMA helps them to monitor their progress in their PhD project.
95
10.1 Do you use the website graduateschool.tudelft.nl?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 664) = 15.49, p > .05 No data from 2011 No data from 2011
10.2 Do you use the website of your Faculty Graduate School?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 666) = 18.39, p > .05 No data from 2011 No data from 2011
10.3 How often do you read the monthly newsletter (PhD and DE News)?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(28, 663) = 50.36, p < .01 No data from 2011 No data from 2011
55% 49%
62% 53%
49% 58%
68% 86%
55%
41% 45%
31% 39%
38% 34%
25% 14%
37%
5% 6% 7% 8%
13% 8% 8%
8%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
didn't know website
29% 30%
66% 25% 24%
38% 55%
71% 35%
56% 62%
30% 57%
56% 48%
40% 29%
51%
15% 9%
4% 18%
20% 14%
5%
14%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
didn't know website
10% 11%
14% 12% 13%
10%
24% 15%
13% 29%
31% 35%
18% 29%
26%
39% 43%
50% 40%
34% 31%
33% 29%
37%
20% 23%
24% 14%
18% 13%
35% 29%
19%
8% 9%
11%
5% 8%
13% 14%
7%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
Never
Rarely
Sometimes
Usually
Always
96
10.4 Are you aware that there are Quick Reference Cards about your PhD process?
Test 2014 (faculties and TUD) Test 2011 vs. 2014 (faculty) Test 2011 vs. 2014 (TUD)
χ2(7, 335) = 3.7, p > .05 No data from 2011 No data from 2011
10.5 graduateschool.tudelft.nl provides all the information I need
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 356) = 22.08, p < .05 No data from 2011 No data from 2011
17% 11%
16% 7% 7%
15% 10%
14% 12%
83% 89%
85% 93% 93%
85% 90%
86% 89%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
34% 17%
13% 27%
27% 22%
10%
23%
26% 34%
39% 22%
32% 32%
46% 29%
31%
21% 26%
45% 19%
33% 31%
33% 29% 29%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,5
0,3
0,6
0,6
0,5
0,4
0,4
0,8
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
97
10.6 The Faculty Graduate School website provides all the information about the requirements that I need to meet
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 221) = 41.47, p < .01 No data from 2011 No data from 2011
10.7 I find the information in the monthly newsletter useful
7%
12% 13%
16% 24%
10%
13%
59% 50%
56% 58%
50% 50%
48% 40%
53%
28% 14%
30% 29%
31% 26%
29% 40%
28%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
-0,1
0,6
0,7
0,6
0,5
0,4
0,5
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
33% 20%
20% 38%
27% 36%
23% 14%
30%
57% 58%
63% 48%
57% 42%
54% 43%
53%
9% 13%
15% 9%
10% 15%
17% 43%
12%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
98
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 523) = 29.06, p > .05 No data from 2011 No data from 2011
10.8 I find the Quick Reference Cards helpful
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 68) = 22.28, p > .05 No data from 2011 No data from 2011
0,6
-0,1
0,6
0,7
0,6
0,5
0,4
0,5
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
29% 20%
10%
10% 13%
25%
15%
43% 80%
50% 33%
50% 53%
50% 100%
50%
29%
20% 22% 20%
33% 25%
24%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,6
-0,1
0,6
0,7
0,6
0,5
0,4
0,5
0,5
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
99
10.9 The Intake interview provided me with all the information I need to get started in DMA
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 432) = 14.62, p > .05 No data from 2011 No data from 2011
10.10 DMA helps me to monitor the progress of my PhD project
11% 14% 14%
18% 22%
19% 19%
17% 17%
41% 40%
33% 42%
36% 41%
25% 17%
38%
36% 29%
36% 32% 31% 32% 31%
50% 33%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
0,5
0,3
0,4
0,5
0,4
0,5
0,1
0,5
0,4
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
29% 18%
18% 24%
36% 33%
26%
28%
35% 38%
32% 30%
26% 36% 29%
33% 32%
13% 15%
27% 21%
16% 8%
10% 50%
15%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
strongly disagree
slightly disagree
slightly agree
strongly agree
100
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(21, 413) = 25.42, p > .05 No data from 2011 No data from 2011
-0,1
-0,1
0,1
0,0
-0,2
-0,2
-0,4
0,7
-0,1
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
101
3.9 Online Education Introduction At the request of the Extension School, this category was added. Open and online education is a top priority at TU Delft and the Extension School would therefore like to know how many doctoral candidates are already following or are aware of Massive Open Online Courses (MOOC). Additionally, they feel it is important to research how many doctoral candidates would be interested in taking online courses for their Doctoral Education programme. The Graduate School is already thinking about the influence that open and online education can have on Doctoral Education13.
Items 11.2 and 11.4 are not displayed here (see appendix 1).
Item*
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
11.1 No data No data 11.3 No data No data
* The items in this cluster were only present in the 2014 questionnaire.
Summary
The results are quite straightforward. Only 12 percent of doctoral candidates have followed a MOOC so far or was following one at the time of the survey. The other 88 percent hadn’t tried a MOOC or was even aware of what a MOOC is.
11.1 Have you followed, or are you currently following, a Massive Online Open Course (MOOC)?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 664) = 16.98, p > .05 No data from 2011 No data from 2011
13 http://delta.tudelft.nl/article/online-also-counts/28489
9% 13% 13%
6% 12%
18% 15% 14%
12%
58% 55%
60% 59%
57% 51%
63% 86%
57%
34% 32%
27% 36%
31% 31%
23%
31%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
don't know what MOOC is
102
11.3 Would you be interested in taking online courses for your Doctoral Education Programme?
Test 2014 (faculties and TUD)
Test 2011 vs. 2014 (faculty)
Test 2011 vs. 2014 (TUD)
χ2(14, 665) = 11.49, p > .05 No data from 2011 No data from 2011
47% 57%
61% 49%
54% 59%
48% 71%
54%
20% 17% 11%
21% 16%
19% 18%
17%
33% 26%
28% 30% 30%
22% 35%
29% 29%
0% 25% 50% 75% 100%
3mEAEArchASCEGEEMCSIDETPMTU Delft
yes
no
don't know
103
3.10 Final grade of PhD programme Introduction
Last but most certainly not least, respondents were asked to grade the entire PhD programme. This includes everything from intake to doctoral defence ceremony and everything in between and surrounding this. What grade would you give the PhD programme at TU Delft, ranging from 1-10? (In hindsight it would have been better to ask for a grade between 1 and 10 for the separate categories. However it was decided best to repeat the same question used in 2011.
Results
The results of 2014 are an improvement to the results of 2011 on three different levels. Firstly, five of the eight faculties have seen an increase over the years and the other three faculties still score higher than a 7. Secondly, no faculties score lower than a 7. In 2011 Architecture scored a 6.6 but this year a 7.3. Lastly, the decrease in standard deviation between 2011 and 2014 means that there is greater consensus among doctoral candidates from different faculties on the grade of the PhD programme at TU Delft in 2014. In 2014, at TU level, the grade for the PhD programme increased from 7.2 to 7.34. Additionally, there are no significant differences amongst faculties. This means that the faculty is not a determinant in the general satisfaction about the whole PhD programme.
In chapter 4 and 5 the final grade is extensively examined. In chapter 4, to see where significant statistical differences exist between subgroups. The differences defined are:
• Dutch versus international • VSNU-categories • Pre-Graduate School versus Graduate School doctoral candidates • Peer group learning • Low or high number of meetings with supervisors (especially the daily supervisor) • Low or high satisfaction about supervision
In chapter 5, regression analysis has been used to determine which cluster of items has the strongest effect on the final grade.
Originally there was also an item 12.2. This item gave room to comments that were not addressed in any of the 105 items preceding it. The Graduate School will look at the answers to this open question and use it as another source of input to improve the PhD programme.
104
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between faculties and the whole TU Delft in 2014
Standard deviation for the whole TU Delft is 1.47.
Test 2014 (faculties and TUD) F(7, 657) = 1.05, p > .05
Differences between faculties and the whole TU Delft in 2011
Standard deviation at TU Delft level is 1.54.
Test 2011 (faculties and TUD) F(7, 888) = 2.61, p < .05
7,3 7,6
7,3 7,4
7,1 7,5
7,2 7,4
7,3
0,0 2,0 4,0 6,0 8,0 10,0
3mEAE
ArchAS
CEGEEMCS
IDETPM
TU Delft
7,2
7,1
6,6
7,5
7,2
7,3
7,5
7,0
7,2
0,0 2,0 4,0 6,0 8,0 10,0
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
105
Differences between faculties and the whole TU Delft in 2011 and 2014
Test 2011 vs. 2014 (faculty) Test 2011 vs. 2014 (TUD)
F(7, 1546) = 2.36, p < .05 F(1, 1546) = 2.55, p > .05
7,2
7,1
6,6
7,5
7,2
7,3
7,5
7,0
7,2
7,3
7,6
7,3
7,4
7,1
7,5
7,2
7,4
7,3
0,0 2,0 4,0 6,0 8,0 10,0
3mE
AE
Arch
AS
CEG
EEMCS
IDE
TPM
TU Delft
2011
2014
106
3.11 Faculty-related questions When the questionnaire was designed, the directors of the Faculty Graduate School were asked if they wanted to submit questions that were specific to their faculty and not yet covered in the ‘basic’ questionnaire. Four of the directors provided the questions on the following pages. There was a set maximum of five questions. The answers more or less speak for themselves and the further interpretation will be left up to the Faculty Graduate School involved.
Aerospace Engineering
No. Question Number of valid cases
1 Is a research plan part of your PhD agreement? 47 2 Is a publication plan part of your PhD agreement? 47 3 Is an internship abroad part of your PhD project? 47 4 I believe the Go/No Go review meeting helps me to stay on
schedule with my PhD project 41
5 The influence of the industry on my PhD project is too big 38
74%
55%
15%
13%
30%
62%
13%
15%
23%
0% 25% 50% 75% 100%
Question 1
Question 2
Question 3
yes
no
don't know
20%
40%
39%
8%
37%
11%
0% 25% 50% 75% 100%
Question 4
Question 5
strongly disagree
slightly disagree
slightly agree
strongly agree
107
Civil Engineering and Geosciences
No. Question Number of valid cases
1 Have you had contact with your mentor after the introduction meeting?
145
2 Did you have an external committee member at your Go/No Go meeting?
145
3 Was she/he from outside your section or research group? 137 4 The mentor system is an asset of the Graduate School 64 5 I received constructive feedback during the Go/No Go
meeting 65
6 Working in DMA has made me realise that I seriously have to plan my PhD
71
11%
28%
60%
37%
29%
36%
0% 25% 50% 75% 100%
Question 1
Question 2
yes
no
don't know
26% 32% 37%
0% 25% 50% 75% 100%
Question 3
yes
no
don't know
no external member
25%
23%
24%
47%
46%
31%
16%
22%
18%
0% 25% 50% 75% 100%
Question 4
Question 5
Question 6
strongly disagree
slightly disagree
slightly agree
strongly agree
108
Electrical Engineering, Mathematics and Computer Sciences
No. Question Number of valid cases
1 I would ask my mentor for help in case of problems within the PhD project
94
2 The 6-month-meeting is a good opportunity to start preparing for the Go/No Go meeting
88
3 The Go/No Go meeting helped me in planning my research 84 4 The DE programme has made me a better and broader
researcher 75
5 Working in DMA has made me realise that I seriously have to plan my PhD
85
25%
9%
20%
24%
19%
37%
51%
40%
43%
39%
31%
34%
30%
19%
19%
0% 25% 50% 75% 100%
Question 1
Question 2
Question 3
Question 4
Question 5
strongly disagree
slightly disagree
slightly agree
strongly agree
109
Technology, Policy and Management It was mentioned before but unfortunately there were only 7 respondents for the faculty of TPM. A combination of a wrong mailing list and technical issues with the delivery of the questionnaire resulted in this small response group.
No. Question Number of valid cases
1 Have you taken courses at a Research School (even if not a member)?
7
2 My mentor assists me in my (personal) learning experience 5 3 I would ask my mentor for help in case of problems (e.g.
expecting a ‘No go’ or a conflict with your promotor or daily supervisor)
7
4 The DMA system helps me to (better) plan my PhD project 5 5 How often are you in touch with your mentor? 7
43% 43% 14%
0% 25% 50% 75% 100%
Question 1
yes
no
don't know
20%
20%
40%
29%
40%
40%
57%
40%
0% 25% 50% 75% 100%
Question 2
Question 3
Question 4
strongly disagree
slightly disagree
slightly agree
strongly agree
14% 43% 29%
0% 25% 50% 75% 100%
Question 5
monthly
quarterly
half yearly
once per year
110
4. Subgroup Differences
111
4.1 Introduction This chapter provides more in-depth detail of the different subgroups of the entire 2014 response group. An almost infinite number of combinations between subgroups and items are possible but not every test is significant and perhaps more importantly: not every conclusion can be influenced by a change in policy. Therefore, it was decided to carry out statistical tests on a select number of subgroups and with a selection of items. These are the same statistical tests that have been used in chapter 3.
Subgroup Items Scale questions Final grade Woman/Man Scale questions: Project&Planning, Supervision and DE
Items 4.5, 4.8 and 4.9 Final grade
Dutch/international Scale questions: Project&Planning, Supervision, DE, Working environment and Career planning VSNU-category (also separate Dutch/Chinese) Items 4.5, 4.8 and 4.9 Items 8.19 and 8.22 on Teaching Final grade
VSNU-category
Scale questions: Project&Planning, Supervision and DE Items 4.5, 4.8 and 4.9 (4.8 and 4.9 both 2011 and 2014) Final grade
Pre-GS (before 2012)/GS (2012 and later) Scale questions DE and Career planning Final grade
Before or after Go/No Go Item 4.1 Member/not member of Research School Scale question: DE
Item 6.21 Teach/not teach in bachelor or master Items 4.8 and 4.9 Peer group learning Items 6.2, 6.5 and 6.7
Final grade Frequency appointments with supervisors Item 6.7 (separately for promotor and daily supervisor)
Final grade Supervision satisfaction Items 4.5, 4.8 and 4.9
Final grade In the previous chapter the results of separate univariate analyses for the underlined subgroups are visible in the tables at the beginning of every category. Item number Question
4.1 I have a clear overview of the different phases of my PhD project (from intake to the doctoral defence ceremony and everything in between)
4.5 I believe I can finish my PhD within the time set 4.8 Please indicate your progress/status 4.9 Which of these reasons has contributed the most to your delay? 6.2 How often do you have an appointment with your promotor? (indication) 6.5 How often do you have an appointment with your supervisor? (indication) 6.7 I am satisfied with the way my supervision is organized 6.21 I receive sufficient methodological support 8.19 Do you teach courses to bachelor and/or master students? 8.22 I enjoy teaching
112
4.2 Scale questions A new subgroup is introduced which is also an item, namely the scale question. Scale questions are composed of individual Likert scale questions. Although a bit rough as a measuring instrument, it enables you to look at a whole range of Likert scale questions within a category and draw some tentative conclusions. It is particularly useful to see how much impact a whole category can have on the general satisfaction. General satisfaction has been measured using regression analysis and is discussed in chapter 5.
The tables at the start of every cluster in chapter 3 show the result of separate univariate analyses on every item for the subgroups woman/man, Dutch/international, VSNU-category and Pre-GS/GS. For these subgroups, it is possible to draw rather distinct conclusions about their mutual differences.
In this chapter, the scale questions are presented in two manners. Firstly, they are presented as a subgroup (low and high satisfaction on e.g. supervision) and have been lined against the final grade. The result is that it is possible to see what final grade a respondent gives who has low satisfaction on a category as opposed to someone who has high satisfaction. Secondly, other subgroups have been lined against the scale questions and this results in a satisfaction number on a range of 1 to 4 for both subgroups.
Four scale questions were created out of the Likert scale items in the following categories:
• Supervision • Doctoral Education • Working Environment • Career Planning
To use them as subgroups, the scale questions have been dichotomised. Each scale question has a different cut off point for the 50% percentile.
• Supervision = 3.35 (lower means a low satisfaction on supervision and vice versa) • DE = 2.9 (ibidem) • Working Environment = 3.36 (ibidem) • Career Planning = 3.13 (ibidem)
All individual Likert scale questions that are part of the scale questions were formulated in a positive way. Statistically this means that a value of 1 is always more negative than 2, 3 or 4, a value of 2 always more negative than 3 and 4, etcetera. Linguistically it means that positive words are used:
• Clear • Motivate • In line with • Available • Support • Have agreed on
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Analysis makes clear that the results on all scale questions are significant. Not very surprising but if a doctoral candidate has low satisfaction on any of the scale questions, they will not only give the PhD programme at TU Delft a lower grade but it will also be significantly lower than the final grade given by a doctoral candidate that has high satisfaction on any of the scale questions.
113
Differences between low and high satisfaction on supervision (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(1, 657) = 121.4, p < .01
Differences between low and high satisfaction on doctoral education () in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(1, 657) = 135.55, p < .01
6,8
7,9
0,0 2,0 4,0 6,0 8,0 10,0
low
high
6,7
8,0
0,0 2,0 4,0 6,0 8,0 10,0
low
high
114
Differences between low and high satisfaction on working environment (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(1, 657) = 87.62, p < .01
Differences between low and high satisfaction on career planning (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(1, 657) = 60.23, p < .01
6,8
7,8
0,0 2,0 4,0 6,0 8,0 10,0
low
high
6,9
7,8
0,0 2,0 4,0 6,0 8,0 10,0
low
high
115
4.3 Gender Between women and men there are significant differences in response to:
• Scale questions: o Project and Planning o Supervision
• Reasons for delay Scale question: Project and Planning
Differences between women and men (TU Delft wide) in 2014
Standard deviation is .65.
Test 2014 (TUD) F(1, 662) = 9.96, p < .01 Scale question: Supervision
Differences between women and men (TU Delft wide) in 2014
Standard deviation is .63.
Test 2014 (TUD) F(1, 661) = 8.24, p < .01
2,93
3,10
0,00 1,00 2,00 3,00 4,00
women
men
3,12
3,27
0,00 1,00 2,00 3,00 4,00
women
men
116
Scale question: Doctoral Education
Differences between women and men (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(1, 660) = .74, p > .05
4.5 I believe I can finish my PhD within the time set
Individual answers per gender (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 651) = 5.29, p > .05
4.8 Please indicate your progress/status
Individual answers per gender (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 662) = 3.08, p > .05
2,88
2,92
0,00 0,50 1,00 1,50 2,00 2,50 3,00 3,50 4,00
women
men
19%
13%
32%
37%
36%
39%
0% 25% 50% 75% 100%
women
men
strongly disagree
slightly disagree
slightly agree
strongly agree
50%
53%
44%
42%
0% 25% 50% 75% 100%
women
men
on schedule
behind schedule
time out or discontinue
finished
117
4.9 Which of these reasons has contributed the most to your delay?
Individual answers per gender () in 2014
Test 2014 (TUD) χ2(6, 284) = 13, p < .05
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between women and men (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(1, 654) = 2.22, p > .05
53%
35%
16%
18%
17%
24% 6%
8%
6%
0% 25% 50% 75% 100%
women
men
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
7,2
7,4
0,0 2,0 4,0 6,0 8,0 10,0
women
men
118
4.4 Nationality14 Between Dutch and international doctoral candidates there are significant differences in response to:
• Scale questions: o Project and Planning o Working environment o Career planning
• VSNU-category in 2014 (and also between Dutch and Chinese doctoral candidates in 2011 and 2014 because Chinese candidates are our largest group of internationals).
• Reasons for delay • Involved in teaching bachelor/master • Enjoyment of teaching • Final grade
The most remarkable findings:
• Looking at ‘the connection to TU Delft’, only 10% of the Dutch doctoral candidates are in VSNU category 3 whereas this is 60% amongst Chinese doctoral candidates.
• Concerning reasons for delay (4.9) 9% of the Dutch doctoral candidates answered that this was because they were busy due to private reasons. Amongst the international doctoral candidates, 2% gave the same reason.
• 8.19 shows that 66% of the Dutch doctoral candidates teach courses, as opposed to40 % of the international doctoral candidates
Scale question: Project and Planning
Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
Standard deviation is .63.
Test 2014 (TUD) F(1, 659) = 7, p < .01
14 There are 195 Dutch and 465 international respondents; there are 7 system missing.
2,95
3,10
0,00 1,00 2,00 3,00 4,00
national
inter-national
119
Scale question: Supervision
Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
Standard deviation is .63.
Test 2014 (TUD) F(1, 661) = .17, p > .05
Scale question: Doctoral Education
Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(1, 657) = 3.19, p > .05
3,24
3,22
0,00 1,00 2,00 3,00 4,00
national
inter-national
2,85
2,94
0,00 1,00 2,00 3,00 4,00
national
inter-national
120
Scale question: Working environment
Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
Standard deviation is .55.
Test 2014 (TUD) F(1, 658) = 4.77, p < .05
Scale question: Career planning
Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(1, 655) = 19.78, p < .01
3,37
3,27
0,00 1,00 2,00 3,00 4,00
national
inter-national
2,91
3,13
0,00 1,00 2,00 3,00 4,00
national
inter-national
121
How are you connected to TU Delft?
Individual answers for Dutch and international doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 650) = 10.94, p < .05
Individual answers for Dutch and Chinese doctoral candidates (TU Delft wide) in 2011
Test 2011 (TUD) χ2(3, 415) = 117.51, p < .01
Individual answers for Dutch and Chinese doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 301) = 66.04, p < .01
60%
51%
30%
43%
8%
5%
0% 25% 50% 75% 100%
national
international
VSNU 1
VSNU 2
VSNU 3
VSNU 4
72%
38%
10%
60%
16%
0% 25% 50% 75% 100%
Dutch
Chinese
VSNU 1
VSNU 2
VSNU 3
VSNU 4
60%
20%
30%
78%
8%
0% 25% 50% 75% 100%
Dutch
Chinese
VSNU 1
VSNU 2
VSNU 3
VSNU 4
122
4.5 I believe I can finish my PhD within the time set
Individual answers for Dutch and international doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 648) = 6.39, p > .05
4.8 Please indicate your progress/status
Individual answers for Dutch and international doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 659) = 4.61, p > .05
4.9 Which of these reasons has contributed the most to your delay?
Individual answers for Dutch and international doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(6, 283) = 13.55, p < .05
16%
14%
39%
34%
30%
41%
0% 25% 50% 75% 100%
national
international
strongly disagree
slightly disagree
slightly agree
strongly agree
52%
52%
45%
42%
0% 25% 50% 75% 100%
national
international
on schedule
behind schedule
time out or discontinue
finished
38%
42%
14%
19%
18%
23%
10% 9%
6%
11%
6%
0% 25% 50% 75% 100%
national
international
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
123
8.19 Do you teach courses to bachelor and/or master students?
Individual answers for Dutch and international doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(1, 658) = 35.8, p < .01
8.22 I enjoy teaching
Individual answers for Dutch and international doctoral candidates (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 313) = 9.54, p < .05 Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
66%
40%
34%
60%
0% 25% 50% 75% 100%
national
international
yes
no
12%
30%
29%
66%
57%
0% 25% 50% 75% 100%
national
international
strongly disagree
slightly disagree
slightly agree
strongly agree
1,1
0,9
-1,5 -1,0 -0,5 0,0 0,5 1,0 1,5
national
international
124
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between Dutch and international doctoral candidates (TU Delft wide) in 2014
Standard deviation is 1.48.
Test 2014 (TUD) F(1, 650) = 8.36, p < .01
7,1
7,5
0,0 2,0 4,0 6,0 8,0 10,0
national
inter-national
125
4.5 VSNU category Between doctoral candidates of the different VSNU categories there are significant differences in response to:
• Scale questions: o Project and Planning o Supervision o Doctoral Education
• Believe in finishing the PhD within • The time set • The progress/status between Doctoral candidates in 2011 and 2014 • Reasons for delay in 2011 and in 2014 (but not between 2011 and 2014) • Final grade
The most remarkable findings:
• Only 9% of the internal Doctoral candidates believe they can finish within the time set, against about an average of 75% in the other 3 categories. The reasons that internal Doctoral candidates are delayed are:
o too busy with research (70%) o or private affairs (30%)
• VSNU category 3 – contract PhD’s – is most satisfied about the PhD programme with an overall grade of 7,5
• VSNU category 2 – internal PhD’s – are the least satisfied (6,6) Scale question: Project and Planning
Differences between VSNU categories (TU Delft wide) in 2014
Standard deviation is .64.
Test 2014 (TUD) F(1, 656) = 3.15, p < .05
3,02
2,64
3,13
3,01
0,00 0,50 1,00 1,50 2,00 2,50 3,00 3,50 4,00
VSNU 1
VSNU 2
VSNU 3
VSNU 4
126
Scale question: Supervision
Differences between VSNU categories (TU Delft wide) in 2014
Standard deviation is .63.
Test 2014 (TUD) F(3, 655) = 3.58, p < .05
Scale question: Doctoral Education
Differences between VSNU categories (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(3, 654) = 8.38, p < .01
3,16
3,35
3,31
3,23
0,00 0,50 1,00 1,50 2,00 2,50 3,00 3,50 4,00
VSNU 1
VSNU 2
VSNU 3
VSNU 4
2,81
3,00
3,03
2,98
0,00 1,00 2,00 3,00 4,00
VSNU 1
VSNU 2
VSNU 3
VSNU 4
127
4.5 I believe I can finish my PhD within the time set
Individual answers per VSNU category (TU Delft wide) in 2014
Test 2014 (TUD) χ2(9, 647) = 31.8, p < .01 4.8 Please indicate your progress/status
Individual answers per VSNU-category (TU Delft wide) in 2011
Test 2011 (TUD) χ2(9, 863) = 13.51, p > .05 Individual answers per VSNU-category (TU Delft wide) in 2014
Test 2014 (TUD) χ2(9, 656) = 14.48, p > .05
12%
64%
16%
24%
38%
35%
26%
39%
9%
38%
37%
0% 25% 50% 75% 100%
VSNU 1
VSNU 2
VSNU 3
VSNU 4
strongly disagree
slightly disagree
slightly agree
strongly agree
57%
58%
66%
45%
33%
33%
26%
45%
0% 25% 50% 75% 100%
VSNU 1
VSNU 2
VSNU 3
VSNU 4
on schedule
behind schedule
time out or discontinue
finished
54%
17%
53%
45%
42%
83%
40%
48%
0% 25% 50% 75% 100%
VSNU 1
VSNU 2
VSNU 3
VSNU 4
on schedule
behind schedule
time out or discontinue
finished
128
TU Delft wide in 2011 and 2014
Test 2014 (TUD) χ2(3, 1555) = 24.6, p < .01 4.9 Which of these reasons has contributed the most to your delay?
Individual answers per VSNU-category (TU Delft wide) in 2011
Test 2011 (TUD) χ2(18, 277) = 37, p < .01 Individual answers per VSNU-category (TU Delft wide) in 2014
Test 2014 (TUD) χ2(18, 277) = 50.47, p < .01
58%
52%
32%
43%
0% 25% 50% 75% 100%
2011
2014
on schedule
behind schedule
time out or discontinue
finished
48%
57%
27%
11%
15%
15%
19%
100%
10%
21%
6%
12%
6%
13%
21%
0% 25% 50% 75% 100%
VSNU 1
VSNU 2
VSNU 3
VSNU 4
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
46%
40%
26%
19%
19%
18%
70%
20%
37%
30%
11%
6%
8%
16%
10%
7%
0% 25% 50% 75% 100%
VSNU 1
VSNU 2
VSNU 3
VSNU 4
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
129
TU Delft wide in 2011 and 2014
Test 2011 vs. 2014 (TUD) χ2(6, 554) = 71.32, p < .01 Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between VSNU categories (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(3, 649) = 2.99, p < .01
46%
41%
13%
17%
18%
21%
7%
7%
12%
8%
0% 25% 50% 75% 100%
2011
2014
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
7,2
6,6
7,5
7,3
0,0 2,0 4,0 6,0 8,0 10,0
VSNU 1
VSNU 2
VSNU 3
VSNU 4
130
4.6 Pre-GS/GS The cut-off point to determine pre-GS vs. GS is not completely true to the actual situation. In the below analysis the pre-GS group consists of all the doctoral candidates that started before January 1st 2012 and the GS group consists of all the doctoral candidates after January 1st 2012. This is not completely correct because three Faculty Graduate Schools started on September 1st 2011.
Significant differences can be seen between the two groups in all the scale questions and the final grade.
Scale question: Project and Planning
Differences between pre-GS and GS doctoral candidates (TU Delft wide) in 2014
Standard deviation is .65.
Test 2014 (TUD) F(1, 654) = 55.56, p < .01 Scale question: Supervision
Differences between pre-GS and GS doctoral candidates (TU Delft wide) in 2014
Standard deviation is .63.
Test 2014 (TUD) F(1, 654) = 30.19, p < .01
2,83
3,20
0,00 1,00 2,00 3,00 4,00
pre-GS
post-GS
3,06
3,33
0,00 1,00 2,00 3,00 4,00
pre-GS
post-GS
131
Scale question: Doctoral Education
Differences between pre-GS and GS doctoral candidates (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(1, 652) = 16.48, p < .01 Scale question: Career planning
Differences between pre-GS and GS doctoral candidates (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(1, 650) = 26, p < .01
2,80
2,98
0,00 1,00 2,00 3,00 4,00
pre-GS
post-GS
2,93
3,16
0,00 1,00 2,00 3,00 4,00
pre-GS
post-GS
132
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between pre- and GS doctoral candidates (TU Delft wide) in 2014
Standard deviation is 1.46.
Test 2014 (TUD) F(1, 646) = 14.73, p < .01
7,1
7,5
0,0 2,0 4,0 6,0 8,0 10,0
pre-GS
post-GS
133
4.7 Go/No Go One of the reasons for doing this whole research and in particular this subgroup analyses, is to test assumptions or expected effects of newly implemented procedures. With the implementation of the Go/No Go regulations, it was expected that this would be an important moment where doctoral candidates not only hear whether they can continue their project but also help structure the next years of their PhD project.
4.1 I have a clear overview of the different phases of my PhD project (from intake to the doctoral defence ceremony and everything in between)15
Individual answers pre- and post-Go/No Go meeting (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 663) = .62, p > .05 Unfortunately, as the analysis shows, the Go/No Go meeting does not seem to help doctoral candidates to get a clear overview of the different phases of their PhD project after the Go/No Go meeting.
15 For this analysis, the variable ‘Go/No Go Meeting’ has been recoded into the values ‘yes’ and ‘no’ – the value ‘not yet’ is part of the new value ‘no’.
12%
14%
48%
49%
35%
34%
0% 25% 50% 75% 100%
pre-Go/No Go
post-Go/No Go
strongly disagree
slightly disagree
slightly agree
strongly agree
134
4.8 Research School16
The most important conclusion is that it pays off to be a member of a research school when it comes to satisfaction of Doctoral Education and methodological feedback.
Scale question: Doctoral Education
Differences between doctoral candidates that are a member of a research school or not (TU Delft wide) in 2014
Standard deviation is .57.
Test 2014 (TUD) F(1, 497) = 14.05, p < .01
16 170 doctoral candidates did not know whether they were members of a research school or not; they were not counted in these analyses.
3,01
2,82
0,00 0,50 1,00 1,50 2,00 2,50 3,00 3,50 4,00
member
not a member
135
6.21 I receive sufficient methodological feedback
Differences between doctoral candidates that are a member of a research school or not (TU Delft wide) in 2014
Standard deviation is .93.
Test 2014 (TUD) F(1, 490) = 11.04, p < .01
3,12
2,84
0,00 1,00 2,00 3,00 4,00
member
not amember
136
4.9 Teaching Between doctoral candidates who teach and those who don’t, there are only significant differences in the final grade. It was thought this might due to the fact that doctoral candidates that teach are more behind schedule or have different reasons for delay. However, this was tested and turned out to be false.
4.8 Please indicate your progress/status
Individual answers of doctoral candidates who teach and who don’t teach (TU Delft population) in 2014
Test 2014 (TUD) χ2(3, 664) = 5.3, p > .05
48%
55%
46%
40%
0% 25% 50% 75% 100%
teach
don't teach
on schedule
behind schedule
time out or discontinue
finished
137
4.9 Which of these reasons has contributed the most to your delay?
Individual answers of doctoral candidates who teach and who don’t teach (TU Delft wide) in 2014
Test 2014 (TUD) χ2(6, 284) = 5.57, p > .05
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between doctoral candidates who teach and who don’t teach (TU Delft wide) in 2014
Standard deviation is 1.46.
Test 2014 (TUD) F(1, 656) = 7.11, p < .01.
41%
39%
15%
20%
25%
17% 5%
5%
9%
8%
8%
0% 25% 50% 75% 100%
teach
don't teach
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
7,2
7,5
0,0 2,0 4,0 6,0 8,0 10,0
teach
don'tteach
138
4.10 Peer group learning The decision to examine this subgroup was based on several assumptions:
- Doctoral candidates learn from each other, so the more embedded they are in their working environment, the better they perform;
- Doctoral candidates that are well-embedded in the organisation are more satisfied about the different levels of the PhD programme and on the programme as a whole.
This subgroup has been dubbed ‘peer group learning’ and it has been constructed using the category ‘Professional Embedding’.
Factor analysis shows that the Likert scale items in the category ‘Professional Embedding’ can be divided into two scale questions. The following items have been computed into the new scale question ‘Professional Embedding Rest’:
5.1 I have regular (formal or informal) contact with fellow doctoral candidates about my PhD project
5.2 My research group meets at least once every two weeks 5.6 I know several other doctoral candidates who use the same research methods as I do 5.7 A sufficient number of experts are available in my working environment to help me deal with
typical issues in my project 5.8 I receive good support during the collection of my data The remaining items have been computed into the scale question ‘Professional Embedding Awareness’:
5.3 I am aware of who else at TU Delft is working on a topic closely related to mine 5.4 I am aware of who else in the Netherlands is working on a topic closely related to mine 5.5 I am aware of who else in the world is working on a topic closely related to mine A score on ‘Professional Embedding ’ of 2.75 and lower is considered low peer group learning, a score higher than 2.75 is considered high peer group learning. The two resulting groups are almost equal in size. As the awareness questions are not relevant for the following analyses they were not included.
6.2 How often do you have an appointment with your promotor? (indication)
Individual answers for low and high peer group learning (TU Delft wide) in 2014
100%
76%
68%
56%
47%
52%
64%
24%
32%
44%
53%
48%
36%
0% 25% 50% 75% 100%
daily
once per week
once per two weeks
monthly
every half year
yearly
never
high
low
139
Test 2014 (TUD) χ2(6, 652) = 24.52, p < .01
6.5 How often do you have an appointment with your daily supervisor? (indication) Individual answers for low and high peer group learning (TU Delft wide) in 2014
Test 2014 (TUD) χ2(6, 594) = 44.05, p < .01 6.7 I am satisfied with the way my supervision is organized
Individual answers for low and high peer group learning (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 662) = 69.24, p < .01 Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences between low and high peer group learning (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) F(1, 657) = 100.17, p < .01
80% 68%
58% 39%
15%
50%
20% 32%
42% 61%
85% 100%
50%
0% 25% 50% 75% 100%
dailyonce per weekonce per two weeksmonthlyevery half yearyearlynever
high
low
21%
8%
36%
34%
30%
55%
0% 25% 50% 75% 100%
low
high
strongly disagree
slightly disagree
slightly agree
strongly agree
6,7
7,8
0,0 2,0 4,0 6,0 8,0 10,0
low
high
140
4.11 Meetings with supervisors Supervision is one of the key factors for the success of doctoral candidates in their PhD project as well as their satisfaction on their process/experience. This assumption has been used to devise a crude measuring tool: the number of meetings a doctoral candidate has with his or her supervisors.
For this analysis, the seven categories of questions 6.2 and 6.5 were recoded into two categories:
• Daily, once per week and once per two weeks = 1 • Monthly, every half year and once per year, I have never had an appointment = 2
Category 1 is considered a high number of meetings, category 2 is considered a low number of meetings.
It can be seen that supervision is important. Even more specifically, doctoral candidates consider the frequency of the meetings with their daily supervisor as very important.
6.7 I am satisfied with the way my supervision is organized
Individual answers for low and high number of meetings with promotor (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 662) = 15.56, p < .01 Individual answers for low and high number of meetings with daily supervisor (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 662) = 68.47, p < .01
7%
16%
33%
35%
55%
41%
0% 25% 50% 75% 100%
high
low
strongly disagree
slightly disagree
slightly agree
strongly agree
10%
24%
32%
42%
53%
20%
0% 25% 50% 75% 100%
high
low
strongly disagree
slightly disagree
slightly agree
strongly agree
141
Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences for low and high number of meetings with promotor (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) χ2(1, 657) = .77, p > .01 Differences for low and high number of meetings with daily supervisor (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) χ2(1, 657) = .77, p > .01
7,4
7,3
0,0 2,0 4,0 6,0 8,0 10,0
high
low
7,5
6,9
0,0 2,0 4,0 6,0 8,0 10,0
high
low
142
4.12 Supervision satisfaction The assumption here is that high satisfaction on supervision means that a doctoral candidate is more optimistic about finishing their PhD project on time and is more on schedule and mentions less frequently that supervision is a reason for delay. In general, these doctoral candidates are also more satisfied about the entire PhD programme.
For this analysis, the four categories of question 6.7 were recoded into two categories:
• Strongly disagree, slightly disagree = 1 • Slightly agree, strongly agree = 2
Category 1 is considered a low satisfaction on supervision, category 2 high satisfaction on supervision.
All the aforementioned assumptions are supported by the statistical tests.
4.5 I believe I can finish my PhD within the time set
Individual answers for low and high satisfaction with supervision (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 655) = 46.35, p < .01 4.8 Please indicate your progress/status
Individual answers for low and high satisfaction with supervision (TU Delft wide) in 2014
Test 2014 (TUD) χ2(3, 666) = 77.34, p < .01
22%
13%
29%
37%
22%
42%
0% 25% 50% 75% 100%
low
high
strongly disagree
slightly disagree
slightly agree
strongly agree
25%
59%
65%
37%
8%
0% 25% 50% 75% 100%
low
high
on schedule
behind schedule
time out or discontinue
finished
143
4.9 Which of these reasons has contributed the most to your delay?
Individual answers for low and high satisfaction with supervision (TU Delft wide) in 2014
Test 2014 (TUD) χ2(6, 286) = 54.43, p < .01 Overall, what grade would you give the PhD programme at TU Delft (1-10)?
Differences for low and high satisfaction with supervision (TU Delft wide) in 2014
Standard deviation is 1.47.
Test 2014 (TUD) χ2(1, 657) = 97.8, p < .01
32%
44%
41%
7%
17%
23% 5% 9% 10%
0% 25% 50% 75% 100%
low
high
research is difficult
issues supervision
too busy (research)
too busy (private)
personal
other
no specific
6,3
7,6
0,0 2,0 4,0 6,0 8,0 10,0
low
high
144
5. Cause and Effect
145
5.1 Introduction This chapter will cover how the different categories correlate with each other and secondly what category has the strongest effect on general satisfaction about the whole PhD programme. The overall PhD-programme satisfaction has been measured using one question, answered on a 10-point scale: 1 (strongly dissatisfied) to 10 (strongly satisfied). The following describes what TU Delft and the Graduate School need to do to, in order to improve the results of 2014.
5.2 Correlations The first correlation was made using bivariate Pearson-correlation analysis. All Likert scale items in each category are summarized into one item (e.g. “Working Environment” is the mean of all sub-item Likert scale scores like access to workspace, facilities, software, etcetera).
In this correlation table, it is clear that some items correlate more strongly with each other than others do, the strongest being: Supervision with Project and Planning (r = .65 p < .01) and Supervision with Professional Embedding (r = .54 p < .01). This suggests that Supervision needs most attention to raise the satisfaction score on the other two categories as well.
Correlations on six categories from the questionnaire (TU Delft wide) in 2014
Category
Project& Planning
Prof. Embedding*
Supervision
Doctoral Education
Working Env.
Career Planning
Project& Planning
N
X .45 667
.65 666
.39 665
.44 666
.48 663
Prof. Embedding
N
.45 667
X .54 666
.33 665
.46 666
.25 663
Supervision
N
.65 666
.54 666
X .48 664
.54 665
.44 662
Doctoral Education
N
.39 665
.33 665
.48 664
X .45 664
.44 661
Working Env.
N
.44 666
.46 666
.54 665
.45 664
X .31 663
Career Planning
N
.48 663
.25 663
.44 662
.44 661
.31 663
X
* Questions 5.3, 5.4 and 5.5 were not included in the category.
All correlations are significant at the 0.01 level (2-tailed). All values of .4 or higher are bold.
146
This same analysis was carried out again, but this time the response group was divided into two groups: Dutch and international doctoral candidates.
Correlations on six categories for Dutch doctoral candidates (TU Delft wide)
Category
Project& Planning
Prof. Embedding*
Supervision
Doctoral Education
Working Env.
Career Planning
Project& Planning
N
X .45 195
.67 195
.32 194
.42 194
.43 192
Prof. Embedding
N
.45 195
X .49 195
.3 194
.46 194
.17 192
Supervision
N
.67 195
.49 195
X .45 194
.48 194
.38 192
Doctoral Education
N
.32 194
.3 194
.45 194
X .4
193 .34 191
Working Env.
N
.42 194
.46 194
.48 194
.4 193
X .27 192
Career Planning
N
.43 192
.17 192
.38 192
.34 191
.27 192
X
* Questions 5.3, 5.4 and 5.5 were not included in the category.
All correlations are significant at the 0.01 level (2-tailed). All values of .4 or higher are bold.
Correlations on six categories for international doctoral candidates (TU Delft wide)
Category
Project& Planning
Prof. Embedding*
Supervision
Doctoral Education
Working Env.
Career Planning
Project& Planning
N
X .45 465
.64 464
.42 464
.46 465
.48 464
Prof. Embedding
N
.45 465
X .57 464
.34 464
.48 465
.29 464
Supervision
N
.64 464
.57 464
X .5
463 .58 465
.48 463
Doctoral Education
N
.42 464
.34 464
.5 463
X .48 465
.48 463
Working Env.
N
.46 465
.48 465
.58 465
.48 465
X .36 464
Career Planning
N
.48 464
.29 464
.48 463
.48 463
.36 464
X
* Questions 5.3, 5.4 and 5.5 were not included in the category.
All correlations are significant at the 0.01 level (2-tailed). All values of .4 or higher are bold.
All the correlations in the three tables are positive which means that if a doctoral candidate is more positive about one category (e.g. Supervision), she or he is also more positive on another category (e.g. Project and Planning). The higher the correlation number, the stronger the relationship (it runs from 0.00 to 1.00, from no relationship to a 100% correlation). In the previous example, the same can be said the other way around: a doctoral candidate who is positive about Project and Planning will be more positive about Supervision. However, correlations do not give clues about causality. It is therefore also necessary to carry out a regression analysis.
147
5.3 Regression As this type of analysis implies a cause-effect relation between the items, it is assumed that the six categories are the causes of general satisfaction on the PhD programme. Regression analysis will reveal the relative impact of the categories on satisfaction (as the Beta-value) and the exact amount of influence (B-value). If the cause’s score (measured on a 4-point scale) would be raised by 1, the general satisfaction score would be raised by the B-value (measured on a 10-point scale). This way, it is possible to reveal exactly which categories need most attention to make doctoral candidates more satisfied about their programme.
Analysis
This model fits the data well (F(7, 1513) = 169.14, p < .001) and loosely translated the causal items explain about 44% of the variance in the satisfaction score: R2 = .44. This shows that 56% of the variance in the satisfaction score is explained by other factors than those measured and/or put into this analysis.
Category B Beta t p <
Project Planning .53 .21 7.80 .001
Supervision .51 .19 6.57 .001
Working Environment, Facilities and Teaching .45 .15 5.97 .001
Professional Embedding .33 .13 5.14 .001
Doctoral Education .31 .11 4.68 .001
Career Planning .17 .06 2.68 .01
(Constant) .31 1.34 ns
Project planning turns out to be the most influential factor when it comes to scoring the PhD programme: Beta = .21. The B-value predicts that if this score is raised by one point on its 4-point scale, the score of the general satisfaction of the PhD programme would be raised by 0.53 point on its 10-point scale. The same is true the other way around: if that score would drop by one point, so would the score of the general satisfaction of the PhD programme by 0.53 point.
Practical improvements
If TU Delft wants to work on these first five most influential factors, it needs to be determined which particular factors need work. By testing the influence of the individual items on the general satisfaction about the PhD programme, an estimate on which items are most influential is obtained.
This method is somewhat ‘quick and dirty’. It would be more preferable to use the satisfaction per factor instead of the whole PhD programme. However, since these questions haven’t been asked, this is an alternative to have at least an impression of what topics to work on. The items named per category are the items that have the strongest influence on the B-value of their category.
Project and Planning 4.1 clear overview of project 4.2 promotor motivates me 4.3 daily supervisor motivates me 4.6 progress in line with expectations Supervision 6.11 own input is taken seriously 6.18 get help to expand professional network 6.19 what to expect from supervision
148
6.21 support/help with methodology Working Environment, Facilities and Teaching 8.2 available facilities 83 content of own work 8.4 social relationships at work 8.6 contact with research group
Professional embedding 5.7 sufficient number of experts available 5.8 receiving good support during data collection
Doctoral Education 7.3 enough room for personal development 7.6 supervisors motivates me to participate in courses not directly related to my PhD-project 7.11 the GS offers the right courses to develop my transferable competences and skills 7.12 the PSU contributed to a good start of my project
Career planning 9.9 obtaining my doctorate degree will help me find a job
149