sigcse 2008 presentation

84
A Case Study of Retention Practices at the University of Illinois at Urbana-Champaign Tanya L. Crenshaw, Erin Wolf Chambers and Umesh Thakkar University of Illinois at Urbana-Champaign Heather Metcalf University of Arizona Presented at SIGCSE 2008 | March 15th, 2008

Upload: tanya-crenshaw

Post on 03-Jul-2015

592 views

Category:

Technology


0 download

DESCRIPTION

A Case Study of Retention Practices at the University of Illinois at Urbana-Champaign, published at SIGCSE 2008

TRANSCRIPT

Page 1: SIGCSE 2008 Presentation

A Case Study of Retention Practices at the University of Illinois at Urbana-ChampaignTanya L. Crenshaw, Erin Wolf Chambers and Umesh ThakkarUniversity of Illinois at Urbana-Champaign

Heather MetcalfUniversity of Arizona

Presented at SIGCSE 2008 | March 15th, 2008

Page 2: SIGCSE 2008 Presentation

2

Hi. My name is Tanya.

This is the web version of the presentation I gave at SIGCSE 2008 in Portland, Oregon.

Page 3: SIGCSE 2008 Presentation

This is one of my co-authors:Erin Wolf Chambers.She studies computational geometry.

Page 4: SIGCSE 2008 Presentation

She investigates the properties of geometrical surfaces, with applications to networking and graphics.

The Stanford Bunny and Dragon appear with permission from Stanford’s 3D Scanning Repository

Page 5: SIGCSE 2008 Presentation

5

This is another co-author:Heather Metcalf

Her body of work includes: Human Computer Interaction, Gender Studies, and Higher Education Policy.

Page 6: SIGCSE 2008 Presentation

6

Heather has studied low-fidelity prototyping, and multiple display environments.

Page 7: SIGCSE 2008 Presentation

7

She merges theories from gender studies and human computer interaction to research gender bias in the design of computer interfaces.

Page 8: SIGCSE 2008 Presentation

8

Heather also runs marathons.

Page 9: SIGCSE 2008 Presentation

9

This is my third co-author:Umesh Thakkar

He investigates Cyber Learning and GraduateEducation.

Page 10: SIGCSE 2008 Presentation

10

This includes teaching middle school students about virtual reality.

Page 11: SIGCSE 2008 Presentation

11

Umesh also runs marathons.

Page 12: SIGCSE 2008 Presentation

12

Among the four of us, our work spans a lotof really cool opportunities in computer science.

Page 13: SIGCSE 2008 Presentation

13

Page 14: SIGCSE 2008 Presentation

14

And yet...enrollment in computer science isdeclining.

Page 15: SIGCSE 2008 Presentation

15

Page 16: SIGCSE 2008 Presentation

16

And the faces of computer scientists don’t reflect the faces of our global community.

Page 17: SIGCSE 2008 Presentation

17

Page 18: SIGCSE 2008 Presentation

18

And I’ve watched my own friends drop outof graduate school.

Page 19: SIGCSE 2008 Presentation

19

Page 20: SIGCSE 2008 Presentation

20

Page 21: SIGCSE 2008 Presentation

21

So the four of us did a study of UIUC’s CS department.

We wanted to know how we could improveretention of students...

both undergrad and grad.

Page 22: SIGCSE 2008 Presentation

22

Over 10 months, we surveyed 119 students; we interviewed 20 students. And we learnedsomething:

Page 23: SIGCSE 2008 Presentation

23

To increase retention, we must increase positive interaction.

Page 24: SIGCSE 2008 Presentation

24

This talk is about two of our results.

Page 25: SIGCSE 2008 Presentation

Community Identity: how students identify with the norms of their surrounding community.

We learned that we need to close the gap between the perception and reality of computer scientists.

25

Page 26: SIGCSE 2008 Presentation

26

Community Relationships: how students are connected to their community via community members.

We learned that UIUC needs better mentoring relationships and networking contacts for students to reach their academic and professional goals.

Page 27: SIGCSE 2008 Presentation

27

At the time of our study, this is what UIUC’s Dept.of CS student population looked like:

Page 28: SIGCSE 2008 Presentation

28

Undergraduates Graduates

Total.............................Female........................African American....Latino/a......................International.............

7349.0%1.5%3.8%

10.4%

Total.............................Female........................African American....Latino/a......................International.............

38614.8%

0.5%1.3%

45.3%

Page 29: SIGCSE 2008 Presentation

29

multiple choicequestions

short answerquestions

60 minuteinterviews

Undergraduates Graduates

We used a mixed methodology: survey questions, some short-answer, supplemented by interviews to expand on survey questions.

Page 30: SIGCSE 2008 Presentation

30

We conducted our study in two phases.

Page 31: SIGCSE 2008 Presentation

31

Pilot study. We interviewed four undergraduates and seven graduates hand-picked for breadth of experience.

We wanted to know what they would ask if they were to do a study.

Page 32: SIGCSE 2008 Presentation

32

Second phase. We surveyed on-line 61 undergraduates and 58 graduates. Surveys were supplemented by nine interviews.

Our participants were 17% female and 83% male.

We announced the study to all-female cs groups in the department 1 week before announcing it to everyone else.

Page 33: SIGCSE 2008 Presentation

33

We conducted our study under Institutional Review Board project #06290.

Page 34: SIGCSE 2008 Presentation

34

Community Identity

We wanted to know if students felt likethey identified with their computer sciencecommunity at UIUC.

So we asked them questions like:

Page 35: SIGCSE 2008 Presentation

1. How much do you agree: I fit in at UIUC Department of Computer Science?

2. How does your role as a computer scientist affect your own masculinity and/or femininity?

3. Do you think you are a typical computer scientist? Why or why not?

35

Page 36: SIGCSE 2008 Presentation

1. How much do you agree: I fit in at UIUC Department of Computer Science?

2. How does your role as a computer scientist affect your own masculinity and/or femininity?

3. Do you think you are a typical computer scientist? Why or why not?

36

When we asked them question 3, we did notdefine “typical.” We wanted to know how theydefined it for themselves.

Page 37: SIGCSE 2008 Presentation

37

Across the board, about 30% did not feel typical.

Page 38: SIGCSE 2008 Presentation

38

0102030405060 No

SomewhatYes

“Are you a typical computer scientist?”

%

Graduate(58)

Undergraduate(61)

Female(28)

Male(91)

Total(119)

Page 39: SIGCSE 2008 Presentation

39

Not just the women. Across the board.

Look again.

Page 40: SIGCSE 2008 Presentation

40

0102030405060 No

SomewhatYes

“Are you a typical computer scientist?”

%

Graduate(58)

Undergraduate(61)

Female(28)

Male(91)

Total(119)

Page 41: SIGCSE 2008 Presentation

41

We asked them why not. Some said it wasbecause of how they looked or what they did.

Page 42: SIGCSE 2008 Presentation

“Are you a typical computer scientist?”

“No. I’ve noticed a lot of the people in the major don’t look like me and I’m not particularly enjoying the major at that.”

--male undergraduate

“No. I’m more of a jack of all trades. I like computer science, but my life doesn’t completely revolve around it. I write; I read; I make music; I cook.”

--male graduate

42

Page 43: SIGCSE 2008 Presentation

43

Some said it was because of what they studied.

Page 44: SIGCSE 2008 Presentation

“Are you a typical computer scientist?”

“No, because I do not enjoy the low level intricacies of computer systems. I am more interested in building computer tools that have a direct impact on human life...”

--female graduate

“No. I think we theoreticians are far too ‘math’ to be typical.”

--female graduate

44

Page 45: SIGCSE 2008 Presentation

Community Relationships.

We also wanted to know if students interact with those who can help them become members of the community.

So we asked them questions like:

45

Page 46: SIGCSE 2008 Presentation

1. Do you have a mentor?2. Who is your mentor?3. How easy or difficult was it for you to

get an advisor?

46

Page 47: SIGCSE 2008 Presentation

Total(119)

0

20

40

60

80

100

I do not want one

No

Yes

Undergraduates(61)

Graduates(58)

% “Do you have a mentor?”

47

Page 48: SIGCSE 2008 Presentation

48

We admit it. Not everyone wants a mentor.

But 52% of undergraduates and 26% of graduates who did not have a mentor would like to have one.

Page 49: SIGCSE 2008 Presentation

49

So we asked them why they didn’t have one.

Page 50: SIGCSE 2008 Presentation

“Why don’t you have a mentor?”

“I think I know who I would ask. I feel sort of stupid going up to her and say, I feel I need a mentor, would you be willing?...There is no formal system, which is unfortunate”

--post-qual graduate student

“The last thing the faculty cares about is chatting about my problems. No one would be interested in mentoring me. People here just care about great research, not about mentoring.”

--pre-qual graduate student

50

Page 51: SIGCSE 2008 Presentation

51

We also asked about sources of mentors.

Page 52: SIGCSE 2008 Presentation

52 Graduates(58)

Undergraduates(61)

0102030405060708090

%

0102030405060708090

%

My advisor.

A student in the department.

“Who is your mentor?(check all that apply)”

A faculty member in the department

A faculty member outside the department.

Other.

A student outside the department.

I do not have one.

Page 53: SIGCSE 2008 Presentation

53 Graduates(58)

Undergraduates(61)

0102030405060708090

%

0102030405060708090

%

My advisor.

A student in the department.

“Who is your mentor?(check all that apply)”

A faculty member in the department

A faculty member outside the department.

Other.

A student outside the department.

I do not have one.

Only 11 out of 61 undergraduates reported

having a mentor.

Page 54: SIGCSE 2008 Presentation

54 Graduates(58)

Undergraduates(61)

0102030405060708090

%

0102030405060708090

%

My advisor.

A student in the department.

“Who is your mentor?(check all that apply)”

A faculty member in the department

A faculty member outside the department.

Other.

A student outside the department.

I do not have one.

ouch.

Page 55: SIGCSE 2008 Presentation

Graduates(58)

Undergraduates(61)

0102030405060708090

%

0102030405060708090

%

My advisor.

A student in the department.

“Who is your mentor?(check all that apply)”

A faculty member in the department

A faculty member outside the department.

Other.

A student outside the department.

I do not have one.

55

We noticed that manygraduates had advisors.

And yet...

Page 56: SIGCSE 2008 Presentation

Graduates(58)

Undergraduates(61)

0102030405060708090

%

0102030405060708090

%

My advisor.

A student in the department.

“Who is your mentor?(check all that apply)”

A faculty member in the department

A faculty member outside the department.

Other.

A student outside the department.

I do not have one.

56

Only 49% of graduate students with an advisor

regarded their advisor as their mentor.

Page 57: SIGCSE 2008 Presentation

57

So we asked them why they did not considertheir advisor their mentor.

Page 58: SIGCSE 2008 Presentation

“Why don’t you consider your advisor your mentor?”

“My advisor is only in her thirties. It's not like she's 60 with lots of experiences. When I think of a mentor, I think of some old guy who can pull strings for you to get a job.”

--pre-qual graduate student

“That one conference that I went to, [my advisor] wasn't there. I listened to people's talks, but I couldn't make any connections.”

--post-prelim graduate student

Page 59: SIGCSE 2008 Presentation

59

Based on these results, UIUC is trying to put some retention improvements into place.

Page 60: SIGCSE 2008 Presentation

In an open-ended question, many participants cited increasing student-professor interactions as a way to improve the department:

• undergraduates: 24%• graduates: 31%

60

Page 61: SIGCSE 2008 Presentation

61

Increasing positive interactions lets students meet other people in the community.

Page 62: SIGCSE 2008 Presentation

62

They meet people who are similar and people who are different.

Page 63: SIGCSE 2008 Presentation

63

They identify more with the norms of the community and expand their definition of computer science.

Page 64: SIGCSE 2008 Presentation

64

At UIUC, the undergrads organize an annualevent called “Casino Night.”

Page 65: SIGCSE 2008 Presentation

65

Professors, staff, and members of industry arethe dealers. Students gamble for prizes.

Page 66: SIGCSE 2008 Presentation

66

That’s Jeff Erickson dealing black jack.

Page 67: SIGCSE 2008 Presentation

67

Casino night is cool because students get tointeract with professors in an informal environment.

Page 68: SIGCSE 2008 Presentation

68

It’s only once a year, though. UIUC needs more cool events like these. But UIUC can’t rely entirely on undergraduates to organize them.

Page 69: SIGCSE 2008 Presentation

69

There are other things that can be done toincrease positive interactions.

Page 70: SIGCSE 2008 Presentation

70

One idea is to create multiple, diverse mentoring programs.

Page 71: SIGCSE 2008 Presentation

One example is at the University of Southern California, Dept. of Mathematics.

71

Page 72: SIGCSE 2008 Presentation

Incoming undergraduates and graduates are assigned a “mentoring triplet.”

72

Page 73: SIGCSE 2008 Presentation

That’s one freshman, one grad student, and one professor who have lunch about once a month.

73

Page 74: SIGCSE 2008 Presentation

It’s cool, because people who wouldn’t normally meet are interacting with each other in an informal environment.

74

Page 75: SIGCSE 2008 Presentation

UIUC is trying something similar. Incoming freshman are now assigned mentors from a pool of UIUC alumni

75

Page 76: SIGCSE 2008 Presentation

Another idea for providing diverse mentoring opportunities is to harness existing social networks.

76

Page 77: SIGCSE 2008 Presentation

77

Many UIUC graduate students have signed up to this Facebook group. This lets other students know they are interested in mentoring

Page 78: SIGCSE 2008 Presentation

78

We still have a lot of work to do to improve retention.

Page 79: SIGCSE 2008 Presentation

79

We want to repeat the study at UIUC in a couple of years, after these changes have been put into place.

Page 80: SIGCSE 2008 Presentation

80

We also want to repeat the study at other institutions and see how retentions issues compare across universities, big and small.

Page 81: SIGCSE 2008 Presentation

81

If you want to give us feedback on this work, go to my website:

http://www.kaju.dreamhosters.com

Click on the “blog” tab and leave a comment on the SIGCSE 2008 entry.

Page 82: SIGCSE 2008 Presentation

82

Page 83: SIGCSE 2008 Presentation

83

Or you can just send me e-mail at:

[email protected]

Page 84: SIGCSE 2008 Presentation

84

Thanks.