odessa college case study: improving student …...odessa college case study improving student...

19
ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With TechSmith’s Lecture Capture Platform

Upload: others

Post on 25-Apr-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

ODESSA COLLEGE CASE STUDY

Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With TechSmith’s Lecture Capture Platform

Page 2: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

“Odessa College experienced

more than 10 times the adoption at

one third the cost of our previous

system, all within six months of

introducing TechSmith Relay.”

– Shawn Shreves

VP of IT at Odessa College

Page 3: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

01

“It’s common for online

students to not succeed

at the same levels as

face-to-face students.

Knowing that’s true for us,

we had to do something.”

The SituationWhile forging their blended learning program, Odessa College quickly realized they were facing multiple obstacles. They wanted to transition to an eight-week term – a task in and of itself. At the same time, they wanted to significantly increase student retention.

For the shortened term-length to work, they needed to increase student success

rates not only in their traditional classrooms, but in online courses in particular.

They knew the latter could be a much more difficult task.

“I know it’ s common for online students to not succeed at the same levels as

face-to-face students,” explained Robert Rivas, Executive Director of Innovation

and Research. “Knowing that’s true for us, we had to do something.”

Page 4: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

02

Online communication

felt robotic and de-humanized.

The Challenge One of the big hurdles to growth was their legacy lecture capture system. It was expensive, lacked a sense of direction, and was difficult to use.

The platform was so clunky that faculty had become uninterested in using video –

at all. Across the entire campus, there were only six to eight faculty actively

making videos. “It was a lot of trouble for the instructors to use,” commented

Jennifer Lee, Web Design and Instructional Technology Specialist. “That’s why

they opted not to use it because it was just more trouble than it was worth.”

In addition, their legacy lecture capture system used an enormous amount of

disk space. Because it was self-hosted, it ate up more than its share of energy,

time, and expenses. “It was a resource hog – bandwidth coming in and out of our

network, and raw disk storage,” explained Shawn Shreves, Vice President of IT.

At a cost of $18,000 per year, it clearly wasn’t worth the cost for only six faculty.

“From the 30 ,000-foot view, that’s what caught my attention,” said Shawn.

Deterred from using video, faculty didn’t have any feasible way to add interactive

features in their courses. Online communication felt robotic and de-humanized.

Page 5: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

03

“We realized there

was not a lot of

engagement happening

as far as multimedia.”

“Once we started looking at a lot of our courses, we realized there was not a lot

of engagement happening as far as multimedia – videos, audio, or anything like

that,” said Jennifer. “They were pretty much text, uploaded PowerPoints, maybe

some PDFs. There was really not a lot of video-type engagement.”

Their legacy video platform also didn’t give instructors any way to analyze whether

their students were watching the videos, or not. There was no interaction between

the students and instructors.

Not surprisingly, students were having a hard time retaining the course material

and participating in the course in general. “That was one of the things that we

really wanted to try to increase,” Jennifer explained. ‘We hoped that if we increased

engagement in the courses we would help increase retention and success rates.”

A Quest for QualityOdessa College administrators soon realized that finding a way to assure creation

of engaging, multimedia course content was a central step in keeping students

interested and accountable, especially in online classes. They spearheaded an

initiative to encourage the creation of quality courses on campus.

Formed in the spirit of the Quality Matters guidelines, they set out to develop a

straightforward rubric to review and measure the quality score of each course.

Page 6: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

04

“Relationships matter. Engagement

matters. Those two things almost

matter more than what or how

we’re teaching the students.”

“We wanted to take something that was a little more simplified so our faculty could

get on that level and make sure they were meeting the basic requirements,”

explained Jennifer. “We’ve seen some very detailed [rubrics] and knew that would

be really overwhelming.” Instead, they set out to focus their own program on a few

key elements, hoping to center faculty’s attention on the things that mattered most.

They began by looking at what elements were working for traditional students,

to see if they could translate that to help with online students. As part of the overall

engagement effort, Odessa College was already focusing on three main goals for all

students across campus:

1 Enhance the student-instructor relationship.

2 Increase student engagement across all course types.

3 Increase student success rates and retention.

They knew that creating more connection and providing a quality experience online

was essential, particular to the second goal. Robert explained: “We have so much

data at the college from before we started doing this with our online courses that

relationships matter. Engagement matters. Those two things almost matter more

than what or how we’re teaching the students. The data is the same across all of

our instructors, all of our different disciplines.”

Page 7: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

05

“We were looking for different tools that would

let the faculty use their creativity and provide

better analytics for student information.”

In addition to requirements for rich multimedia and interaction online, the rubric

also clearly laid out concrete ideas on how to build relationships with online

students. “If we know what works and we don’t try to do it for our online students,”

said Robert, “we’re just doing our students a disservice. They were struggling.”

Given their inadequate lecture capture system, Odessa College knew that getting

better technology would be crucial to their overall initiative. Shawn knew their

video platform wasn’t working for them. Instead, he wanted something that

would not only help instructors enhance face-to-face classes within their Learning

Management System (LMS), but would provide insight into student participation.

“W e were looking for different tools that would let the faculty use their creativity

and provide better analytics for student information,” said Shawn.

Implementing a New PlatformOdessa adopted TechSmith Relay as their video platform for lecture capture,

which offered interactive features that integrated with their LMS – a key component

to their overarching initiative, as well as ways to measure learning outcomes.

Given the widespread aversion to the old system, their first task was to assure

faculty that the new platform was a much better way of doing things.

Page 8: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

06

“When you get a good tool like

TechSmith Relay, it spreads naturally.”

“One of our biggest challenges was that we had to convince them that this wasn’t

some horrible monster – that it was easy to use, it was convenient to use, and it

would improve their classes,” Jennifer explained.

Upper management proactively offered training camps during professional

development weeks before the semester began. The idea of a ‘better way to do

this’ caught on with instructors, and soon they were willing to learn the ropes.

“There ’s going to be certain faculty that lead the herd, if you will, that everyone

else is going to follow,” said Shawn. “It’s kind of a virus that spread, in a good way.”

The trainings showed how simple Relay is compared to their previous platform,

and encouraged instructors to make the switch. “It is just so easy to use compared

to [our old platform] Tegrity. You hit the record button, you get the link, and it’s done,”

said Shawn. “When you get a good tool like TechSmith Relay, it spreads naturally.”

Unlike the old system, faculty were now able to record and manage video

content from their own devices. “The flexibility for being able to add video media

is great, and it’s really easy,” explained Jennifer. “All you have to do is install the

desktop recorder, or you have the Fuse app on your phone, and you’re good

to go. And training is really simple.” Relay also granted peace of mind, since it

copyrights and protects content, preventing it from be shared on non-sanctioned

avenues such as YouTube.

Page 9: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

07

They started asking

faculty to focus on high-

engagement strategies

with their online students.

Because TechSmith Relay is so intuitive, word of mouth played a big role in

spreading adoption, with instructors showing each other how it works. “We have

some faculty jumping in and helping as well, because they kind of get excited about

it and say ‘Ooh, look how easy this is,’” remarked Jennifer. “It’s been nice to have our

faculty get excited about it and want other faculty to know how to do it, too.”

Results & ROIHaving the right organization-wide video creation solution was the underlying foundation Odessa College needed to increase the student-instructor connection in their online programs. Now, it was up to instructors to put those rubrics into practice.

Expanding the Drop-Rate Improvement Program already in place for face-to-face

courses to their online offering, they started asking faculty to focus on high-

engagement strategies with their online students. “Get to know your students.

Talk to them by name, meet with them all the time, tell them that you care, that

they’re real people,” explained Robert. “We were just looking to see if we could

get more students to stay in our classes. It was surprising, because we did. What

was most surprising is our [online] students started succeeding at higher rates.”

Page 10: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

08

“We want them to know

that there’s actually

another person on the

other side of the screen.”

According to Robert, the focus of these guidelines were what helped it succeed.

“W e asked our faculty to just try four things. It wasn’t ‘You have to do this.’ It wasn’t

‘Change everything you’re teaching, ’ it was just ‘Try these four things’.” Since

faculty were already accustomed to getting to know face-to-face students, they

were ready to try it with online students, too. “Most faculty were eager to jump in

and start doing that.”

Rules of EngagementIn addition to guidelines about how to include interactive content in courses,

they asked instructors to create videos that help build a personal connection,

even when a student is long-distance. “We ask them to do an introduction of

themselves because we want it to feel more personal to the students,” said

Jennifer. “We want them to know that there’s actually another person on the

other side of the screen.”

‘Navigation videos ’ are another requirement, to help students get oriented with

the course expectations and those of the instructor. “For a student who has

never taken an online course before, and is really afraid - asking things like

‘I don ’t know where my assignments are, where to find my grades’ – we ask the

instructor to do a quick little walk-through of the course,” said Jennifer.

Page 11: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

09

More than 90% of

students who sign up

for classes at Odessa

College actually complete.

They found that personalized videos were helping to enhance blended

classrooms, too. For lab-based hybrid courses, having access to online content

at home gave students more of a foundation to interact with their instructors

when they met face-to-face. It also gave instructors another way to connect with

students. “A nursing faculty put the app on her phone. She said: ‘Students can’t

find my office. Let me walk you to it.’ It was different, but people loved it because

it showed she’s a real person,” Shawn explained. “It made it personal.”

The focus on relationships began to show results, first with participation. “As soon

as you build that personal connection, you get their attention a whole lot better.”

said Shawn. “That shows up in all of our analytics.”

More than 90% of students who sign up for classes at Odessa College actually

complete, with close to 85% earning a ‘C’ or higher. “Most students are not only

sticking with us but are doing better,” commented Robert. ”As we started to focus

on those relationships we’ve seen continuous improvements in those two areas.”

Efficiencies in Teaching and AdministrationHaving an easy way to create and share videos within their LMS helps instructors

have more productive time in class by giving students important class content

ahead of time. “When we were in college, you went in, you got the syllabus, met

the instructor and then, ‘Thank you, have a nice day’. We need that time now,”

Page 12: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

10

Video communication is a

great way to connect for

staff-related training and

professional development.

explained Shawn. “We’re encouraging faculty to get the students trained – before

they even go into class they’re already logged into BlackBoard. They skip all

the frivolities, and the first day of class is a functioning time. It’s what we used to

consider the second or third day of class, back in the old days.”

Additionally, faculty are finding new efficiencies in how they teach, now that they

have a simple way to create and share videos; similar to team-teaching, except

voluntary and informal. “If we have one English instructor who really likes talking

about grammar, they can make a video on grammar and share it in that master

course so that all ten instructors who teach it can use the same video,” explained

Jennifer. “We’re trying to reduce the amount of work they have to do and still

share learning objects. A lot of our nursing instructors all share videos because

they all teach the same courses, but they’re in different locations. One might have

a really good module on newborn infant care, and they decide they want to use it

both on campus and at the Andrews center. It makes it a lot easier on them.”

Odessa College is also finding that video communication is a great way to

connect with faculty who aren’t in the area, for staff-related training and

professional development. “Many of our adjuncts aren’t local in Odessa,

they are all over the United States,” explained Jennifer. “It’s easier to reach

adjuncts with video – record workshops and put them in BlackBoard.”

Page 13: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

11

Instructors can now track

student data to find

strengths and weaknesses.

Actionable AnalyticsEven better, instructors can now track student data to find strengths and

weaknesses. They are able to provide quick responses to students, follow

along with their performance, and guide them in the right direction.

Instructors use data analytics to measure participation, especially in online

courses. “If they’re not there, we can’t teach them,” said Robert. “They can’t learn

anything.” Beyond participation, real-time data helps identify at-risk students by

monitoring their viewing percentages prior to major exams. These analytics are

key to identifying students who aren’t participating, early on, with enough time

to make a difference. “We need to know when those students are struggling,

when they’re not watching a video, or when they blow a quiz in BlackBoard,”

said Shawn. “All that data just gives us more information so we can provide a

much quicker response, so we can grab them by the hand or the neck, as the

case may be, and get them back on track.”

The analytics were a crucial part of tracking their efforts. “We can see the

achievement of our students improved rapidly since we implemented that

program,” said Robert. “Online success improved more rapidly than for

students in the classroom.”

Page 14: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

12

In courses with dense

content and a rigid

schedule, video has

really helped keep

everything on track.

Thomas Crawford, a biology professor at Odessa College believes in the

analytics that TechSmith Relay offers by observing the correlation between the

engagement level and performance of the students. He meets with each student

in his class to analyze how they can improve and be successful in the course.

“If you can’t measure it, you can’t change it. If we can catch those students not

watching the lectures, we pretty much can predict that grade before the exam ever

gets there. That’s something we have used TechSmith Relay for exclusively, is

pulling the analytics to see exactly which students are watching, how often they’re

watching, and the percentage of the recordings they watch.”

A Successful Transition to Eight-Week TermsWith instructors on board creating quality interactions through the new lecture

capture system, Odessa College successfully switched to eight-week terms, while

increasing completion rates and retention. Jennifer explained the role technology

integration played in that transition. “A huge component of being able to maintain

the rigor of those courses – still offer the same content and meet the outcomes

– was that we had to have a way to give our lecture content inside a learning

management system so they could spend more time in class discussing and

working on assessments.”

Especially in courses with dense content and a rigid schedule, video has really

helped keep everything on track.

Page 15: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

13

“Having the video ability was really big.

Especially for our biology program,

and some of our science and nursing

programs; they use it quite heavily.”

“Having the video ability was really big, ” said Jennifer. “Especially for our biology

program, and some of our science and nursing programs; they use it quite

heavily. That was a really big deal for the transition to eight-week.”

The eight-week term now allows for more hybrid courses to be offered, which

has helped attract more students, particularly the growing number who are in the

midst of a very busy time in their lives, balancing work schedules or childcare. Having

flexible options outside of regular school hours – and in any location – give these

students options to put in the time needed to successfully reach their degree.

Cost Savings and Student OutcomesAs an added benefit, Odessa College has seen considerable savings on IT and

staff costs since using TechSmith Relay.

“ Odessa College experienced more than 10 times the adoption at one third the

cost of our previous system, all within six months of introducing TechSmith Relay,”

said Shawn. “It’s not self-hosted, so it’s resources my staff doesn’t have to deal

with. From the IT perspective, it’s hands-off. We don’t have to back it up, we don’t

have to store it, or buy the tapes. It’s very cost-effective, with students and faculty

both using it and engaging more than they ever did with the previous platform.”

Page 16: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

14

TechSmith Video Media Views

During the first year of implementation, utilization increased significantly. Media views for classes at

year one were 36,627 and

by the end of the third year

have more than doubled

to 75,978.

Odessa College Course Withdrawal Rates

8%

9%

6%

4%

2%

7%

5%

3%

1%

Year 1 Year 2 Year 3

0%

6%

8%

5%

4%

5%

3%

Web

F2F/Hybrid

Student retention and performance improved. Withdrawal rates for web

courses dropped from 8% to 5% and hybrid courses

decreased from 5% to 3%.

Odessa College Course Success Rates

80,000

60,000

40,000

20,000

70,000

50,000

30,000

10,000

Year 1 Year 2 Year 3

0

36,627

67,89175,978

Media Views

Year 1 Year 2 Year 3

66%

72%

78%

68%

74%

80%

84%

70%

76%

82%

86%

77%

72%

75%

84%

82%

84%

Web

F2F/Hybrid

Course success rates

jumped from 72% to 75%, with students receiving a

C or better in the course.

For hybrid and face-to-face

courses, success rates

increased from 82% to 84%. Students enrolled in

an online lab had scores

11-14% higher than students

enrolled in just a face-to-face

classroom lab.

Page 17: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

15

Odessa College received

the Rising Star award for

doubling graduation and

transfer rates, and rapidly

improving student completion.

Getting NoticedOdessa College soon found that others were noticing the improvements they had made to student engagement.

They were identified as a 2017 Aspen Award top-ten national finalist out of

1,200 schools. “We were identified based on our numbers and success rates,”

explained Shawn. “All of a sudden we were in the top ten, based on the data.”

The award process is disciplined and well-respected. “There are some very

detailed metrics where you have to show the numbers – student retention,

student performance. You have to show them that we are on the right track.”

Odessa College received the Rising Star award for doubling graduation and

transfer rates, and rapidly improving student completion. “We were very honored to

get that award, being the new kid on the block and still making it into the top five.”

Page 18: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

16

“We did it. Other colleges

can do it, too.”

– Shawn Shreves

VP of IT at Odessa College

Looking Forward Now, Odessa College is continuing to improve their quality rubrics and engagement program, as well as extending their reach to more students and doing more flipped learning.

“The prize has never been about winning the prize ,” explained Robert. “What the

Aspen prize does is it looks at colleges who are doing something that can move

the needle and help us to do more. We want to get to the point where 60% of all

Texans between 25-35 have college credentials.”

Instructors at Odessa College are working toward integrating the flipped

classroom approach where the students learn course material through lecture

capture on their own time, then use valuable face-to-face time during class for

group discussions, activities, and similar higher-order learning.

Now, Odessa wants to share what they’ve learned with other colleges. “We’ve

been getting schools who want to come out and visit. We’re starting to look at

organizing a two-day workshop so that everyone can come at the same time.”

As much as possible, Odessa wants to let other colleges know that better student

engagement can be accomplished, regardless of other factors. “We did it,” said

Shawn with a smile. “Other colleges can do it, too.”

Page 19: Odessa College Case Study: Improving Student …...ODESSA COLLEGE CASE STUDY Improving Student Engagement and Retention with Video Keeping The Human Element In Blended Learning With

The higher education video platform you’ll actually use.Better adoption • Better engagement • Better results

Contact TechSmith Sales:

+1.517.381.5901 | +1.888.750.0685

https://www.techsmith.com/techsmith-relay.html