comparative and non comparative evaluation studies

Introduced to: Dr. AlaaDone by: Haitham ALSheyadi 85753 Yousuf ALKaabi 86471

Comparison Item

Comparative studyNon-Comparative study

Study TitleA Comparison of Student Outcomes & Satisfaction Between Traditional & Web Based Course Offerings

Post-Secondary Students’ Purposes for Blogging

Author Julio C. Rivera & Margaret L. Rice

Paul LeslieElizabeth Murphy

TypeLearners’ perception and performance

Non-Comparative

Comparison Item


purpose of evaluation

1)Compare the efficacy of three class formats (Traditional section, web-based section, hybrid section) as well as to learn from the experiencecompared student performance student satisfaction and instructor experiences2.benefits and limitations of the three delivery alternatives.

The purpose of this study is to explore post-secondary students’ purposes for blogging with particular attention to the social and instructional purposes

Comparison Item


ParticipantThe number of students were: 41 in the traditional course section53 in the web based course section 40 in the hybrid course section(Note: all the three sections studied Introduction to Information Systems course)

•9 students of the 2005-2006 group of Foundation year students. •all of whom created a blog to which they made at least one posting. All students are: Emirati citizensFemalesand between 17 and 20 years old (Note: The sample of blogs came from an all-women’s college in the United Arab Emirates. )

Comparison Item


Instrumentsmultiple-choice exams using questions selected by the instructors from the publisher’s test bank ( to evaluate students performance)a researcher-developed questionnaire (To evaluate students satisfaction)Chi square test of independence

Rourke et al. (2001) test to analyze content and assessing social presence.

Gunawardena et al. (1997) model (“explain the process by which construction of knowledge occurred )

interviews .(Look some examples of the interview question)

Comparison Item


ResultsStudent Performance:There was no significant difference in student performance, regardless of the class format(look table 1)Student Satisfaction:students were not completely satisfied with the web based course offering (less technological mastery ,The student instructional experience)Table 2: Teaching EvaluationsTable3: Sign-up for Similar Course in the Future (# Students)

the primary use of blogging was for social purposes. Self-disclosure was the most notable purpose for blogging ,in addition to sharing emotional responses to learning.The lack of teaching nature may have influenced students’ use of blogging for social rather than instructional purposes.

Comparison ItemComparative studyNon-Comparative study

advantages•Students should be informed regarding course delivery methodology and the requirements for student participation•Support for web delivered classes needs to be expanded. Both students and instructors require support.

•Need more focus and use for the blogs for instructional purposes•Encourage teachers to use blog in instructional process

limitations•there is no guarantee that a homogenous cross-section enrolled in each course section•two different instructors taught the three sections. Obviously each instructor would place emphasis on different topics and conduct the class in a slightly different manner

•It is unclear how having mixed-gender classes might have affected the social presence and knowledge construction in which students engaged.

Course Section Exam Score Average

Traditional Class

74.85

Hybrid Class 73.35

Web based Class 73.97

Table 1: Exam Score AverageTable 1: Exam Score Average

Back

Question Traditiona

l Class

Hybrid

Class

Web based

Class

Method of Presentation

Easy to Follow

3.632 3.235 2.419

Improved Understanding

of Concepts and

Principles

3.421 3.059 2.545

Explained Difficult

Material Clearly

3.632 3.059 2.484

Table 2: Student Course Section Selection (# Students)

Back

Section Yes No

Traditional Class 35 3

Hybrid Class 30 4

Web based Class 33 17

Table 3: Student Satisfaction by Class (# Students)

Back

Some of the interview questionsSome of the interview questions::

Why did you select the pictures and images or fonts colours? What motivated you to post? What motivated you to comment on others’ blogs?How useful or not useful were others comments to you?

Back

References:References:

C. , Julio & L. Margaret, “A Comparison of Student Outcomes & Satisfaction Between Traditional & Web Based Course Offerings”, Fall 2002 [Online] Journal of Distance Learning Administration, http://www.westga.edu/~distance/ojdla/fall53/rivera53.html (Accessed: April 30/2008)

Leslie, Paul; Murphy, Elizabeth, “Post-Secondary Students’ Purposes for Blogging”, October 2008. [online] Journal of Distance Learning Administration. Available: http://www.irrodl.org/index.php/irrodl/article/view/560/1099 [Accessed: April 30/2008]

comparative and non comparative evaluation studies

Education