teaching with lecture or debate? testing the effectiveness

18
Please note that this is an author-produced PDF of an article accepted for publication following peer review. The publisher version is available on its site. [This document contains the author’s accepted manuscript. For the publisher’s version, see the link in the header of this document.] Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction Mariya Y. Omelicheva and Olga Avdeyeva Paper citation: Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603- 7, 2008. Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

Upload: others

Post on 23-Dec-2021

5 views

Category:

Documents


0 download

TRANSCRIPT

Plea

se n

ote

that

this

is a

n au

thor

-pro

duce

d PD

F of

an

artic

le a

ccep

ted

for p

ublic

atio

n fo

llow

ing

peer

revi

ew. T

he p

ublis

her v

ersi

on is

ava

ilabl

e on

its

site

.

[This document contains the author’s accepted manuscript. For the publisher’s version, see the link in the header of this document.]

Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active

Learning Methods of Instruction Mariya Y. Omelicheva and Olga Avdeyeva

Paper citation: Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active

Learning Methods of Instruction

Mariya Y. Omelicheva & Olga Avdeyeva

Lecture is, arguably, the oldest known instructional technique used in the university setting.

Since it was first employed in Plato’s Academy, lecture has become an indispensable part of

teaching favored across the college and university curriculum. Recently, this time-honored

method of instruction has come under attack for its presumed inability to foster higher order

cognitive and attitudinal goals (Cashin 1985; Day 1980; Frederick 1999; Renner 1993). Critics of

traditional lecture-based formats call for their replacement with active learning approaches that

provide students with an opportunity to meaningfully talk, interact, write, read, and reflect on the

content, ideas, and issues of an academic subject (Meyers and Jones 1993, 6).

Shall we cut back on lecturing in favor of novel “active” methods of instruction? Are

lectures less effective than active learning techniques in promoting students’ learning? This study

compares student learning in traditional lecture and debate formats. Educational debate is an

active learning strategy designed to engage students in the practice of important cognitive skills,

such as critical thinking and deliberation, among others (Bonwell and Elison 1991; Scannapieco

1997). Developing these skills and shaping learners’ attitudes toward divisive topics is widely

assumed to be the greatest educational value of debate (Bauer and Wachowiak 1977; Brembeck

1949; Budesheim, Lee, and Lundquist 1999; Combs and Bourne 1994). There is, however, a lack

of compelling evidence linking debates to improved student learning (Hill 1993; Nandi et al.

2000).

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Much of the research on the educational value of debate assesses the performance of

students enrolled in argumentation courses, or those involved in formal debate tournaments.

Since these analyses extend over a long period of time, during which debaters experience a

medley of influences on their thinking, isolating the impact of debates on student learning has

proven problematic. The attraction of students with high cognitive abilities to formal debates

hindered the establishment of an irrefutable causal link between participation in debates and

improved critical thinking (McGlone 1974, 140). The dearth of scholarship comparing debates

with other instructional techniques, and problems with the measurement of learning outcomes,

have undermined the quality of empirical findings (Antepohl and Nerzig 1999, 107).

Furthermore, since the majority of past studies have analyzed debating students but drawn

conclusions about the impact of debates generalized to all students, to date no research has

convincingly demonstrated whether and how educational debates contribute to the learning of

both debaters and non-debaters.

Our research analyzes the immediate effects of debating on the well-defined levels of

student learning and compares the impact of debates on the students’ higher order cognitive

skills to that of traditional lectures. To do so, we conduct a classroom experiment which exposes

students to both debates and lectures over the course of the study. We also develop improved

measurements of students’ cognitive skills and learning. These skills - knowledge of factual

information, comprehension of complex concepts, the higher level cognitive skills of application

and evaluation, and affective learning - encompass the majority of levels of intellectual behavior

important in learning (Bloom 1956; Krathwohl, Bloom, and Bertram 1973).

The Effect of Lectures vs. Debates on Student Learning

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

The persistent popularity of the lecture-based teaching model among teachers has been attributed

to its efficiency as a method for instruction. It is inexpensive, since one instructor can teach a

large group of students, and familiar to students and teachers alike. Lectures are effective in

covering large chunks of the material quickly, and can be easily adapted to fit the needs and

interests of a particular audience (McKeachie 1986). It is for its assumed ineffectiveness as a

method for student learning that lecture fell into disrepute among educators. Lecture’s strength,

“speed teaching and learning,” is also one of its major weaknesses as this type of presentation

leaves little room for fostering important intellectual virtues (Paul 1999, 128). Green and Dorn

(1999, 60) find that when students take an alienated and superficial approach to learning, as they

often do in lecture, the result is short-term memorization of lecture content.

Thus, the memorization of information, or the transfer of basic knowledge, is the only

learning outcome that has been attributed to lecture (Antepohl and Herzig 1999; Nandi et al.

2000). The lecture format is conducive to direct reproduction of information laid out by the

instructor. Since the lecturer has maximum control over the flow of information, and is able to

provide students with precise, up-to-date, and not otherwise available information more

effectively than debaters, who may deliberately or inadvertently misrepresent or omit data, we

expect that lecture will be more effective than educational debate in transmitting factual

knowledge to students.

Many educators contend that lectures are ill-suited for fostering higher order cognitive

skills. Comprehending complex material, for example, requires the ability to connect several

components of a phenomenon in a logical and meaningful way. It requires greater student

engagement with the material and more “mental energy” than students typically expend in a

traditional lecture mode, unless the lecture is accompanied by discussion, short papers, etc.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

(Renner 1993; Ruyle 1995). Subsequently, we expect that lectures will be less effective than

debates in fostering students’ understanding of complex concepts.

Lectures also do not excel in fostering the skills of application, analysis, and evaluation.

In a lecture class, students are passive learners, engaged in extensive note-taking. This format of

instruction enhances students’ ability to memorize and reproduce the presented information

directly without examining and analyzing it. Educational debate, on the other hand, can help

students learn how to formulate clear, precise, and logical arguments. The latter is one of the

most complex cognitive tasks as it requires research, analysis, synthesis, organization, and

evaluation of information (Puchot 2002). In debates, students often invoke real-life examples to

corroborate their theoretical arguments. Motivated to persuade the audience to their side,

debaters can appeal to familiar practices to make their arguments relevant to students’ lives.

Therefore, we expect that debate will surpass lecture in promoting students’ skills of application.

Participants of debates are encouraged to weigh facts, compare arguments from various

perspectives, generalize, and reveal fallacies in their own positions and in arguments of their

opponents. For this reason, we expect that, compared to lectures, debates will better facilitate

students’ evaluation skills.

Effective learning is impossible without engaging students’ emotional side—their

attitudes, feelings, preferences, and values. Learners who have no desire to acquire and use new

knowledge cannot obtain an in-depth understanding of the complex issues and transferable skills

of well-reasoned thinking. For the purpose of this study, we tested the impact of lectures and

debates on three affective components of learning: students’ interests, concerns, and attitudes

toward the subject of a lecture or debate.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Some scholars argue that lecture is an effective way of communicating the intrinsic

interest of the subject matter (Cashin 1985, 54; Frederick 1999, 63). Others contend that lecture

experiences are “boring, irrelevant, and not useful” (Renner 1995; Nandi et al. 1999). Debates,

on the other hand, often generate a highly-engaged learning environment. Many students rate

debates highly both for their ability to enhance learning and for the personal enjoyment they

derive from participating in them, and some report important attitude changes attributed to the

debate format (Bauer, Gene, and Wachowiak 1997; Budesheim and Lundquist 1999; Green and

Klug 1990). Consequently, we expect that debates will generate higher interest and greater

concern with the debated topics than will lecture, and that students will be more likely to change

their points of view following a debate than after a lecture.

To recapitulate, we believe that lecture is an effective method to disseminate factual

knowledge, but inappropriate for developing high-level cognitive skills. We expect that students

who are presented with the material in the debate format will have a better understanding of

complex issues, and will demonstrate better application and evaluation skills than those students

learning from lectures. Further, we hypothesize that students who participate in the debate format

will be more engaged with the subject matter than will students who participate in the lecture

format.

Research Design

Overview. To examine the comparative advantages of lectures and debates in fostering student

learning, we conducted an experiment. The participants were 60 undergraduates (27 females and

33 males) enrolled in introductory political science courses at a large public research university.

The data were collected during fall 2005 and spring 2006 semesters in two classes.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Our research was conducted in the classroom setting. We selected six controversial topics

from the classroom curriculum taught by one of the researchers. The topics were reformulated

into questions with two opposite and well-documented positions. In the first class, topics 1, 3,

and 5 were presented using debate format; topics 2, 4, and 6 were presented in lecture format. In

the second class, we switched the formats and presented the first trio of topics using lecture, and

the second trio using debate. Both lectures and debates were structured similarly. At the

beginning of a class meeting, an instructor (one of the researchers) posited a question and

summarized the opposite perspectives on the raised controversy. Then, students were offered a

brief questionnaire (a pre-test questionnaire) asking about their degree of interest, level of

concern, and attitudes toward the topic.

Following this introduction, in the debate sections, two teams—a pro and a con team—

had to defend opposite sides of the topics; in the lecture sections, the instructor presented,

defended, and challenged the topics’ contrary positions. In the debate sections, the teams were

required to conduct a thorough analysis of the debate topics and prepare arguments in defense of

their own positions and in refutation of those of their opponents. In the lecture sections, the entire

class received reading assignments, but only the instructor carried out additional research of the

pertinent literature.

To ensure every student’s direct involvement with the debates, we took a pre-debate poll

of students’ opinions on the debated issue and assigned students the role of debate judges. At the

end of each debate session, students were asked to vote for the team that was able to better

defend its position on the issue. Another strategy for involving the non-debating students was

through the Q&A session. Questions from the audience, during which the non-debating students

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

could request the debaters to clarify their arguments, present additional evidence, or consider

alternative approaches to the issue at hand, was the lengthiest segment of debate.

At the end of the class meeting, the students were administered the same questionnaire (a

post-test questionnaire) tapping into their interests, concerns, and attitudes toward the topic. In

addition, students had to answer six questions that we used to measure learning outcomes.

Measurements of Learning Outcomes. We conceptualize learning outcomes as students’

knowledge of factual information, comprehension of complex concepts, and higher order

cognitive skills of application and evaluation. Knowledge, the simplest cognitive skill, involves

recall and recognition of dates, events, places, or major ideas (Bloom 1956). To measure

students’ knowledge of the topic we offered them three multiple-choice questions. Students had

to choose a correct place, date, or name and recognize a perspective on the debated issue. For

each correct answer a student earned 1 point. We added the points to form a 3-point scale.

Comprehension of concepts is characterized by an ability to grasp and explain their

meanings in one’s own words (Bloom 1956). For every topic, we picked one key concept and

asked students to explain what it means. We identified the core elements of each concept and

evaluated students’ responses against this definitional template on a 5-point scale.

Application is a higher order cognitive skill that enables students to see how the acquired

knowledge can be relevant to situations not discussed or considered in class. To measure

students’ ability to apply the learned material, we developed hypothetical scenarios describing

real-life problems within the scope of the debated topics and asked students to devise informed

solutions to those problems. For each scenario, we identified five elements of an “ideal”

(educated) solution and used this template to gauge students’ responses on a 5-point scale.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Critical evaluation, the most complex cognitive skill, consists of making judgments

based on reasoned argument. It encompasses an ability to derive conclusions, justify and verify

decisions, and think without bias and prejudice. To measure students’ skills of evaluation, we

formulated an argument representative of one position on the discussed issue and asked students

to respond to the argument from the same or a different perspective. These evaluation tasks

tested students’ ability to trace an argument to one of the opposite viewpoints, deduce

conclusions from an approach to the problem, and justify the answer. The evaluation exercises

also required students to resist individual biases and preferences. We identified standards for

successful completion of each evaluation task and graded students’ responses on a 5-point scale.

Appendix I contains sample templates that we used to evaluate students’ skills of

comprehension, application, and evaluation in one of the lectures.

We also examined the impact of lectures and debates on students’ level of interest,

concern, and attitudes on the topics under consideration. To measure students’ interests and

concerns, we used 5-point Likert scales with 1 indicating no interest or concern, 3 indicating a

neutral point, and 5 indicating the presence of interest or concern. To measure students’ attitudes

toward an examined question, we asked which of the two positions they supported, or whether

they were undecided on which side to take. For the final analysis, we subtracted the post-

lecture/debate ratings of interests, concerns, and attitudes from the pre-lecture/debate ratings.

The positive scores indicate an increase in the students’ interests and concerns, or change in the

attitudes following a lecture or debate.

Results. All students’ responses were combined into a large sample consisting of 180

cases with students’ scores recorded after six debates, and 180 cases with students’ scores

recorded following six lectures. We used the runs (Wald-Walfowitz) test procedure to examine

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

whether our data violated the assumption of randomness. Since the runs test demonstrated that

the order of values of the dependent variables was irrelevant, and the data largely satisfied the

assumption of normality, we used the Independent Samples t-test to examine the impact of

lectures and debates on the described learning outcomes. Table 1 contains the results of the t-

tests.

Our expectation that lecture students would score higher on factual knowledge was

somewhat supported by the data. The average knowledge scores from lectures (M=2.42) were

higher than the average knowledge scores from debates (M=2.29), and the difference between

the two groups of scores is statistically significant at the .10 level. Substantively, however, the

difference is rather small, 0.13 or 4.3% on a scale of 0–3.

Debate students received higher comprehension scores than lecture students (M=2.09 for

lectures, M=2.67 for debates, t=-4.53, p=0.000). The average difference is 0.58 on a 5-point

scale, equivalent to 11.6%, or a whole letter grade. In line with our expectations, the average

scores on students’ application and critical evaluation skills were also higher for those students

who learned from debates instead of lectures, and these results are statistically significant at the

.05 and .01 levels. It is important to note, however, that substantively, both the debate and lecture

application and evaluation scores were disappointingly low. The means of the application scores

were only 1.91 for lectures and 2.19 for debates, and the means of the evaluation scores were

1.47 for lectures and 1.91 for debates, all measured on a 5-point scale. These data imply that

neither lectures nor debates seem to excel in developing higher order cognitive skills.

Table 1. Independent Samples t-tests of Cognitive Skills

Dependent Variable

Teaching Format

Means of Scores

T P N

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Knowledge Lecture Debate

2.42 2.29

1.37 P > t = 0.085 147 164

Comprehension Lecture Debate

2.09 2.67

-4.53 P < t = 0.000 146 164

Application Lecture Debate

1.91 2.19

-1.80 P < t = 0.036 145 164

Evaluation Lecture Debate

1.47 1.91

-3.49 P < t = 0.0003 145 163

To examine the impact of instructional methods on students’ affective learning, we used

the two-sample Wilcoxon rank-sum test to examine whether there are differences in the degree

of change in students’ interests, concerns, and attitudes caused by their exposure to different

modes of instruction. We opted for a nonparametric test because the distribution of differences in

scores failed to satisfy the assumption of normality. The Wilcoxon test is performed on the

absolute values of differences between the two test variables. These differences are referred to as

ranks. Negative ranks indicate differences below 0, positive ranks indicate differences above

zero, and ties indicate when differences equal zero. In our case, negative ranks mean all those

instances in which lectures generated higher interest and greater concern in students than did

debates, whereas positive ranks indicate the cases in which students’ interests and concerns

increased more following the debates than the lectures. Table 2 reports the results of the

Wilcoxon tests.

Since the number of negative ranks is greater than the number of positive ranks on the

variable of interests, lectures in our study stirred more student interest in the topics presented by

the instructor than did debates. However, this difference is not statistically significant. The

analysis reveals significantly higher numbers of positive ranks on the measure of students’

concerns. This finding shows that students’ concern for the issue increased more following the

debates than the lectures. Consistent with our expectations, debates impact students’ attitudes

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

more than lectures. A greater number of students changed their position on the issues discussed

in the class following debates than following lectures, a finding significant at a .05 level.

Table 2. Two-sample Wilcoxon Rank-sum Test of Affective Skills

Variable

Compared Scores

Negative ranks N

Positive ranks N

Ties

Z

Asymp. sig. (2-tailed)

Interests Post/pre lecture ratings –post/pre debate ratings

30 24 65 -0.20a

0.84

Concerns Post/pre lecture ratings –post/pre debate ratings

22 36 60 -2.21a

0.027

Attitudes Post/pre lecture ratings –post/pre debate ratings

10 16 61 -1.95a

0.05

a. Based on negative ranks

Discussion of Findings

The empirical analysis largely supported our expectations of the impact of lectures and debates

on student learning conceptualized as the knowledge of facts, comprehension of complex

concepts, production of higher order cognitive skills of application and evaluation, and

engagement with the subject matter. The tests demonstrated that in our classes students acquired

better comprehension, application, and critical evaluation skills when a controversial topic was

taught in the debate format. With regard to basic knowledge, lectures better facilitated students’

memorization, recall, and recognition of information, however, this finding was only significant

at the .10 level.

Although students’ application and evaluation scores were higher after debates than after

lectures, neither lectures nor debates excelled in promoting students’ application and critical

evaluation skills in our classes, as demonstrated by low ratings of student responses to the

application and critical evaluation tasks. To facilitate students’ application skills, instructors

must focus part of their teaching on practicing the transfer of the acquired knowledge to novel

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

situatiotions.. Furthermore, if we want our students to practice higher order cognitive skills, we

must ensure that they are capable and motivated to carry out these complex intellectual tasks.

The former can be accomplished by developing and discussing criteria for making well-reasoned

judgments, communicating the instructor’s expectations to students, and explaining how those

expectations can be met. Students are typically more motivated to invest their intellectual energy

in solving complex problems when they know that their work will be graded, and when they

have sufficient time to complete intellectual tasks. Since we did not grade students’ responses,

they may not have been motivated to think in a highly reasoned way. Instead, students may have

been motivated to arrive at quick solutions in order to finish by the end of the class.

With regard to emotional involvement with the subject matter, to our surprise, lectures

triggered greater interest in students, but this result was statistically insignificant. It is well

known that enthusiasm breeds interest. The increase in student interest in the lecture class could

be a result of the instructor’s enthusiasm for the topic. Debates, on the other hand, encouraged

students to reevaluate their positions and change their attitudes toward the discussed issues. It is

important to note that our students were repeatedly reminded that winning the debate was not its

purpose. The instructor admonished debaters against propagandizing for their position. The

students were aware that their presentations were to be evaluated on the quality of reasoning and

empirical and theoretical support for the arguments. Therefore, we believe that the change in the

students’ opinion occurred largely due to the deliberation accompanying the debates.

The findings of this study confirm that the traditional and active learning methods of

instruction can produce different learning outcomes. Lectures can be used for promoting basic

knowledge of the subject material. Debates appear to be more effective in developing students’

comprehension of complex concepts and application and critical evaluation skills. A combination

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

of both the conventional and active-learning curricula may provide the most effective training for

undergraduate students. We wish to emphasize, however, that debates are not the only way to get

students to think more critically and analytically, and they, perhaps, are not the most effective

active learning strategy for improving students’ critical thinking. The most effective instructional

curriculum has yet to be found.

From a methodological perspective, ours was not a true experiment in that the subjects

were not assigned at random to the lecture and debate treatments. We have tried to rule out the

effects of several potential sources of bias. For example, the distributions of students by year in

college, gender, and major field were similar between the classes. We found no significant

impact of the order in which we administered lectures and debates over the course of the study

on student learning. We also calculated the power of the study to ensure that we did not miss a

possibly relevant influence, other than the teaching format, on the groups.

References

Antepohl, W., and S. Herzig. 1999. “Problem-Based Learning versus Lecture-Based Learning in

a Course of Basic Pharmacology: A Controlled, Randomized Study.” Medical Education (33):

106–13.

Bauer, G., and D. Wachowiak. 1977. “The Home-Court Advantage: A Debate Format for the

Teaching of Personality.” Teaching of Psychology 4(4): 190–3.

Bloom B. S. 1956. Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain.

New York: David McKay.

Bonwell, C., and J. Eison. 1991. Active Learning: Creating Excitement in the Classroom. AEHE-

ERIC Higher Education Report No.1. Washington, DC.: Jossey-Bass.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Brembeck, W. L. 1949. “The Effects of a Course in Argumentation on Critical Thinking

Ability.” Speech Monographs 16: 177–89.

Budesheim, T. L., and A. R. Lundquist. 2000. “Consider the Opposite: Opening Minds Through

In-Class Debates on Course-Related Controversies.” Teaching of Psychology 26(2): 106–10.

Cashin, W. E. 1985. Improving Lectures. Manhattan: Kansas State University.

Combs, H. W., and S. G. Bourne. 1994. “The Renaissance of Educational Debate: Results of a

Five-Year Study of the Use of Debate in Business Education.” Journal on Excellence in College

Teaching 5: 57–67.

Day, R. S. 1980. “Teaching from Notes: Some Cognitive Consequences.” In Learning,

Cognition, and College Teaching: New Directions for Teaching and Learning, ed. W. J.

McKeachie. San Francisco: Jossey-Bass.

Frederick, P. J. 1999. “The Lively Lecture: Eight Variations.” In Fieldguide for Teaching in a

New Century, eds. B. A. Pescosolido and R. Aminzade. Thousand Oaks, CA: Pine Forge Press,

62–71.

Green, C. S., III, and H. G. Klug. 1990. “Teaching Critical Thinking and Writing through

Debates: An Experimental Evaluation.” Teaching Sociology 18(4): 462–71.

Green, C. S., III, and D. S. Dorn. 1999. “The Changing Classroom: The Meaning of Shifts in

Higher Education for Teaching and Learning.” In The Social Worlds of Higher Education:

Handbook for Teaching in a New Century, eds. B. A. Pescosolido and R. Aminzade. Thousand

Oaks, CA: Pine Forge Press, 59–83.

Hill, Bill. 1993. “The Value of Competitive Debate as a Vehicle for Promoting Development of

Critical Thinking Ability.” CEDA Yearbook 14: 1–22.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Krathwohl, D. R., B. S. Bloom, and B. M. Bertram. 1973. Taxonomy of Educational Objectives,

the Classification of Educational Goals. Handbook II: Affective Domain. New York: David

McKay.

McGlone, E. L. 1974. The Behavioral Effects of Forensics Participation. Journal of the

American Forensic Association 10(3): 140–6.

McKeachie, W. J. 1969. Teaching Tips: A Guidebook for the Beginning Teacher, 6th edition.

Lexington, MA: D.C. Health.

Meyers, C., and T. B. Jones. 1993. Promoting Active Learning. Strategies for the College

Classroom. San Francisco: Jossey-Bass.

Nandi, P. L., J. N. F. Chan, C. P. K. Chan, P. Chan, and L. P. K. Chan. 2000. “Undergraduate

Medical Education: Comparison of Problem-Based Learning and Conventional Teaching.”

HKMJ 6(3): 301–6.

Paul, R. 1999. “Critical Thinking, Moral Integrity, and Citizenship: Teaching for the Intellectual

Virtues.” In The Social Worlds of Higher Education: Handbook for Teaching in a New Century,

eds. B. A. Pescosolido and R.Aminzade. Thousand Oaks, CA: Pine Forge Press, 128–36.

Puchot, R. 2002. “Empowering Student Governance and Promoting Activism through

Forensics.” Speaker Points from Phi Rho 9(2). Available at:

www.phirhopi.org/prp/spkrpts9.2/craft2002/puchot.html. Accessed November 25, 2005.

Renner, P. 1993. The Art of Teaching Adults. Vancouver, BC: Training Associates.

Ruyle, K. 1995. “Group Training Methods.” In The ASTD Technical and Skills Training

Handbook, ed. L. Kelly, L. New York: McGraw-Hill.

Scannapieco, F. A. 1997. “Formal Debate: an Active Learning Strategy.” Journal of Dentist

Education 61: 955–61.

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

Appendix 1. Sample Questions and Evaluation Templates Issue: Can workfare help poor women with children escape from poverty? Question 1 (Comprehension): Define workfare under Personal Responsibility and Work Opportunity Act Evaluation guidelines: a satisfactory answer must contain the following five points:

• It is a policy requirement – 1 point • It is a basis for a welfare check or other welfare provisions – 1 point • Recipients have to work – 1 point • Any legal job can be held – 1 point • 30 hours per week for a period of time of not more than three years – 1 point

Question 2 (Application): Imagine the following situation. You are the head of the Indiana Office on Welfare and Social Affairs. The PRWORA is a federally recommended program. In this situation, which policy direction will you choose: (1) Establish welfare on the basis of need for unemployed people without a term; or (2) Follow the PRWORA recommendations and establish workfare requirements for those recipients who spend 5 years on welfare. Explain your position. Evaluation guidelines: five points are awarded to the answer that specifies the following: Clearly states a policy position – 1

• Specifies the reason behind this decision: (1) For the first position, the possible reasons can be to encourage people to get off welfare to work; to take low-income jobs; to create work attachment and work ethics; or to establish training and educational programs. (2) For the second position, the possible reasons can be to understand different situations of people; to understand time constraints that are not enough for people to get out of poverty; to understand the importance of other provisions for women with children, such as childcare, healthcare, food stamps, housing – 3 points maximum.

• Refute/criticize the opposing position; recognize/mention some limitations – 1 point Question 3 (Critical Evaluation): How would an opponent of workfare respond to the following statement: “The research demonstrates that from 1993 to 1998 there was a significant decline in caseloads – by 44%. This decline demonstrates that the PRWORA is a success”?

Evaluation guidelines: five points are awarded for the following considerations: • The PRWORA was designed to decrease the caseload, so people try to get off welfare

when they find a job in order to retain the welfare option if they become unemployed again – 2 points

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.

 Teaching  with  Lecture  or  Debate?  Testing  the  Effectiveness  of  Traditional  versus  Active  Learning  Methods  of  Instruction,  PS:  Political  Science  and  Politics,  (July):  603-­‐7,  2008    

• The decrease in caseload does not mean that people live better. They simply may not have an option to use welfare – 2 point

• Economic growth and the low unemployment rate in that period contributed to the decline in caseloads. If economic crises hit and unemployment goes up, the caseload will increase – 1 point

Omelicheva, Mariya Y. and Olga Avdeyeva. Teaching with Lecture or Debate? Testing the Effectiveness of Traditional versus Active Learning Methods of Instruction, PS: Political Science and Politics, (July): 603-7, 2008. Publisher's Official Version: <http://dx.doi.org/10.1017/S1049096508080815>. Open Access Version: <http://kuscholarworks.ku.edu/dspace/>.