problem‐based learning: a framework for prospective teachers’ pedagogical problem solving
TRANSCRIPT
This article was downloaded by: [Memorial University of Newfoundland]On: 03 August 2014, At: 11:30Publisher: RoutledgeInforma Ltd Registered in England and Wales Registered Number: 1072954 Registeredoffice: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK
Teacher Development: An internationaljournal of teachers' professionaldevelopmentPublication details, including instructions for authors andsubscription information:http://www.tandfonline.com/loi/rtde20
Problem‐Based Learning: a frameworkfor prospective teachers’ pedagogicalproblem solvingChristina De Simone aa University of Ottawa , Ontario, CanadaPublished online: 18 Jul 2008.
To cite this article: Christina De Simone (2008) Problem‐Based Learning: a framework forprospective teachers’ pedagogical problem solving, Teacher Development: An international journalof teachers' professional development, 12:3, 179-191, DOI: 10.1080/13664530802259206
To link to this article: http://dx.doi.org/10.1080/13664530802259206
PLEASE SCROLL DOWN FOR ARTICLE
Taylor & Francis makes every effort to ensure the accuracy of all the information (the“Content”) contained in the publications on our platform. However, Taylor & Francis,our agents, and our licensors make no representations or warranties whatsoever as tothe accuracy, completeness, or suitability for any purpose of the Content. Any opinionsand views expressed in this publication are the opinions and views of the authors,and are not the views of or endorsed by Taylor & Francis. The accuracy of the Contentshould not be relied upon and should be independently verified with primary sourcesof information. Taylor and Francis shall not be liable for any losses, actions, claims,proceedings, demands, costs, expenses, damages, and other liabilities whatsoeveror howsoever caused arising directly or indirectly in connection with, in relation to orarising out of the use of the Content.
This article may be used for research, teaching, and private study purposes. Anysubstantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &Conditions of access and use can be found at http://www.tandfonline.com/page/terms-and-conditions
Teacher DevelopmentVol. 12, No. 3, August 2008, 179–191
ISSN 1366-4530 print/ISSN 1747-5120 online© 2008 Teacher DevelopmentDOI: 10.1080/13664530802259206http://www.informaworld.com
Problem-Based Learning: a framework for prospective teachers’ pedagogical problem solving
Christina De Simone*
University of Ottawa, Ontario, CanadaTaylor and Francis Ltd(Received 11 November 2006; final version received 10 January 2008)RTDE_A_326087.sgm10.1080/13664530802259206Teacher Development1366-4530 (print)/1747-5120 (online)Original Article2008Taylor & Francis123000000August 2008ChristinaDe [email protected]
Current educational reform movements emphasize preparing teachers for pedagogicalproblem solving in the classroom. This study examines the impact of problem-basedlearning on prospective teachers’ problem-solving abilities. Two classes of prospectiveteachers were included in this study. The experimental class used problem-basedlearning while the control group used a more traditional approach. The dependentmeasure was the participants’ analyses of a problem. The participants in problem-basedlearning were significantly better than the controls in constructing the central problem,elaborating the problem, relating their solutions to the problem, and using multipleresources. The results are promising because they give prospective teachers a powerfulapproach that fosters certain aspects of pedagogical problem solving. The implicationsof these results for prospective teachers are discussed.
Keywords: Problem-Based Learning; pedagogical problem solving; teacher education;classroom research; quasi-experimental design
Introduction
Many educational reform movements call for preparing teachers to work through the diverseand complex problems that arise in the classroom and in pedagogy (Putnam and Borko 2000).Problem solving is difficult for teachers because of the complexity of the problems they face:managing the classroom, assessing learning, teaching to meet individual differences, andbuilding parent–teacher relationships (Putnam and Borko 2000; Zeichner and Conklin 2005).Problem solving requires framing problems, considering multiple perspectives, arriving atsolutions, considering consequences, and reflecting on the decision (Harrington 1995;Hmelo-Silver and Barrows 2006; Mayer and Wittrock 2006). Teachers need strategies andstructures that connect theory with practice (Schwartz, Bransford, and Sears 2005). Withoutsuch strategies and structures, problems in the classroom become insurmountable (Zeichnerand Conklin 2005).
Conceptual framework
Problem-Based Learning (PBL) is aligned with the constructivist framework that viewslearning and teaching as the active and meaningful inquiry and building of knowledge bylearners. PBL fosters both inquiry- and knowledge-based approaches to problem solving. Asan inquiry-based approach, its focus is on helping professionals such as teachers work
*Email: [email protected]
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
180 C. De Simone
through authentic, complex problems or cases (Bereiter and Scardamalia 2006; Hmelo-Silver 2004). The cases simulate real-life classroom decision making (Brown, Collins, andDuguid 1989), including considering multiple perspectives, warranting solutions, assessingconsequences, and reflecting on decisions.
In addition to preparing teachers for professional practice, PBL prepares them toconstruct a principled understanding of the issues in the problem case, so they learn to applyprinciples flexibly to problems of varying complexity (Bereiter and Scardamalia 2006) asopposed to merely tackling individual problems or problems that can easily be solved.Under the guidance of a probing mentor, members of small problem-solving groups workat identifying the central issue in the case, an essential initial phase in the problem-solvingprocess (Harrington 1995; Hmelo-Silver 2004). That is, they define the problem and thebasis for its identification as the problem. Understanding a problem allows the problemsolver to see underlying patterns and the big picture.
PBL also requires that group members identify learning issues, that is, what needs to belearned to resolve the problem (Hmelo-Silver 2004; O’Donnell 2006). Grounded in thecontext of their domain, the group must engage in a problem-solving sequence of seekinginformation from a variety of sources, justifying their decisions, discussing findings, andweighing consequences in order to construct a viable and possibly even innovativesolution. These skills and processes are vital in helping prospective teachers to build theirknowledge bases and see the underlying patterns and issues in their classrooms. Otherwise,they will deal with issues in isolation and, eventually, experience difficulty in their class-rooms (Shulman 1987; Spiro et al. 1987).
The expert facilitator has an important function as the groups work through their learningissues. Under the guidance of the expert facilitator, drawing from the literature and practice,group members engage in questioning, revising, and entertaining various views of the issuesthey uncovered within the case. These processes are critical to connecting possible solutionsto the problem and evaluating those solutions, two components of problem solving that bothprospective and new teachers find difficult (Harrington 1995; Hmelo-Silver 2004). Prospec-tive teachers should be able to ground their decisions in the literature and to scrutinize thatliterature, in addition to any information that they can garner from their own experiences(Hmelo-Silver and Barrows 2006). The PBL process helps prospective teachers develop abroader, more principled understanding of classroom and pedagogical issues.
As part of fostering the knowledge-building function of problem-based learning inprospective teachers, the study cases must be presented in multiple contexts so that they canbe revisited from multiple perspectives and purposes. According to researchers (e.g., Spiroet al. 1992), this approach helps prospective teachers form networks of ideas and seepatterns across problems and issues so they extend and transfer their thinking from whatthey encounter in the university to their work as teachers. Thus, problem-based learning letsprospective teachers create a rich foundation for solving similar or more serious problemsin the classroom. In other words, problem-based learning prepares them for their futurelearning (Schwartz, Bransford, and Sears 2005).
Relevant scholarly literature
Problem-based learning has been a valuable pedagogical strategy in medical education for30 years (Barrows and Tamblyn 1980; Gijbels et al. 2005; Walton and Matthews 1989). Ithas become increasingly popular in teacher education since the 1980s (Lambert and Ball1998; Merseth 1996). Researchers have followed two major strands of studies. The first arerich qualitative studies exploring how members of a PBL group collaborate and what affects
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
Teacher Development 181
their collaboration (Hmelo-Silver and Barrows 2006), how the nature of the dialogue affectslearners’ motivation, the quality of PBL cases (Hung 2006), and implementation issues(Ertmer and Simons 2006). The other are studies of PBL in teacher education which havefocused on several innovative descriptions, sometimes involving pre-test and post-testdesign but no control group (Hmelo-Silver 2000; Levin, Hibbard, and Rock 2002; Petersonand Treagust 1998; Torp and Sage 2002).
Unlike medicine, where entire curricula have adopted problem-based learning andexperimental strategies to assess its effectiveness are prominent, in education we typicallyfind one instructor implementing PBL using a pre-test and post-test design. Perhaps, aseducators, we assume the testing and evaluation of strategies is not as important as it is inmedicine, or it may be that education professors do not get support to try educational inno-vations and fear taking risks in case things go wrong and affect their prospects for renewaland promotion. It is critical, however, to assess PBL’s effectiveness in teacher education.
Because in education we cannot conduct true experiments, with random selection andassignment, we use quasi-experimental designs with a control group and pre-measures tocompensate (Creswell 2006). The present study addresses the effectiveness of problem-based learning compared to a more traditional approach to teacher education by using acontrol group. The research design of choice is quasi-experimentation (Tabachnick andFidell 2001).
Using the quasi-experimental design, the main question was ‘Are prospective teacherstrained with problem-based learning better able to engage in problem solving than those nottrained in using PBL?’ and used the definitions of problem solving delineated in Bransfordand Stein (1984), Harrington (1995), and Hmelo-Silver (2002). I examined prospectiveteachers’ abilities to (a) generate varied questions, (b) identify the central problem, (c) statethe problem definition, (d) relate the solution to the problem, (e) evaluate the solution, (f)provide a feasible solution, (g) use the literature to support their solution, and (h) use otherresources to support their solution.
Method
Participants
The participants were prospective teachers enrolled in a one-year teacher educationprogram, who were required to take an introductory educational psychology course (alsoreferred to as a learning processes course). One of the classes was the experimental group(n = 38); the other was the control group (n = 38). The majority of the students in bothsections were English-speaking females (average age 32). The experimental group had fourmale participants (average age 26) while the control group had five male participants(average age 23). Both classes met during the winter session. To control for teacher andresources effects, I taught both classes. I used the same reading materials and resourceswith both classes. To minimize carry-over effects between the two conditions, I scheduledthe sections on consecutive days of the week, the control class earlier and the experimentalclass later. In addition, a research assistant and I developed instructional plans for eachcondition to serve as guides when teaching. Any deviations and the reasons for them wererecorded by me after the class session and discussed with the research assistant. Unfortu-nately, classroom observations of implementation fidelity of both the experimental andcontrol conditions were not feasible. Neither could we monitor if students from eithercondition communicated about their class activities. The advantage, however, was that bothgroups shared many similarities that gave them the appearance that something new washappening in both conditions.
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
182 C. De Simone
Design and measures
This study took advantage of two intact groups of prospective teachers. My main objec-tive was to compare the effectiveness of problem-based learning to a more traditionalproblem-solving approach. In order to reach this objective, an explicit manipulation wasintroduced (PBL vs. traditional) and appropriate steps to control extraneous factors in thedesign, implementation and measures were taken so that statistical inferences could bedrawn. Thus, this study design was a quasi-experimental pre-test/post-test with a controlgroup. The pre-test, a case called ‘A Serious Illness,’ measured the participants’ baselineproblem-solving abilities. The main dependent measure was solving the problem of apost-training case, ‘You’re Not in My Group’ (Durkin 2002). Participants in both groupswere instructed (a) to comment on the appropriateness of the teacher’s actions orthoughts, (b) to describe and give reasons for their approach and (c) to list the advantagesand disadvantages of their recommendations. In their responses, they were to include theproblem-solving components. Participants were scored on their ability to (a) generatequestions that they would like to ask the teacher, (b) identify the problem, (c) state theproblem definition, (d) relate the solution to the problem, (e) evaluate the solution, (e)provide a solution, (f) use the literature to support that solution, and (g) use otherresources to support that solution. Although participants were permitted to work with theirgroup members or peers, each student was required to submit his or her own analysis.Responses were limited to 1000 words.
Description of cases
Training cases
It is critical that the cases used in PBL be authentic, relevant and ill-defined (i.e., there arenumerous ways of approaching the problem as well as diverse responses). They must alsorequire the problem solver to draw upon multiple sources and perspectives. To ensure thatthese criteria were satisfied, the cases, drawn from a textbook of Canadian cases (Durkin2002), were an integral part of the course, and I had used them before (De Simone in press).To ensure that the cases embodied issues that university teacher education professors andpractitioners considered important, they were previewed by a group of in-service teachers,who were also mentoring the teacher education students.
The in-service teachers read through the cases, then rated each one on a scale of 1 to 7according to a formula adapted from Kain (1997). To be acceptable, a case had to (a) beauthentic (the teacher believes that it could be or is an actual event), (b) be ill-defined, (c)require research (the problem needs information beyond the text), and (d) have significance(the problem has meaning). Eight of the cases were rated either 6 or 7 and were selected fortraining purposes. The cases varied in length from 500 to 1000 words and covered assessment,individual differences and classroom management. The judges also described the issues theythought each case covered, as a way to link the course readings to the issues. Some caseswere re-introduced as different topics came up because they exemplified several educationalpsychology concepts. The intention was to help prospective teachers see that multipleconcepts could explain what was going on in a case.
Assessment cases
I had used the assessment cases in a prior study (De Simone in press), and they were judgedby the same criteria. They were of comparable length, but the subject matter, the issue of
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
Teacher Development 183
individual differences, was different. The pre-test case, ‘A Serious Illness’ (Durkin 2002,157), described a situation in which a teacher is asked to balance the needs of a terminallyill child with the needs of the rest of the class. According to the panel of teachers whoreviewed the case, new teachers generally have a difficult time reconciling individuallearner needs with group needs. The post-test case, ‘You’re Not in My Group’ (Durkin2002, 155), dealt with the effects of misapplying cooperative learning to children ofdifferent backgrounds.
In an earlier study (De Simone in press), a research assistant and I segmented both pre-test and post-test cases into ‘idea units’ consisting of a concept, a relationship, and anotherconcept, to form a simple sentence expressing one idea (Mayer 1989). Both cases containedabout the same number of idea units (67 and 72), but the baseline case had 51 facts and 17opinions, while the post-test case had 39 facts and 33 opinions. Therefore, the post-test casecould require participants to make more inferences and was more difficult than the pre-testcase. However, I kept the two cases because the panel of in-service teachers rated them ascomplex and authentic. The cases also required the participants to think beyond theinformation presented and to draw from multiple sources of information to work throughthe problem. The cases were also well suited to the topics discussed in the educationalpsychology course. According to the literature, these characteristics make for goodproblem-based learning cases (Hmelo-Silver 2004). Both cases also contained appendices:a class roster, a brief description of each child in the case, and additional information on thatchild (e.g., medical records and psychological tests as appropriate). This extra informationadds to the authenticity of the case because teachers must sift through irrelevant and relevantinformation to decipher the main issues (Hmelo-Silver 2004).
Case design
I developed a curriculum matrix to illustrate the topics normally covered in an educationalpsychology course (see Table 1) and cases to exemplify the issues presented by the topics.This was to help prospective teachers foster a sense of continuity in learning and give them
Table 1. Curriculum matrix of topics by cases.
Main Topic Sub-topic Bill and Evan Emily Peter Carlos
Human Development Principles of Cognitive Development and Language
X
Principles of Personal, Social, and Emotional Development
X X X
Individual Variations Principles of Learner Differences X X XLearning Theory and
PracticePrinciples of Behavioral Views of
LearningX X X
Principles of Cognitive Views of Learning
X X X
Complex Cognitive Processes X X XPrinciples of Social Cognitive and
Constructivist Views of LearningX X X
Motivation, Management, and Teaching
Motivation: Issues and Explanations X X
Creating Learning Environments X X X XTeaching for Learning X
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
184 C. De Simone
the opportunity to transfer their learning across topics and cases, as opposed to learningdiscrete bits of information (Spiro et al. 1992).
Instruction: PBL and traditional instruction
Classes for both experimental and control conditions met 12 times during the study, forthree hours a week. The same course objectives and reading materials were used in bothconditions.
In the problem-based learning class, I gave mini-lectures on educational psychology andtrained the students to analyze classroom problems in small groups. To probe their priorknowledge and experiences, mini-lectures were typically given after students had discussedtheir learning issues. In fact, their discussions often provided the content for these lectures.Sometimes, when the groups had many questions about basic definitions, I started thesession with the mini-lecture.
Further, Hmelo-Silver, an expert in PBL, was scheduled to conduct the PBL trainingwith the experimental group and began the first hour of the session by modeling the prob-lem-based learning process. She discussed the case and demonstrated PBL activities, suchas summarizing the dialogue for the group, helping them to generate hypotheses about thecase, constructing the essential problem, and showing them how to consider various theoriesand issues. In the second and third hours, Hmelo-Silver encouraged group members to actas summarizers, making predictions and drawing from the literature and their practice tointerpret the case. She began with summarizing, asking the model students to report on whatthey already knew and what needed to be learned. Then, she asked them to make predictionsbased on what they knew. Finally, she helped them explore the broader implications of thecase. In addition, she elicited questions from the audience about the PBL process and aboutthe case itself.
After this initial modeling, the class was divided into 10 groups: nine groups consistedof four members, and one group had three (n = 38). When classes are very small, then theexpert at both the content and PBL is the facilitator. However, because this was a large class,the expert facilitator (first Hmelo-Silver, then the instructor) ‘wandered’ among the groups.A ‘wandering facilitator’ relies on student facilitators to ‘fill them in’ (Hmelo-Silver 2004).In each group, one student acted as a facilitator whose task was to ensure that the group keptits deadlines and performed its tasks while making such requests as ‘Tell me more,’ ‘Canyou show me an example?’ or ‘How about if we consider the case from this perspective?’
Small-group discussions allowed students to give each other feedback on their summa-rizing, probing and elaborating while they discussed, analyzed, and solved the problem.Groups were provided with large Post-It Notes, which they divided into the followingcolumns: basic facts of the case, central problem, and learning issues.
I used the information on the Post-It Notes to gauge the students’ understanding of theessential elements of the case and to monitor their progress. Following the small-group work,students and teacher engaged in large-group discussion to comment on each other’s problemanalyses. I used this opportunity to relate ideas, principles and practices in educationalpsychology to elements of the case.
To help students support their ideas and gather information, the Faculty of Education’shead librarian conducted one three-hour session to maximize students’ use of libraryresources. To equalize the two groups’ ability to use library tools, students in the controlcondition attended the same library workshop as those in the experimental condition.
The control class used the same cases, and I used them for my lectures, either as examplesof a concept or, at the end of the lecture, as an opportunity for students to practice applying
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
Teacher Development 185
the concepts discussed. The control students did not work on any formalized group activities.However, they were divided into groups and instructed to discuss their case analyses. Duringclass, I assisted students if they were having difficulty or if they seemed to be at an impasse.If they were, I asked them to summarize where they were, pose questions, or think aboutalternative perspectives.
Procedure
Problem-based learning was an integral part of the learning processes course. On the firstand second days of the course, after students had consented to participate in the study, studentsin both the experimental and control conditions completed a demographics questionnaire anda pedagogical content questionnaire. They then began work on their pre-test case, ‘A VerySerious Illness.’ In the first session, each student wrote an individual preliminary analysisof the case. The prompt was as follows: ‘Comment on the appropriateness of this teacher’sactions and describe and defend what approach you would have taken in this situation.’
Then students met in their groups to discuss the individual preliminary analyses andgenerate the learning issues (the list of facts and concepts that needed further explorationand resources that would be needed). The students wrote this information on the Post-ItNotes, which they could stick on the wall. For homework, they worked on different parts ofthe learning issues, which they brought to class and discussed. Through collective deliber-ation, they constructed a workable solution. The instructor/researcher also conducted amini-review of educational psychology as it related to the case and answered remainingquestions. At the end, students submitted their analyses. Their protocols were then scoredaccording to the rubric in the Appendix.
The third through tenth classes for the experimental participants comprised trainingsessions in problem-based learning.
At the end of the 12-week semester, all students received the post-test case ‘You’re Notin My Group,’ which they completed in the same manner as the pre-test.
Scoring procedure
Using a scoring technique from an earlier study (De Simone in press), I trained two researchassistants who were blind to the participants’ experimental condition to score the problem-solving protocols. Participants’ problem-solving responses were rated on a scale of 0 to 3(see Appendix). Inter-rater reliability of 20% of the data was computed, yielding 87%agreement. The two raters discussed any disagreements that emerged and, if required, hadthe disagreements resolved by a third person.
Results
A multivariate analysis of variance (MANOVA) was determined to be the optimal methodof analyzing the data for the following reasons: (a) the existence of a conceptual relationshipbetween the components of problem solving, (b) the components’ moderate statistical corre-lation, and (c) independent t tests to assess initial group differences were not statisticallysignificant (Bonferonni adjustment, all p > .01) (Tabachnick and Fidell 2001; D. Trum-power, personal communication 5 April 2007). Moreover, there were no outliers or missingdata to skew the data; the homogeneity of variance and co-variance were met as were theassumption of normality and linearity (Tabachnick and Fidell 2001). The multivariateanalysis of variances was conducted to answer the research question ‘Are prospective
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
186 C. De Simone
teachers trained with PBL better able to engage in problem solving than those not trained inPBL?’ where condition (experimental vs. control) was the between-group factor. Thedependent measures were the eight post-test scores of the problem-solving process.
The results showed that there was an overall condition effect which was significant(based on Pillai criterion: F(7,68) = 7.51, p = .001). The results demonstrated that the PBLgroup significantly surpassed the more traditional approach in four areas of problem solv-ing at the post-test: identification of the central issue/problem F(1,74) = 14.86, p = .001;quality of problem definition F(1,74) = 24.59, p = .001; relationship of the solution to theproblem F(1,75) = 9.45, p = .003; and use of resources F(1,75) = 28.74, p = .001. For theseproblem-solving components, examining the means revealed that the experimental groupsignificantly surpassed the control group at the post-test (see Table 2).
Moreover, not only was there a statistically significant mean difference in these fourcomponents of problem solving between the two groups, there was also a substantiallymoderate effect size (partial eta .436). That is, the magnitude of the difference between thePBL and traditional conditions is considered to be substantial (Tabachnick and Fidell 2001).
Discussion
The main goal of this investigation was to go beyond descriptive studies of problem-basedlearning and instead examine its effectiveness vis-à-vis pedagogical problem solving inprospective teachers who did not receive PBL training. Answering this fundamentalquestion of whether the strategy works could have a significant impact on the field ofteacher education.
Conducting experimental studies in education is important because they allow us toassess critical skills in potential new teachers, such as, in this case, their ability to solveproblems and to establish whether problem-based learning enhances it. To date, PBL ineducation has typically been examined without an adequate control group, but this studyboth included a control group and compared the treatment effect between the two groups.
Table 2. Means and standard deviations for seven components of problem solving during post-testfor experimental and control groups.
Component of Problem Solving Mean SD n
Post 1 Exp 2.61 .495 38Control 2.18 .457 38
Post 2 Exp 2.42 .552 38Control 2.26 .601 38
Post 3** Exp 2.63 .675 38Control 1.87 .665 38
Post 4* Exp 2.45 .602 38Control 2.03 .592 38
Post 5 Exp 2.29 .515 38Control 2.16 .547 38
Post 6 Exp 2.29 .835 38Control 2.03 .753 38
Sources** Exp 2.52 .568 38Control 1.69 .783 38
Note: *p < .01; **p < .001.
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
Teacher Development 187
Four components of problem solving were statistically significant in favor of theexperimental group. They (a) were better at identifying the main problem/issue, (b) hadhigher-quality problem definitions, (c) related the solution to the problem well, and (d) usedresources more effectively. The magnitude of the differences was substantial. The fact therewas a substantial treatment effect between the two conditions is promising because it tellsus that, although PBL is a resource-intensive strategy, it is worth the investment, especiallywhen the issue at hand is a critical one: prospective teachers’ ability to solve problems.
New teachers are often swayed by urgent, but not necessarily important, problems.Consequently, they end up attending to symptoms of problems rather than the causes(Schwartz, Bransford, and Sears 2005). The ability to correctly identify a problem, anddefine it well, are both critical to managing an issue. The probing that occurs between peersand expert facilitators in problem-based learning enables prospective teachers to view thecase from different and deeper perspectives.
Harrington (1995) and Kuhn (1991) have shown that, at least among novices, there isoften a disconnect between solutions proposed and the problems defined. In this study, thePBL group did better than did its control counterpart in relating the problem to the solution.It seems, however, that group discussion alone does not connect the problem to the solution,since both groups participated in discussion. It is more likely, although this can only beinferred from the quantitative data, that the prospective teachers in the PBL condition wereable to ask for clarifications, revisions, and supporting evidence. These activities maketeachers aware of the limitation of their own thinking by considering the pros and cons oftheir pedagogical decisions (Greening 1998).
Finally, the fact the problem-based learning group did better on the use of resources thanthe control group did tells us that one of the strengths of PBL is to introduce and familiarizelearners with the use of more than one resource and to deal with more than one perspective.The informal comments and observations from students revealed that it was difficult forthem cognitively to manage several sources of information simultaneously, make sense ofit, and present it to their groups for discussion. However, this is an essential skill to fosterin practice because teachers have to deal with multiple sources of information, interpreta-tions and perspectives while interacting with parents, children in the class, and even thecommunity.
Other components of problem solving, such as evaluating the consequences of the solu-tion and its feasibility, did not show statistically significant results; however, the means werein the predicted directions (see Table 2). In a previous study (De Simone in press), thesemeasures reached statistical significance. One of the differences between the participants inthis study and those in the previous one is that participants in the earlier study had moretraining in the classroom context and, therefore, may have been more adept at assessing theirsolutions.
Conclusions and implications
The results of this study point to the merit of using a causal-comparison design to addressbasic issues of the effectiveness of problem-based learning and the degree to which it iseffective. Teaching teachers is a complex analytical and integrative enterprise that must beconcerned not only with day-to-day activities but also with the entire teaching landscape.Professionals such as teachers face a particular struggle in eliminating the divide betweenpractice and theory. Problem-based learning, with its emphasis on both scholarship andteaching practice, can accomplish this goal. In problem-based learning, the synergy betweentheory and practice fosters prospective teachers’ problem solving, especially their ability to
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
188 C. De Simone
define the problem, generate solutions, and use both practical and literature-based resourcesto support the solution.
While the design, planning, and implementation of problem-based learning is expensive,it is a powerful strategy for teaching in complex, collaborative systems. However, havingonly one professor teach it in a large faculty is simply not sufficient and was an obstacle inthis study that affects both the implementation of the strategy and the extent to whichprospective teachers can benefit from PBL. We must find ways to make teaching PBLaffordable. Otherwise, it will be accessible only to a privileged few.
The next issue in this line of inquiry is the long-term use of problem-based learning.More research is needed on the extent to which teachers draw upon problem-based learningin the longer term – when they are in practice as professionals – to work through pedagogicaland classroom problems, and also on what factors foster or challenge the extent of their useof problem-based learning strategies. This next line of inquiry would draw upon both quan-titative and qualitative approaches.
AcknowledgementsThe work was supported by a University of Ottawa, Faculty of Education internal grant and by theFonds québecois de la recherche sur la société et la culture (FQRSC) awarded to the author. I amgreatly indebted to Paul Davis for his invaluable assistance throughout this study and to Dr CindyHmelo-Silver for conducting the training in problem-based learning.
Notes on contributorChristina De Simone is an Assistant Professor in the Faculty of Education at the University ofOttawa, in Ottawa, Ontario. Her areas of research are in Problem-Based Learning, problem solv-ing, cognitive transfer, and teacher education. Other publications which represent her work are:‘Problem-based learning and prospective teachers: Implications for problem solving and practice’Journal of Excellence in College Teaching (in press); ‘Concept Mapping: A flexible tool foruniversity students’ College Teaching (2007, Volume 55, 33-37); and De Simone and R.F Schmid,‘Networking from the inside out: Understanding learners’ processes, activities, and experiences’Educational Research and Evaluation Special Issue on Postsecondary Education (2004, Volume10, 523-549).
ReferencesBarrows, H.S., and R.M Tamblyn. 1980. Problem-based learning. New York: Springer.Bereiter, C., and M. Scardamalia. 2006. Education for the knowledge age: Design-centered models
of teaching and instruction. In Handbook of educational psychology, ed. P. Alexander and P.Winne, 695–713. 2nd ed. Mahwah, NJ: Lawrence Erlbaum.
Bransford, J.D., and B.S. Stein. 1984. The IDEAL problem solver. New York: W.H. Freeman.Brown, J., A. Collins, and P. Duguid. 1989. Situated cognition and the culture of learning. Educational
Researcher 18, no. 1: 32–42.Creswell, J.W. 2006. Research design: Qualitative, quantitative, and mixed method approaches. 2nd
ed. Thousand Oaks, CA: Sage Publications.De Simone, C. (in press) Problem-based learning and prospective teachers: Implications for problem
solving and practice. Journal on Excellence in College Teaching.Durkin, J.F. 2002. Cases in educational psychology: A Canadian perspective. Toronto: Pearson.Ertmer, P.A., and K.D. Simons. 2006. Jumping the PBL implementation hurdle: Supporting the
efforts of K–12 teachers. The Interdisciplinary Journal of Problem-based Learning 1: 1–15.Gijbels, D., F. Dochy, P. Van den Bossche, and M. Segers. 2005. Effects of problem-based learning:
A meta-analysis from the angle of assessment. Review of Educational Research 75: 27–61.Greening, T. 1998. Scaffolding for success in problem-based learning. Medical Education On line 3,
no. 4. http://www.med-ed-online.org/f000001.htm.
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
Teacher Development 189
Harrington, H.L. 1995. Fostering reasoned decisions: Case-based pedagogy and the professionaldevelopment of teachers. Teacher and Teacher Education, 11: 203–14.
Hmelo-Silver, C.E. 2000. Knowledge recycling: Crisscrossing the landscape of educational psychol-ogy in a problem-based learning course for preservice teachers. Journal on Excellence in CollegeTeaching 11: 41–56.
———. 2002. Collaborative ways of knowing: Issues in facilitation. In Computer support forcollaborative learning (CSCL ‘01), ed. G. Stahl, 199–208. Mahwah, NJ: Erlbaum.
———. 2004. Problem-based learning: What and how do students learn? Educational PsychologyReview 16: 235–66.
Hmelo-Silver, C.E. and H.S. Barrows. 2006. Goals and strategies of a problem-based learningfacilitator. Interdisciplinary Journal of Problem-based Learning 1: 21–39.
Hmelo-Silver, C.E., E. Katic, A. Nagarajan, and E. Chernobilsky. (in press). Soft leaders, hardartifacts, and the groups we rarely see: Using video to understand peer learning processes. InVideo research in the learning sciences, ed. R. Goldman, R. Pea, B. Barron, and S. Derry.Mahwah, NJ: Erlbaum.
Hung, W. 2006. The 3C3R Model: A conceptual framework for designing problems in PBL. TheInterdisciplinary Journal of Problem-based Learning 1: 1-21.
Kain, D.L. 1997. Problem-Based Learning For Teachers, Grades 6-12. Boston: Allyn & Bacon.Kuhn, D. 1991. The skills of argument. New York: Cambridge University Press.Lambert, M., and D.L. Ball. 1998. Teaching, multimedia, and mathematics: Investigations of real
practice. New York: Teachers College Press.Levin, B., K. Hibbard, and T. Rock. 2002. Using problem-based learning as a tool for learning to
teach students with special needs. Teacher Education and Special Education 25: 278–90.Mayer, R.E. 1989. Models for understanding. Review of Education Research 59: 43–64.Mayer, R.E., and M.C. Wittrock. 2006. Problem solving. In Handbook of educational psychology,
ed. P. Alexander and P. Winne, 287–303. 2nd ed. Mahwah, NJ: Lawrence Erlbaum.Merseth, K.K. 1996. Cases and case methods in teacher education. In Handbook of research on
teacher education, ed. J. Sikula, 722–44. 2nd ed. New York: Macmillan.O’Donnell, A.M. 2006. The role of peers and group learning. In Handbook of educational psychology,
ed. P. Alexander and P. Winne, 781–802. 2nd ed. Mahwah, NJ: Lawrence Erlbaum.Peterson, R.F., and D.F. Treagust. 1998. Learning to teach primary science through problem-based
learning. Science Education 82: 215–37.Putman, R., and H. Borko. 2000. What do new views of knowledge and thinking have to say about
research on teacher learning? Educational Researcher 29: 4–15.Schwartz, D., J. Bransford, and D. Sears. 2005. Efficiency and innovation in transfer. In Transfer of
learning from a modern multidisciplinary perspective, ed. J. Mestre, 1–52. Greenwich, CT:Information Age.
Shulman, L. 1987. Knowledge and teaching: Foundations of a new reform. Harvard EducationalReview 57: 1–22.
Spiro, R.J., P.J. Feltovich, M.J. Jacobson, and R.L. Coulsen. 1992. Cognitive flexibility, constructiv-ism, and hypertext: Random access instruction for advanced knowledge acquisition in ill-structured domains. In Constructivism and the technology of instruction: A conversation, ed.T.M. Duffy and D.H. Jonassen, 57–75. Hillsdale, NJ: Erlbaum.
Spiro, R.J., W.P. Vispoel, J.S. Schmitz, A. Samarapungavan, and A.E. Boerger. 1987. Knowledgeacquisition for application: Cognitive flexibility and transfer in complex domains. In Executivecontrol processes, ed. R.C. Britton, 171–89. Hillsdale, NJ: Erlbaum.
Tabachnick, B.G., and L.S. Fidell. 2001. Using multivariate statistics. 4th ed. Needham Heights,MA: Allyn & Bacon.
Torp, L.T., and S.M. Sage. 2002. Problems as possibilities: Problem-based learning for K-16education, 2nd ed. Alexandria, VA: Association for Supervision and Curriculum Development.
Walton, H.J. and M.B. Matthews. 1989. Essentials of problem-based learning. Medical Education23: 542–58.
Zeichner, K.M., and H.G. Conklin. 2005. Teacher education programs. In Studying teacher educa-tion: The report of the AERA panel on research and teacher education, ed. M. Cochran-Smithand K.M. Zeichner, 645–736. Mahwah, NJ: Erlbaum.
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
190 C. De Simone
App
endi
x. P
robl
em-s
olvi
ng s
cori
ng r
ubri
c.
Par
amet
er0
12
3
A. N
umbe
r of
Var
ied
Que
stio
nsN
o qu
esti
ons.
1–2
dist
inct
que
stio
ns3–
4 di
stin
ct q
uest
ions
5 or
mor
e di
stin
ct q
uest
ions
B. I
dent
ific
atio
n of
C
entr
al P
robl
em/
Issu
e
No
prob
lem
s ar
e id
enti
fied
, cen
tral
or
oth
erw
ise.
One
pro
blem
is
iden
tifi
ed,
but i
t is
not r
elat
ed to
the
text
.
One
pro
blem
is id
enti
fied
, but
it is
no
t ce
ntra
l to
the
cas
e.O
ne p
robl
em is
iden
tifi
ed a
s be
ing
cent
ral
to t
he c
ase,
and
the
id
enti
fica
tion
is
corr
ect.
C. Q
uali
ty o
f P
robl
em
Def
init
ion
No
prob
lem
is
iden
tifi
ed.
A p
robl
em i
s m
enti
oned
in
pass
ing
wit
h no
su
bsta
ntia
l de
fini
tion
of
the
prob
lem
and
wit
h no
ev
iden
ce p
rovi
ded
as t
o th
e ex
iste
nce
of t
he
prob
lem
.
A p
robl
em i
s id
enti
fied
and
E
ITH
ER
a g
ood
defi
niti
on o
f th
e pr
oble
m is
pro
vide
d bu
t no
evid
ence
is
cite
d O
R g
ood
evid
ence
of
the
prob
lem
’s
exis
tenc
e is
cit
ed b
ut n
o de
fini
tion
is
prov
ided
.
A s
ubst
anti
al d
efin
itio
n of
the
pr
oble
m A
ND
som
e ev
iden
ce
of i
ts e
xist
ence
are
pro
vide
d.
The
per
son
stat
es th
e ce
ntra
l or
seco
ndar
y pr
oble
m a
nd p
oint
s to
beh
avio
r or
wor
ds t
hat
indi
cate
the
m.
D. P
rovi
sion
of
a F
easi
ble
Sol
utio
nN
o so
luti
on i
s pr
opos
ed.
One
sol
utio
n is
pro
pose
d,
but
ther
e is
ins
uffi
cien
t in
form
atio
n pr
ovid
ed i
n th
e so
luti
on p
ropo
sal
to
esti
mat
e th
e re
sour
ces
requ
ired
to
impl
emen
t th
e so
luti
on o
r it
s ef
fica
cy.
One
sol
utio
n is
pro
pose
d, a
nd i
t ap
pear
s fr
om i
ts d
escr
ipti
on i
t w
ould
EIT
HE
R
1.C
onsu
me
too
few
res
ourc
es.
2.C
onsu
me
too
man
yre
sour
ces.
3.U
se th
e ap
prop
riat
e re
sour
ces
but
not
solv
e th
e pr
oble
m.
One
sol
utio
n is
pro
pose
d th
at d
oes
not
cons
ume
reso
urce
s be
yond
th
e sc
ope
of t
he p
robl
em, a
nd
the
solu
tion
wou
ld l
ikel
y m
ake
a si
gnif
ican
t im
pact
on
the
stat
ed p
robl
em.
E. R
elat
ions
hip
of t
he
Sol
utio
n to
the
P
robl
em
No
solu
tion
is
prov
ided
.O
ne s
olut
ion
is m
enti
oned
or
des
crib
ed b
ut i
s no
t re
late
d to
the
pro
blem
. W
e ar
e in
ferr
ing
the
rela
tion
ship
.
One
sol
utio
n m
enti
oned
or
desc
ribe
d an
d is
rel
ated
to
or
part
ly r
elat
ed t
o th
e pr
oble
m.
We
are
infe
rrin
g th
e re
lati
onsh
ip.
One
sol
utio
n is
men
tion
ed o
r de
scri
bed.
and
it is
rela
ted
to th
e pr
oble
m. T
he p
arti
cipa
nt
expl
icit
ly m
akes
the
lin
k be
twee
n th
e pr
oble
m a
nd t
he
solu
tion
.
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014
Teacher Development 191
App
endi
x. (
Con
tinu
ed).
Par
amet
er0
12
3
F. E
valu
atio
n of
the
S
olut
ion
The
ben
efit
s an
d li
mit
atio
ns o
f th
e so
luti
ons
are
not
pres
ent.
One
ben
efit
of
the
solu
tion
is
cit
ed, A
ND
/OR
one
li
mit
atio
n of
the
solu
tion
is
cit
ed.
Som
e (2
) be
nefi
ts A
ND
/OR
(2)
li
mit
atio
ns a
re c
ited
.M
ore
than
2 b
enef
its
and/
or
lim
itat
ions
are
cit
ed.
G. L
iter
atur
e S
uppo
rtN
o m
enti
on o
f th
e li
tera
ture
was
m
ade.
An
atte
mpt
is
mad
e to
cit
e th
e li
tera
ture
but
onl
y a
cita
tion
is
prov
ided
.
An
inco
mpl
ete
atte
mpt
was
mad
e to
des
crib
e ap
plic
abil
ity
of t
he
cita
tion
.
The
app
lica
bili
ty o
f th
e ci
tati
on is
de
scri
bed
and
is t
ied
to t
he
solu
tion
.
H. O
ther
Res
ourc
esN
o ot
her
reso
urce
s w
ere
soug
ht.
Som
e re
sour
ces
are
men
tion
ed, b
ut t
here
is
no a
ttem
pt t
o de
scri
be
the
appl
icab
ilit
y of
the
re
sour
ces
to t
he s
olut
ion.
An
inco
mpl
ete
atte
mpt
was
mad
e to
des
crib
e th
e ap
plic
abil
ity
of
the
reso
urce
s to
the
sol
utio
n.
The
app
lica
bili
ty o
f th
e re
sour
ces
is d
escr
ibed
and
is
tied
to
the
solu
tion
.
Dow
nloa
ded
by [
Mem
oria
l Uni
vers
ity o
f N
ewfo
undl
and]
at 1
1:30
03
Aug
ust 2
014