A Quantitative Literature Review of Cooperative Learning Effects on High School and College Chemistry Achievement

Download A Quantitative Literature Review of Cooperative Learning Effects on High School and College Chemistry Achievement

Post on 03-Feb-2017




1 download

Embed Size (px)


<ul><li><p>Research: Science and Education</p><p>116 Journal of Chemical Education Vol. 77 No. 1 January 2000 JChemEd.chem.wisc.edu</p><p>A Quantitative Literature Review of Cooperative LearningEffects on High School and College Chemistry AchievementCraig W. BowenDepartment of Chemistry, Clemson University, Hunter Laboratories, Clemson, SC 29634-1905; cwbowen@clemson.edu</p><p>Several reviews are available on the effects of cooperativelearning on student learning at the K12 level in general and inscience and mathematics (13). In addition, there are reviewsabout effects of cooperative learning in college populations (4).However, no quantitative review has been done of cooperativelearning in high school and college chemistry courses. Thepurpose of this paper is twofold. First, a brief overview of meta-analysis (a quantitative approach to conducting literaturereviews) is given. The second purpose is to illustrate the powerof this technique by reporting quantitative effects of coop-erative learning on chemistry achievement in high school andcollege classes.</p><p>Background on Cooperative Learning</p><p>Before considering meta-analysis and how to conductquantitative summaries of articles on data-based research andevaluation, a short overview is needed to orient readers un-familiar with components of cooperative learning strategiesbecause this will be the focal area for the meta-analyses reportedlater. This Journal has published several articles on how toincorporate cooperative learning into chemistry lecture andlaboratory classrooms (511) and there are other availableresources as well, such as those compiled by Nurrenbern andKrupp (12) and a brief review provided by Nurrenbern andRobinson (13). However, most of these cite a key referencethat highlights components of cooperative learning in itsdifferent forms. Johnson, Johnson, and Smith (4 ) point tofive important components of cooperative learning thatshould be included in activities:</p><p>1. POSITIVE INTERDEPENDENCEStudents are given tasks that they perceive being able tocomplete only if all group members contribute to theeffort. This can be achieved through several designapproaches: (i) providing a group reward for successfulinterdependence; (ii) having activities in which resourcesare shared; or (iii) providing a task that is too difficultfor students to do individually.</p><p>2. FACE-TO-FACE INTERACTIONStudents are given time and space as part of the activityfor meeting with group members and providing assistancewith the learning task at hand.</p><p>3. INDIVIDUAL ACCOUNTABILITYStudents are required to learn the material at hand anddemonstrate that they have mastered it. The group shouldfacilitate the learning of all group members, but eachgroup member needs to be responsible for demonstratinghis or her own learning.</p><p>4. INTERPERSONAL SKILLSStudents are given opportunities to practice variousgroups skills such as developing trust, communicating</p><p>effectively, and handling conflicts. Feedback should beprovided so students can enhance these skills.</p><p>5. GROUP PROCESSINGStudents are given time and space to reflect on the pro-cesses that took place in their group that facilitated (andstymied) achieving the goals of the group. The focus isto learn about group dynamics for future situations.</p><p>This set of components is useful to consider when readingthe articles cited in this paper, in which cooperative learningstrategies are used in chemistry classes.</p><p>Background on Meta-AnalysisA meta-analysis is a quantitative approach to reviewing</p><p>research literature in a specific area. In educational research,the many factors that vary from one teaching context toanother make it difficult to design definitive experiments todetermine the extent to which a given instructional approachaffects a given student outcome. A meta-analysis combines anumber of studies (usually conducted by different researchersin a variety of educational contexts) to quantify the effect aninstructional approach has on a given outcome. By broadeningthe pool of data to include different contexts and to increasesample sizes, a better quantitative estimate can be made ofhow an instructional practice affects student outcomes.</p><p>Technical details on conducting meta-analyses can be foundelsewhere (1416 ). However, the process usually includesthese general steps:</p><p>1. Describing the independent variables (e.g., cooperativelearning as a teaching method) and outcome variables(e.g., academic achievement) of interest.</p><p>2. Identifying quantitative research studies that addressrelations between independent and outcome variables.</p><p>3. Tabulating quantitative information from each studythat indicates the effect the independent variable hason the outcome variable.</p><p>4. Determining the effect size for the data reported inthe study so the data are normalized. The effect sizeis the difference between the means of the outcomescores of the experimental and control groups dividedby the standard deviation of the scores of the controlgroup (although sometimes a pooled standard devia-tion from all scores is used). A positive effect of theinstructional strategy on the outcome variable is indi-cated by a mean effect size across the studies that isgreater than zero.</p><p> Effect size =</p><p>Meantreatment group Meancontrol groupStandard deviationcontrol group</p><p>Chemical Education Research</p><p>http://jchemed.chem.wisc.edu/Journal/http://jchemed.chem.wisc.edu/Journal/issues/2000/Jan/http://jchemed.chem.wisc.edu/</p></li><li><p>Research: Science and Education</p><p>JChemEd.chem.wisc.edu Vol. 77 No. 1 January 2000 Journal of Chemical Education 117</p><p>One caveat when estimating effect size of an instructionaltreatment is that studies that show no effect are less likely tobe published in the literature. In addition, many studies failto report all the information needed to calculate effect size(e.g., only reporting mean scores). Different formulas fromthe one shown here may be used if different quantitative in-formation is reported in a study (e.g., 2 values, t-test results,or F-test results from analyses of variance).</p><p>Because an effect size shows how far the mean outcomevariable of one treatment group is above or below the meanoutcome variable of another group in terms of number ofstandard deviations, the percentile difference in performancein the two groups can be determined by looking at standardnormal scores (or Z scores) found in most applied statistics texts.</p><p>An effect size of zero is thesame as a Z-score of zero.This means that a studentperforming at the 50th per-centile in one group is per-forming at the same per-centile in the other group.With an effect size of 0.20,a student at the 50th per-centile in the treatmentgroup is performing 0.20standard deviations higherthan a student at the 50thpercentile in the controlgroup. By looking up a Z-score of 0.20, we see thatthe student in the treat-ment group is performingat the 58th percentile of thecontrol group. Table 1 giveseffect size and percentile</p><p>change information for selected values; more extensive val-ues can be found in most applied statistics books. Becausethe standard normal distribution is symmetric, negativeeffect sizes are of the same absolute size change in percentiles,but in the opposite direction.</p><p>Using effect sizes is a way to normalize different out-come measures so quantitative comparisons can be made. Forexample, consider two different studies examining the effectsof cooperative learning on different aspects of chemistryachievement. Lonning (27 ) studied high school students(n = 36) taking a physical science course who were assignedto either a control group or a treatment group being taughtthe particulate nature of matter over a four-week period. Bothgroups of students were encouraged to work in groups as theylearned various chemical concepts regarding the particulatenature of matter. However, students in the experimentalgroup were also taught collaborative skills and had both groupand individual components to their grade. Outcomes weremeasured by a test of conceptual understanding about theparticulate nature of matter. These data are summarized inTable 2.</p><p>In a second study examining how cooperative learningaffects chemistry achievement, Dinan and Frydrychowski (25)worked with students in organic chemistry. College students(n = 36) in a first-term organic chemistry course were assignedto team-learning groups for the semester. The teams were re-</p><p>quired to read material before lecture and were then given anindividual minitest followed by a group minitest. Responseswere graded immediately and a lecture was given on materialnot well understood. Comparison of the students achievementon the final exam with previous cohort performance (tradi-tional lecture classes) showed that students achieved more inthe team group. Their data are also summarized in Table 2.</p><p>The mean scores from these two studies cannot be directlycompared across the treatment groups because differentachievement measurements were used and they had a differentrange of possible scores. However, by calculating the effectsize from each study, a quantitative summary of the overalleffect can be estimated even though different ways of mea-suring the outcome were used. In both studies, cooperativelearning had a positive effect on chemistry achievement.</p><p>Summary of Meta-Analysis of Cooperative LearningEffects on Outcomes in College-Level SMET Courses</p><p>A review and meta-analysis was conducted to answer thequestion Is cooperative learning more effective than tradi-tional instruction in promoting academic achievement, per-sistence, and attitudes among undergraduates in science,mathematics, engineering, and technology [SMET]courses?(17 ). The authors used these criteria for including researchstudies in the analysis:</p><p>1. The target instructional population was undergraduatesin SMET courses.</p><p>2. The instructional treatment took place in a classroom,incorporated one or more components of cooperativelearning (described earlier), and included individualaccountability.</p><p>3. Experimental and control groups were used in thestudy, and sufficient statistical information was pro-vided to generate the data needed for the meta-analysis(e.g., means and standard deviations are reported).</p><p>4. The research was reported in English between 1980and 1996 (journal articles, conference proceedings,dissertations, and unpublished manuscripts).</p><p>Using various abstracting services (e.g., in education andpsychology), a total of 37 research studies were identified thatmet these criteria for examining how cooperative learningimpacts achievement. Of these studies, four involved chemistrycourses (1821). Nine studies contained persistence data(none in chemistry), and 11 studies contained attitudinal data(one in chemistry).</p><p>Achievement OutcomesA summary of the analysis of the studies, which involved</p><p>almost 3,500 students, indicates that cooperative learning (inits varied forms) has a significant and positive effect on</p><p>aA student performing at the 50thpercentile of the treatment group isperforming at this percentile of thecontrol group.</p><p>dnaseziStceffE.1elbaTneewtebsegnahCelitnecreP</p><p>spuorGlortnoCdnatnemtaerTeziStceffE egnahCelitnecreP a</p><p>00.0 0502.0 8504.0 6606.0 3708.0 9700.1 4802.1 8804.1 2906.1 5908.1 69</p><p>tnemeveihcAyrtsimehCnoscitsitatS.2elbaTseidutSowTmorf)maxEmreT-fo-dnE(</p><p>ydutS puorGtnemtaerT naeM )DS( tceffE eziS(gninnoL 72 ) gninraelevitarepooC</p><p>gninraellaudividnI92.2 )12.1(24.1 )22.1(</p><p>17.0</p><p>dnananiD(ikswohcyrdyrF 52 )</p><p>gninraelevitarepooCgninraellaudividnI</p><p>8.07 )2.01(1.76 )2.41(</p><p>62.0</p><p>http://jchemed.chem.wisc.edu/http://jchemed.chem.wisc.edu/Journal/issues/2000/Jan/http://jchemed.chem.wisc.edu/Journal/</p></li><li><p>Research: Science and Education</p><p>118 Journal of Chemical Education Vol. 77 No. 1 January 2000 JChemEd.chem.wisc.edu</p><p>achievement-related outcomes of college students in SMETcourses. From these 37 studies a total of 49 effect sizes werecalculated (some studies measured multiple outcomes) forachievement outcomes. Figure 1 shows the distribution of theseachievement effect sizes. The mean effect size is 0.51 with astandard deviation of 0.35. Because it shows a positive effect,the data support the assertion that cooperative learning cansignificantly enhance student achievement in undergraduateSMET courses. In practical terms, an effect size of 0.51 meansthat median student performance is increased from the 50thpercentile in the group taught by traditional methods to the70th percentile in the cooperative learning group.</p><p>Persistence and Attitude OutcomesA summary of the 9 studies that collected persistence</p><p>data and 11 studies that reported attitudinal data indicatesthat cooperative learning also has a significant and positiveeffect on student attitudes towards SMET courses. The authorsreport that persistence for continued study in SMET coursesof students taught with cooperative learning approaches was22% greater than persistence of students taught by traditionalapproaches. Students in cooperative learning classes also hadmore positive attitudes toward their classes.</p><p>Meta-Analysis of Cooperative Learning Effects onAchievement in High School and College-LevelChemistry Courses</p><p>Although the meta-analysis reported in the previoussection involved some college-level chemistry students, anadditional meta-analysis is reported here. It focuses on highschool and college chemistry courses using cooperativelearning. In addition to the four chemistry studies identifiedin the SMET meta-analysis, other college-level studies werefound, and studies involving high school students were alsoincluded. Identification of these studies was not limited toabstracting services; the author located additional articles byscanning articles that might involve cooperative learning in</p><p>chemistry in these journals: Journal of Chemical Education,Science Education, International Journal of Science Education,and Journal of Research in Science Teaching. This was donebecause these journals tend to publish data-based articles thatcan be used in meta-analysis and because abstracts do notalways indicate the educational treatment (in this case coop-erative learning) that is applied in a study.</p><p>A total of 437 high school and almost 1,100 collegestudents participated in the 15 chemistry studies that wereidentified (11 more chemistry studies than were included inthe previous meta-analysis). Table 3 shows the effect sizes ofcooperative learning on chemistry achievement (as defined byeach study) associated with these chemistry-related studies, aswell as the grade level, content area, and number of students.Figure 2 shows the effect-size outcomes in a graphic form.</p><p>These research reports on cooperative learning inchemistry courses show a mean effect size of 0.37 (and astandard deviation of 0.39) across the 30 effect sizes reportedin the 15 identified chemistry studies. This indicates thatwhile median student performance in a traditional course isat the 50th percentile, the median student performance in acooperative learning environment is 14 percentile pointshigher.</p><p>Conclusion</p><p>This paper has briefly introduced...</p></li></ul>