Research Trends: Research Trends: Qualitative Analysis in Qualitative Analysis in CSCLCSCL

Heisawn Jeong, PhD

Hallym University, S. Korea

Web 2.0Web 2.0

• Social networking, blogs, wiki, video sharing, etc.Social networking, blogs, wiki, video sharing, etc.

• Web environment/technology that enables Web environment/technology that enables interactions among usersinteractions among users

• User creates contents as well as receives.User creates contents as well as receives.

Collaboration and Collaboration and learninglearning• Effectiveness of collaboration as a tool for Effectiveness of collaboration as a tool for

learning and knowledge buildinglearning and knowledge building

• Increased use of technology to support Increased use of technology to support learninglearning

• CSCL: Computer-Supported Collaborative CSCL: Computer-Supported Collaborative LearningLearning

• Multi-disciplinary and multi-method research Multi-disciplinary and multi-method research approachesapproaches

Goals of the talkGoals of the talk

• Methodological trends in Computer-Supported Methodological trends in Computer-Supported Collaborative LearningCollaborative Learning

• Mixed-Method approaches Mixed-Method approaches

• Methodological issues and challengesMethodological issues and challenges

• Disclaimer: Speaker’s methodological Disclaimer: Speaker’s methodological backgrounds (cognitive psychology, verbal backgrounds (cognitive psychology, verbal data analysis)data analysis)

Methodological trendsMethodological trends

• Meta content-analysis of CSCL empirical Meta content-analysis of CSCL empirical research papersresearch papers

• On-going researchOn-going research Jeong, H., & Hmelo-Silver, C. (2010). Jeong, H., & Hmelo-Silver, C. (2010). An overview of CSCL An overview of CSCL

methodologies. Paper presented at the International methodologies. Paper presented at the International Conference of the Learning Sciences, Chicago.Conference of the Learning Sciences, Chicago.

Jeong, H., & Hmelo-Silver, C. (2011). Jeong, H., & Hmelo-Silver, C. (2011). A portrait of CSCL A portrait of CSCL methodologies. Paper to be presented at the Computer-methodologies. Paper to be presented at the Computer-Supported Collaborative Learning, Hong Kong.Supported Collaborative Learning, Hong Kong.

Method of analysisMethod of analysis

• 7 leading journals of the field7 leading journals of the field

• 4 years of publication (2005-2008)* 4 years of publication (2005-2008)* (N=1,423)(N=1,423)

• Empirical papers (N=315*)Empirical papers (N=315*)

Results are based on N=265 (Coding is still in Results are based on N=265 (Coding is still in progress)progress)

JournalsJournals

1.1. International Journal of Computer Supported International Journal of Computer Supported Collaborative Learning (ijCSCL)Collaborative Learning (ijCSCL)

2.2. Journal of the Learning SciencesJournal of the Learning Sciences

3.3. Learning and InstructionLearning and Instruction

4.4. Computers and EducationComputers and Education

5.5. Journal of Computer Assisted LearningJournal of Computer Assisted Learning

6.6. International Journal of Artificial Intelligence in International Journal of Artificial Intelligence in EducationEducation

7.7. Computers in Human Behavior. Computers in Human Behavior.

Paper selectionPaper selection

1.1. Papers published during 2005~2008 Papers published during 2005~2008 (exception: 2006~2007 for ijCSCL)(exception: 2006~2007 for ijCSCL)

2.2. Empirical CSCL papers:Empirical CSCL papers:

Report on dataReport on data

Collaborative learningCollaborative learning

Use of computers or other technologiesUse of computers or other technologies

3.3. 315* empirical CSCL papers (out of 1,423 315* empirical CSCL papers (out of 1,423 papers).papers).

Coding categoriesCoding categories

1.1. Design Design

2.2. Study settings Study settings

3.3. DataData

4.4. Analysis Analysis

5.5. Research questionsResearch questions

6.6. Theoretical Theoretical frameworkframework

7.7. Learner levelLearner level

8.8. Domain Domain

9.9. Pedagogical Pedagogical approachesapproaches

10.10.Technologies Technologies

11.11.Type of Type of collaborationcollaboration

Research designResearch design

• Majority of the studies are descriptive (e.g., Majority of the studies are descriptive (e.g., survey, observations, ethnographic studies).survey, observations, ethnographic studies).

Research settingsResearch settings

• Majority of the studies were carried out in Majority of the studies were carried out in classrooms.classrooms.

Data typesData types

• Multiple types of data are collected in a given Multiple types of data are collected in a given study (M=2.72)study (M=2.72)

• Data on learning processes are:Data on learning processes are:

• Data on learning outcomes are:Data on learning outcomes are:

• Other data sources include:Other data sources include:

AnalysesAnalyses

• Quantitative analyses are dominant Quantitative analyses are dominant throughout, but substantial proportion of the throughout, but substantial proportion of the studies use qualitative analysesstudies use qualitative analyses

• Popular quantitative analyses are:Popular quantitative analyses are:

• Qualitative analyses are getting more Qualitative analyses are getting more popular, but they are not clearly defined.popular, but they are not clearly defined.

Summary of trendsSummary of trends

1.1. Increase of field (i.e., classroom) researchIncrease of field (i.e., classroom) research

2.2. Increase of design-based research Increase of design-based research

3.3. Increase of mixed-methods or multi-methods Increase of mixed-methods or multi-methods researchresearch

Types of mixed-Types of mixed-approachesapproaches

Collect qualitative data in addition to Collect qualitative data in addition to quantitative data. Contextualize quantitative quantitative data. Contextualize quantitative analysis with qualitative analyses. analysis with qualitative analyses.

Collect qualitative data, but analyze them to Collect qualitative data, but analyze them to allow quantitative analyses (e.g., verbal allow quantitative analyses (e.g., verbal analysis, quantitative content analysis)analysis, quantitative content analysis)

Use quantitative and qualitative analysis to Use quantitative and qualitative analysis to address different research questionsaddress different research questions

Methodological Methodological challengeschallenges1.1. Shallow application of methodologiesShallow application of methodologies

2.2. Increase of qualitative methods, but often lack Increase of qualitative methods, but often lack clear definition and rigor of applicationclear definition and rigor of application

3.3. Lack of more sophisticated methodological Lack of more sophisticated methodological vocabularies vocabularies

4.4. Epistemological incompatibility: Epistemological incompatibility:

Reality vs. InterpretationReality vs. Interpretation

Procedure vs. MeaningfulnessProcedure vs. Meaningfulness

Presented at the Asia-Pacific Presented at the Asia-Pacific conference on Qualitative Research conference on Qualitative Research

in Web 2.0 in Web 2.0 22 & 23 Feb 2011, Macau SAR 22 & 23 Feb 2011, Macau SAR

For more informationFor more informationPlease visit: Please visit: http://www.merlien.org