building an information community: it and research working together does technology improve student...

Building an Information Community: IT and Research Working Together

Does Technology Improve Student Learning?

Michelle Barton, Palomar CollegeDarla Cooper, Oxnard College

Kelvin Leeds, Santa Ana CollegeSusan Longacre, City College of San FranciscoJohn Whitmer, @ONE Project, Evergreen Valley

College


Outline1. Overview (John)

2. Researchers (Darla & Michelle)

3. The Effect of Tablet PCs on Learning and Collaboration (Kelvin)

4. Developing Critical Thinking in the Nursing Student Using Simulated Online Clinical Scenarios (Sue)

5. Q & A


Overview (1)• @ONE Project • Vision: evaluate effectiveness of

technology in CCC classrooms• Goals of Scholar Program:

1. To create and share original research on the impact of instructional technology on student learning in California Community College classrooms

2. To support the improvement of faculty members’ research abilities, technology skills, and pedagogical approaches


Overview (2)• Faculty-designed research project (competitive

application), using Classroom Action Research methodology

• Ongoing program: 6 Scholars 04-05, 10 Scholars 05-06, 10 Scholars 06-07

• Research support: added to 05-06 cohort through Center for Student Success

• Support team: Pedagogical Support, Research Support, Instructional Tech Support, Logistics

• Program Elements: Summer Retreat, Winter Retreat, Spring Graduation (06-07 only), Virtual Group Meetings, individual support


2005-06 @ONE Carnegie Scholars (1)

1. Gregory Beyrer - Distance Education and Media Services, Cosumnes River College"Online Student Success": Making a Difference

2. Carolyn Brown - Graphic Design, Foothill CollegeStudent engagement and outcome in online courses; what can we learn from face-to-face learning communities?

3. Cheryl Carter - Counseling, Diablo Valley CollegeNon-Traditional Student Participation in Synchronous Online Workshops

4. Bobby Hutchison - Business, Behavioral and Social Sciences, Modesto Junior CollegeThe Impact of Online Human Sexuality Education on Percpetions of Risk, Worry and Knowledge

5. Kelvin Leeds - Mathematics, Santa Ana CollegeTechnology: Fad or Fixture

http://one.evc.edu/carnegie/05-06/beyrer_gregory.htm

http://one.evc.edu/carnegie/05-06/brown_carolyn.htm

http://one.evc.edu/carnegie/05-06/brown_carolyn.htm

http://one.evc.edu/carnegie/05-06/carter_cheryl.htm

http://one.evc.edu/carnegie/05-06/hutchison_bobby.htm



http://one.evc.edu/carnegie/05-06/leeds_kelvin.htm


2005-06 @ONE Carnegie Scholars (2)

6. Patrick Len - Physical Sciences, Cuesta CollegeAnalyzing Individual and Cooperative Electronic Response Systems to Improve Student Learning and Attitudes in Astronomy

7. Susan Longacre, - Registered Nursing, City College of San FranciscoUtilizing Online Simulated Clinical Scenarios to Develop Critical Thinking in the Nursing Student

8. Scott Lukas - Anthropology/Sociology, Lake Tahoe CollegeAn Assessment of Reflexive Student Learning in Online Social Science Courses

9. Frances Rice-Farrand - Nursing, Los Angeles City CollegeEducation for Future

10. Denise Stiglich - Math and Science, Antelope Valley CollegeInteractive PowerPoint and Online Homework Programs in the Classroom

http://one.evc.edu/carnegie/05-06/len_patrick.htm

http://one.evc.edu/carnegie/05-06/len_patrick.htm

http://one.evc.edu/carnegie/05-06/longacre_susan.htm

http://one.evc.edu/carnegie/05-06/longacre_susan.htm

http://one.evc.edu/carnegie/05-06/lukas_scott.htm

http://one.evc.edu/carnegie/05-06/lukas_scott.htm

http://one.evc.edu/carnegie/05-06/rice_farrand.htm

http://one.evc.edu/carnegie/05-06/stiglich_denise.htm


The Researchers

The Odd Couple


Overview

• What Did We Do?

• How Did We Do It?

• Why Did We Do It?

• Would We Do It Again and What Would We Do Differently?

• What Did the Scholars Study and How Did They Do It?


What Did We Do?

• Worked with @ONE staff

• Retreats

• Worked with the scholars


Worked with @ONE Staff

• Helped select the scholars• Met regularly to review program• Met regularly with scholars to get

updates on their progress• Discussed drafts of monographs• Helped plan for next year


Retreats

• Helped plan the retreats• Prepared and gave presentations at

the retreats• Met individually with each scholar to

review: – Research design and methodology

(1st retreat) – Data analysis and interpretation

(2nd retreat)


Worked with the Scholars

• Helped refine and solidify research question, design and methodology

• Reviewed and helped develop survey instruments, databases, and definition files

• Helped with data analysis and interpretation

• Reviewed monographs and provided feedback to scholars

• Helped with data presentation in the monograph

• On call for help


How Did We Do It?

• TEAMWORK!!

• Communication (Lots of it!)

• Humor

• Patience


Why Did We Do It?

• To do research again

• To learn about technology and its impact on learning in different disciplines

• To do research that matters and directly impacts students


Would We Do It Again and What Would We Do Differently?

• YES! YES! YES!• Lessons learned

– Focus is key– Data storage and organization– Data presentation– Review instruments– Submission of written methodology


What Did the Scholars Study andHow Did They Do It?

• Impact of collaborative use of “clickers” on student learning and attitudes in astronomy (Mixed design, pre-test post-test & two groups)

• Comparison of student perceptions and experiences regarding participation in face-to-face and online discussion groups (Questionnaire and interview)

• Impact of an online preparation course on student performance in online courses (Analysis of historical data and questionnaire)


What Did the Scholars Study andHow Did They Do It?

• Participation and satisfaction of non-traditional students in synchronous online student services workshops (Questionnaire)

• Student perceptions of learning using Tablet PCs (Questionnaire and interview)

• Effect of online clinical scenarios on the development of critical thinking skills (Mixed design, pre-test post-test with experimental and comparison groups)


The Effect of Tablet PCs on Learning and Collaboration:

A Study of Student Perceptions

Kelvin LeedsSanta Ana College

April 11, 2006

Background

• Technology is changing the classroom setting

• Keyboards are not conducive for Math and Science Type classes

• Tablet PCs may be more suitable for Math and Science classes

Technology Uses• Tablet PC

– Use Tablet PC as virtual paper to take notes

• Synchroneyes– Software program that enables the instuctor to view

student computer screens

• Blackboard– Online portal used to post course materials

• Whiteboard– Software program that allows students to form

virtual groups

Research Questions

• Do students think the use of Tablet PCs in the classroom enhances their learning when compared to traditional methods?

• Do students think the use of Tablet PCs during class increases collaboration between them and their classmates?

• Are students hesitant to share their classroom work since others in class may know whose work is whose?

Methodology

• MESA Pre-Calculus Course at Santa Ana College, Fall 2005 Semester, 23 students

• Developed two questionnaires:– Background Questionnaire– Student Perception Questionnaire

• Follow up interviews

Background Questionnaire

11 questions designed to investigate students’ knowledge/experience with computers, 22 students

• Overall computer use

• Course work and computer use

• Computer access

Background Questionnaire

Sample QuestionIn general, how often do you use a computer during scheduled class time at this college? a.) I never use computers during class

timeb.) Less than half of the timec.) Half of the timed.) More than half of the time

Background QuestionnaireKey Findings for Background Questionnaire

• Overall Computer Use– Virtually all students use computers outside of class– Half of students use computers for more advanced tasks

beyond word processing/email/Internet• Course Work and Computer Use

– Most students use computers outside of class to complete course related materials

– Half of students use computers in class to complete course related materials

• Computer Access– Most students have access to a computer at home or

work– Half of students use computers on campus, the other

half have access to a more convenient computer

Student Perception Questionnaire

• 18 Questions designed to investigate students’ perceptions about using Tablet PCs during class• Instructor's Notes• Students’ Notes• Homework• General Comments

• Two Administrations, 14 students– Middle and end of the term


Sample Question When the instructor uses Synchroneyes to

present my notes on the screen in front of the class:a.) I feel very comfortableb.) I feel somewhat comfortablec.) I feel somewhat uncomfortabled.) I feel very uncomfortablee.) It does not bother me one way or the otherf.) Not Applicable


Key Findings for Instructor’s Notes

• All students felt it was helpful to have instructors notes available on the Internet

• Most students access these notes at least half of the time


Key Findings for Students’ Notes

• More than half of students felt using the Tablet PC to take notes was more helpful than using traditional pencil/paper

• Most students feel comfortable when their notes are presented in front of the class using Synchroneyes

• Most students think using Synchroneyes to present other students’ notes is helpful


Key Findings for Homework

• Most students think using Whiteboard to review homework is more helpful than traditional paper/pencil

• Most students think using Whiteboard to review homework creates more collaboration than traditional paper/pencil


Key Findings for General Comments

• Most students think that using computers in non-computer related courses during regular class time is more helpful than not using computers in class

• More than half of students think that using computers during class time improves their performance during class

Follow up Interviews

• Students feel it is helpful to use Synchroneyes since they see more than one way to solve a problem

• Some students do not take notes because this allows them to focus on what the instructor says, knowing they will have access to the instructor’s notes later

Overall Results

• More than half of students felt that using computers in class improved their performance during class

• More than half of students felt that they collaborate more using Whiteboard and the Tablet PC rather than traditional paper/pencil

• Most students felt comfortable when their work was presented to class using Synchroneyes with the Tablet PC

Future Research

• Do students think it is worth the time and effort that it takes to learn to use the Tablet PC?

• Do students think that using the Tablet PCs in combination with blackboard helps to keep course information more organized?

• Students have access and knowledge about computers, thus the background survey is not necessary

Implications

• Although it takes time both to learn and use in the classroom, students think that using computers during class improves their classroom performance

• Having access to a copy of the instructors notes online is helpful to students

• Tablets PCs can be used to increase collaboration amongst students in other classes


Developing Critical Thinking in the Nursing Student Using Simulated Online Clinical

Scenarios

Sue Longacre, RN, MSRegistered Nursing Department

City College of San Francisco


Problem Statement

“The new nurses can detect there is a problem; they may be able to determine that it is urgent, but then all they do is call the doctor. They cannot diagnose what is wrong, even in instances where the problem is as common as an oncoming stroke or heart attack.”

Betty and Gordon Moore Foundation Focus Group Study, 2005


Critical Thinking Definition

Critical thinking is a purposeful, results-oriented process that focuses on decision making, problem solving, and clinical judgment.

Brunt (2005)


Critical Thinking Competencies

Faccione’s (1990) Critical Thinking Competencies• Interpretation• Analysis• Evaluation• Inference• Explanation• Self-Regulation

.


Course Content

• Maternal/Newborn Nursing• Simulated online clinical scenarios• Multi-media and text• Asynchronous learning, available via

WebCT• Students completed written

responses via WebCT• Assignments returned with faculty

comments via WebCT


Research Hypothesis

Students who complete the online clinical scenarios will demonstrate a larger increase in their post-test critical thinking skills over their pre-test critical thinking skills than those students who do not complete the online clinical scenarios.


Research Group Pre-Test(first day of course)

Treatment(4 times during

course)

Post-Test(last day of course)

Experimental (n=19)

X O X

Comparison (n=19)

X X

Study Design

X = Critical Thinking Assessment Instrument

O = Simulated Online Clinical Scenarios

Formal survey administered on the last day of class to experimental students to gather feedback on students’ perceptions of the online assignments.


Demographics by Research Group

• Gender: predominantly female

• Ethnicity: experimental group Asian/Filipino (68%), comparison group Caucasian (68%)

• Median age 32

• Direct patient care experience: 5 experimental and 4 comparison students


Clinical Scenario AssignmentExample


• The patient is a 25 year old Gravida 2 Para 1 @ 28 weeks gestation.

• Her first pregnancy and delivery were normal.

• She takes prenatal vitamins.

• Today’s fundal height measurement is 28 centimeters.

Patient Assessment

Sample Online Clinical Scenario slide using picture and text.


The patient’s BMI before pregnancy was 21.

Her prepregnant weight was 59K (130#).

Her weight today is 68K (150#)

Pregnancy Weight Gain

Sample Online Clinical Scenario slide using a graph and text.


The patient is complaining of frequent ‘leg cramps’ of her calf area.

The patient asks the nurse, “What can I do to stop this muscle cramping of my legs?”

Patient’s Question

Sample Online Clinical Scenario slide with patient’s question.


1. How would you answer the patient’s

question?

2. What would be pertinent nursing diagnoses, starting with the highest priority and why? (This may include risk for...)

3. Describe appropriate nursing actions and/or interventions for the patient. Describe your rationale for these actions and/or interventions.

Assignment

You are the nurse caring for this patient today in the clinic. Based on the information provided;


Critical Thinking Assessment Instrument

DEVELOPMENT•Standardized Critical Thinking Instruments not adequate for nursing

•Instrument developed to measure critical thinking competencies in a nursing environment

•Reviewed by @ONE staff and nursing faculty

•Piloted on previous students


Critical Thinking Assessment Instrument

SCORING•Scored by two faculty blind to purpose of research project

•Reviewers agreed with majority of scores

•When scores differed, a 3rd faculty assigned final score, always agreed with one of previous scores


Results

Mean SD N Mean SD NPre-test 5.1 1.5 19 5.6 1.9 19Post-test 8.6 3.4 19 7.6 2.2 19

Experimental Comparison

Mean Scores for Critical Thinking Pre and Post-Tests by Research Group

• Both groups mean individual scores show an increase in each of the critical thinking competencies

•Two students in each group demonstrated a decrease in their post-test scores over their pre-test scores

•The majority of students in each group improved their scores


Survey• The clinical scenario assignments improved my

ability to analyze multiple assessments in a complicated patient.– 78% strongly agreed– 22% agreed

• The clinical scenario assignments better prepared me to base my nursing care on sound nursing theory.– 67% strongly agreed– 33% agreed


Survey• Students spent considerable time completing

assignments, 33% reported spending 5 hours or more on each assignment

• Faculty feedback was important in learning

• “The most helpful thing is the patient’s question.”

• “Pictures made it real life.”

• “It provided me a chance to practice critical thinking.”


Conclusion

While the performance of both groups improved significantly over time, the experimental group shows a significantly larger improvement in mean critical thinking test scores from pre-test to post-test.


Implications

• Construct validity of critical thinking assessment instrument needs to be established

• Instrument specific to maternal/newborn nursing, could easily be adapted to other areas of nursing

• Cost-effective alternative to supplement students’ clinical internship hours

• Students expressed satisfaction with computer based clinical scenarios

• Students thought assignments should be part of course curriculum


Future Research

Further research may determine what component of these clinical scenario assignments improved the students’ critical thinking skills. Was it:

•the technology tool,

•the faculty feedback,

•the patient’s questions,

•or possibly all of these factors combined?


Questions?

Michelle Barton [email protected] (760) 744-1150 ext. 2360

Darla Cooper [email protected] (805) 986-5800 ext 7697

Kelvin Leeds [email protected] (714) 564-6737

Sue Longacre [email protected] (415) 452-5214

John Whitmer [email protected] (408) 223-6788

Contact Information

building an information community: it and research working together does technology improve student...

Documents

student learning

research support

cuesta college

nursing student

original research

information community

santa ana college technology

student success support