brad wuetherick, gmcte krista trinder, college of medicine
TRANSCRIPT
Brad Wuetherick, GMCTEKrista Trinder, College of Medicine
Data Collection◦ Reminder about key issues discussed in previously
Data Analysis◦ Explore data analysis tools, and key issues to
remember when analyzing SOTL data Dissemination
◦ Explore where and what to disseminate, and what to look out for
Poster Tips◦ Discuss what makes a good poster (and not so
good poster)
Prior to data collection◦ Decide on your instruments and pilot test◦ Try to use previously validated instruments when
possible.◦ When creating your own tools, have them
reviewed by judges for clarity, content, etc.
How many participants do you need?◦ Sample size depends on the type of research and
intended analyses.◦ Quantitative methods should have a sample size
of at least 30. ◦ Some analyses require sample sizes >100.◦ Qualitative methods often need fewer
participants.
G*Power can help you estimate how large your sample needs to be to find a statistically significant result.◦ Need to know your statistical test◦ Effect size (d = .2 is small, .5 = medium, .8 =
large)◦ Probability of error (0.05)◦ Power (.80)◦ Allocation ratio (whether groups are equal)
◦ http://www.psycho.uni-duesseldorf.de/abteilungen/aap/gpower3/
Online vs. Paper/pencil Online Pros
◦ Ability to reach more participants◦ Can be completed at participants’ convenience◦ Greater sense of anonymity◦ Less paper!◦ Saves time – can upload results into Excel/SPSS◦ Reduces data entry errors
Online Cons◦ Lower response rate◦ Perceived privacy issues
U of S Survey Tool The U of S offers a free survey tool that is
very flexible and customizable – this survey works very well for small groups on campus (using an NSID login/password)
http://www.usask.ca/its/services/websurvey_tool/create.php
Survey Monkey◦ Free basic version
Up to 10 questions per survey 100 responses per survey More limited options
◦ Professional version Many survey options Unlimited questions per survey Unlimited responses per survey $225/year – monthly rates of $25 available
Hiring/Training a Research Assistant (undergrad or grad) Some key issues:
◦ Hiring a student from your discipline Pros: vested interest in the discipline, know the culture
of the discipline, often known to the researcher Cons: may be new to this type of research, need
training/support on methods/analysis◦ Hiring a student from education/social sciences
Pros: often know the research methods being used which can speed up project, can be a resource to researchers new to this area
Cons: usually less connected to specific disciplines, usually new to the researchers (which may make them harder to find)
Quantitative Programs◦ SPSS (PASW)◦ Excel◦ SAS◦ R
Qualitative Programs◦ NVivo◦ ATLAS ti
ITS offers training sessions in several data analysis programs
SPSS◦ January 18 & 20◦ January 18 & 25
Nvivo◦ By demand
Excel◦ By demand
Data screening Check that data set is accurate and
complete◦ RAs should code data as soon as possible◦ Check for errors in coding
Have 2nd RA code some data independently to identify discrepancies.
◦ Make sure missing data is actually missing Go to raw data
◦ Run frequency counts for all variables to identify out of range responses
Missing data and outliers
◦ There are several options for dealing with missing data or with outliers.
◦ Options can be rather technical
◦ Please contact us or a statistician if you have any questions about your data.
Good to know your analyses before collecting data
See handout
Don’t fall into the following traps◦ Quantitative – data mining◦ Qualitative – finding what you want to find while
ignoring other data
There are three main ways to disseminate:◦ Publications◦ Conferences◦ Public Talks (or College/Department Committees,
institutional symposia, GMCTE presentations, etc.) Publications:
◦ Discipline-specific Education journals◦ General Higher Education◦ General Education (often themed – ie. technology,
international, etc.)◦ Monographs/Edited Volumes
Conferences:◦ Discipline-specific conferences◦ Higher Education Teaching and Learning
Conferences Practice-oriented SOTL-oriented Research-oriented
Key things to remember:◦ What type of audience? What type of session
(concurrent session, roundtable, workshop, poster)? What are the conferences expectations (interactive, conference proceedings, etc.)?
Can use PowerPoint, Adobe Illustrator, or Adobe InDesign
ITS offers training sessions:◦ PowerPoint – January 27◦ Illustrator – by demand◦ InDesign – February 16
Attract attention◦ Draw people to your poster◦ Should be able to review in less than 10 minutes
Simple and uncluttered◦ Don’t use too much text; at least a 24 pt serif font◦ Summarize key points◦ You can explain the rest
Light background and dark font
Use charts and images where appropriate
General sections to include (may vary slightly by conference)◦ Title◦ Introduction◦ Materials and methods◦ Results◦ Conclusions◦ Literature cited◦ Acknowledgments
See: http://www.swarthmore.edu/NatSci/cpurrin1/posteradvice.htm
Thank you!