Download - Mentor Self-efficacy and Perceived Program Support scale : M-SEPPS Suzannah Vallejo Calvery, PhD
Mentor Self-efficacy and Perceived Program Support
scale: M-SEPPS
Suzannah Vallejo Calvery, PhD
National Mentoring SummitJanuary 25, 2013
THE AGENDA
Down the Rabbit Hole: Lit Review and Design
Fun with Scales: Instrumentation
Psychometric Joy: Validity and Reliability
Back out of the looking glass: Implications and Applications
THE BIG QUESTION Funding is increasingly focused on:
Outcomes-based assessment Best-practices
Only proven interventions are receiving the funding necessary to implement solutions.
DOWN THE RABBIT HOLE: DOES MENTORING WORK?
Best practices gleaned over time Match quality Match length Program infrastructure
2002 vs. 2011 findings of DuBois et al. studies (2002, 2011)
WHAT ABOUT THE MENTOR? Dyadic construct
with monadic research base
Best practices tied to mentor self-efficacy
NEW INSTRUMENT PREPARATION & VALIDATION
M-SEPPS InstrumentResearch Questions:1) What are the
psychometric properties of the proposed measure?
2) Are there significant differences between demographic groups?
FUN WITH SCALES1. Literature Review2. Item Construction*3. Pilot4. Item Refinement5. Data Collection
6. Analysis: • Assumptions• Exploratory Factor
Analysis• Item analysis• Reliability
estimation* Bandura, 2006; Fowler, 2009; Gefen & Straub, 2005; Netemeyer, Bearden, & Sharma, 2003; Nunnally, 1978; Nunnally & Bernstein, 1994; Pett, Lackey, & Sullivan, 2003.
METHOD
Participants
Original scale/item pool: General self-efficacy Personal teaching
efficacy Mentor/tutor self
efficacy Program Support
PRINCIPAL AXIS FACTORING 104 participants in remaining analysis 18 total items 3 latent constructs
Process: 1. PAF (Pett, Lackey, & Sullivan, 2003, Tabachnik &
Fidell, 2007)2. Direct Oblimin rotation w/delta level of -.5*3. 5 original factors extracted, 3 retained*Pett et al.
PSYCHOMETRIC JOY!
RELIABILITY ESTIMATESFactor M SD 1 2 31. General self-efficacy (n = 8) 64.21 8.091 0.882. Perceived Program Support
(n = 4) 32.53 4.973 0.257 0.833. Mentor/Tutor self-efficacy (n
= 6) 46.88 5.863 0.511 0.172 0.78Total Scale (n = 18) 144 14.763 0.892Factor Correlations and Factor Alpha Coefficients for the M-SEPPS Scale
Per Research Question #2:Original Demographic data variables:
Age, Gender, Ethnicity, Level of education, Previous experience tutoring, Years tutoring.
Age was the only demographic variable that had significant differences between levels on Factors 2 an 3.
BACK OUT OF THE LOOKING GLASS:LIMITATIONS AND FUTURE RESEARCH
Limitations: Sample size Test-retest reliability Scale redundancy
Next Steps: CFA Larger sample Scale reduction
AND AFTER THAT? IMPLICATIONS FOR PRACTICE
Program Evaluation Dynamic program assessment Building support for implementation of
best practices
Thank you for attending.
Q & A