daniela c. schröter (schroeter) › sites › default › files › curriculum-vitae › schroeter...

33
Curriculum Vitae | Daniela C. Schröter | Page 1 of 33 Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs and Administration College of Art and Sciences, Western Michigan University, Kalamazoo MI 49008-5440 Office telephone: (269) 387-8930; Cell: (269) 267-8227 E-mail: [email protected], Skype: daniela.schroeter Education 2008 Ph.D. in Interdisciplinary Evaluation, Western Michigan University, Kalamazoo, MI, USA Examination committee: Michael Scriven, Daniel Stufflebeam, & Brooks Applegate. Dissertation committee: Matthew Mingus, Michael Scriven, & Jennifer Palthe. Dissertation: Sustainability Evaluation: Development and Validation of an Evaluation Checklist (Checklist featured by USAID Project Starter). 2002 M.A. (Magistra Artium) in German as a Foreign/Second Language, Intercultural Business Communication, and American Studies, Friedrich Schiller University, Jena, Germany Advisors: Drs. Jürgen Bolten & Hermann Funk. Thesis: Training Competencies Through Internet-Supported Cooperative Learning: Integrative Internships in Teaching German as a Foreign/Second Language. 1998 – 99 Study Abroad, Michigan State University, East Lansing, MI, USA Advisor: Dr. Thomas Lovik Concentration: Linguistics and Business Anthropology Employment History 2015 – Assistant Professor (since 8/17/2015), School of Public Affairs and Administration, Western Michigan University 2009 – Associate Graduate Faculty Member, Interdisciplinary Ph.D. in Evaluation Program, Western Michigan University 2008 – 15 Director of Research (12/1/2008 – 8/16/2015), The Evaluation Center, Western Michigan University 2008 Project Manager (September–November), Nexus Market Research, Inc. 2003 – 07 Co-Owner/Evaluator/Consultant, CS Evaluation, LLC. Portage/Kalamazoo, MI, USA 2002 – 04 Adjunct Faculty, Friedrich Schiller University, Department of Intercultural Business Communication, Jena, Germany 2000 – 02 Manager, Consultant, Trainer, Interculture.de, Jena, Germany 2000 – 01 Adjunct Faculty, Bauhaus University, Weimar, Germany 1999 – 00 Instructor, Institute for Intercultural Communications, Jena, Germany

Upload: others

Post on 30-Jun-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 1 of 33

Daniela C. Schröter (Schroeter) Assistant Professor

School of Public Affairs and Administration College of Art and Sciences, Western Michigan University, Kalamazoo MI 49008-5440

Office telephone: (269) 387-8930; Cell: (269) 267-8227 E-mail: [email protected], Skype: daniela.schroeter

Education

2008 Ph.D. in Interdisciplinary Evaluation, Western Michigan University, Kalamazoo, MI, USA

Examination committee: Michael Scriven, Daniel Stufflebeam, & Brooks Applegate. Dissertation committee: Matthew Mingus, Michael Scriven, & Jennifer Palthe. Dissertation: Sustainability Evaluation: Development and Validation of an Evaluation Checklist (Checklist featured by USAID Project Starter).

2002 M.A. (Magistra Artium) in German as a Foreign/Second Language, Intercultural Business Communication, and American Studies, Friedrich Schiller University, Jena, Germany

Advisors: Drs. Jürgen Bolten & Hermann Funk. Thesis: Training Competencies Through Internet-Supported Cooperative Learning: Integrative Internships in Teaching German as a Foreign/Second Language.

1998 – 99 Study Abroad, Michigan State University, East Lansing, MI, USA

Advisor: Dr. Thomas Lovik Concentration: Linguistics and Business Anthropology

Employment History

2015 – Assistant Professor (since 8/17/2015), School of Public Affairs and Administration, Western Michigan University

2009 – Associate Graduate Faculty Member, Interdisciplinary Ph.D. in Evaluation Program, Western Michigan University

2008 – 15 Director of Research (12/1/2008 – 8/16/2015), The Evaluation Center, Western Michigan University

2008 Project Manager (September–November), Nexus Market Research, Inc.

2003 – 07 Co-Owner/Evaluator/Consultant, CS Evaluation, LLC. Portage/Kalamazoo, MI, USA

2002 – 04 Adjunct Faculty, Friedrich Schiller University, Department of Intercultural Business Communication, Jena, Germany

2000 – 02 Manager, Consultant, Trainer, Interculture.de, Jena, Germany

2000 – 01 Adjunct Faculty, Bauhaus University, Weimar, Germany

1999 – 00 Instructor, Institute for Intercultural Communications, Jena, Germany

Page 2: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 2 of 33

Awards and Recognition

2016 WMU Recognition for Excellence in Discovery: Research and External Funding over $1 Million Lever for 5 Years 2010 - 2015

2015 WMU Recognition for Excellence in Discovery: Research and External Funding over $1 Million Lever for 5 Years 2009 - 2014

2013 American Evaluation Association Marcia Guttentag Award

2011 Western Michigan University Outstanding New Professional Award

Nominated for the Western Michigan University Supervisor Superstar “Supervisor of the Year” 2010-2011

2010 Western Michigan University Research Development Award

2006 Western Michigan University Graduate College International Travel Award

2006 Western Michigan University Graduate College Travel Award

2006 European Evaluation Society/United Kingdom Evaluation Society Bursary

2006 European Union Grant ($2,000), supported by the European Community’s Sixth Framework Program under the Marie-Curie Conferences and Training Courses Action, to cover costs of attending and presenting at the Evaluation of Sustainability conference (EASY-ECO) in October 2006

2006 Honor Society of Phi Kappa Phi, induction on invitation as a top 10 percent graduate student at Western Michigan University (April)

2006 Doctoral Seminar on Results-Driven Organizational Change of Robert H. Schaffer & Associates, nominated by R. O. Brinkerhoff. (January 12-13, 2006)

2004 Western Michigan University Graduate Student Travel Award

Graduate Associateships

Fall 2007 Doctoral Research Associate, Interdisciplinary Ph.D. in Evaluation, Western Michigan University (Supervisor: Dr. Michael Scriven)

Summer 2006 Doctoral Research Associate, Kalamazoo Community Indicators Project (Irving S. Gilmore Foundation), Interdisciplinary Ph.D. in Evaluation, Western Michigan University (Supervisor: Dr. Michael Scriven)

2003 – 06 Doctoral Research Associate, The Evaluation Center, Western Michigan University, National Science Foundation: National, multisite evaluation of the Advanced Technological Education (ATE) program (Supervisor: Carl Hanssen)

2003 – 04 Doctoral Research Associate, Interdisciplinary Ph.D. in Evaluation, Western Michigan University (Supervisor: Dr. E. Jane Davidson)

2002 – 03 Doctoral Research Associate, Western Michigan University, Department of Teaching, Learning, and Leadership, College of Education, Kalamazoo (Supervisors: Dr. Cheryle Crawford and Dr. Sue Poppink)

Page 3: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 3 of 33

2000 – 02 Research Assistant, Friedrich Schiller University, Department of Intercultural Business Communication, Jena, Germany: Edited and published an anthology, papers presented at the first intercultural summer academy in Jena, 2000 (see publications); edited the second edition of Intercultural Negotiation Training in different languages; advised first-semester students (Supervisor: Dr. Jürgen Bolten)

1998 – 99 Teaching Assistant, Michigan State University, East Lansing (Supervisor: Dr. Thomas Lovik)

Publications

Peer-Reviewed Journal Articles

Coryn, C. L. S., Wilson, W. N., Westine, C. D., Hobson, K. A., Ozeki, S., Fiekowsky, E. L., Greenman II, G. D., Schröter, D. C. (2017). A Decade of Research on Evaluation: A Systematic Review of Research on Evaluation Published Between 2005 and 2014. American Journal of Evaluation. (Currently available on AJE Online First awaiting print).

Coryn, C. L. S., Ozeki, S., Wilson, L. N., Greenman II, G. D., Schröter, D. C., Hobson, K. A., Azzam, T., & Vo, A. T. (2016). Does research on evaluation matter? Findings from a survey of American Evaluation Association members and prominent evaluation theorists and scholars. American Journal of Evaluation. 1098214015611245.

Schröter, D.C., Magura, S., Coryn, C. (Eds.). (2015). Deconstructing Evidence-Based Practice: Progress and Ambiguities. Evaluation and Program Planning, 48, 90-91.

Burkhardt, J.T., Schröter, D.C., Magura, S., Means, S.N., Coryn, C.L.S. (2015). An Overview of Evidence-Based Program Registers (EBPRs) for Behavioral Health. Evaluation and Program Planning, 48, 92-99.

Means, S.N., Magura, S., Burkhardt, J.T., Schröter, D.C, & Coryn, C.L.S. (2015). Comparing Rating Paradigms for Evidence-Based Program Registers in Behavioral Health: Evidentiary Criteria and Implications for Assessing Programs. Evaluation and Program Planning, 48, 100-116.

Magura, S., Burkhardt, J., Schröter, D. C., Means, S., Vladimirovna, Y., & Coryn, C. L. S. (2015). Assessing standards of evidence in evidence-based program registers for behavioral health treatments. Drug and Alcohol Dependence, 146, e191.

Coryn, C.L.S., Schröter, D.C., & McCowen, R.H. (2014). A Mixed Methods Study of Some of the Factors Associated With Successful School Strategies for Native Hawaiian Students in the State of Hawai’i. Journal of Mixed Methods Research 8(4), 377-395.

Coryn, C. L. S., Schröter, D. C., Cullen, A., Semen, L., & McLaughlin, J. (2012). Assessing implementation fidelity of a national nutrition education program: A case study of Share Our Strength’s Operation Frontline. Journal of MultiDisciplinary Evaluation, 8(19), 15-25.

Schröter, D. C., Coryn, C. L. S., Cullen, A., Robertson, K. N., & Alyami, M. (2011). Using concept mapping for planning an evaluation of a statewide energy efficiency initiative. Energy Efficiency, 5(3), 365-375.

Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011). A systematic review of theory-driven evaluation practice from 1990 to 2009. American Journal of Evaluation, 32(3).

Page 4: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 4 of 33

The Oral History Project Team (Miller, R. L., Coryn, C. L. S., & Schröter, D. C. (2010). The oral history of evaluation: An interview with James R. Sanders. American Journal of Evaluation.

Coryn, C. L. S., Schröter, D. C., & Hanssen, C. E. (2009). A modification of the Success Case Method for strengthening causal inferences from single-group studies. American Journal of Evaluation, 30(1), 80-92.

The Oral History Project Team (Miller, R. L., Coryn, C. L. S., & Schröter, D. C.). (2008). The oral history of evaluation: The professional development of Daniel L. Stufflebeam. American Journal of Evaluation, 29(4), 555-571.

Dewey, J. D., Montrosse, B. E., Schröter, D. C., Sullins, C. D., & Mattox, J. R. (2008). Evaluator competencies: What’s taught versus what’s sought. American Journal of Evaluation, 29(3), 268-287.

Coryn, C. L. S., Gugiu, P. C., Davidson, E. J., & Schröter, D. C. (2008). Assessing needs in hidden populations using respondent-driven sampling. Evaluation Journal of Australasia, 7(2), 3-11.

Schröter, D. C., Coryn, C. L. S., & Montrosse, B. (2008). Peer review of submissions to the annual American Evaluation Association conference by the Graduate Student & New Evaluators Topical Interest Group. Journal of MultiDisciplinary Evaluation, 5(9), 25-40.

Coryn, C. L. S., Schröter, D. C., & Zeller, P. A. (2005). Practical ethics for program evaluation: Client impropriety. Journal of Multidisciplinary Evaluation, 2, 72-75.

Conference Proceedings

Schroeter, D.C., Snow, J., Means, S.N., Ozeki, S., Greenman II, G., Fiekowski, E. (2015). PEEPs for PD: Project Evaluation Effectiveness Principles for Professional Development in Elementary Science Teaching. American Educational Research Association Conference Proceeding.

Greenman II, G. D.; Schroeter, D. C.; Smith, C. D.; Wilson, L. N.; Robertson, K. N.; Mateu, P.; & Hobson, K. A. (2015). Examining An International Outreach Program Using Multi-Attribute Utility Theory (MAUT): A Case Study. Midwest Political Science Association Conference Proceeding.

McCowen, R.H., Schroeter, D.C., Snow, J., Means, S.N. (2014). Exploratory Identification of Project Evaluation Effectiveness Principles for Professional Development in Elementary Science Teaching: PEEPs for PD. Educational Research Association.

Books and Chapters

Schröter, D. C. (2009). Sustainability Evaluation: Development and validation of an approach to sustainability evaluation. Saarbrücken, Germany: Südwestdeutscher Verlag für Hochschulschriften.

Schröter, D. C. (2008). Kompetenztraining im Studium DaF/Z durch netzgestütztes kooperatives Lernen. [Teaching Competencies in the Degree Program German as a Foreign/Second Language via Internet-Supported Cooperative Learning]. Saarbrücken, Germany: VDM. (Master’s thesis).

Schröter, D. C. (2008). The logic and methodology of sustainability evaluation: A checklist approach. (pp. 217-236). In M. Ant, A. Hammer, & O. Löwenbein (Eds.), Nachhaltiger Mehrwert von Evaluation [Sustained value-added via evaluation]. Bielefeld, Germany: Bertelsmann.

Page 5: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 5 of 33

Schröter, D. (2001). Workshop: Die Critical–Incident–Methode. In J. Bolten and D. Schröter (Eds.), Im Netzwerk interkulturellen Handelns. Theoretische und praktische Perspektiven der interkulturellen Kommunikationsforschung [In the Network of Intercultural Activity. Theoretical and Practical Perspectives in Intercultural Communication Research.] (pp. 100-104). Sternenfels: Verlag für Wissenschaft und Praxis.

Schröter, D. (2001). Selling cars abroad—communicative styles in contemporary car advertisements: USA/Germany—a contrastive analysis. In J. Bolten (Ed.), Aktuelle Perspektiven der interkulturellen Wirtschaftskommunikation. Band 6 (pp. 236-253). Jena: Jenaer Skripten zur Interkulturellen Wirtschaftskommunikation.

Bolten, J., & D. Schröter. (Eds.). (2001). Im Netzwerk interkulturellen Handelns. Theoretische und praktische Perspektiven der interkulturellen Kommunikationsforschung [In the Network of Intercultural Activity. Theoretical and Practical Perspectives in Intercultural Communication Research.]. Sternenfels: Verlag für Wissenschaft und Praxis.

Checklists

Wingate, L. A. & Schroeter, D. C. (2016). Evaluation Questions Checklist for Program Evaluation. Kalamazoo, MI: The Evaluation Center. Available at: http://wmich.edu/evaluation/checklists

Schröter, D. C. (2010). Sustainability Evaluation Checklist. Available at USAID Project Starter: http://usaidprojectstarter.org/sites/default/files/resources/pdfs/SEC-revised.pdf

Blog Posts

Wingate, L.A. & Schroeter, D. C. (January, 2016). Lori Wingate and Daniela Schroeter on Introducing the Evaluation Questions Checklist for Program Evaluation. AEA 365. Available at: http://aea365.org/blog/lori-wingate-and-daniela-schroeter-on-introducing-the-evaluation-questions-checklist-for-program-evaluation/

Reviews of Books and Journals

Schröter, D. C., & Alyami, M. (2011). Evaluation of distance education and e-learning. [Review of Evaluation of Distance Education and E-Learning]. American Journal of Evaluation.

Schröter, D. C. (2010). Outcome-based program development and evaluation. [Review of Outcome-based program development and evaluation]. Canadian Journal of Program Evaluation, 23(2), 262-264.

Schröter, D. C., & Urschel, J. (2008). Logic modeling methods in program evaluation. [Review of Logic modeling methods in program evaluation]. Journal of MultiDisciplinary Evaluation, 9.

Schröter, D. C. (2007). Program evaluation: Forms and approaches. [Review of Program evaluation: Forms and approaches]. Evaluation and Program Planning 30(3), 321-323.

Schröter, D. C. (2006). Handbook of practical program evaluation. [Review of the Handbook of practical program evaluation]. American Journal of Evaluation, 27(2), 282-284.

Schröter, D. C. (2006). Evaluation methodology basics: The nuts and bolts of sound evaluation. [Review of the book Evaluation methodology basics: The nuts and bolts of sound evaluation]. Canadian Journal of Program Evaluation, 21(1), 175-178.

Page 6: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 6 of 33

Schröter, D. C. (2006). Evaluation: The International Journal of Theory, Research and Practice, 11(2, 3, and 4), [Review]. Journal of MultiDisciplinary Evaluation, 4.

Schröter, D. C. (2005). Evaluation: The International Journal of Theory, Research and Practice, 11(1), [Review]. Journal of MultiDisciplinary Evaluation, 3, 214-216.

Schröter, D. C. (2005). Evaluation: The International Journal of Theory, Research and Practice, 10(4), [Review]. Journal of MultiDisciplinary Evaluation, 2, 164-167.

Schröter, D. C. (2004). Evaluation: The International Journal of Theory, Research and Practice, 2003-2004 [Review]. Journal of MultiDisciplinary Evaluation, 1, 114-120.

Glossary Entries

Schröter, D. C. (2009). Evaluation. In L. E. Sullivan (Ed.), The Sage Glossary of the Social and Behavioral Sciences (p. 187). Thousand Oaks, CA: Sage.

Schröter, D. C. (2009). Formative evaluation. In L. E. Sullivan (Ed.), The Sage Glossary of the Social and Behavioral Sciences (p. 209). Thousand Oaks, CA: Sage.

Schröter, D. C. (2009). Logic of evaluation In L. E. Sullivan (Ed.), The Sage Glossary of the Social and Behavioral Sciences (p. 188). Thousand Oaks, CA: Sage.

Schröter, D. C. (2009). Metaevaluation. In L. E. Sullivan (Ed.), The Sage Glossary of the Social and Behavioral Sciences (p. 323-324). Thousand Oaks, CA: Sage.

Schröter, D. C. (2009). Summative evaluation. In L. E. Sullivan (Ed.), The Sage Glossary of the Social and Behavioral Sciences (p. 499). Thousand Oaks, CA: Sage.

Other Publications

Robertson, K.N. & Schröter, D.C. (2014). Leveraging Appraisal Findings to Improve Evaluation Quality. i-eval THINK Piece, No. 4, The International Labour Organization. Available at: http://www.ilo.org/eval/newsletter-and-think-pieces/WCMS_237914/lang--en/index.htm

Schröter, D. C. (2006). Evaluating sustainability and sustainment: Concepts and criteria. Conference proceedings: EASY-ECO Saarbrücken, Germany, October 11-14, 2006.

Schröter, D. C. (2008). Sustainability Evaluation: Development and Validation of an Evaluation Checklist (Unpublished doctoral dissertation). Western Michigan University, Kalamazoo, MI.

Schröter, D. C., & Beywl, W. (2006). Die Key Evaluation Checklist von Michael Scriven [Translation of Michael Scriven’s Key Evaluation Checklist]. Available at: http://www.kwb.unibe.ch/lenya/kwb/live/3/33/Info/checklisten/liste/Key_Evaluation_Checklist.pdf

Coryn, C. L. S., Schröter, D. C., & Scriven, M. (2005). A call to action: The first international congress of qualitative inquiry. Journal of MultiDisciplinary Evaluation, 3, 155-165.

Schröter, D. C. (2005). An update on evaluation in Europe. Journal of MultiDisciplinary Evaluation, 2, 132-136.

Schröter, D. C. (2004). Evaluation in Europe: An overview. Journal of MultiDisciplinary Evaluation, 1, 68-76.

Page 7: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 7 of 33

Manuscripts Under Review

Greenman II, G. D.; Schroeter, D. C. (corresponding author); Smith, C. D.; Wilson, L. N.; Robertson, K. N.; Mateu, P.; & Hobson, K. A. (under review). Comparing Apples and Oranges: Applying Multi-Attribute Utility Theory in Outreach Evaluation. Evaluation and Program Planning.

Technical Reports

Schroeter, D.C., Watts, B, Robertson, K. N., Greenman III, G.D., & Fiekowsky, E. (October 2016). 2016 Annual Report: External Evaluation of Indiana State University’s DOE FIPSE FITW “Accelerating College Completion through Academic Mindset (ACCAM)” Project. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D.C., Watts, B, Robertson, K. N., & Greenman III, G.D. (September 2016). Accelerating College Completion through Academic Mindset: Year 3 Monitoring and Evaluation Plan. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D.C., Watts, B, Robertson, K. N., & Greenman III, G.D. (May 2016). “Thrive” – ISU Professional Development: Feedback from the Faculty Interviews and Surveys External Evaluation of Indiana State University’s DOE FIPSE FITW “Accelerating College Completion through Academic Mindset (ACCAM)” Project. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D.C., Watts, B, Robertson, K. N., & Greenman III, G.D. (March 2016). Accelerating College Completion through Academic Mindset: Year 2 Monitoring and Evaluation Plan. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D.C., & Snow, J. Z. (November, 2015). NSF PEEPs Project Outcomes Report for the General Public. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D.C., & Snow, J. Z. (November, 2015). PEEPs for PD 2015 Final Report to NSF. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D.C., Watts, B, Robertson, K. N., Greenman III, G.D., & Mateu, P. (September 2015). 2015 Annual Report: External Evaluation of Indiana State University’s DOE FIPSE FITW “Accelerating College Completion through Academic Mindset (ACCAM)” Project (ED-GRANTS-051614-001, FIPSE FITW Development CFDA 84.116F, PR/Award No: P116F140000). Kalamazoo, MI: Western Michigan University, Evaluation Center.

Hobson, K. A., Schröter, D. C., & Mateu, P. (2015). Evaluation of Research Coordination Networks – Undergraduate Biology Education: Microbial Genome Annotation Network, Update 2015. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D. C., Smith, C., Wilson, L. N., Greenman II, G. D., Robertson, K.N. & Mateu, P. (2015, March). Evaluation of the USDA FAS International Codex Outreach Program: Final Report. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schroeter, D. C., Smith, C. D., & Wilson, L. N. (2015, February). Evaluation of the USDA FAS International Codex Outreach Program: Recommendations for Monitoring and Evaluation. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Page 8: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 8 of 33

Schröter, D. C., Martens, K., & Ozeki, S. (2014, October). Findings from the 2014 Partnership Survey of the EU Social Literacy Project. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schröter, D. C., Smith, C., Wilson, L. N., Greenman II, G. D., Robertson, K.N. & Mateu, P. (2014, October). Evaluation of the USDA FAS International Codex Outreach Program: Tentative Findings and Conclusions. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schröter, D. C., Snow, J., Means, S.N., & Greenman II, G. D. (2014, September). 2013-2014 PEEPs for PD Annual Report to the NSF. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Smith, C., Robertson, K.N., Greenman, G. D., Wilson, L.N., Hobson, K., & Mateu, P. (August, 2014). Interpretation Workshop-Tentative Findings from the Evaluation of the USDA FAS International Codex Outreach Program. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schröter, D. C. & Smith, C. (June, 2014). Evaluation of the International Codex Outreach Program: June Quarterly Report. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Schröter, D. C. & Smith, C. (March, 2014). Evaluation of the International Codex Outreach Program: March Quarterly Report. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Hobson, K. A., Schröter, D. C., & Mateu, P. (2014). An evaluation of Research Coordination Networks – Undergraduate Biology Education: Microbial Genome Annotation Network. Kalamazoo, MI: Western Michigan University, Evaluation Center.

Robertson, K. N., & Schröter, D. C. (2013, December). Findings from the FIPSE Student Interview: Exploring Innovative Approaches to Advising: Applying Learning Communities, a Learning Paradigm, and Structured Reflection. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Mateu, P., Coryn, C. L. S., Schröter, D. C., & Robertson, K. N. (2013, December). FIPSE student questionnaire: Factor analysis, reliability statistics, and group comparisons. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., McCowen, R.H, Smith, C., &. Roth, Y. (2013, October). Impact of Axiom Sales Skills Training: Silverpop Impact Evaluation report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., McCowen, R.H, Smith, C., &. Roth, Y. (2013, August). Impact of Axiom Sales Skills Training: Silverpop Interim Impact Evaluation report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Snow, J., McCowen, R.H, & Means, S.N. (2013, July). 2012-2013 PEEPs for PD Annual Report to the NSF. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Robertson, K. N., Schröter, D. C., Arbour, G., Mateu, P., Roth, Y, & Proctor, C. (2013, July). Evaluation Appraisals for ILO Technical Cooperation Projects: Independent Quality Appraisal of ILO’s 2009-2011 Project Evaluation Reports and Evaluation of the Status of Implementing the UN System-Wide Action Plan. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., McCowen, R.H, Smith, C., &. Roth, Y. (2013, June). Impact of Axiom Sales Skills Training: CommScope Impact Evaluation report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Robertson, K. N., & Schröter, D. C. (2013, April). Spring 2012 FIPSE Project Faculty and Staff Questionnaire: Summary of Results. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Page 9: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 9 of 33

Hobson, K. A., & Schröter, D. C. (2013, March). Evaluation of RCN-UBE: Microbial Genome Annotation Network: Findings from the 2012 Student Pre-Survey. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Means, S. N., Coryn, C. L. S., Zinser, R. W., Mateu, P., and Proctor, C. (2012, December). External Evaluation of the National Research Center for Career and Technical Education’s 2007-2012 Effectiveness and Performance on Government Performance and Results Act Measures: Final Synthesis and Metaevaluation Report. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Means, S. N., Coryn, C. L. S., Zinser, R. W., Mateu, P., and Proctor, C. (2012, December). External Evaluation of the National Research Center for Career and Technical Education’s 20011-2012 Effectiveness and Performance on Government Performance and Results Act Measures: Final Year 5 Report. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Applegate, E. B., Schröter, D. C., Martens, K. S., & McCowen, R. H. (2012, November). An evaluation of the overall quality and transparency of evaluation at the Swiss National Science Foundation: Final report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Martens, K. S., Almueed, S., Manga, A., Means, S.N., Perk, E., Roth, Y.,& Smith, C. (2012, October). Impact of Axiom Sales Skills Training: Verizon Impact Evaluation report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Applegate, E. B., Schröter, D. C., Martens, K. S., & McCowen, R. H. (2012). An evaluation of the overall quality and transparency of evaluation at the Swiss National Science Foundation: Interim report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., Risukhin, V., Applegate, E. B., Means, S., McCowen, R. H., & Roth, Y. (2012, June). Dynasty performance evaluation: Phase I technical report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Robertson, K.N., & Schröter, D. C. (2012, June). Exploring Innovative Approaches to Advising: Applying Learning Communities, a Learning Paradigm, and Structured Reflection: Kalamazoo College Year 1 FIPSE Evaluation Report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Martens, K. S., McCowen, R. H., Schröter, D. C., Coryn, C. L. S., & Applegate, E. B. (2012). Evaluation of the overall quality and transparency of evaluation at the Swiss National Science Foundation: Inception report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Hobson, K. A., Coryn, C. L. S., & Mateu, P. (2012). Strategic evaluation on research excellence: Interview management plan. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Schröter, D. C., Hobson, K. A., & Mateu, P. (2012). Strategic evaluation on research excellence inception report. Kalamazoo, MI: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Zinser, R. W., & Coryn, C. L. S. (2012, February). Evaluation of NRCCTE’s Effectiveness and Performance on GPRA Measures: Final Year 4 (2010-2011) Report. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Zinser, R. W., Noakes, L., Burkhardt, J., McCowen, R., Hobson, K., Subramain, M., Westine, C., Almueed, S.M., Fields, J. K., & Coryn, C. L. S. (2011, September). External Evaluation of NRCCTE’s Technical Assistance Project: Green-Focused POS. Research Snapshot. Kalamazoo: Western Michigan University, The Evaluation Center. Available at:

Page 10: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 10 of 33

http://www.nrccte.org/resources/publications/external-evaluation-nrcctes-technical-assistance-green-focused-programs-study.

Schröter, D. C., Cullen, A., Robertson, K. N., Coryn, C. L. S., Burkhardt, J., Fields, J., McCowen, R., Hobson, K., Subramain, M., Westine, C. (2011, August). Michigan Saves: Statewide Program Evaluation. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Zinser, R. W., Noakes, L., Burkhardt, J., McCowen, R., Hobson, K., Subramain, M., Westine, C., Almueed, S.M., Fields, J. K., & Coryn, C. L. S. (2011, July). External Evaluation of NRCCTE’s Technical Assistance Project: Green-Focused POS. Final technical report. Kalamazoo: Western Michigan University, The Evaluation Center. Available at: http://136.165.122.102/UserFiles/File/Tech_Reports/Green_POS_TA_Evaluation_Report.pdf

Schröter, D. C., Cullen, A., Robertson, K. N., & Coryn, C. L. S. (2011, January). Management plan for evaluating the statewide Michigan Saves program. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Zinser, R. W., Robertson, K. N., & Coryn, C. L. S. (2011, January). Management plan for assessing the implementation of NRCCTE’s AED technical assistance project. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Zinser, R. W., & Coryn, C. L. S. (2010, December). Evaluation of NRCCTE’s Effectiveness and Performance on GPRA Measures: Final Year 3 (2009-2010) Report. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Cullen, A., Robertson, K. N., & Coryn, C. L. S. (2010, October). Process Evaluation of the Michigan Saves Cherryland Pilot Project. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Coryn, C. L. S., & Cullen, A. (2010, May). Evaluability assessment of Michigan Saves! Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., Robertson, K. N., & Zinser, R. W. (2010, May). Management plan for assessing NRCCTE’s performance against GPRA metrics in 2010-2011. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Zinser, R. W., & Coryn, C. L. S. (2010, April). Synthesis of the Evaluation Methodology and Results of NRCCTE’s Effectiveness and Performance on GPRA Measures, Years 1 & 2. Kalamazoo: Western Michigan University, The Evaluation Center.

Cullen, A., Schröter, D. C., Robertson, K. N., & Coryn, C. L. S. (2010, March). Michigan $aves Cherryland Evaluation Plan. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., Cullen, A., & Coryn, C. L. S. (2010, March). Michigan $aves Management Plan: Status of March 2010. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Robertson, K. N., & Coryn, C.L.S. (2009, August). Comparison of the Independent Quality Appraisals of International Labour Organization’s 2007 and 2008 Independent Project Evaluation Reports. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., & Robertson, K. N. (2009, August). Needs Assessment of the Center for Student Opportunity’s 2008 College Access and Opportunity Guide. Kalamazoo: Western Michigan University, The Evaluation Center.

Page 11: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 11 of 33

Schröter, D. C., Coryn, C. L. S., Zinser, R. W., & Robertson, K. N. (2009, July). Evaluation of NRCCTE’s Effectiveness and Performance on GPRA Measures: Final Year 1 (2007-2008) Report. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., Zinser, R. W., & Robertson, K. N. (2009, July). Findings from the questionnaire: Briefing Paper 3. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., Zinser, R. W., & Robertson, K. N. (2009, July). Feedback for revising the panel studies: Briefing Paper 2. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., Zinser, R. W., & Robertson, K. N. (2009, July). Findings from the panel study: Briefing Paper 1. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Cullen, A., Robertson, K., & Coryn, C. L. S. (2009, June). Appraisal of ILO’s 2008 Evaluation Reports. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., & Cullen, A. (2009, June). Process evaluation of Operation Frontline’s national nutrition education program: Monitoring Plan. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., Zinser, R. W., & Robertson, K. N. (2009, May). Management plan for assessing NRCCTE’s performance against GPRA metrics. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., & Cullen, A. (2009, May). Process evaluation of Operation Frontline’s national nutrition education program: Final report. Kalamazoo: Western Michigan University, The Evaluation Center.

Ritchie, L. A., Wingate, L., Gullickson, A., Schröter, D. C., Thomas, W., & Coryn, C. L. S. (2009, May). Birth of the American Evaluation Association: The merger of the Evaluation Network and Evaluation Research Society. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., & Schröter, D. C. (2009, April). Preconference survey results for the 2009 International Conference on Fatigue Management in Transportation Operations. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Bruss, M. B., Cullen, A., & Schröter, D. C. (2008, November). Process evaluation of Operation Frontline’s national nutrition education program: Briefing paper #1. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., & Urschel, J. (2007, December). Logische Modelle: Theorie und Praxis. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., & Ramlow, M. (2007, December). The interdisciplinary Ph.D. program in evaluation: Status report 2007. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., & Urschel, J. (2007, November). Annotated bibliography: Logic models in evaluation. Kalamazoo: Western Michigan University, The Evaluation Center.

Gullickson, A. R., Schröter, D. C., & Gehrki, J. (2007, July). H3-Impact evaluation of Heifer Project International: Eight cases in Kenya. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Schröter, D. C., Miron, G., Kana’iaupuni, S. K., Tibbets, K., Watkins-Victorino, L. M., & Gustafson, O. W. (2007, May). A study of successful schools for Hawaiians: Identifying that which matters. Kalamazoo: Western Michigan University, The Evaluation Center.

Page 12: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 12 of 33

Coryn, C. L. S., Schröter, D. C., & Miron, G. (2007, February). A study of successful schools for Hawaiians: Identifying that which matters—Interim report. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., & Schröter, D. C. (2006, November). Current status of Hispanic American Council programs. Kalamazoo, MI: CS Evaluation, LLC.

Hanssen, C. E., Coryn, C. L. S., & Schröter, D. C. (2006). Evaluation of the Making It Work program—Year 2: Final report. Ada, MI: Hanssen Consulting, LLC.

Coryn, C. L. S., Schröter, D. C., Youker, B. W., & Bakerson, M. A. (2006, December). Kalamazoo Public Schools’ Middle School Summer Enrichment Program: Year three evaluation. Kalamazoo: Western Michigan University, The Evaluation Center.

Thomas, W. H., Coryn, C. L. S., & Schröter, D. C. (2006, December). Kalamazoo Public Schools’ parent involvement evaluation—Phase II: Parent focus groups. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Schröter, D. C., & Miron, G. (2006, November). Successful schools for Hawaiians study—Phase II: Methodological framework. Kalamazoo: Western Michigan University, The Evaluation Center.

Ritchie, L. A., Schröter, D. C., & Wygant, B. (2006, September). Assessing interest in an interactive health education resource center. Sarah Bush Lincoln Health Foundation Telephone Survey. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Schröter, D. C., & Miron, G. (2006, August). Successful schools for Hawaiians study—Phase I: Quantitative analysis. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., Schröter, D. C., Youker, B. W., Bakerson, M. A., Thomas, W. H., Lyke, R. E., Obure, J., & Yuan, W. (2006, August). Kalamazoo Public Schools’ parent involvement evaluation—Phase I: Administrators and teachers. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Miron, G., & Gullickson, A. M. (2006, August). Heifer Nepal quantitative analysis. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Miron, G., Martens, K., & Gustafson, O. (2006, July). An evaluation of Heifer projects in Nepal. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Ritchie, L. A., & Wygant, B. (2006, July). Summary of findings of the Educator Survey for Sarah Bush Lincoln Health Services. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., Coryn, C. L. S., & Youker, B. W. (2006). Evaluation of the 2005 Kalamazoo Public Schools’ middle school summer enrichment program: Synthesis. Kalamazoo: Western Michigan University, The Evaluation Center.

Scriven, M., Chianca, T., Gullickson, A. R., Coryn, C. L. S., Hite, A., Persaud, N., Schröter, D. C., Youker, B., & Hoey, L. (2005). An evaluation of a sample of HPI projects in South Central USA and Peru. Kalamazoo: Western Michigan University, The Evaluation Center.

Coryn, C. L. S., & Schröter, D. C. (2005). Goal-based evaluation of the 2005 Kalamazoo Public Schools Middle School Summer Enrichment Program: Final report. Kalamazoo: Western Michigan University, The Evaluation Center.

Hanssen, C. E., Coryn, C. L. S., & Schröter, D. C. (2005). Evaluation of the Making It Work program: Year 1: Current status, preliminary findings, and looking forward. Ada, MI: Hanssen Consulting, LLC.

Page 13: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 13 of 33

Coryn, C. L. S., Schröter, D. C., & Hanssen, C. E. (2005). Evaluation of the Making It Work program: Program design and status. Ada, MI: Hanssen Consulting, LLC.

Coryn, C. L. S., Gullickson, A. R., Schröter, D. C., & Hanssen, C. E. (2004). Assessing the impact and effectiveness of the ATE program—Survey 2004: Volume III: Status of the ATE projects and articulation partnerships. Kalamazoo: Western Michigan University, The Evaluation Center.

Schröter, D. C., & Coryn, C. L. S. (2004). The effectiveness of the World Links Discourse software pilot program in Burkina Faso, Philippines, India, Senegal, and Uganda. Washington, DC: Educational Testing Service/World Links.

Coryn, C. L. S., Risley, J. S., & Schröter, D. C. (2004). Evaluation of the KPS Middle School Summer Enrichment Program. Kalamazoo, MI: Kalamazoo Public Schools, Title I and School Improvement.

Presentations

Peer-Reviewed Presentations

Schroeter, D. C. (2016). Using 360 Degree Evaluation to Build Key Evaluation Competencies in Group Settings. Skill-building session presented at the annual meeting of the American Evaluation Association, Atlanta, GA, October, 2016.

Schroeter, D.C., Watts, B., Robertson, K.N., & Fiekowsky, E. L. (2016). Design Clashes: How do we handle tensions between Program and Evaluation designs? Roundtable session presented at the annual meeting of the American Evaluation Association, Atlanta, GA, October, 2016.

Schroeter, D. S., Fiekowsky, E., Coryn, C. L. S., Means, S. N., Greenman II, G. D., Snow, J. Z., & Ozeki, S. (2015). A Metaevaluation of Professional Development Evaluations in Science Education and Implications for Evaluation Reporting. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 14, 2015.

Ozeki, S., Schroeter, D. S., Coryn, C. L. S., & Haitova, N. (2015). The Logic of Evaluation in Professional Development Evaluation Practice. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 14, 2015.

Means, S. N., Greenman II, G. D., Schroeter, D. S., Snow, J. Z., Ozeki, S., Fiekowsky, E., Coryn, C. L. S., & McCowen, R. (2015). A Systematic Review of Evaluation Approaches and Reports: The Status of Evaluation Reporting in Professional Development in Elementary Science Teaching. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 14, 2015.

Means, S.N., Burkhardt, J. (now Lee, M.), Magura, S., Schroeter, D.C., Coryn, C.L.S., Structure and Operations of Evidence-Based Registers for Behavioral Health. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 13, 2015.

Greenman II, G. D., Coryn, C. L. S., Schroeter, D. S., Amough, T. E., Endres, C. L., Fiekowsky, E. L., & Holley, S. (2015). At What Cost? A Systematic Review of Cost Analysis in Evaluation. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 14, 2015.

Coryn, C.L.S., Mateu, P. B., Azzam, T., Schroeter, D. S., Vo, A. T., Fiekowsky, E. L., Wilson, L. N., Greenman II, G. D., & Ozeki, S. Do Incentives Increase Response Rates in Surveys of American Evaluation Association Members? Findings From a Randomized Experiment. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 14, 2015.

Page 14: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 14 of 33

Coryn, C.L.S., Ozeki, S., Azzam, T., Schroeter, D. S., Greenman II, G. D., Wilson, L. N., Vo, A. T., & Hobson, K. A. (2015). Does Research on Evaluation Matter? Findings from a Survey of American Evaluation Association Members and Prominent Evaluation Theorists and Scholars. Paper presented at the annual meeting of the American Evaluation Association, Chicago, IL, Nov. 14, 2015.

Schroeter, D. S. & Greenman II, G. D. (2015). What counts as evidence? The misalignment of evaluation in the policy cycle. Paper presented at the annual meeting of the Fall Research Conference of the Association for Public Policy Analysis & Management (APPAM), Miami, FL, Nov. 13, 2015.

Different format for presentations before August 2015

Examining International Outreach Programs Using Multi-Attribute Utility Theory [Greenman II, G.D. [Presenter], Schroeter, D.C., Smith, C.D., Wilson, L.N., Robertson, K.N., Mateo, P. & Hobson, K.A.] Paper presented at the annual meeting of the Midwest Political Science Association, Chicago, IL, April 17, 2015.

PEEPs for PD: Project Evaluation Effectiveness Principles for Professional Development in Elementary Science Teaching [ Schroeter, D.C. [Presenter], Snow, J., Means, S.N. [Presenter], Ozeki, S., Greenman II, G., Fiekowski, E.] Paper accepted for presentation at the annual meeting of the American Educational Research Association, Chicago, IL, April 17, 2015.

Informing the Effectiveness of Regional Partnership Programs Through Social Network Analysis [Smith, C.D., Wilson, L., Schroeter, D.C., & Greenman II, G.D.] Paper presented at the annual meeting of the American Evaluation Association, Denver, CO, October 17, 2014.

Examining Complex Outreach Programs Using Multi-Attribute Utility Theory [Greenman II, G.D., Schroeter, D.C., Wilson, L, & Smith, C.D.] Paper presented at the annual meeting of the American Evaluation Association, Denver, CO, October 17, 2014.

Applying Multi-Attribute Attribute Theory and Social Network Analysis to a Government-Funded Outreach Program. Multi-Paper Session chaired at the annual meeting of the American Evaluation Association, Denver, CO, October 17, 2014.

Building Relations Between New and Experienced Evaluators: The Importance of Evaluator Competencies. Panelist at the annual meeting of the American Evaluation Association, Denver, CO, October 17, 2014.

Exploratory Identification of Project Evaluation Effectiveness Principles for Professional Development in Elementary Science Teaching: PEEPs for PD [McCowen, R.H., Schroeter, D.C., Snow, J., Means, S.N.] Paper accepted for presentation at the annual meeting of the American Educational Research Association, Philadelphia, PA, April, 2014.

Insights, Barriers, and Strategies for Research on Evaluation Practice [Schroeter, D.C.]. Multipaper session facilitated at the annual meeting of the American Evaluation Association, Washington, DC, October 19, 2013.

Accessibility, Transparency, and Other Barriers to Metaevaluation [McCowen, R.H., Schroeter, D.C., Means, S., Greenman II, G. D.]. Paper presented at the annual meeting of the American Evaluation Association, Washington, DC, October 19, 2013.

Language Use, Coding Mechanisms, and Initial Findings [Means, S., Schroeter, D.C., McCowen, R.H., Greenman II, G. D.].Paper presented at the annual meeting of the American Evaluation Association, Washington, DC, October 19, 2013.

Page 15: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 15 of 33

Perspectives and Profiles in Evaluation: A Comparison of Evaluation Methodology and Evaluator Background in the Energy Efficiency Sector [Schroeter, D. C.]. Multipaper session chaired at the annual meeting of the American Evaluation Association, Washington, DC, October 19, 2013.

Lessons Learned From a Critical Review of Evidence Based Program Repositories in Behavioral Health [Burkhardt, J., Schroeter, D.C., Morell, J., Magura, S., Means, S., Coryn, C.L.S.]. Roundtable presented at the annual meeting of the American Evaluation Association, Washington, DC, October 18, 2013.

The Complexity of Training and Development Evaluation. [Schroeter, D.C., Martens, K.S. Robertson, K.N.]. Paper presented at the annual meeting of the American Evaluation Association, Minneapolis, MN, October 27, 2012.

Identifying Project Evaluation Effectiveness Principles in Professional Development Evaluation [Discussants: Snow, J., Hartry, A., Schroeter, D.C.] Think Tank facilitated at the annual meeting of the American Evaluation Association, Minneapolis, MN, October 26, 2012.

Critical Review of Evidence-Based Program Repositories for Behavioral Health Treatment [Robertson, K.N., Schroeter, D.C., Burkhardt, J., Magura, S., Coryn, C.] Paper presented at the annual meeting of the American Evaluation Association, Minneapolis, MN, October 25, 2012.

Strategies and Lessons Learned from Implementing External Peer Review Panels Online: A Case Example from a National Research Center [with Robertson, K., Coryn, C., & Zinser, R.]. Paper accepted for presentation at the annual meeting of the American Evaluation Association, Anaheim, CA, Nov. 2011. (Presented by Kelly Robertson)

Strategies for Improving International Development Evaluation Terms of Reference (TORs) or Requests for Proposals (RFP). [with Robertson, K., Cullen, A., Tarsilla, M., & Mateu, P.]. Paper accepted for presentation at the annual meeting of the American Evaluation Association, Anaheim, CA, Nov. 2011. (Presented by Kelly Robertson)

Critical Review of Evidence-Based Program Registers for Behavioral Health Treatment. [with Magura, S., & Coryn, C.]. Paper accepted for presentation at the annual meeting of the American Evaluation Association, Anaheim, CA, Nov. 2011. (Presented by Kelly Robertson)

Exploring Evaluation Quality in International Development Evaluation: An Examination of How International Development Organizations Issue and Contract Evaluations [with Cullen, A., Tarsilla, M., Rugh, J., Robertson, K., & Mateu, P.]. Roundtable prepared for presentation at the annual meeting of the American Evaluation Association, San Antonio, TX. Nov. 2010.

The Role of Metaevaluation in Promoting Evaluation Quality at the International Labor Organization [with Cullen, A., Robertson, K., & Russon, C.]. Paper prepared for presentation at the annual meeting of the American Evaluation Association, San Antonio, TX. Nov. 2010.

Evaluation learning needs, assets, and interests of National Science Foundation (NSF) principal investigators and evaluators [with Na’im, A., Wingate, L., & Alyami, M.]. Paper prepared for presentation at the annual meeting of the American Evaluation Association, San Antonio, TX. Nov. 2010.

Context sensitivity in a multi-site process evaluation [with A. Cullen, L. Seman, L. Kunins, & C. L. S. Coryn]. (2009, November). Demonstration presented at the American Evaluation Association, Orlando, FL.

Developing and using evaluation checklists to improve evaluation practice [with Drs. W. Martz & N. Persaud]. (2009, November). Skill-building workshop presented at the American Evaluation Association, Orlando, FL.

Page 16: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 16 of 33

An empirical review of theory-driven evaluation practice from 1990–2008. [with C. Westine, L. Noakes, & C. L. S. Coryn]. (2009, November). Paper presented at presentation at the American Evaluation Association, Orlando, FL.

Comorbid patients improve on substance use and psychological symptoms in psychiatric day treatment [for Drs. S. Magura & A. Rosenblum]. (2009, November). Paper presented at the American Evaluation Association, Orlando, FL.

Revisiting the criteria and process for evaluating AEA conference proposals and presentations [with H. Mzumara & S. Kistler]. (2008, November).Think Tank presented at the American Evaluation Association, Denver, CO.

Evolution of evaluation checklists: From creation to validation [with Dr. W. Martz]. (2008, November). Demonstration presented at the American Evaluation Association, Denver, CO.

Foundations of evaluation: Theory, method, and practice [with Dr. C.L.S. Coryn]. (2008, November). Skill-building workshop presented at the American Evaluation Association, Denver, CO.

Evaluation of sustainability for sustainability: Development and validation of a checklist. (2008, October). Paper accepted for presentation at the 8th Biennial Conference of the European Evaluation Society, Lisbon, Portugal.

The logic and methodology of sustainability evaluation: A checklist approach. (2007, November). Paper presented at the annual American Evaluation Association conference, Baltimore, MD.

Learning from the American Evaluation Association topical interest groups proposal review standards. (2007, November). Think Tank facilitated at the annual American Evaluation Association conference, Baltimore, MD.

Can these checklists work? Simplifying cost and sustainability evaluations. (2007, November). Roundtable facilitated at the annual American Evaluation Association conference, Baltimore, MD.

Needs Assessment: A contributor to evaluating sustainability. (2006, November). Paper presented at the annual American Evaluation Association conference, Portland, OR.

Consequence of competing and complementary evaluation approaches: A case study. [with C. L. S. Coryn, B. W. Youker, & M. A. Bakerson]. (2006, November). Poster presented at the annual American Evaluation Association conference, Portland, OR.

What you learn versus what you can apply: Results of a survey of employers and recent graduates in the field of evaluation. [with Jennifer Dewey, John R. Mattox, Bianca Montrosse, & Carolyn Sullins, Discussants: David A. Cotton, ORC Macro, Maurya West Meiers, World Bank, Joelle Skaga Nausin, Starbucks Coffee Company, Lynda M Sagrestano, Southern Illinois University at Carbondale, & Gary Miron, The Evaluation Center]. (2006, November). Debate at the annual American Evaluation Association conference, Portland, OR.

Evaluating sustainability and sustainment: Concepts and criteria. (2006, October). Paper presented at the EASY-ECO Saarbrücken, Germany, Conference.

Sustainability: A value in evaluation? (2006, October). Paper presented at the 7th Biennial Conference of the European Evaluation Society, Joint international conference with the United Kingdom Evaluation Society, London, UK.

Think Tank/Roundtable: Developing and completing a doctoral dissertation. [with J. S. Risley & C. L. S. Coryn). (2005, October). Think Tank chaired at the cosponsored American Evaluation Association/Canadian Evaluation Society conference. Toronto, Ontario, Canada.

Page 17: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 17 of 33

Would you hire me? What organizations look for in evaluators. [with J. D. Dewey, J. R. Mattox, B. Montrosse, & C. D. Sullins]. (2005, October). Think Tank at the cosponsored American Evaluation Association/Canadian Evaluation Society conference. Toronto, Ontario, Canada.

Criteria for evaluating program sustainability within a multi-site context: A longitudinal approach. [with J. A. Morell.] (2005, October). Paper presented at the cosponsored American Evaluation Association/Canadian Evaluation Society conference. Toronto, Ontario, Canada.

The Success Case Method in human and social service contexts: A different meaning of the terms success and return on investment. [with C. L. S. Coryn]. (2005, October). Paper presented at the cosponsored American Evaluation Association/Canadian Evaluation Society conference. Toronto, Ontario, Canada.

Practical ethics for program evaluation. [with C. L. S. Coryn]. (2005, October). Paper presented at the cosponsored American Evaluation Association/Canadian Evaluation Society conference. Toronto, Ontario, Canada.

Preparing decision-making. Fundamental issues in providing information for summative evaluation. [with J. S. Risley]. (2004, November 5). Paper presented at the annual American Evaluation Association conference. Atlanta, GA.

Invited Presentations

Schroeter, D.C. & Greenmann, III, G.D. (2015, October). What counts as evidence? The misalignment of evaluation in the policy cycle. Presentation prepared for The Evaluation Center’s Evaluation Café Series. Kalamazoo: Western Michigan University.

Schroeter, D.C. (2014, November). Using Multi-Attribute Utility Theory in Evaluation: Challenges and Opportunities. Presentation prepared for The Evaluation Center’s Evaluation Café Series. Kalamazoo: Western Michigan University.

Schroeter, D.C. & Smith, C. (2014, August). Tentative Findings from the Evaluation of the International Codex Outreach Program: Data Interpretation. Presentation at USDA. Washington, D.C.

Schroeter, D.C. & Smith, C. (2014, March). Evaluation of the International Codex Outreach Program. Presentation at U.S. Codex Outreach Colloquium in Johannesburg, South Africa.

Schroeter, D.C. & Smith, C. (2014, March). Evaluation of the International Codex Outreach Program. Presentation at U.S. Codex Outreach Colloquium in San Jose, Costa Rica.

Schroeter, D.C. & Smith, C. (2013, December). Evaluation of the International Codex Outreach Program. Presentation at the USDA Foreign Agricultural Services in Washington, D.C.

Different format for presentations before August 2015

Winning Evaluation Grants and Contracts: Tips and Tricks for New Investigators (2013, November). Presentation prepared for The Evaluation Center’s Evaluation Café Series. Kalamazoo: Western Michigan University.

A question of worth. (2010, October). A lunch seminar organized by the Geneva Evaluators Network and hosted by the World Health Organization, Geneva, Switzerland.

Evaluation checklists: An overview. (2010, September). Presentation invited by the Norwegian Evaluation Association conference/EVA seminar, Bodø, Norway.

Page 18: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 18 of 33

Michigan $aves: Evaluability assessment & process evaluation of an innovative energy program. (2010, March). Presentation given at The Evaluation Center’s Evaluation Café Series. [with K. N. Robertson, A. Cullen, & M. Alyami]. Kalamazoo: Western Michigan University.

(Meta)Evaluation at the International Labour Organization: Current practice, potential for improvement, and prospects for in-depth study. (2009, October). Presentation prepared for The Evaluation Center’s Evaluation Café Series [with A. Cullen and K. Robertson]. Kalamazoo: Western Michigan University.

Validating evaluation checklists. (2008, March). Presentation prepared for The Evaluation Center’s Evaluation Café Series. Kalamazoo: Western Michigan University.

Sustainability evaluation: A checklist approach. (2007, October). Presentation given at The Evaluation Center’s Evaluation Café Series. Kalamazoo: Western Michigan University.

Evaluator skills: What’s taught vs. what’s sought. (2006, January). Presentation given at The Evaluation Center’s Evaluation Café Series. [with C. Sullins and C. Ellis]. Kalamazoo: Western Michigan University.

Identifying relevant evaluative criteria: Lessons learned from the evaluation of a middle school enrichment program. (2005, November). Presentation given at The Evaluation Center’s Evaluation Café Series. [with C. L. S. Coryn]. Kalamazoo: Western Michigan University.

Hosted Survey™: An introduction. (2005, March). Presentation given at The Evaluation Center’s Evaluation Café Series. Kalamazoo: Western Michigan University.

Methodological implications for developing Web-based training: A summary of workshop results. (2002). E-Learning Conference of Interculture.de in Cooperation with BIBB [Federal Department of Professional Training] and IHK of East Thuringia Gera, [Chamber of Commerce and Industry].

Awarded Research and Evaluation Grants and Contracts

2016 – 17 Evaluation Competencies in Public Administration Western Michigan University, School of Public Affairs and Administration Sponsor: Western Michigan University Support for Faculty Scholars Award (SFSA) (S2016-013) Amount: $2,000 Project Director

2014 – 18 Evaluation of Indiana State University’s “Accelerating College Completion through Math Mindset” Grant Western Michigan University, The Evaluation Center & The School of Public Affairs and Administration Sponsor: Indiana State University (ED-GRANTS-051614-001) Amount: $359,081 Evaluation Director (Co-PI, Dr. Brad Watts, since October 2015)

Page 19: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 19 of 33

2015 Evaluation of the Luxembourg National Research Fund's (FNR) CORE Selection Process Western Michigan University, Collaboration between the Interdisciplinary Ph.D. in Evaluation program, the Evaluation Center, and the Evaluation, Measurement, and Research program Sponsor: Luxembourg National Research Fund Amount: $53,758 Co-PI (PI: Chris Coryn; Co-PI: E. Brooks Applegate)

2013 – 15 Social Literacy Training Evaluation, A Subaward from a European Union Grant Western Michigan University, The Evaluation Center Sponsor: Intregra Institute, Slovenia Amount: $23,968 Project Director

2012 – 15 PEEPs for PD: Identification of Project Effectiveness Principles for Professional Development in Elementary Science Teaching Western Michigan University, The Evaluation Center Sponsor: National Science Foundation (Award Number: DRL-1228809) Amount: $249,993 Principal Investigator

2011 – 15 External Evaluation of the Augustana College NSF RCN-UBE: Microbial Genome Annotation Network Project Western Michigan University, The Evaluation Center Sponsor: Augustana College (NSF DBI Subaward: 0954829) Amount: $60,000 Project Director

2013 – 14 Evaluation of the International Codex Outreach Program Western Michigan University, The Evaluation Center Sponsor: USDA FAS (TA-CR-13-012) Amount: $150,000 Project Director

2013 – 14 ILO Workshop and Thought Paper Western Michigan University, The Evaluation Center Sponsor: International Labour Organization, Genève, Switzerland Amount: $12,001 Co-Project Director

2013 – 14 Research Paper Development Western Michigan University, The Evaluation Center Sponsor: Advantage Performance Group Amount: $2,000 Project Director

2012 – 14 Centers for Disease Control and Prevention University Training Order Western Michigan University, The Evaluation Center Sponsor: Centers for Disease Control and Prevention Amount per workshop: $9,375; Total: $93,750 Co-Project Director

Page 20: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 20 of 33

2012 – 14 Training Impact Evaluations of Axiom Sales Force Development Western Michigan University, The Evaluation Center Sponsor: Axiom Sales Force Development Project Director

Project I: Evaluation Planning (January through May 2012), Amount: $5,000 Project II: Verizon Sales Training Evaluation (May through July 2012), Amount:

$34,100 Project III: CommScope Sales Training Evaluation (December 2012 through April

2013), Amount: $29,900 Project IV: Silverpop Sales Training Evaluation (March 2013 through June 2013),

Amount: $28,500

2012 – 13 Evaluation Appraisals for ILO Technical Cooperation Projects Western Michigan University, The Evaluation Center Sponsor: International Labour Organization, Genève, Switzerland Amount: $20,000 Project Director

2011 – 14 Systematic Review of Evidence-Based Program Repositories Western Michigan University, The Evaluation Center Sponsor: NIH NIDA (Award Number: 1R21DA032151-01) Amount: $409,750 Co-PI

2011 – 13 External Evaluation of the Kalamazoo College “Improving Student Retention and Connection through Innovative Advising Practices” grant Western Michigan University, The Evaluation Center Sponsor: Kalamazoo College (DOE FIPSE Subaward: P116B100047) Amount: $75,000 Project Director

2012 Performance Evaluation of Dmitry Zimin’s Dynasty Foundation for Not-for-Profit Programs Western Michigan University, The Evaluation Center Sponsor: Dynasty Foundation, Moscow, Russia (April through June 2012) Amount: $101,901 Project Director

2012 Evaluation of Overall Quality and Transparency of Evaluation at the Swiss National Science Foundation Western Michigan University, The Evaluation Center Sponsor: Swiss National Science Foundation Amount: $230,000 Co-Project Director

2011 – 12 IDRC Strategic Evaluation on Research Excellence Western Michigan University, The Evaluation Center Sponsor: IDRC, Canada Amount: $27,607 Co-PI

Page 21: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 21 of 33

2009 – 12 Evaluation of NRCCTE’s Effectiveness and Performance on GPRA Measures Western Michigan University, The Evaluation Center Sponsor: The National Research Center for Career and Technical Education, University of Louisville (DOE OVAE Subaward) Amount: $475,742 Project Director

2009 – 11 Evaluation of the Michigan Saves Program Western Michigan University, The Evaluation Center Sponsor: Public Sector Consultants, Lansing, MI, USA Amount: $120,000 Project Director

2010 Peer Review of the “Diploma of Advanced Studies in Evaluation (DAS EV UNIBE)” Western Michigan University, The Evaluation Center Sponsor: University of Bern Amount: $4,500 (plus travel) Reviewer with Dr. Donald Yarbrough, University of Iowa

2009 Comparative Study of Independent Quality Appraisals of the International Labour Organization’s 2007 and 2008 Independent Project Evaluation Reports Western Michigan University, The Evaluation Center Sponsor: International Labour Organization, Genève, Switzerland Amount: $2,500 Project Director

2009 Support Services for the needs assessment of the College Access and Opportunity Guide Western Michigan University, The Evaluation Center Sponsor: Center for Student Opportunity, Bethesda, MD Amount: $9,937 Project Director

2009 Evaluation Appraisals for ILO Technical Cooperation Projects Western Michigan University, The Evaluation Center Sponsor: International Labour Organization, Genève, Switzerland Amount: $8,000 Project Director

2009 Support Services for the Evaluation of the 2009 International Conference on Fatigue Management in Transportation Operations Western Michigan University, The Evaluation Center Sponsor: Fulcrum Corporation, Fairfax, VA Amount: $12,540 Project Director

2008 – 09 Process Evaluation of a National Multisite Nutrition Education Program: Operation Frontline Western Michigan University, The Evaluation Center Sponsor: Share Our Strength’s Operation Frontline, Washington, DC Amount: $54,939 Project Director

Page 22: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 22 of 33

2007 Logic model theory and practice: A review of manuals, handouts, other written materials, and computer programs Western Michigan University, The Evaluation Center Sponsor: Deutsches Jugendinstitut/German Youth Institute, Munich, Germany Amount: $4,370 Project Lead

2007 Evaluation of Heifer International programming to achieve and sustain income and food security for families and communities in Kenya, Tanzania, Cameroon, and China Western Michigan University, The Evaluation Center Sponsor: Heifer Project International, Little Rock, AR, USA Evaluator (Project Director: Dr. Michael Scriven)

2006 – 07 Evaluation and capacity building of the Hispanic American Council’s liaison, youth and family, and women’s programs CS Evaluation, LLC, Portage, MI Sponsor: Hispanic American Council of Kalamazoo Amount: $6,000 Project Director

2006 – 07 Successful Schools for Hawaiians Study Western Michigan University, The Evaluation Center Sponsor: Hawai’i Department of Education and Kamehameha Schools Amount: $68,357 Research Associate

2006 Evaluation of Heifer International programming to achieve and sustain income and food security for families and communities in Albania, Nepal, and Thailand Western Michigan University, The Evaluation Center Sponsor: Heifer Project International, Little Rock, AR, USA Evaluator (Project Director: Dr. Michael Scriven)

2006 Feasibility study/market analysis of potential use of the health education resource facility to be housed in the Healthier Communities Complex Western Michigan University, The Evaluation Center Sponsor: Healthier Communities, Sarah Bush Lincoln Health Foundation of East Central Illinois, USA. Research Associate (Project Director: Dr. Liesel Ritchie)

2005 – 06 Formative and summative evaluation of the Kalamazoo Public Schools’ Title I Parent Program Western Michigan University, The Evaluation Center Sponsor: Kalamazoo Public Schools—Parent Programming Amount: $7,000 Co-Project Manager

2004 – 06 Formative and summative evaluation of the Kalamazoo Public Schools’ Title I Middle School Summer Enrichment Program Western Michigan University, The Evaluation Center Sponsor: Kalamazoo Public Schools—Middle School Summer Enrichment Program Amount: $20,000 Co-Lead Evaluator (with Dr. Chris Coryn)

Page 23: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 23 of 33

2004 – 06 Making It Work program evaluation Hanssen Consulting, LLC, Ada, MI Sponsor: Goodwill Industries of Southwestern Michigan; Kalamazoo County Department of Human Services and Housing Resources, Inc. Amount: $3,000 Evaluator

2005 Evaluation of Heifer International programming to achieve and sustain income and food security for families and communities in southern United States and Peru Western Michigan University, The Evaluation Center Sponsor: Heifer Project International, Little Rock, AR, USA Amount: $11,000 Evaluator (Project Director: Dr. Michael Scriven)

2004 Evaluation of the Educational Testing Services/World Links Discourse Software pilot project in Burkina Faso, Philippines, India, Senegal, and Uganda CS Evaluation, LLC, Portage, MI Sponsor: Educational Testing Service/World Links Co-Principal Investigator

Research without Grants and Contracts

2017 Systematic Review of Research Designs Published in Journals of Leading Public Administration Member Associations Research Team: Daniela Schröter and the students enrolled in PADM 6640

2015 Mapping Practice to Theory: Trends from Ten Years of Evaluation Practice Research Team: Lyssa N. Wilson, Corey D. Smith, and Daniela Schröter

2014 – 15 Does Research on Evaluation Matter? Survey of American Evaluation Association Members and Prominent Evaluation Theorists and Scholars Research Team: Chris L. S. Coryn, Tarek Azzam, Daniela Schröter, Lyssa N. Wilson, Gregory D. Greenman II, and Satoshi Ozeki

2014 – 15 The Use of Cost Analysis in Evaluation: Systematic Review of Evaluations Published Between 2005 and 2014 Research Team: Chris L. S. Coryn, Daniela Schröter, Erica L. Fiekowsky, Lyssa N. Wilson, Gregory D. Greenman II, and Satoshi Ozeki

2014 - Do Incentives Increase Response Rates in Surveys of American Evaluation Association Members? A Randomized Experiment Research Team: Chris L. S. Coryn, Pedro F. Mateu, Tarek Azzam, Daniela Schröter and Erica L. Fiekowsky

2009 – 11 The Nature and Politics of Evaluation Terms of References and Requests for Proposals in International Development: A Systematic Review Research Team: Daniela Schröter, Anne Cullen, Kelly Robertson, Jim Rugh, Michele Tarsilla, and Pedro Mateu

2009 – 10 Theory-Driven Evaluation Practice: A Systematic Review Research Team: Chris Coryn, Lindsay Noakes, Daniela Schröter, and Carl Westine

Page 24: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 24 of 33

2009 – 10 The Use of OECD/DAC standards in the International Labour Organisation: Evidence from Evaluation Practice Research Team: Daniela Schröter, Anne Cullen, and Kelly Robertson

2007 – 08 American Evaluation Association Oral History Project Research Team Member: Collaborated with Drs. Robin Miller (MSU, Editor of the American Journal of Evaluation) and Chris L. S. Coryn in developing and conducting interviews with Drs. Daniel Stufflebeam and James Sanders

2007 American Evaluation Association Topical Interest Groups Conference Proposal Review Practices Researcher: Conducted an exploratory study of AEA’s TIGs’ conference proposal review practices. Developed and led a think tank regarding the findings of the study and shared the report with board members of the AEA

2006 – 07 American Evaluation Association Research Assistant (Volunteer): Birth of the American Evaluation Association 1984-87. Western Michigan University, The Evaluation Center, Kalamazoo. Conducted interviews with multiple informants in person and via telephone; organized interviews and scheduled interviews for parts of the study.

Teaching, Training, and Professional Development

Courses Taught

2017 Western Michigan University, School of Public Affairs and Administration PADM 6390 – Performance Measurement and IT (Spring, 2017) PADM 6640 – Advanced Research Design (Spring, 2017) EVAL 7300 – Doctoral Dissertation (Spring, Summer, Fall 2017)

2016 Western Michigan University, School of Public Affairs and Administration PADM 5830 – Grant Writing for Nonprofit Organizations (Spring, 2016) PADM 6461 – Evaluation of NPOs (Summer II, 2016) PADM 6400 – Nonprofit Governance (Spring & Fall, 2016) PADM 6060 – Analytical Methods (Fall, 2016) PADM 5980 – Independent Study in Performance Measurement and IT (Fall 2016)

2016 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 7300 – Doctoral Dissertation (Spring, Summer, Fall 2016)

2015 Western Michigan University, School of Public Affairs and Administration PADM 6461 – Evaluation of NPOs (Spring 2015, Fall 2015) PADM 6060 – Analytical Methods (Fall 2015), Co-Faculty of Record with Stephen Kleinschmit

2015 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 7100 – Independent Research: Multi-Attribute Utility Analysis, Faculty of Record/Facilitator for Gregory D. Greenman II (Spring, 2015) EVAL 7100 – Independent Research: Research on Evaluation Practice: Connecting Theory with Practice, Faculty of Record/Facilitator for Lyssa Wilson and Corey Smith (Spring & Fall, 2015)

Page 25: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 25 of 33

EVAL 7120 – Professional Field Experience (Summer II, 2015) EVAL 7300 – Doctoral Dissertation (Fall & Spring, 2015)

2014 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 7300 – Doctoral Dissertation (Fall, 2014) EVAL 7100 – Independent Research: Multi-Attribute Utility Analysis and Social Network Analysis (Fall), Faculty of Record/Facilitator for Corey Smith

2012 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 7120 – Professional Field Experience (Fall) Faculty of Record/Facilitator: Field experience of Saeed Almueed and Kristin Hobson (Fall 2012)

2012 Western Michigan University, Education and Human Development, Department of Educational Leadership, Research & Technology EMR 6520 – Evaluation Practicum (Spring) Faculty of Record/Facilitator

2011 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 7120 – Professional Field Experience (Summer I & II, 2011) Faculty of Record

2010 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 7120 – Professional Field Experience, Adjunct Faculty: Supervision of field experience for Mohammed Alyami (6 credits, Spring 2010) EVAL 7100 – Independent Research: Cost Analysis in Evaluation (Spring 2010), Adjunct Faculty: Three-credit course offered for the Interdisciplinary PhD program in Evaluation; Teaching Assistant: Mohammed Alyami

2009 Western Michigan University, Interdisciplinary Ph.D. program in Evaluation EVAL 6970 – Cost Analysis (Spring 2009) Adjunct Faculty: Three-credit course offered for the Interdisciplinary PhD program in Evaluation Teaching Assistant: Amy M. Gullickson

2005 Western Michigan University, Extended University Programs, Kalamazoo EDLD 6010—Evaluation of Nonprofit Organizations Adjunct Faculty: Two-credit graduate seminar for Public and Arts Administration students designed as an introductory crash course in (i) the logic and methodology of evaluation, (ii) evaluation design, (iii) essential critical thinking skills, and (iv) the evaluation profession. Co-facilitated with Thomaz Chianca

2002–04 Friedrich Schiller University, Department of Intercultural Business Communication, Jena, Germany Negotiation and Presentation Techniques Adjunct Faculty: Facilitated multiple two-day compact seminars for multinational student groups with emphasis on theories of negotiation, presentation techniques, and simulations with video feedback.

2000–02 Friedrich Schiller University, Department of Intercultural Business Communication, Jena, Germany Seminar to supplement the lecture course “Introduction to Intercultural Business Communication”

Page 26: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 26 of 33

Instructor/Teaching Assistant: Presentations and exercises in 2000-01 of own design, in 2001-02 departmental exercises and lecture contents.

2000–01 Bauhaus University, Weimar, Germany Introductory German Adjunct Faculty: Seminars for multicultural/international students

1999–00 Institute for Intercultural Communication (a nonprofit organization), Jena, Germany Intermediate German and English as Foreign/Second Language Instructor: Courses for German-Russian immigrants

1998–99 Michigan State University, East Lansing Integrative Studies in the Arts and Humanities (IAH 201)—“The U.S. and the World” Teaching Assistant: Four-credit course taught to 60 undergraduate students at MSU

1998–99 Michigan State University, East Lansing German (GRM 101)—“Introduction to German” Teaching Assistant: Taught one section of GRM 101

Invited Workshops

Schroeter, D.C. (June, 2016). A Primer on Evaluation Theory and Approaches. Daylong workshop invited by the American Evaluation Association Summer Institute, Atlanta, GA.

Schroeter, D.C. (April, 2016). Evaluation Evidence Throughout Policy and Program Cycles. 90-minute, peer-reviewed workshop presented at the Michigan Association of Evaluation Conference, Lansing, MI.

Different format for workshops before August 2015

2012-14 Centers for Disease Control and Prevention University, Atlanta, GA

Data interpretation in evaluation (Schroeter & Wingate): December 2012, May 2013, May 2014

Evaluation questions: The foundation for meaningful program evaluation (Wingate & Schroeter): March 2013, December 2013, April 2014

Translating evaluation findings into action (Wingate & Schroeter): May 2013, February 2014, September 2014

2011 Educational Research and Evaluation at the Kasetsart University, Bangkok, Thailand Using Checklists for Evaluation Trainer/Faculty. Half-day workshop for doctoral students and faculty in evaluation. January 29, 2011

2010 Center for Continuing Education, University of Berne, Switzerland Cost Analysis in Evaluation Trainer/Faculty. One-day workshop for evaluation professionals and postgraduate students. Koordinationsstelle für Weiterbildung, Universität Bern, Switzerland, October 27, 2010

Page 27: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 27 of 33

2010 Geneva Evaluators Network A Question of Worth. Trainer/Faculty. A lunch seminar organized by the Geneva Evaluators Network and hosted by the World Health Organization, Geneva, Switzerland, October 25, 2010.

2010 Norwegian Evaluation Association conference/EVA seminar, Bodø, Norway Checklists for Evaluation: Sustainability and Organizational Effectiveness Trainer/Facilitator. Workshop, September 9, 2010

2009 Western Michigan University, Department of Social Work Outcome Evaluation Facilitator: Interactive guest lecture presented to graduate students in Social Work, Western Michigan University. November 03, 2009

2009 Western Michigan University, First Year Program Survey Development Facilitator: Interactive guest lecture presented to students of Dr. David Reinhold’s First Year Students seminar, Western Michigan University. October 19, 2009

2009 EU-China Manager Exchange and Training Program (METP), Beijing, China Monitoring and Evaluation of the Performance of Academic Institutions Facilitator/Trainer: Five-day interactive workshop/seminar presented to academic and administrative staff from the Beijing University of International Business and Economics. August 21-25, 2009

2008 Annual Conference of the Michigan Association for Evaluation, Lansing Evaluation 101 Co-Facilitator: Workshop co-facilitated with Dr. Chris L. S. Coryn

2006 German Youth Institute, Munich, Germany Goal-Free Evaluation Facilitator/Trainer: Two-and-a-half hour lecture with workshop characteristics presented to the advisory board meeting of the German Youth Institute. Beiratssitzung des Deutschen Jugendinstituts, Munich, Germany. October 20, 2006

2006 German Youth Institute, Munich, Germany Scriven’s Key Evaluation Checklist Facilitator/Trainer: Half-day workshop utilizing case studies. Deutsches Jugendinstitut, e.V. (German Youth Institute), Munich, Germany. October 19, 2006

2006 Center for Continuing Education, University of Berne, Switzerland Weshalb Empfehlungen in der Evaluation sinnlos sind… und weitere Denkanstösse aus Michael Scriven’s Key Evaluation Checklist (Why Recommendations Don’t Make Sense… and Other Food for Thought from Michael Scriven’s KEC) Lead Facilitator/Trainer: Evening discussion group with evaluation professionals and postgraduate students. Koordinationsstelle für Weiterbildung, Universität Bern, Switzerland. October 09, 2006 [supported by W. Beywl and Chris L. S. Coryn]

2006 Center for Continuing Education, University of Berne, Switzerland Goal-Free Evaluation: Wirkungspotentiale eines Evaluationsansatzes der aus dem Rahmen fällt (Potentials of an Evaluation Approach that Falls Out of the Frame) Lead Facilitator/Trainer: One-day workshop for advanced evaluators.

Page 28: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 28 of 33

Koordinationsstelle für Weiterbildung, Universität Bern, Switzerland. October 09, 2006 [co-facilitated by Chris L. S. Coryn and moderated by W. Beywl]

2006 11th Annual Conference of the Michigan Association for Evaluation, Lansing The Field of Evaluation 101: Are you new to the field of evaluation or considering it as a career? Co-Facilitator: Workshop led by Michael Scriven and co-facilitated with Chris L. S. Coryn. March 30, 2006

2005 The Learning Alliance, Inc. Success Case Method Assistant: Success case workshop led by Dr. Robert Brinkerhoff and Dennis Dressler. Assisted in implementing the workshop for the W.K. Kellogg Foundation.

2002 Interculture.de, Jena, Germany Culture-Specific Negotiation Training Trainer: Two-day compact seminar in Ilmenau, Germany: Focus on assessing internship experiences abroad of unemployed individuals with academic degrees. Theories of negotiation, presentation techniques, simulations with video feedback.

2001 Second Intercultural Summer Academy, Interculture.de in cooperation with the Friedrich Schiller University, Jena, Germany Negotiation Training: Conducting Business in Germany Trainer: Simulations with video feedback and content discussion

2000–01 European Summer Academy in Weimar, Germany Intermediate German Instructor: Intensive foreign language courses for international students

2000 First Intercultural Summer Academy cosponsored by interculture.de and Friedrich Schiller University, Jena, Germany Critical Incidents as a Method in Intercultural Communication Training Trainer: Half-day workshop

1998–99 Evening College at Michigan State University, East Lansing Introductory German as a Foreign Language Faculty: Conversational German

Student Advising

Dissertation Committees (completed, WMU College of Arts and Sciences)

Manga, A. W. (Spring, 2016). Crowdsourced Product Reviews: A study of evaluation standards used. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Chair]

Fields, J. K. (2014). A Metaevaluation of Evaluations of Health Care Programs that Employ the Chronic Care Model. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Committee member]

Brown, B. (2013). A metaevaluation of energy efficiency evaluations. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Committee member]

Page 29: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 29 of 33

Dissertation Committees (current, WMU College of Arts and Sciences)

• Gregory Greenman (since 2015). To be determined. [Chair] • Corey Smith (since 2015). To be determined. [Chair]

Dissertation Committees (completed, WMU College of Education and Human Development)

Satoshi Ozeki (2017). Three Empirical Investigations into the Logic of Evaluation and Valuing Practices. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Reader]

Almueed, Saeed (Spring, 2016). A metaevaluation of school counseling program evaluations. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Committee member]

Wilson, K. (2013). Harnessing complexity: Analysis, methodology, and ethical framework to facilitate utilization of video data in evaluations. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Committee member]

Alyami, M. (2013). Modification and adaptation of The Program Evaluation Standards in Saudi Arabia. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo. [Committee member]

Service

Profession

2017– Association for Research on Nonprofit Organizations and Voluntary Action (ARNOVA) LAC

2016 American Evaluation Association “Use and Influence of Evaluation” TIG conference proposal reviews

2016 American Evaluation Association “Teaching of Evaluation” TIG conference proposal reviews

2015– Reviewer/Referee, Evaluation Review

2014– Reviewer/Referee, Journal of Mixed Methods Research

2014 Book Proposal Reviewer, Sage Publications

2013-2015 Member At Large, Joint Committee on Standards for Educational Evaluation

2013 Book Proposal Reviewer, Sage Publications

2013 Reverse Site Visitor, National Science Foundation

2013 Grant Proposal Reviewer, National Science Foundation

2011 Book Proposal Reviewer, Elsevier Publications

2011 Member of the National Science Foundation Committee of Visitors to review the Federal Cyber Service: Scholarship for Service Program

Page 30: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 30 of 33

2011 Member of the International Development Evaluation Association’s (IDEAS) ITIG on Assessment Frameworks for Projects, Programs and Policies

2010 Reviewer for the United Kingdom Economic and Social Research Council Reviewer for the U.S. Department of Education’s “Teaching American History” grant

2010–13 Associate Member, Joint Committee on Standards for Educational Evaluation

2009–11 Member of the American Evaluation Association’s Social Program Task Force

2009– Associate Member, Graduate Faculty, Western Michigan University

2009 Member of the International Development Evaluation Association’s (IDEAS) working group on Evaluator Competencies

2009– Reviewer/Referee, American Journal of Evaluation

2008–12 Appointee to the American Evaluation Association’s Policy Development Committee

2007–09 Program Chair, American Evaluation Association—Business and Industry TIG

2006– Reviewer/Referee, Evaluation and Program Planning

2005–07 Program Chair, American Evaluation Association—Graduate Student and New Evaluators TIG

2004– Associate Editor, Journal of MultiDisciplinary Evaluation Conference proposal reviewer for the American Evaluation Association

2003–05 Publicity Chair, American Evaluation Association—Graduate Student and New Evaluators TIG

University

2016 WMU Office of the Vice President for Research “Discovery Discovery” Faculty Seminar Panelist “Everything You Wanted to Know About Communicating with Sponsors but Were Afraid to Ask”

2015 Supervised Nizora Haitova as summer intern through the Edmund S. Muskie Internship Program.

2013 WMU Office of the Vice President for Research “Discovery Discovery” Faculty Seminar Panelist “Everything You Wanted to Know About Communicating with Sponsors but Were Afraid to Ask”

College of Arts and Science

Fall 2016 Social Science Representative on the College Curriculum Committee

School of Public Administration and Affairs

Spring 2017 MPA Program Committee NASPAA Self-study Committee

Page 31: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 31 of 33

Fall 2016 MPA Program Committee Mentoring PADM 5830 Instructor Providing independent study for one MPA student

Summer 2016 Developed evaluation options for NASPAA self-study

Spring 2016 MPA Program Committee Stine Scholarship Review Committee MPA Program Admission MPA Advising

Community

2017, Feb– Board Member, Colleagues International Chair, Administration Committee with emphasis on data and performance measurement

2016, Sept– Parent Volunteer, Kalamazoo Public Schools

Professional Affiliations

2016–Present Member of the Michigan Association of Evaluation (MAE)

2015–Present Member of the Association for Public Policy Analysis and Management (APPAM)

2014–Present Member of the American Society for Public Administration (ASPA)

2014 – 2016 Member of the Australasian Evaluation Society (AES) Member of the Mixed Methods International Research Association (MMIRA) Member of the Canadian Evaluation Society (CES)

2013 – 2015 Member of the Project Management Institute (PMI) (2013 only) Member of the American Society for Training and Development (ASTD)

2013 Member of the Michigan Association of Evaluation (MAE)

2012–2015 Member of the American Educational Research Association (AERA)

2009–Present Member of the International Development Evaluation Association (IDEAS) (Life Member)

2006–Present Member of the European Evaluation Association (EES)

2003–Present Member of the American Evaluation Association (AEA)

Personal Professional Development & Continuing Education

2016 Elearning Certification (Fall 2016)

WWC How to Meet Evidence Standards - Postsecondary Edition Institute of Education Science Webinar (March 10, 2016)

OVPR Discover Discovery: Involving Students in Research Western Michigan University (February 9, 2016)

Page 32: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 32 of 33

2015 – 2016 New Faculty Seminar Western Michigan University (bi-weekly during academic year)

2015 OVPR Discover Discovery: Taking Inventory: Establishing and utilizing your discovery plan (Part 2) Western Michigan University (October 20, 2015

OVPR Discover Discovery: Internal Funding Resources Western Michigan University (December 1, 2015)

Cool Tools: TechSmith Relay Western Michigan University (August 28, 2015)

Cool Tools: Effective Class Discussions In-Person and Online Western Michigan University (August 26, 2015)

OFD New Faculty Orientation Western Michigan University (August 18-19, 2015)

2013 Systems-oriented Evaluation: From Afterthought to Forethought Eval Café by Beverly Parson

2012 Developing high-level questions to guide your whole evaluation (and make sure it doesn't get lost in the details!) Webinar by E. Jane Davidson, Real Evaluation.

Kirkpatrick Four LevelsTM Evaluation Certificate Program (June 5-14, 2012) Online Certificate Program offered by Kirkpatrick Partners.

2011 Elearning (D2L) Intro & Overview (December 7, 2011) Half-day workshop presented by the Office of Faculty Development, Western Michigan University.

2010 Increasing Quality and Impact through Systematic Application of Evaluation Practice Standards Instructor: Prof. Donald Yarbrough, Center for Evaluation and Assessment, College of Education, The University of Iowa. One-day workshop at Zentrum für universitäre Weiterbildung, University of Bern, Switzerland.

2010 Research Development Award Workshops Multiple half-day workshops provided by the Office for the Vice President of Research to help faculty and staff develop competitive grant proposals. Western Michigan University.

2009 Exploring a Utilization-Focused Evaluation Option: Developmental Evaluation Using Systems Thinking and Complex Nonlinear Dynamics One-day workshop given by M. Q. Patton, Independent Consultant.

2009 Cost Analysis One-day workshop given by B. Yates, American University.

Logic Modeling: Beyond the Traditional View One-day workshop given by J. A. Morell, TechTeam Government Solutions.

The Success Case Method: Simple, Strategic, and Convincing Evaluation One-day workshop given by R. O. Brinkerhoff, Western Michigan University.

Page 33: Daniela C. Schröter (Schroeter) › sites › default › files › curriculum-vitae › Schroeter … · Daniela C. Schröter (Schroeter) Assistant Professor School of Public Affairs

Curriculum Vitae | Daniela C. Schröter | Page 33 of 33

2008 Quasi-Experimental Design and Analysis in Education Instructors: T. D. Cook and W. R. Shadish. Four-day workshop, Northwestern University.

2006 Survey Design and Sampling Procedures. (2006). Instructor Dr. T. Babinec. Four-week Web-based seminar via statistics.com.

2006 Multiple Regression Full-day workshop with Dr. D. Berger at the meeting of the American Evaluation Association, Portland, Oregon.

2004 Shoestring Evaluation Full-day workshop with Dr. M. Bamberger at the meeting of the American Evaluation Association, Atlanta, Georgia.

2004 Designing Evaluations of Complex Open Systems Full-day workshop with Dr. B. Kibel at the meeting of the American Evaluation Association, Atlanta, Georgia.

2003 Evaluation-Specific Methodology Full-day workshop with Dr. M. Scriven at the meeting of the American Evaluation Association, Reno, NV.

Utilization-Focused Evaluation Full-day workshop with Dr. M. Q. Patton at the meeting of the American Evaluation Association, Reno, NV.