making your data work - laccd atd retreat

8/3/2019 Making Your Data Work - LACCD AtD Retreat

http://slidepdf.com/reader/full/making-your-data-work-laccd-atd-retreat 1/29

Rob Johnstone & Priyadarshini Chaplot

LACCD Achieving the Dream Retreat

January 20, 2012

Making Your Data Work



What we will cover 1. Framing the issue

2. What we learned from the BRIC Initiative, theAspen Prize, and Completion by Design

3. Making the connection

Building Stronger Systems for SLOs and Program Review – September 2011 2



WHO IS THE RP GROUP?

Putting our work in context




The RP Group

● Strengthens the abilities of California communitycolleges to gather, analyze and act on informationin order to strengthen student success

● Provides research, evaluation, professionaldevelopment, and technical assistance services

that support evidence-based decision-makingand inquiry

● Work is defined and conducted by communitycollege practitioners




A RESOURCE FOR INSTITUTIONAL CHANGE

A Culture of Inquiry

An Applied Inquiry Framework for Student Completion – September 2011 5



What is a Culture of Inquiry?Institutional capacity for

supporting open, honest andcollaborative dialog focused on

strengthening the institution

and the outcomes of its

students.




Culture of Inquiry: Why All the Fuss?

● Because this ongoing work is challengingbut necessary!

● Work needs to marry insight & evidence

● Problems are large and recurring● No silver bullet / evident answers

● Multiple solutions likely needed

● Progress is not linear

● Requires cross constituency interaction




Culture of Inquiry: Features

● Widespread sharing and easy accessto user-friendly information on student

outcomes

● Encouraging more people to ask awider collection of questions and use

their evidence and conclusions to

enhance decision making● Shared, reflective and dynamic

discussions




Culture of Inquiry: More Features

● Multiple opportunities to discussinformation within and across

constituency groups

● Continuous feedback so adjustmentscan be made along the way and

processes can be adapted

● Culture that values curiosity,questions and robust conversations




THE IMPETUS FOR OUR WORK

Why does prioritizing a

culture of inquiry makesense?




You’re wastingtime and money

when your outcomesdon’t focus on

the right data.

11



0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Retention Rate

Success Rate

1999 2008

20 year trend for

institutional outcomes

What does that tell us

about the usefulness of

these metrics in setting

institutional strategies?




Much of what isneeded to support

good decision making is

beyond thetraditional

accountabilitymeasures.

13



What is Our College’s Transfer Rate?



Data

do not

speak

for themselves.

15



The vital role of conversation

● In order to make data useful, ample time andspace are needed to discuss and analyze the

information and connect it back to the original

research question.

● Answers are not always immediately apparent,so skilled facilitation may be needed

to dig out the deeper meaning.

● Multiple perspectives and

types of information are oftenneeded to make sense of

individual data points.!




WHAT CAN WE DO?

What the RP Group has

learned




BRIC’s on-campus support helps collegesimprove internal practices.

• Technical experts who are communitycollege practitioners

• Focus on discrete practices such as

program review

• Opportunities for dialog




Strategy 1:Reform processes

to make them

simpler andprovide

more usefulinformation.

19



age 2:

While what colleges developedvaried, each system was:

• Meaningful• Sustainable

• Consistent


For example…



Comprehensive Assessment Report Examples

http://www.rpgroup.org/resources/comprehensive-

assessment-reports-best-practice-examples-around-country

Resource Compendium on Assessment

http://www.rpgroup.org/resources/assessment-strategies-and-models-help-tell-story




Strategy 2: Createspace and

time to talkso good ideas can

be put into action

22



Get conversations going using inquiry guides.

• Assessing Student Learning Outcomes

• Using an Equity Lens to Assess Student Learning

• Assessing Student Services Outcomes

• Maximizing the Program Review Process

• Assessing Non-credit Student Learning Outcomes




Strategy 3:Make better use of

existing processes;don’t

reinvent thewheel.

24



Strategy 4:Pick your

organizationalimprovement priorities

and stickto them.

25



Strategy 5:To build lasting

changes, ensureyou involve a

broad rangeof leadership.

26



WHAT THIS MEANS FOR YOU

How can you improve your

accountability and successefforts?




Brainstorm & DiscussPick one of the following questions to answer and pair up with

someone to share your ideas.

• What process could we simplify at our college?

• How could we create more opportunities for conversations

about our student outcomes?

• What is a process we could redesign to make it more

useful?

• What should be my college’s top improvement priority?

• How could we build stronger and deeper support for

improvement efforts?

Making Your Data Work – November 2011 28



Find Out MoreThe RP Group Websitewww.rpgroup.org

Rob Johnstone, Senior Research [email protected]

Bob Gabriner, Leadership Chair

[email protected]

29

making your data work - laccd atd retreat

Documents