office of planning, assessment and research … presentation (9_5_1… ·  · 2013-10-10o an...

45
TracDat Electronic Planning and Assessment Reporting System Tia A. Minnis Assistant Director for Assessment Sept 5, 2012 OFFICE OF PLANNING, ASSESSMENT AND RESEARCH OPAR/TAM 1

Upload: hoangdiep

Post on 22-Mar-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Electronic Planning and Assessment Reporting System

Tia A. Minnis

Assistant Director for Assessment

Sept 5, 2012

OFFICE OF PLANNING, ASSESSMENT AND RESEARCH

OPAR/TAM

1

Page 2: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Overview o TracDat is:

o An innovative and comprehensive electronic system for the process of institutional planning and assessment.

o Used to manage and document data results for continuous improvement with Academic Programs and Administrative Support Services.

o Allows for the development of Action Plans and follow-up to align with assessment results.

o Provides for customization of budget request for objectives and outcomes link to continuous improvement.

OPAR/TAM

2

http://cauvmtracdat/tracdat/

Page 3: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Accessing TracDat o TracDat can be accessed in three Ways:

o 1. In the TracDat manual click the following link: http://cauvmtracdat/tracdat

o 2. Type http://cauvmtracdat/tracdat into the browser o 3. Access the CAU Homepage

o Select Departments o Click on Office of Planning, Assessment, and Research o Click on Institutional Assessment o Click on TracDat o Select http://cauvmtracdat/tracdat

OPAR/TAM

3

Page 4: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Accessing TracDat

OPAR/TAM

4

If this is your first time logging in: Your username is the initial

of your first name plus your last name (e.g. John Smith's Username would be jsmith)

Your default password is

clark.

NOTE: To access TracDat users must be on the CAU network

Page 5: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

5

Page 6: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Academic Homepage

OPAR/TAM

6

Admin Homepage

Page 7: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Changing Your Password

STEP ONE: Under the Home Tab click Profile

STEP TWO: Click the Change Password button at the bottom of the screen

STEP THREE: Type your Current Password

STEP FOUR: Then type your New Password and Confirm the password

STEP FIVE: Click Save Changes

OPAR/TAM

7

Page 8: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I (1)

Program/Department/Unit New Mission and Vision

Statements,

(2) Student Learning Outcomes or Program

Objectives

(3) Means of Assessment, and Criteria for Success.

(4) Preliminary Budget Request for the academic

year

Phase II

(5) Results

(6) Use of Results

(7) Action Plan

(8) Budget Adjustments (Request for the next

academic year)

TracDat Annual Assessment Cycle

OPAR/TAM

8

Page 9: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan STEP ONE: Select the Program/Unit name from the drop down menu

STEP TWO: Click the Program/AU Tab at the top of the screen

Enter Departmental Mission and Vision Statements in the text box > Click on the question mark to the right of the text box if additional information is needed

Click Save Changes

STEP THREE: Click the Program/Admin Assessment Plan Tab at the top of the screen

STEP FOUR: Select the Outcomes/Objectives Sub-Tab Existing outcome: Edit | Copy| Delete Add New Outcome Click the Add New Outcome/Objective button at the bottom of the screen

OPAR/TAM

9

Page 10: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase I)

(2) STUDENT LEARNING OUTCOME

• Learning outcomes define the goals of learning experiences (activities, courses, majors, curricula, engagement with post-secondary education)

• What any student should be able to do, know, or value as a result of engaging in that learning experience

• Outcomes are expressed as knowledge, skills, attitudes or values.

• Outcomes define impact – how the student has changed

• Not the same as satisfaction with education, professors, facilities, activities, or experiences

• Not the same as outputs, such as grades, GPA, retention rate, graduation rate

OPAR/TAM

10

Page 11: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan FILTERING OLD OUTCOMES/OBJECTIVES

Select the filter icon in the top right corner of the screen.

To show only active outcomes/objectives, select Active on the filter menu option. Then select Apply Filter

All inactive outcomes/objectives will be hidden.

You can clear your filter option at any time to show hidden outcomes/objectives. Simply select the Filter Icon and the Clear Filter

OPAR/TAM

11

Page 12: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I - Your Plan

Additional steps required to complete a New Outcome:

Type the Outcome/Objective Name > Click question mark to the right of the text box if additional information is needed

Type description in the next text box titled Outcome/Objectives

Select your Outcome/Objective Type You can hold down the control key to select multiple outcome

types.

Click Outcome/Objective Status (Active or Inactive)

OPAR/TAM

12

Page 13: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I - Your Plan

Additional steps required to complete a New Outcome:

Click Calendar Icon select a Start Date > Beginning of the assessment period

Click Calendar Icon select an End Date > End of the assessment period

Enter amount of funds requested for this outcome/objective if included in the submitted preliminary budget for the year (attach the budget)

Click Save Changes

OPAR/TAM

13

Page 14: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase I)

(3a) MEANS OF ASSESSMENT:

o Assessment Method

o A systematically designed process to gather information/data related to a specific learning Outcome/Objectives.

o Multiple Means of Assessment (if applicable)

o Assessment Tool

o Direct and Indirect

o Quantitative or Qualitative

o Formative or Summative

OPAR/TAM

14

Page 15: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase I)

Direct Measures (all students) o Capstone projects/senior projects o Samples of student work o Project-embedded assessment o Observations of student behavior

(internships/field experiences) o Performance on a case

study/problem o Pre- and post-tests

Indirect Measures (sample) o Alumni, employer, student

surveys o Focus groups o Job placement statistics o Exit interviews with graduates

(3a) MEANS OF ASSESSMENT: o Assessment Tool

o Appropriate measures of Learning Outcomes include:

OPAR/TAM

15

Page 16: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

STEP FIVE: While still in the Program/Admin Assessment Plan > Click Means of Assessment Sub-Tab

Select an Assessment Method Tool from the drop down menu

Type the Assessment Method > How will the tool be administered

OPAR/TAM

16

Page 17: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

17

Page 18: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase I) (3b) CRITERIA FOR SUCCESS

o Establishes a specific indicator for accomplishment of the outcome/objective and overall target for the program/department’s performance.

o Example:

o At least 80% of the students are required to score a minimum of 80 points on the assessment rubric

OPAR/TAM

18

Page 19: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan STEP FIVE: While still in the Program/Admin

Assessment Plan > Click Means of Assessment Sub-Tab

Click the Criterion box and type desired quantitative or qualitative measurement

Click Assessment Schedule > When will the assessment tool be administered

Documents related to the outcome assessment can also be added (i.e. preliminary budgets, rubrics, etc.)

Select Related Documents The option to select a new document, document from repository, or

previously related document is given. Select the appropriate option, and select relate document.

OPAR/TAM

19

Page 20: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

ADDITIONAL ASSESSMENT INFORMATION

o Related Courses: Course ID; Course Names; Course Description; Credit Hours, Course Suffix; General ED; Owned Unit; Related Unit; Related Documents (AP Only) o Generates Program Curriculum Map

o Activities (Task Name; Task Description)

o Related Goals (Institutional, Strategic Plan; Department; School; Accrediting Bodies – Standards, etc.)

o Allow you to show how the Program Outcome supports: o the higher level goals of the institution. o the standards of the accrediting body

TracDat Annual Assessment Cycle (Phase I)

OPAR/TAM

20

Page 21: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan STEP SIX: While still in the Program Assessment Plan

> Click Related Courses

Select all related courses (You will be provided a list of courses)

Indicate whether the outcome is Introduced; Reinforced or Assessed in this course

Click Save Changes

After all related courses have been selected, click return to the outcome

OPAR/TAM

21

Page 22: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

22

Page 23: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

23

Can be exported to Excel

Page 24: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

STEP SEVEN: While still in the Program/Admin Assessment Plan > Click Activities

From the drop down menu choose an Outcome/Objective to attach a Measure

Click the Add New Activity button at the bottom of the screen

Type the activity Name and a Description of the activity

Click Save Changes

OPAR/TAM

24

Page 25: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan STEP EIGHT: While still in the Program/Admin

Assessment Plan > Click Related Goals >

Check appropriate Strategic Goals the Academic Program supports.

Departmental Goals and Program Goals or Standards can also be added if available

Click Save Changes

OPAR/TAM

25

Page 26: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

ADDING A DOCUMENT:

STEP ONE: Click the Documents Tab at the top of the screen

STEP TWO: Click the Add New Folder button at the bottom of the screen

Type New Folder Name (i.e. Assessment) > Click Save

OPAR/TAM

26

Page 27: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

ADDING A DOCUMENT:

STEP THREE: Click the New Folder Name (Assessment) to the left of the screen in blue

STEP FOUR: Click the Add New Document button on the bottom of the screen

Click Browse and Select the document > Click Open

Type Name and Description > Click Save

OPAR/TAM

27

Page 28: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

PRINTING YOUR PLAN

Click the Reports Tab at the top of the screen

Click run to the right of the report you would like to run (Assessment Plan,.)

Click the Open Report button at the bottom of the screen

Print or Save the report as a pdf

OPAR/TAM

28

Page 29: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

OPAR/TAM

29

Page 30: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase I – Your Plan

OPAR/TAM

30

Page 31: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase II)

(5) RESULTS of Assessment: o Include a summary of the assessment outcome:

o Major findings o Achievements o Assessment data

o Submit evidence documents

OPAR/TAM

31

Page 32: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results STEP ONE: Select the Program/Unit name from the drop

down menu if assigned more than one program; if only one program is assigned it will be the only option to choose

STEP TWO: Click the Results Tab at the top of the screen

Each outcome with at least one result entered will be displayed

Click Show Results - Listed chronological in descending order

Select the number under the actions column to see action taken based upon the result - the number reflect the number of actions taken

Attach raw assessment data – Related Documents – number indicate how many documents are attached.

OPAR/TAM

32

Page 33: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

33

Page 34: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

34

Page 35: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results Click Add Result button at the bottom of the screen

Click Select for the appropriate Outcome/Objective, then click Select again beside the appropriate assessment method you are reporting on

OPAR/TAM

35

Page 36: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results Type in the Results box a summary of the assessment results

Click the Calendar Icon next to Results Date > Select the day the results were actually collected (Current date entered by default)

Click drop down menu Result Type > Select Criterion Met or Criterion Not Met

Click drop down menu Action Status, select Action Plan Complete, or Action Plan Incomplete > for any suggested action

Click Calendar Icon next to Action Status Update if Action Plan was marked incomplete

Documents can also be attached to the results

OPAR/TAM

36

Page 37: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase II)

(6) USE OF RESULTS • Explain how the results will be used.

OPAR/TAM

37

Page 38: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results

STEP TWO: Click the Results Tab at the top of the screen

Type in Use of Results > Use of results should contain information on how you plan to use your results for the next academic year

Click the Save Changes

OPAR/TAM

38

Page 39: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

TracDat Annual Assessment Cycle (Phase II) (7) ACTION PLAN:

• Review assessment results, focus on weakness and identify methods for continuous improvement (Objectives/Activities to be implemented for the next Academic Year)

(8) BUDGET REQUEST: • Indicate the budget resources needed to implement the Action Plan

OPAR/TAM

39

Page 40: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results

STEP THREE: While still in Results > Click add Plan of Action for Improvement at the bottom of the screen

Type the Plan of Action for Improvement

Click Calendar Icon and select a date

Select Yes if the Plan of Action impacts the budget

Enter Requested Amount > Please add whole numbers only, no characters or decimals

Type Planning Based Budgeting Description

Click Save Changes

OPAR/TAM

40

Page 41: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results

STEP FOUR: PRINTING YOUR REPORT

Click the Reports Tab at the top of the screen

Click run to the right of the report you would like to run (e.g. Assessment Plan, Unit/Program Assessment Report Four Column, Curriculum Map, etc.)

Click the Open Report button at the bottom of the screen

Print or Save the report as a pdf

OPAR/TAM

41

Page 42: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Phase II – Your Results

OPAR/TAM

42

Page 43: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

OPAR/TAM

43

Page 44: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

Planning/ Assessment

Period Phase Implemented

For Academic

Year

TracDat Submission Due

Date

Fall 2010 Phase I - Plan 2011/2012

December 6, 2010

Summer 2012 Phase II – Assess, Action Plan July 2, 2012

Fall 2011 Phase I - Plan 2012/2013

December 5, 2011

Summer 2013 Phase II – Assess, Action Plan July 1, 2013

Fall 2012 Phase I - Plan 2013/2014

December 5, 2012

Summer 2014 Phase II – Assess, Action Plan July 1, 2014

OPAR/TAM

44

Page 45: OFFICE OF PLANNING, ASSESSMENT AND RESEARCH … presentation (9_5_1… ·  · 2013-10-10o An innovative and comprehensive electronic system for the ... Click on Office of Planning,

QUESTIONS?

OPAR/TAM

45