Evaluation Tools and ModelsNorthern Plains CCC Program

Comprehensive Cancer Control2008 Annual Grantee Meetings

May 14th, 2008Atlanta, GA

Northern Plains Comprehensive Cancer Control Program Logic Model

Inputs OutputsParticipationActivities

Outcomes - ImpactShort Term Medium Term Long Term

Funding – CDC and other resources

Staff: ~2 full time

Coalition and Partners

Current data and research

Conference calls and meetings with Coalition and partners

Educate community

Create Strategic Plan

Improve cancer data

Engage tribal community for support

Tribal Leadership

Health Professionals

Cancer Organizations

Cancer Survivors

Tribal Health Workers

Media

State Cancer Programs

Increased knowledge and awareness of cancer prevention and control

Increased numbers of cancer activities in tribal communities

1-3 years 4-6 years 7-10 years

Increased skills and capacity to address cancer

Increase in cancer screening accessibility

Change in risk factors for cancer

Increased cancer treatment resources and support

Increase in cancer survivor and caregiver support systems

Increase in treatment follow-up

Decreased Cancer Incidence Rates

Decreased Cancer Mortality Rates

Increase in Quality of Life for Cancer Patients

Implement cancer control activities/interventions

Indian Health Service employees

Cancer Researchers

Increase in cancer screening rates

Improved data and surveillance

Increased support from key partners

Improved cultural sensitivity/competency

Strategies• Tracking Data of Coalition and Partnerships

(meeting participation, agendas, rosters, etc.)

• Partnership Satisfaction and Needs Assessments

• Pre and Post Assessments • Cancer Burden and Risk Factor

Surveillance• Evaluate absolutely every activity or

intervention…– somehow….if we can…

Tools• Audience Response System (ARS)

• Online Evaluation Database

Sample Question:What do you like most

about this meeting?

1. Presentations from my peers and colleagues

2. Poster Session3. Free candy and pens4. Doing the chicken dance5. I don’t know/I’m not sure

How we are using ARS?

• Short-term Outcome: Increased knowledge and awareness of cancer prevention and control– Cancer 101 Workshops – Education Conference– Community Colorectal Cancer Workshop– Family Caregiver Workshop

ARS Advantages• Knowledge, Attitude, Belief,

Satisfaction outcomes from workshops, meetings, etc.

• Efficient data collection, analysis, reporting

• Better response rate than paper surveys

• Mostly well-received in communities• Can help facilitate group processes

ARS Disadvantages

• Cost….?• Technology• Portability (ARS unit

and staff)– Community Grant

Example

• Does not measure knowledge retention or outcome in behavior

Online Evaluation Database

Online Evaluation Database

• Password protected system

• Upload ARS, tracking, evaluation data

• Automatically generate reports and summarize data

• Tabs for different inputs: Committees, Partnerships, Products, Dissemination, etc.

Presentation / Outreach / Inservice Your Products: Articles Brochures Vide os Curricula Etc.

Other (e.g. radio, cable, PSA)

Figure 3. Schematic of the Dissemination Tab.

Dissemination

Presentations

Workshops

Training

OtherÕs Products: Articles Brochures Videos Curricula Etc.

Online Evaluation Database Advantages

• Provides external consultants/partners access

• Easier to generate reports

• Uniform measures and comparison

• Partners information/data?

» ……at least we hope……

Online Evaluation DatabaseDisadvantages

• Technology

• You only get what you put in…– Cancer Burden Data

• Time and resources to upload data and maintain site

• Appropriate data-sharing

• What will we miss?

Evaluation Plans

• Update and Revise Evaluation Plan

• Continue to improve use of ARS

• Tailor and begin using Online Database

• Northern Plains Cancer Data Improvement Initiative