![Page 1: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/1.jpg)
Healthy StartVirtual Grantees’ Meeting
Healthy StartData Systems &
Resources(including CAREWare!)
Ada Determan, DHSPSLina Barrett, DHSPS
Matt Biewener, NICHQ
June 25, 2020
![Page 2: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/2.jpg)
Lina Barrett, DHSPS
Ada Determan, DHSPS
Matt Biewener, NICHQ
![Page 3: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/3.jpg)
HS Data Systems & Data ResourcesHealthy Start Virtual Grantees’ Meeting
June 25, 2020
Lina Barrett, Matthew Biewener, & Ada DetermanProject Officer (MCHB/DHSPS), Senior Manager (NICHQ), Public Health Analyst (MCHB/DHSPS) Maternal and Child Health Bureau (MCHB)
![Page 4: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/4.jpg)
Plenary Objectives
1. Review the flow of information from client- and grantee-level data collection to national program outcomes and quality improvement efforts
2. Discuss new Healthy Start data systems and their applications
▪ Demo CAREWare
▪ Outline the upcoming release of HSMED2 and client-level data reporting requirements
3. Provide brief updates on data collection and reporting tools
4. Outline future evaluation activities
4
![Page 5: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/5.jpg)
Healthy Start Data ProcessesFrom Collection to Outcomes
![Page 6: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/6.jpg)
Monthly
Aggregate
EXCEL Report
EHBs
HRSA Data Systems
DGISAnnual
Reports
National
Evaluation
Reports to Federal
Leadership
Publications &
Presentations
Measuring
Outcomes
Meeting
Program Goals
Program
Quality
Improvement
Other
Analyses
Project Officer
MonitoringInfo Requests/
Summaries
Aggregate Data Uses
Required
Reporting
Data
Applications
Program
Benefits
Healthy Start Data Processes
![Page 7: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/7.jpg)
Data
Collection
Forms
Monthly
Aggregate
EXCEL Report
Client-Level
Data File
and others…
HSMED2(Backdoor in EHBs)
EHBs
HRSA Data Systems
DGISAnnual
Reports
National
Evaluation
Reports to Federal
Leadership
Publications &
Presentations
Aggregate Data Uses
Measuring
Outcomes
Meeting
Program Goals
Program
Quality
Improvement
Other
Analyses
Project Officer
MonitoringInfo Requests/
Summaries
HS Site
Databases
Required
Reporting
Data
Applications
Program
Benefits
Healthy Start Data Processes
![Page 8: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/8.jpg)
CAREWare for Healthy Start –
8
Resources & Support Improve Data Quality
Why?
![Page 9: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/9.jpg)
CAREWare for Healthy Start – Background
• CAREWare is…
9
No cost to grantees
A tested, long-term HRSA investment
Highly customizable
![Page 10: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/10.jpg)
CAREWare for Healthy Start – Background
10
Browser-based Canned & Custom Reports
![Page 11: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/11.jpg)
CAREWare for Healthy Start – Background
• DHSPS is partnering with NICHQ to adapt the system to Healthy Start case management and reporting needs
• Features available upon release:1. Three HS data collection forms
2. Monthly aggregate data report
3. Case management modules
11
![Page 12: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/12.jpg)
Healthy Start Virtual Grantees’
Meeting
CAREWare: An Introduction
Matthew Biewener
June 25, 2020
![Page 13: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/13.jpg)
CAREWare: An Introduction
How do I access the system?
13
• Access using a web browser
• Grantee data are separate, private, and secure
• Different levels of permissions for users
• Grantee site administrators can manage their users/permissions
➢Grantees are not required to use CAREWare
Healthy Start Virtual Grantees’ Meeting, June 2020
![Page 14: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/14.jpg)
CAREWare: An Introduction
What will it do?
14
• Primary data collection forms
• Reporting and exports (e.g., monthly aggregate report)
• Case management
• Scoring for standardized assessment scales
• Custom forms and form fields
• Migration of data from another system
![Page 15: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/15.jpg)
CAREWare: An Introduction
Can we see what it looks like?
15
• Live demonstration• System access
• Using the data collection forms
• Generating reports
![Page 16: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/16.jpg)
CAREWare: An Introduction
What can we expect next?
16
• Initial users created; training and onboarding
• Additional guidance, documentation, and technical assistance
• An Advisory Group to be announced
• Important updates announced in newsletter and on EPIC
• Monthly Aggregate Report export available July 15
• Data Collection Forms available for data entry August 1
• HSMED reporting available October 1
![Page 17: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/17.jpg)
HSMED2Healthy Start Monitoring and Evaluation Database (v2)
![Page 18: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/18.jpg)
HSMED2 Overview
• Portal for submission of client-level data
▪ Integrated into the EHBs
▪ Project Directors can manage users
▪ Download submitted data
• Tools & Resources for grantees
▪ XML schema & Data Dictionary
▪ Training & Technical Assistance
18
HSMED2(Backdoor in EHBs)
EHBs
Revised release date – November 12th
![Page 19: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/19.jpg)
Data Collection & Reporting Updates
![Page 20: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/20.jpg)
Data
Collection
Forms
Monthly
Aggregate
EXCEL Report
Client-Level
Data File
and others…
HSMED2(Backdoor in EHBs)
EHBs
HRSA Data Systems
DGISAnnual
Reports
National
Evaluation
Reports to Federal
Leadership
Publications &
Presentations
Aggregate Data Uses
Measuring
Outcomes
Meeting
Program Goals
Program
Quality
Improvement
Other
Analyses
Project Officer
MonitoringInfo Requests/
Summaries
HS Site
Databases
Required
Reporting
Data
Applications
Program
Benefits
Your Data is Important!
Grantee Site Data
![Page 21: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/21.jpg)
Monthly Aggregate Template
• Updates/Modifications
▪ Moderate changes to the behavior-related indicators to better align with DGIS measures & those of other MCHB programs
▪ Multiples will now be counted individually in the birth outcomes columns
▪ Corrected “sum” formulas
• Data Dictionary
▪ MCHB will provide detailed definitions; numerators & denominators; and clarifications, as needed (e.g., monthly numbers vs cumulative YTD numbers)
• Request for CY2020 Aggregate Data Resubmission
▪ Grantees will need to resubmit their data from Jan-Jun following the new template & guidance to ensure accuracy & consistency in the HS database
21
![Page 22: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/22.jpg)
HS Data Collection Forms Updates
• Updates and Modifications Overview
▪ The Data Collection Forms (released in Apr) have undergone some minor, but important, changes
▪ Discussed in detail in the Deep Dive into HS Data breakout session
• Release of Revised Forms
▪ Forms to be shared next week for immediate use
• HSMED2 XML Schema and Data Dictionary to support systems
▪ Additional materials will soon be developed and released to assist grantees with data collection & reporting
22
![Page 23: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/23.jpg)
HS Evaluation
![Page 24: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/24.jpg)
Restating Key Findings & Lessons Learned
• Importance of baseline data▪ Pre-/post-test analyses → outcomes
assessment
• The diminishing effects of missing data on results▪ Effects on statistical power
▪ Introduction of bias
• Grantee: better data in →more robust results out
• MCHB: stronger evaluation design plan →improved conduct of evaluation study
24
![Page 25: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/25.jpg)
Future National Evaluation
• Evaluation Design Contract
▪ RFQ should hit the streets soon
▪ Award in early September
▪ Begin work in mid-September
• Statement of Work
▪ 1-year effort
▪ Design an evaluation plan for HS program
▪ Assess data collection & evaluation capacity of HS grantees
▪ Followed by a 3-year implementation of the evaluation activities per the design plan
25
![Page 26: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/26.jpg)
Future National Evaluation
Why evaluate the HS Program?▪ Demonstrate accountability
✓Government Accountability Office Requirements
✓Office of Management & Budget Justification
✓Congressional Justification
✓Health & Human Services Justification
▪ Contribute to the body of knowledge ✓Share successes! And, not-successes!
✓Inform quality improvement efforts
✓Add to the evidence-base for some interventions
✓Provide information for others to use in conducting similar work
26
![Page 27: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/27.jpg)
Announcements
• Vendor meeting announcement▪ July 9th – for vendors, data leads, & anyone in charge of updating systems
▪ Purpose:
✓Discuss a proposed communications strategy
✓Ensure vendors are provided information in a fair & equitable manner
✓Provide updated materials to vendors
✓Identify the most appropriate point of contact for updates & collect contact information
✓Answer questions
27
![Page 28: Healthy Start Data Systems & Resources (including …...HS Data Systems & Data Resources Healthy Start Virtual Grantees’ Meeting June 25, 2020 Lina Barrett, Matthew Biewener, & Ada](https://reader034.vdocuments.mx/reader034/viewer/2022042415/5f2fe070b87e17433a3badc9/html5/thumbnails/28.jpg)
Connect with HRSA
Learn more about our agency at:
www.HRSA.gov
Sign up for the HRSA eNews
FOLLOW US:
28