star metrics

37
Science and Technology for America’s Reinvestment: Measuring the EffecTs of Research on Innovation, Competitiveness and Science STAR METRICS FDP Technical Data Requirements Discussion July 15, 2010 1 Star Metrics Data Requirements Webinar

Upload: zarek

Post on 05-Jan-2016

35 views

Category:

Documents


2 download

DESCRIPTION

STAR METRICS. S cience and T echnology for A merica’s R einvestment: M easuring the E ffec T s of R esearch on I nnovation, C ompetitiveness and S cience. FDP Technical Data Requirements Discussion July 15, 2010. FDP Technical Data Requirements Discussion. Agency Budget. Award - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: STAR METRICS

Star Metrics Data Requirements Webinar

1

Science and Technology for America’s Reinvestment: Measuring the EffecTs of Research on Innovation, Competitiveness

and Science

STAR METRICS

FDP Technical Data Requirements Discussion

July 15, 2010

Page 2: STAR METRICS

Star Metrics Data Requirements Webinar

2

FDP Technical Data Requirements Discussion

Decision to Participate in Star

Metrics

Assessment of Data Required and Impact on

University Systems

Initial data upload, data

validation, use case tests, ongoing

operational automation plan

Page 3: STAR METRICS

Star Metrics Data Requirements Webinar

3

Institution STAR METRICSSTARPilot

ProjectAcquisition

And Analysis

DirectBenefitAnalysis

IntellectualPropertyBenefitAnalysis

InnovationAnalysis

Jobs,Purchases,Contracts

BenefitAnalysis

DetailedCharacterization

andSummary

Institution

Agency Budget

Award

StateFunding

Personnel Vendor Contractor

HR System ProcurementSystem

SubcontractingSystem

EndowmentFunding

Financial System

Hire Buy Engage

Disbursement

Award

Record

Start-Up

Papers

Patents

DownloadState

ResearchProject

ExistingInstitutionalReporting

Agency

MEASURED OUTCOMES

Page 4: STAR METRICS

Star Metrics Data Requirements Webinar

4

Overarching Principle

• We want to leverage EXISTING academic processes and administrative data.

=> We’ll work with you. If a particular data element is not available, let us know.

• Our goal is to work towards the development of an integrated and consistent reporting structure that minimizes the burden of “one off” reporting by academic institutions while growing a base of knowledge of how grant funding is shaping our country’s competitive future in science and technology.

Page 5: STAR METRICS

Star Metrics Data Requirements Webinar

Based on Existing Record Reporting

5

Page 6: STAR METRICS

Where do the Star Metrics Requested Data Elements

(or their equivalent) exist in your systems?

6Star Metrics Data Requirements

Webinar

DescriptionElement ID Item

Data Source Unit of Analysis

Infornation on Award

1 Unique Award Number

University

Award

2 Recipient Account Number Award

3 Overhead charged Award

Information on People

4 Occupational Classification

University

Individual

5 Proportion of time (or earnings) allocated to award Individual

6 FTE status Individual

7 De-identified Employee ID # Individual

Payment to Vendors

8 Vendor Duns # or Zip Code

University

Vendor

9 Amount of Contract disbursed in period Vendor

Subaward Payments

10 Subaward Recipient Duns # or Zip Code

University

Subcontractor

11 Amount of Contract disbursed in period Subcontractor

Information on Overhead 12 Proportion of overhead associated with salaries

(from indirect cost rate proposal) University University

Page 7: STAR METRICS

7Star Metrics Data Requirements

Webinar

Page 8: STAR METRICS

Star Metrics Data Requirements Webinar

8

Getting Started

• Identify where the requested data exist in your university’s administrative systems

• Assess any impacts which affect your university’s response to the data request (e.g. privacy impact(s), data access issues)

• Identify approaches to pull the data from your systems:– Banner or Peoplesoft? Check out sample queries already developed

on our Star Metrics demonstration web site– Already pulling similar data for ARRA or other Federal or State

Reporting? Check out Star Metrics demonstration web site for FAQs and other tips located at http://starmetricscomp.synthosys.com

• Review the Star Metrics Participation Agreement and Memorandum of Understanding

We encourage you to send a sample extract of your data to us. We will provide you with initial results and feedback.

Page 9: STAR METRICS

Star Metrics Data Requirements Webinar

9

Award Data

STAR METRICS

Page 10: STAR METRICS

Star Metrics Data Requirements Webinar

10

Field Description FormatField

Length

Period Start Date The start date for each transaction. Date (YYYYMMDD) 8

Period End Date The end date for each transaction. Date (YYYYMMDD) 8

Unique Award Number

The unique federal number is defined by concatenating the 6 position CFDA code with the assigned Federal Award ID from the awarding Federal Agency (such as the

federal grant number, federal contract number or the federal loan number).

Format example: 47.074 AGS-0120950 where "47.074" is the CFDA and "AGS-

0120950" is the Federal Award ID.

String

(Example)

47.074 AGS-0-120950

50

Recipient Account Number University's internal number for the award. string 255

Overhead ChargedActual F&A/indirect dollars charged to the

award in the specified period.Currency (Dollar value -

numeric) 18,2

File Set 1: Overhead charged grouped by Award

We ask for Period Start dates and Period End dates for all transactions so we can adjust your data to the appropriate calendar quarters. If you send us data already summarized at a quarterly level we will simply take your summary results.

Your Recipient Account Number is the Primary Key we use to link your records. Your university may have multiple Recipient Account Numbers associated with one Unique Award ID.

The CFDA 5 digit codes enable us to identify ARRA awards

Page 11: STAR METRICS

Star Metrics Data Requirements Webinar

11

Star Metrics FAQsWhat type of award data is requested?

 We would like data on all federal awards (ARRA and non-ARRA); however at the present time, please do not include federal loan funds, non-federal sponsored projects, university funds or gifts.

What do the Period Start date and Period End date refer to?

Most universities have financial and human resources transaction periods that are weekly, biweekly, or monthly. We ask that you send the data at the frequency that they are generated. The Period Start date and Period End date refer to the start and end period associated with each data record. As an example, if your payroll records are bi-weekly, the data provided would reflect the bi-weekly pay period and would be the start and end dates of that pay period.

 

Page 12: STAR METRICS

Star Metrics Data Requirements Webinar

12

Star Metrics FAQsWhat if our pay periods do not begin or end with a calendar month or quarter?

 The STAR METRICS team will convert the data to a calendar quarter.

 What constitutes a quarter? 

Quarters are calendar quarters consistent with ARRA and other federal reporting: Q1: 10/1 to 12/31; Q2: 1/1/ to 3/31; Q3: 4/1 to 6/30; Q4: 7/1 to 9/30 

Why don’t you just ask for the quarterly summaries?

Our main goal is to reduce your reporting burden. The transaction level data and also enables us to handle within quarter changes, such as if an individual changes status during a quarter (i.e., part-time to full-time or occupational classification). If you provide transaction data, the STAR METRICS team will calculate the quarterly summaries. However, if you provide your data to STAR METRICS in a quarterly summary, we will simply use your calculated summaries.

 

Page 13: STAR METRICS

Star Metrics Data Requirements Webinar

13

Star Metrics FAQs

What is the Unique Award Number?

The Unique Award Number is defined by concatenating the 6 position CFDA code with the assigned Federal Award ID from the federal agency. An example might be: “47.074 AGS-0120950” where “47.074 is the CFDA code and “AGS-0120950” is the Federal Award ID. When concatenating the CFDA code and the federal award ID to create the Unique Award Number, please leave a space between the CFDA code and Federal Award ID as shown in the example above (e.g., no commas or dashes between the two fields).  What is the Recipient Account Number?

The Recipient Account Number is the internal systems identifier that uniquely tracks each federal award received by your Institution. We use this number as the primary key to link your data records. If you do not have a consistent Recipient Account Number across awards, please discuss this with the Star Metrics Team so we can employ another method.

Page 14: STAR METRICS

Star Metrics Data Requirements Webinar

14

Star Metrics FAQs

How much historical data are needed?

We would like to receive consistent data as far back as you are able to provide. Historic records permit us to build a documented basis of evidence for impact.  How often and when should data be sent?

Once your initial data upload is completed we request that data be sent on a quarterly basis. We will maintain baseline information in your profile. Indirect Cost information does not need to be resent each quarter but updated on a yearly basis.

If there is no activity in a report category for the quarter being reported, should the report for that category still be submitted with an indication that there is no data to report?

Yes

 

Page 15: STAR METRICS

Star Metrics Data Requirements Webinar

15

Upload File Examples

Period Start Period End Unique Award # Recipient Account # Overhead Charged

01/01/2010 01/31/2010 47.074 AGS-0120950 A101556 $222,340

02/01/2010 02/31/2010 47.074 AGS-0120950 A101556 $12,564

01/01/2010 01/31/2010 93.826 DP2OD007501 A985112 $49,885

01/01/2010 01/31/2010 93.112 K99CA169712 A012556 $1,475

02/01/2010 02/31/2010 93.112 K99CA169712 A012556 $31,112

03/01/2010 03/31/2010 93.112 K99CA169712 A012556 $65,745

File Set 1 Example: Overhead charged grouped by Award

Page 16: STAR METRICS

Star Metrics Data Requirements Webinar

16

Employee Data

STAR METRICS

Page 17: STAR METRICS

Star Metrics Data Requirements Webinar

17

Field Description Format Field Length

Period Start Date The start date for each transaction.

Date (YYYYMMD

D)8

Period End Date The end date for each transaction.

Date (YYYYMMD

D)8

Recipient Account NumberUniversity's internal number

for the award. string 255

De-Identified Employee IdUnique Employee ID (not

Social Security number) of award funded personnel

string 50

Occupational Classification

Occupational classification / Job description of the funded

personnel (ex. Faculty, Undergrad Student, Grad Student, Admin, Technical

Support, Post grad Student)

string 55

FTE Status

Designation of the status (percent) of the funded

personnel (full time = 1.0, half time = .5)

percent 5,2

Proportion of earnings allocated to award

Calculated portion of funds expended by funded personnel

in the specified period. percent 5,2

File Set 2: Employee Detail

At this time we cannot collect personally identifiable information; however, we DO want job classes of the employees so that we can report statistics on job classes created

1) FTE Status is your university’s designation of an employee’s FTE Status

2) Proportion of employee earnings allocated to an award =

Salary earned on award/Salary earned in

period

We cannot take direct salary information at this time.

Page 18: STAR METRICS

Star Metrics Data Requirements Webinar

18

Star Metrics FAQ’SWhat is a de-identified employee id?

This is a unique identifier, typically an existing University ID, that does not contain a Social Security number or any other personally identifiable information. In situations where a university uses personally identifiable information to identify employees, the STAR METRICS team will work with the university to develop an acceptable solution. What occupational classifications (job classes) are being reported?

Based on our discussions with pilot universities, the following occupational classifications are being used to categorize the data – Technician/Staff Scientist, Clinicians, Administrative Support, Research Assistant/Coordinator, Faculty, Undergraduate Student, Graduate Student, and Post-Doctoral Fellow.  You DO NOT need to remap your data to the STAR METRICS categories . You should provide your own job classification in this requested field. We will map your job classes to the standards being used for the Star Metrics Program noted below. We may request that you send job descriptions so that we can better map your job classes to the appropriate category. 

Page 19: STAR METRICS

Star Metrics Data Requirements Webinar

19

Star Metrics FAQ’S What is the FTE Status in the Employee file?

 FTE Status is your university’s own designation of the status of the funded personnel. For example, full time = 1.0, half time = .5.

What is Proportion of Earnings Allocated to the Award in the Employee File and how is this being used?

Proportion of Earnings Allocated to the Award represents the earnings charged by the employee to the award divided by total earnings in the time period.  Should these data be pulled from our HR SYSTEM?

Yes, this is the best source for this information.

 

Page 20: STAR METRICS

Star Metrics Data Requirements Webinar

20

Star Metrics FAQ’S

 How should retroactive payroll transfers be handled? Do you want to include payroll amounts related to periods outside the quarter being reported, which were processed during the reporting period? (e.g. should a retroactive salary transfer for service dates within the prior quarter be included on this quarter’s report or not?)

We would like you to include any retroactively added or modified payroll related information if it is part of the regularly generated HR system reports. The updates can be sent in any subsequent update data feeds. The STAR METRICS team will incorporate them in the updated calculations.

What population should be included on employee reports?

All employees on federally-funded awards

Page 21: STAR METRICS

Star Metrics Data Requirements Webinar

21

Period Start Period End De-Identified Employee ID # Occupational Classification FTE status

Prop. time allocated to award

07/01/2010 09/30/2010 1005987Administrative

Assistant I 1 0.25

07/01/2010 09/30/2010 1005789 Staff Associate 1 0.1

07/01/2010 09/30/2010 1005687 Technical Assistant II 0.5 0.4

07/01/2010 09/30/2010 1005445Technical Support

Specialist 0.5 0.33

07/01/2010 09/30/2010 1005998 Post Doc 1 0.5

07/01/2010 09/30/2010 1005457 Assistant Professor 1 0.09

File Set 2 Example: % Time on Award by Employee

Upload File Examples

Page 22: STAR METRICS

Star Metrics Data Requirements Webinar

22

Vendor Data

STAR METRICS

Page 23: STAR METRICS

Star Metrics Data Requirements Webinar

23

File Set 3: Payments to Vendors

Field Name Description Format Field Length

Period Start Date The start date for each transaction. Date (YYYYMMDD) 8

Period End Date The end date for each transaction. Date (YYYYMMDD) 8

Recipient Account Number University's internal number for the award. string 255

Vendor DUNS Number

Vendor DUNS Number. The Vendor's 9 digit DUNS number. If DUNS is unavailable

then substitute zip code with "Z" prefix in order to distinguish it from the DUNs

number.

String

(example)123456789

OrZ20850

10

Payment Amount The funds disbursed to the vendor in the specified period.

Currency (Dollar value - numeric) 18,2

If you don’t have Vendor Duns Number, please provide zip code of Vendor with a Z prefix.

The amount paid to the Vendor during the time period specified. From the amount and the DUNS (or zip code), we will estimate jobs created from industry and census data.

Page 24: STAR METRICS

Star Metrics Data Requirements Webinar

24

Star Metrics FAQ’SWhy do you need the Vendor DUNS Number?

The DUNS Number is used to provide estimates of the jobs associated with the disbursement of funds to sub-awardees and vendors. We calculate these estimates based on Census data for the vendor industry and geography. If DUNS numbers are not available, please provide the Zip Code information; this can be used to calculate the estimates based on geographical information. If zip code data are provided, please use a leading Z to enable us to recognize that these are zip code data. On Payments to Vendors, should non-payroll payments made to existing university employees be included? Examples include reimbursement and consulting payments. Or should the report only report on payment to entities outside the university? For Payments to Vendors, please only report on payments made to entities outside the university. 

Page 25: STAR METRICS

Star Metrics Data Requirements Webinar

25

Star Metrics FAQ’SDo you want to collect Vendor Payments under $25,000?

 Since both ARRA reporting and the proposed FFATA reporting requirements do not require identifying vendor information for payments under $25,000, please only report vendor payments that are greater than $25,000.  Should there be one entry per vendor, per recipient account number? Yes Should we exclude payments to sub-awardees from the vendor payment report assuming these payments are captured in the sub-awardee payments files?

Yes

What about International Vendors?

Please provide the country code, if available. Otherwise, just note that it is international.

Page 26: STAR METRICS

Star Metrics Data Requirements Webinar

26

Period Start Period End Recipient Account # Vendor Duns # (or Zip) Amount Disbursed

5/15/2010 5/31/2010 A101598 123456789 $222,340

5/15/2010 5/31/2010 A011549 123456789 $1,234,567

Upload File Examples

File Set 3 Example: Payments to Vendors

Page 27: STAR METRICS

Star Metrics Data Requirements Webinar

27

Sub-Award Data

STAR METRICS

Page 28: STAR METRICS

Star Metrics Data Requirements Webinar

28

Field Description Format Field Length

Period Start Date The start date for each transaction. Date (YYYYMMDD) 8

Period End Date The end date for each transaction. Date (YYYYMMDD) 8

Recipient Account Number University's internal number for the award. string 255

Sub recipient DUNS Number

The sub recipient organization’s 9- digit DUNS number. If DUNS is

unavailable then substitute zip code with "Z" prefix so as to distinguish it

from the DUNs number.

string 10

Sub-award Funds Disbursed The amount of cash disbursed to the sub-awardee in specified period.

Currency (Dollar value -

numeric)18,2

File Set 4: Payments to Sub-awardees

If you don’t have Sub-Contractor Duns Number, please provide zip code of Vendor with Z prefix.

The amount paid to the Vendor during the time period specified. From the amount and the DUNS or zipcode, we will estimate jobs created from industry and census data.

Page 29: STAR METRICS

Star Metrics Data Requirements Webinar

29

Star Metrics FAQ’SWhy do you need a Sub-Award Recipient DUNS Number?

The DUNS Number is used to provide estimates of the jobs associated with the disbursement of funds to sub-awardees and vendors. We calculate these estimates based on Economic Census data for the vendor industry and geography. If DUNS numbers are not available, please provide the Zip Code information; this can be used to calculate the estimates based on geographical information. If zip code data are provided, please use a leading Z to enable us to recognize that these are zip code data. On Payments to Sub-awards: Should non-payroll payments made to existing university employees be included? Examples include reimbursement and consulting payments.

For Payments to Sub-awardees, please only report on payments made to those entities. Do you want to collect Sub-award Payments under 25K?

Since both ARRA reporting and the proposed FFATA reporting requirements do not require identifying subawardee information for payments under $25,000, please only report subawardee payments that are greater than $25,000.

Page 30: STAR METRICS

Star Metrics Data Requirements Webinar

30

Period Start Period End Recipient Account # Sub Recipient Duns # Amount Disbursed

5/15/2010 5/31/2010 A120005 123456789 $222,340

5/15/2010 5/31/2010 A100549 123456789 $1,234,567

Upload File ExamplesFile Set 4 Example: Payments to Sub-recipients

Page 31: STAR METRICS

Star Metrics Data Requirements Webinar

31

File Set 5: Indirect Costs

Please send us your full indirect cost rate proposal. We are working with our steering committee members to finalize the approach to estimating the salaries associated with indirect costs.

Page 32: STAR METRICS

Star Metrics Data Requirements Webinar

32

Getting Ready to Send Data

• Participation Agreement Requirements• Secure FTP Data Transfer

Page 33: STAR METRICS

Star Metrics Data Requirements Webinar

33

Participation Agreement Instructions

The Participation Agreement or Memorandum of Understanding is the proposed agreement for use and treatment of data between the university and the National Institutes of Health that must be signed prior to participation in the Star Metrics Project. The agreement template can be found on the Star Metrics demonstration web site.

When you are ready to submit the agreement, please send two signed copies of the participation agreement to:

Stefano Bertuzzi, Ph.D.Office of the DirectorOffice of Science PolicyNational Institutes of HealthBg.1 Rm.2241, Center Dr. Bethesda, MD 20892Phone 301 496 9286Fax 301 402 0280

Page 34: STAR METRICS

Star Metrics Data Requirements Webinar

34

Secure Environment and Secure Data Transfer Discussion

What Data Security Standards will STAR METRICS use for data storage?

 The STAR METRICS data will be housed at the NIH Data Center and adhere to Federal Information Security Management Act of 2002 (FISMA) guidelines. The NIH Data Center provides a secure computing environment suitable for applications and data categorized at the low or moderate security level per FIPS Publication 199, Standards for Security Categorization of Federal Information and Information System. The NIH Data Center will be able to provide a secure computing environment suitable for applications and data categorized at the high security level shortly.

The NIH CIT has implemented appropriate security controls conforming to the FISMA to protect your data. CIT maintains physical and host system security controls and procedures to protect the computer hardware, applications, and data from improper access by unauthorized individuals and to ensure continued availability.

Page 35: STAR METRICS

Star Metrics Data Requirements Webinar

35

Secure Environment and Secure Data Transfer Discussion

What file format should be used to send data?

We will accept data in CSV or XML format. Please refer to the CSV and XML templates on the STAR METRICS demonstration website

http://starmetricscomp.synthosys.com/dashboard.aspx

Page 36: STAR METRICS

Star Metrics Data Requirements Webinar

36

Secure Environment and Secure Data Transfer Discussion

How do we send our data to STAR METRICS?

In the short term, the files can be sent using the National Institutes of Health (NIH) secure email transmission capability, which allows for message and document transfer up to 2 GB over an encrypted channel. Information on the secure e-mail file transfer process can be found at(link to page on web site). The process is the following:

We will send you a secure email from https://secureemail.nih.gov, which has information on how to register to transmit data (this is a one time registration). 

You then return to the email we sent, enter a message, attach the data files, and hit “reply.”

We will confirm receipt and then start the creation of the job reports. When will a secure web server be available for data upload?

It is anticipated that the integrated upload web based system that will allow for verification and validation will be made available by September, 30th 2010. At that time you may continue to use the secure e-mail data transfer method, or use the web based upload system.

Page 37: STAR METRICS

Star Metrics Data Requirements Webinar

37

For More Information

• Linda Yu [email protected]• Julia Lane [email protected]• Jack Vinner [email protected]