integrated postsecondary education data system a primer iips summer conference july 26, 2006
TRANSCRIPT
Integrated Postsecondary Education Data
System
A Primer
IIPS Summer ConferenceJuly 26, 2006
What is IPEDS?
• The core postsecondary education data collection program for NCES
• Designed to collect data from ALL institutions whose primary purpose is to provide postsecondary education
• Is a comprehensive system of interrelated surveys that collects institution-level data
Who has to submit IPEDS?
• Institutions that have a Program Participation Agreement (PPA) with the US Dept of Ed to participate in federal student financial aid programs
• Section 487(a)(17) of the Higher Education Act of 1965 as amended (HEA), 20 USC 1094(a)(17)– “… institutions will complete surveys
conducted as part of the Integrated Postsecondary Education Data System (IPEDS) … in a timely manner and to the satisfaction of the Secretary.”
IPEDS Surveys
•9 7 Components– General Information
• Institutional Characteristics
– Student Surveys• Enrollment• Completions• Graduation Rates• Student Financial Aid
– Resource Surveys• Finance • Human Resources
X
Reporting Compliance
• Each year, NCES is required to provide a list to the Office of Federal Student Aid (FSA) of institutions that do not submit IPEDS reports
• FSA sends out fine letters and warnings to noncompliant institutions
• Penalty for not submitting IPEDS can be as high as $27,500 per occurrence, or loss of Title IV eligibility
How Are IPEDS Data Used?
• National Research/Reporting
• COOL• Higher Education
Reauthorization Act• Postsecondary Education
Commission
System features
• Data are pulled forward from one section/component to another
• Totals, differences, percents, rates are calculated for you
• Prior year values are preloaded for comparison, editing
Security
• System is password protected• UserID and password provided to
KH• KH can create up to 6 additional
UserIDs, each with unique password• Additional users
– Can usually enter data – Cannot lock the data
• Contact HELP Desk for lost passwords 877-225-2568 or [email protected]
Disclosure Protection
• NCES is required by law to protect against disclosure of individually identifiable information collected by IPEDS
• Four IPEDS data files:– Graduation Rates– Student Financial Aid– Salaries– Fall Staff
Perturbation
• Random alteration of data in cells with small number of observations
• Occurs during migration of data from data collection system to Peer Analysis System
Imputation
• IPEDS data are imputed for total nonresponse and item nonresponse– Various methods used such as prior
year adjusted values; nearest neighbor; group means
• Imputation allows files to be used for national totals
• Imputed values on final data files
Keyholder Responsibilities
• Register, and keep contact information current– Receive all email messages from ED
• Coordinate all aspects of data submission at the institution level– Make sure all data are entered (step
1)– Make sure all surveys are edited and
clean (step 2)– Lock the data for all surveys before
the collection close date (step 3)
External Responsibilities
• Communicate with system and/or state coordinators about the timing of data submission
• Call the IPEDS Help Desk with any questions or concerns
Contact the Help Desk if…
• You have ANY questions• You haven’t received your
UserID and password• You think your list of
applicable surveys is not correct
• You think a survey status is not correct
Contact the Help Desk if…
• You have problems entering data
• You have problems resolving edit failures
• You have problems locking your data
• You have questions concerning ANY follow-up email you receive
Web-based Data Tools
• IPEDS COOL • Executive Peer Tool • IPEDS Peer Analysis System
– Peer tool– Dataset cutting tool
• IPEDS DAS– Table generator– Tables library
Additional Resources Available at AIR Website
• www.airweb.org• Training• Web-based Tutorials• Webinars
IPEDS Web Tools
IPEDS COOL
• Is a direct link to information on nearly 9,000 postsecondary institutions in the United States.
• COOL includes colleges, universities, and community colleges, as well as trade and technical schools.
• College Opportunities On-Line was authorized by Congress in 1998 to help college students, future students, and their parents understand the differences between colleges and how much it costs to attend college.
• Significantly revised in 2006 – now includes ability to make institutional comparisons
IPEDS COOL
• Designed to help college students, future students, and their families understand the differences between colleges and the price of attendance.
• Can be used by decision-makers to access data on comparison institutions.
Institution Search
• Enables a user to search for a particular school by name or for a group of schools using shared characteristics.
– Primary search:
• by Institution name; • by geographic location (multiple states or
region)• by instructional program (major)
– More options include:
• Characteristics• Enrollment levels• Religious affiliation• Distance from zip code
Available Information• Once selected, the data available on the institution is
divided into ten distinct categories.
– General Information
– Estimate Student Expenses
– Financial Aid
– Admission
– Enrollment
– Retention / Graduation Rates
– Awards / Degrees
– Accreditation
– Campus Security
– Federal Student Loan Default Rates.
Comparing Institutions
• Comparing institutions is a new feature added into the 2006 revised COOL site.
• You can select up to 4 institutions for side by side comparisons.
– Just like those car sales web sites!
• Two steps for creating comparisons:
– Select institutions for comparison – List the IPEDS data
Summary and Benefits to Users
• The benefits and short-comings of COOL are discussed in terms of two potential target audiences:
– Prospective students and their parents and families.
– Academic planners and decision makers.
Students
• The major benefit to current and prospective students and their parents and families is information.
– IPEDS COOL provides information on more postsecondary institutions and more types of postsecondary institutions than any other source currently available.
– Plus, COOL provides three years of price information - more than any other source currently available.
– The addition of comparisons to COOL provides good consumer information.
• The major weakness is that the tool that it provides for comparisons without explanation.
– For example, three years of price information enables trend analysis comparing the price of attending the institution over the last 3 years.
• The student or a family member can determine if the cost of attendance has
remained fairly constant or has the institution increased tuition over this time period.
• Help me here what is the weakness? Doesn’t provide context of why tuition changes?
Academic Planners & Decision Makers
• The major benefit of COOL to academic planners and decision makers is also information.
– IPEDS COOL provides valid and reliable information on comparison institutions.
– COOL can be thought of as being an on-line fact book that is publicly available on almost all institutions of higher education.
– The COOL consumer information tool now allows side-by-side comparisons of up to four institutions which allows decision makers preliminary access to direct comparisons.
• The short-comings of COOL from the administrative perspective is that:
– This tool provides only limited access to variables that are available within IPEDS, and
– The ability to make comparisons across institutions is limited (to four institutions).
• As a result, academic planners and decision makers need a more advanced tool that provides access to more IPEDS data and enables direct comparisons across multiple institutions.
– NCES provides such a tool for IPEDS data in the Peer Analysis System.
Academic Planners & Decision Makers
Demonstration
http://collegesearch.nces.ed.gov
Executive Peer Tool (ExPT) and
IPEDS Data Feedback Reports• The Executive Peer Tool was developed as
part of the project that developed the IPEDS Data Feedback Reports.
• The Data Feedback Report.– The report came from an NPEC project.
• NPEC is the National Post Secondary Education Collaborative.
– The report is designed to be useful to institutional executives for comparative purposes.
– These reports provide each institution a context for examining their IPEDS data based upon a comparison group.
– Part of the goal of the project was to help improve the quality and comparability of IPEDS data.
Executive Peer Tool (ExPT)
• How does ExPT work?– ExPT leads the user through a
simple, step-by-step process.– The user must complete five steps:
1)identify a focus institution,2)pick comparison institutions (up
to 100 allowed),3)pick the data they want (up to 8
variables at a time), 4)view a statistical report (summary
data and graph); and5)view statistical data for all
institutions in the comparison group.
Strengths & Limitations of ExPT
• ExPT does what it was designed to do:– Provides access to executives in a
straight forward manner. – Provides data at institution level, – Data are tied directly to the Data
Feedback report, and– ExPT does whet your appetite for
more. . .• Which leads us to some limitations of
ExPT– ExPT limits you to up to 100 schools at
a time in your comparison group.– You have limited options for picking
peer schools– Data are presented based on the Data
Feedback Report chart structure.– You may view data online only, eight
variables at a time.
Peer Analysis System
• The Peer Analysis System is a web-based tool that is designed to enable a user to easily retrieve data on a group of postsecondary institutions of the user’s choice. – In addition, the user can compare one
institution to a group of comparison institutions.
– The comparison institutions are selected by the user.
– The system allows the user to generate reports or files using selected IPEDS variables of interest.
Peer Analysis System
• The Peer Analysis System include two additional tools, the Executive Peer Tool, and the Dataset Cutting Tool (DCT).
• The Dataset Cutting Tool allows:– Allows dump of raw tables or– Allows the user to quickly create
customized datasets.•This tool was designed for advanced
users – additional advanced training is available.
Flow and Sequence of the Peer Tool• To become proficient with the Peer Analysis System,
you need to understand the flow and sequence of the Peer Analysis System.
• The flow and sequence of the Peer Analysis System is designed around the steps you need to complete while using the peer tool. The steps include:
1. Select a level of access2. If necessary login to the peer tool3. Select the either the Peer Analysis System or the
Dataset Cutting Tool4. Identify a LinchPin institution5. Construct a comparison group6. Prepare your analysis
• Let us look more closely at the flow of each of these steps…
Flow and Sequence of the Peer Analysis System
1. Select the level of access that you desire to the Peer Analysis System.• Three levels of access exist.• Each level provides access to different years of data and
as a result has different levels of security.
2. If necessary login to the peer tool.• Different login procedures are necessary for the varying
levels of access.
3. Choose the Peer Analysis System by identifying a LinchPin institution• A Linch Pin Institution is the institution that you want to
compare to other comparison institutions.• In most instances, the Linch Pin is usually your own
institution.
4. Construct a comparison group• Usually your predefined comparison group.
5. Prepare your analysis• Generate the reports or files.
Data Release Stages
• Pre-release: login at collection level– Data are reviewed and perturbed– Locked institutions are migrated to PAS– Data available for peer comparisons
only
• Early release: login at institution level – All institutions are migrated to PAS– Data available for peer comparisons
only
• Final release: login at guest level– Data are imputed and fully adjudicated– No restrictions on data use
• Peer Analysis System (PAS)
With selected schools & variables:– rank schools
by variable – calculate new
variables– create
standard and custom reports
– View/download data, reports, graphs
• Dataset Cutting Dataset Cutting Tool (DCT)Tool (DCT)
For one data year:– download
entire IPEDS data files
– Custom-build large datasets, selecting mix of schools, surveys, variables
– Download datasets for analysis off-line using Excel, SPSS, SAS, or STATA
ComparinComparingg
PASPAS DCTDCT
Schools 4 – 1,200 No Limit
Surveys 1 or more 1 or more
Variables 1 – 250 No Limit
Years of Data 1 or more per survey 1 per session
Analysis within Application
Calculated variables, rankings, summary statistics, graphs, etc.
None
Analysis after Exiting
Download in csv format for use with spreadsheet
Download csv, SPSS, SAS or STATA data files
DCT OptionsDCT Options1.1. CreateCreate aa customizedcustomized
IPEDS datasetdataset of selected variables from one or more survey components
2.2. Download entireDownload entire IPEDS survey data filesdata files
Both options provide dictionary & syntax for importing data into SAS, SPSS, or STATA
33 Steps for Creating a Steps for Creating a Custom Dataset:Custom Dataset:
1. Select the schoolsschools for which you want data
2. Choose the yearyear of data you needdata you need
3. Select variablesvariables from one or more survey components
Downloading Custom Dataset Downloading Custom Dataset FilesFiles
(1) Create Subdirectory/FolderSubdirectory/Folder to receive DCT output, e.g., “C:\DCT”
(2) Select outputSelect output from drop-down list, one at a time, and save in subdirectory
(3) Use DCT BackDCT Back ButtonButton to return to output page to get each file
(4) Download datadata file, readread programprogram (syntax), & dictionarydictionary
DAS is not PAS!!!
• In PAS…– The rows are individual institutions– User defines the columns by selecting
other IPEDS variables
• The DAS…– Is a table generator– Which produces aggregated data– The user creates or modifies table
parameter files (TPFs) by tagging: • Row variables• Column variables and specifying• Spanner variables, Filters, etc.
The DAS Web Site
• The vehicle for public access to education survey data collected by the U.S. Department of Education.
• Comprehensive source for tables, findings, and reports generated by NCES researchers.
• Data Analysis System On Line (DASOL) enables users to generate their own tables.