data mart training handout

8/8/2019 Data Mart Training Handout

1/16

AQS Data Mart & Business Objects TrainingAQS Data Mart & Business Objects Training 11

AQS Data Mart TrainingAQS Data Mart Training

Jonathan Miller, USEPAJonathan Miller, USEPA

millmillee [email protected]@epamail.epa.gov(919) 541(919) 541 --77387738
mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]


2/16


AQS Data MartAQS Data Mart -- OverviewOverview

In Production March 24, 2006In Production March 24, 2006

Methods of AccessMethods of AccessWeb Services (July, 2006)Web Services (July, 2006)Air Explorer (June, 2006)Air Explorer (June, 2006)Business Objects (Business Objects ( WebIWebI )) Available NowAvailable Now

Inside EPA FirewallInside EPA Firewall Minimal IssuesMinimal Issues

Outside EPA FirewallOutside EPA Firewall Requires AAA TokenRequires AAA TokenNeed this Training Before a User Id Will beNeed this Training Before a User Id Will beGrantedGrantedCurrent Limits: 50,000 Records / QueryCurrent Limits: 50,000 Records / Query


3/16


AQS Data MartAQS Data Mart Data ProfileData Profile

Data Updated Every NightData Updated Every Night

Combines AQS Data and AirNow DataCombines AQS Data and AirNow DataAQS Data Takes PrecedenceAQS Data Takes PrecedenceAirNow Data Removed After 1 Year if Not Updated byAirNow Data Removed After 1 Year if Not Updated byAQSAQSAirNow Participants AuthorizesAirNow Participants Authorizes SharingSharing of Dataof Data

Site / Monitor Descriptions (From AQS)Site / Monitor Descriptions (From AQS)All Raw Data (1980 +)All Raw Data (1980 +)Daily Summary DataDaily Summary DataAnnual Summary DataAnnual Summary DataBlanks DataBlanks Data


4/16


AQS Data MartAQS Data Mart -- MetadataMetadataTechnical MetadataTechnical Metadata

Used primarily for the various system components toUsed primarily for the various system components toautomatically do their job and for monitoring ofautomatically do their job and for monitoring ofperformanceperformance

Business MetadataBusiness Metadata Available via Business ObjectsAvailable via Business ObjectsHuman understandable names for fieldsHuman understandable names for fieldsDescriptions of fields add information for useDescriptions of fields add information for use

ANNUAL_ARITH_STDDV vs. Annual Arithmetic Standard DeviationANNUAL_ARITH_STDDV vs. Annual Arithmetic Standard Deviation

Field GuideField Guide to Ambient Datato Ambient Data Separate ApplicationSeparate ApplicationA userA user s manuals manualExplanation not only of each data field, but how they relateExplanation not only of each data field, but how they relateto each otherto each otherMore detailed explanations and caveats about dataMore detailed explanations and caveats about data(AirNow, non(AirNow, non --FRM PM, etc.)FRM PM, etc.)

Data About Data


5/16


AQS Data MartAQS Data Mart Conformed DataConformed Data

Conforms to EPA standard names and formatsConforms to EPA standard names and formatsUseful when integrating with other datasetsUseful when integrating with other datasetsSubstance Registry SystemSubstance Registry System

Chemical names (AQS = parameters)Chemical names (AQS = parameters)Common names and linkages across systemsCommon names and linkages across systems

Facility Registry SystemFacility Registry SystemAn AQS site is aAn AQS site is a facilityfacilityUsually not, but sometimes sharedUsually not, but sometimes shared

TimeTimeIs, like the others, the same for everybodyIs, like the others, the same for everybodyDay in year, day in week + week in year, weekend, holiday,Day in year, day in week + week in year, weekend, holiday,nominal hours of daylightnominal hours of daylight


6/16


TerminologyTerminology Star SchemaStar Schema

FactsFacts at the centerat the centerFact = something youFact = something you rereinterested in queryinginterested in querying

Raw DataRaw DataSummary DataSummary Data

DimensionsDimensions each linkedeach linkedto the factsto the facts

Dimension = somethingDimension = somethingyou will use as a filter oryou will use as a filter orcriteria to get at the facts ofcriteria to get at the facts ofinterestinterest

FACT

Dimension

DimensionDimension


7/16


TerminologyTerminology Additional TypesAdditional TypesSnowflakeSnowflake

Additional Information About a Dimension that You May Want toAdditional Information About a Dimension that You May Want toFilter byFilter byChildChild of a Dimensionof a DimensionExample: Monitor TypeExample: Monitor Type

FactoidFactoidA Dimension Containing Information You are Not Likely to FilterA Dimension Containing Information You are Not Likely to FilterByByExample: Monitoring SeasonExample: Monitoring Season

BridgeBridgeResolvesResolves Many to ManyMany to Many Types of Relationships BetweenTypes of Relationships BetweenTablesTablesExample: Agency RolesExample: Agency Roles


8/16


TerminologyTerminology -- Changes From AQSChanges From AQS

Why?Why?

Help in Merging with Other Data SystemsHelp in Merging with Other Data SystemsConsistent with EPA Data StandardsConsistent with EPA Data Standards

Parameter =Parameter = SubstanceSubstance Site =Site = FacilityFacility

Raw Data =Raw Data = MeasurementMeasurement


9/16


Business ObjectsBusiness Objects

Access Address:Access Address:http://www.epa.gov/ttn/airs/aqsdatamart/access.htmMust Have User ID / Password

Only 200 Available

Must Attend the 2-Hour Training Course (Congratulations!)Expires after 90 DaysIf You Dont Use it, You Lose it!

If you are Outside the EPA Firewall.AAA Token RequiredRetrieval Limit Set at 50,000 Rows / Query
http://www.epa.gov/ttn/airs/aqsdatamart/access.htmhttp://www.epa.gov/ttn/airs/aqsdatamart/access.htm


10/16


Business Objects

Components of Business ObjectsComponents of Business Objects

InfoView Web Intelligence(WebI )

PersonalDocuments

CorporateDocuments

Navigate BOExecute Existing DocsManage Documents

Separate Application

Opens a new window Modify Existing DocsCreate New Docs


11/16


Business Object TerminologyBusiness Object Terminology

UniverseUniverse

Set of Tables, Views, and Functions toSet of Tables, Views, and Functions toAddress a Given Business AreaAddress a Given Business Area

AQS Datamart Universe (Fact_Measurement)AQS Datamart Universe (Fact_Measurement)AQS Datamart Daily UniverseAQS Datamart Daily Universe(Fact_Daily_Summary)(Fact_Daily_Summary)AQS Datamart Annual UniverseAQS Datamart Annual Universe((Fact_Annual_SummaryFact_Annual_Summary ))


12/16


Business Object TerminologyBusiness Object Terminology

Corporate DocumentsCorporate Documents

PrePre --formatted reportsformatted reports3 Corporate Documents Defined3 Corporate Documents Defined

Raw Data ListingRaw Data ListingAnnual Summary ListingAnnual Summary ListingData AvailabilityData Availability

Personal DocumentsPersonal DocumentsAdAd--Hoc Query capabilityHoc Query capability


13/16


Navigating in Business ObjectsNavigating in Business Objects


14/16


Setting Your Default UniverseSetting Your Default Universe

From Business Objects Home, SelectFrom Business Objects Home, Select

OptionsOptions Select theSelect the Create/EditCreate/Edit TabTabSelectSelect WebIntelligenceWebIntelligence (Select Default Universe)(Select Default Universe) ClickClick (Select Default Universe)(Select Default Universe)

Select Your Default Universe and ClickSelect Your Default Universe and Click OKOK

ClickClick OKOK When You are Returned to theWhen You are Returned to theCreate/EditCreate/Edit TabTabIf you DonIf you Don t Set your Default Universe, You will Get ant Set your Default Universe, You will Get an

Error When Creating aError When Creating a New DocumentNew Document


15/16


Running inRunning in InfoViewInfoView

EditEdit OpensOpens WebIWebI to Make Changes to theto Make Changes to theDocumentDocumentSaveSave

Personal DocumentsPersonal DocumentsExport the DataExport the Data

ExcelExcelPDFPDFCSVCSV

SendSend

Puts the Query in Another UserPuts the Query in Another User

ss

InboxInbox

Change the ViewChange the ViewHTML (Default)HTML (Default)PDFPDF


16/16


Running Documents InRunning Documents In InfoViewInfoView(Applies to Personal and Corporate Documents)(Applies to Personal and Corporate Documents)

Open the DocumentOpen the Document

Fill out the Prompts as AppropriateFill out the Prompts as AppropriateExecute the QueryExecute the Query

You May Edit the DocumentYou May Edit the DocumentOpens Web IntelligenceOpens Web Intelligence

If you want to Save the Changes, You MustIf you want to Save the Changes, You MustSave it as a Personal DocumentSave it as a Personal Document