1

Build Your Own Data.gov Mashup-of-Mashups Catalog

Brand NiemannSenior Enterprise Architect

U.S. EPANovember 5, 2010

2

Tim Berners-Lee:The Five Stars of Linked Open Data

• 1. Make your stuff available on the web (whatever format);

• 2. Make it available as structured data (e.g. excel instead of image scan of a table);

• 3. Non-proprietary format (e.g. csv instead of excel);

• 4. Use URLs to identify things, so that people can point at your stuff; and

• 5. Link your data to other people’s data to provide context.

http://inkdroid.org/journal/2010/06/04/the-5-stars-of-open-linked-data/

3

Jim Hendler: The Semantic Web - 2010 Update

• The “Buzz” around data on the Web – especially open government data.

• Facebook’s Open Graph Protocol likely to become the most “used” ontology ever.

• Modeling is very expensive and the return on investment must be very high.

• Data.gov originated from 3rd parties doing the Semantic Web bottom up.

• The big one is still out there.– I think TBL’s Five Stars of Linked Open Data is it!

http://www.slideshare.net/jahendler/the-semantic-web-2010-update

4

A Se-Mash Hit

http://www.data.gov/semantic/a-se-mash-hit

40 Apps

5

Demos

http://data-gov.tw.rpi.edu/wiki/Demos

Facts About This Demo

6

Facts about this Demonstration

http://data-gov.tw.rpi.edu/wiki/Demo:_Broadband_Internet_Use_versus_Total_Internet_Use_-_United_States_Households,_2009

Dataset

7

Dataset 10040

http://data-gov.tw.rpi.edu/wiki/Dataset_10040

Data Source

8

Data Source

http://www.ntia.doc.gov/data/CPSTables/t11_2lst.txt

Five Categories:All 2009TotalUrbanRuralPrincipal City

Extract Four Columns:Total Urban Internet UseUrban Broadband Internet UseTotal Rural Internet UseRural Broadband Internet Use

9

Live Demo

http://data-gov.tw.rpi.edu/demo/stable/demo-10040-broadband-home.html

Click on State andClick on Bar Graph

10

Spreadsheet

http://federaldata.wik.is/@api/deki/files/1845/=Data.gov.xls

11

Energy Mashup

http://en.openei.org/apps/mashathon2010/

MashupInformation(see next slide)

Datasets

12

Mashup information• This mashup was created at the first Data.gov mashathon event, August 24-25, 2010.

It was further refined from October 6-8, 2010 by theNational Renewable Energy Laboratory. This mashup profiles 7 cities in different parts of the United States that have a population of roughly 600,000 according to the 2000 census data and 2006 census-estimated population.

• Sources used:EIA's Electric Sales, Revenue and Average Price 2008 on Data.gov, OpenEI.org, U.S. Census data, SmartGrid.gov

• Please note: this application was made as a mashup demonstration and is not a complete application. Some assumptions were made in creation of this application and merging of data sources. This application is provided as-is with no warranty as to the usability or suitability of this application or data towards any specific intent or purpose.

• Annual solar (PV) value was calculated using the National Renewable Energy Laboratory's Solar Advisor Model application. A typical residential solar PV system is approximately 5kW, and depending on how good the sunshine is where you live, such a system can offset between 6,000 kWh and 9,000 kWh of your electricity usage per year. That’s equivalent to 50% - 80% of the average US home energy usage per year!

• When you multiply your solar system’s annual energy output by your electric utility rate, you can see how much money your solar energy is worth (Annual PV Value). An average rate in California is about 15 cents per kWh. Multiplying that by your solar system’s energy shows that you can get about $1000 every year from having solar on your roof!

13

Mashup information

• This mashup's source code may be downloaded, modified and reused.

• Are you a developer? Here are several ideas to make this application better:

• Tie application directly to the 2000 US Census records, pulling other interesting facts

• Add other cities or allow user to add his/her city. This will require some code cleanup and further data linkages to make adding new cities programmatic.

• Update application when 2010 census data is released.• Find other data sources on Data.gov and other sites to

make the application more interesting.• Create more detailed charting.

14

OpenEI Datasets

http://en.openei.org/datasets/

15

OpenEI Datasets

http://en.openei.org/datasets/node/43

16

Spotfire

PC Desktop and Web Player

17

Spotfire

Web Player

18

Getting to 'the 5 stars of Linked Open Data' for Data.gov

• 1. Make your stuff available on the web (whatever format); YES

• 2. Make it available as structured data (e.g. excel instead of image scan of a table); YES

• 3. Non-proprietary format (e.g. csv instead of excel); YES

• 4. Use URLs to identify things, so that people can point at your stuff; and YES

• 5. Link your data to other people’s data to provide context. YES