1 free and open source research environment for recultivation of a waste deposit dept. of ecosystems...

1

Free and Open Source Research Environment for Recultivation of a Waste Deposit

Dept. of Ecosystems and Environmental Informatics

Mirko Filetti, Ronald Obst, Albrecht Gnauck

Landkreis Dahme-SpreewaldUmweltamt

2

CONTENT

CONTENTS


1. Introduction

2. Free and Open Source Software (FOSS)

3. Recultivation of the Waste Deposit „Großziethen“

4. Conclusions

3

01INTRODUCTION

4

01 · INTRODUCTION

ICT WORKING STEPS

1. Within environmental research projects a general database has to be set up to store the data of sub-projects and to record them with metadata. The interoperability is warranted for all external and internal data repositories.

2. The following data processing features have to be implemented to:- maintain and validate the research data,- include network repositories with different data structures,- distribute information with harvesting mechanism.

3. The information retrieval system has to be designed. This will be happen by a user orientated implementation of interoperability and communication tools.

4. Secure long term storage of data and archiving tools haveto be set up inside and outside the project for a furtheruse and reuse of data over a long time horizon.


5

02Free and Open Source Software (FOSS)

6

02 · FREE AND OPEN SOURCE SOFTWARE (FOSS)

FREE AND OPEN SOURCE SOFTWARE (FOSS)

The use of free and open source software (FOSS) is an attractive alternative to high cost commercial and often proprietary software solutions because of:

• low cost, • short cycles of software development,• big user and programmer community• independency from enterprise,• according to international standards,• security.

But - no single FOSS or enterprise software can be the best in all fields!


7

FOSS for Research Activities


A virtual research environment (VRE) can be defined as:“a platform for internet-based collaborative working that enables new

ways of collaboration and a new way of dealing with research data and information.” (DFG 2007)

• The key issue of a VRE is the development and implementation ofan information and data sharing concept where data sharing canbe done by different media.

• But, the most important point is that VREs need to be more consi-dered as community building projects than as technology projects.

• VRE’s gives benefits to scientific disciplines at all levels of research. There is neither an ‘out of the box-solution’ nor a ‘one size fitsall realizations’ approach that will meet the demands of allresearch activities.


8

VRE SERVICES AND FOSS APPLICATIONS

VRE service FOSS application relations

Project website, community CMS: Joomla+RDF, Typo3, Drupal+RDF LDAP, Shibboleth

Access management (SSO) LDAP, Shibboleth other

Project collaboration, communication and workflows

BSCW, Joomla components LDAP, Shibboleth

Repository search with meta data GNOS, (BExIS, Pangea, InGrid) LDAP, Shibboleth

Documentation and best practice Mediawiki Bridge for Joomla

Monitoring Joomla component „Art Data“ LDAP, Shibboleth

Data analysis/Data warehousing Infobright.org, noSQL, Joomla component „Art Data“

Stand alone on local PC, data Bridge for Joomla

Decision support Infobright.org, Joomla components, other

E-Learning Moodle Bridge for Joomla

Webserver-software Linux, Apache, MySQL, Tomcat (JAVA), PHP, XML/XSLT

other

Social web Joomla-Facebook/Twitter integration Bridge for Joomla

Mobile access:Optimized Homepage, APPs, RSS, Augmented Reality (AR)

Joomla Components, MacOS-API, ANDROID-API, JUNAIO…

Joomla, Drupal

SEO Joomla component, FOSS integrated Joomla, Drupal

Dept. of Ecosystems and Environmental Informatics02 · FREE AND OPEN SOURCE SOFTWARE (FOSS)

9

GEONETWORK OPENSOURCE (GNOS)

• GNOS is a web 2.0 spatial Information-Management-System (IMS) based on international standards with network interoperability, metadata management, web map server and optional INSPIRE functionality.

• GNOS was developed since 2001 by the UN and is continuous enhanced by many 3rd party organizations.

• User management guarantees the admin and editing management, and gives users restricted front end access to each dataset.

• Today, a worldwide user community including several research organizations are successfully using GNOS within large networks.


There is an out of the box installation for GNOS under www.geonetwork-opensource.org including DB and WMS for Windows and Linux.


http://www.geonetwork-opensource.org/

10

NETWORK STRUCTURES (ACCESS / HARVESTING)

• stand allone server with all data sources

• closed intranet with hierarchical structures and distributed datasets

• www with external nodes and different data sources

A

Intranet www

AB

C

AB

CD


11

RELEVANT STANDARDS


Standard Description

Dublin Core (DC) Metadata(International Organization for Standardization, ISO)

Basic standard for a (minimal) metadata description (not special for spatial data).

Content Standard for Digital GeospatialMetadata (CSDGM) (Federal Geographic Data Committee FGDC; ESRI FGDC);

Standard for digital geospatial metadata from the leading GIS manufacturer ESRI and the Federal Geographic Data Committee

ISO 19115 Geographic Information Metadata, common base with FGGC, but more detailed

ISO19139 ISO 19139 provides the XML implementation schema forISO 19115

INSPIRE(Infrastructure for Spatial Information in Europe)

INSPIRE is based on the infrastructures for spatial information established and operated by the 27 MemberStates of the European Union.

Catalogue Service for the Web (CSW) Spatial data for web catalogues specified by Open Geospatial Consorcium (OGC)

OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting).

The Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) is a low-barrier mechanism for repository interoperability. Data Providers are repositories that expose structured metadata via OAI-PMH. Service providers then make OAI-PMH service requests to harvest that metadata.


12

SYSTEM REQUIREMENTS

• Fast Server with (minimal) dual/quad core CPU…

• >500 GB / 1TB hard disk,

• >4 GB RAM,

• OS: Windows Server 2003 / 2008 or Linux,

• Extensions: MySQL/PostgreSQL, PHP, Tomcat, Java,

• GIS: Included WebMapServer / ArcIMS (GisWebServer, optional),

• Cloud-Server (optional):dynamical scaling according to the requirements,

• Virtualisation (optional):load-balancing, reliability, desaster management.


13

MAIN FEATURES OF GNOSS


• Fast, sensitive and intuitive search for local and distributed (linked) spatial data,

• according to international standards (metadata, ICT),

• interactive map-viewer with maps and layer from servers worldwide, including interactive Google Maps connection,

• simple editing of metadata with powerful template system,

• data harvesting (data exchange / synchronization of data and metadata within closed and open networks),

• fine grained user management and access control for datasets,

• intern / external thesauri catalogue for keywords + RDF/SKOS, …

• social networking and bookmarking included (facebook, …).


14

GNOS DATA RETRIEVAL


15

INSPIRE DIRECTIVE CONFORM SEARCH


GNOS makes it more easy to get a rapid realisation of the new requirements to build an INSPIRE compliant data management system.

It is possible to search according to the INSPIRE directive for the following criteria: annex, source type, service type taxonomy, themes


16

DATA TYPES (Example)


Data type Description

Applications Special software like simulation software, mobile apps, etc.

Case studies, best practice Text documents: expertises, studies, etc.

Data sets Excel-files: measurement values for each period and measurement point

Interactive resources Interactive Maps (WMS), etc.

Law and guidelines Different formats: Environmental law, threshold values, standards

Maps PDF, JPG files from ESRI ArcGIS

Other information resources Other

Photo, video Video (WMV): time-laps animation of the maps


17

03RECULTIVATIONOF THE WASTE DEPOSIT „GROSSZIETHEN“

18

03 · RECULTIVATION OF THE WASTE DEPOSIT „GROSSZIETHEN“

STUDY AREA (active part)


19

STUDY AREA (recultivated border)

Dept. of Ecosystems and Environmental Informatics03 · RECULTIVATION OF THE WASTE DEPOSIT „GROSSZIETHEN“

20

STUDY AREA (overwiev)


21

SAMPLING POINTS


To guarantee the groundwater safety and human’s health for this place, a long-term monitoring of chemical substances in the groundwater with different measurement points in two levels has been established for the last 10 years.

Annually, two measurement campaigns (spring and fall) provide data from 19 sampling points with 53 chem. / phys. indicators.

houses & gardens

waste deposit


22

ISO 19115:2003/19139 SCHEME FORWASTE DEPOSIT “GROSSZIETHEN”


Scheme Example

Data identificationTitleDateAbstractContact information MaintenanceData qualityKeywords Ressource constraintsLanguageCharacter setSpatial resolutionCoordinates and Reference systemsTime / Time periodOnline resources

“DGZ Lead 2011 (spring) lower level”“01.01.2011”“Maps for groundwater contamination”Addresses, website, contact person“No actualization”Uncertainness, conditions, etc.“Waste deposit, groundwater”, etc.“No commercial use”“German”“UTF-8”“1:5,000”“50.3556, 13.4656”, “ETRS 89” “1990-2010”Download link

MetadataPersistent file identifierLanguageCharacter setContact information

“914ae19e-c3d1-44ba-97fd-1c1a20bdd”“German”“UTF-8”Addresses, website, contact persons


23

DATA SEARCH AND RESULTS


Rekultivierung


24

POLLUTION PROFILE


Groundwater flow direction


25

POLLUTION PROFILE


26

COOPERATIONS


Landkreis Dahme-SpreewaldUmweltamt


27

06CONCLUSIONS

28

CONCLUSIONS


General:

• GNOS is a main FOSS component to handle spatial (meta)data and access previlleges with interoperable harvesting mechanisms,

• VRE´s are able to facilitate or enhance any research activities in all fields of sciences with data management and communication tools (ICT).

Study area:

• Management of big and small science data with geographic reference,

• Laboratories

• Forecast of pollution profiles

VRE Development:

• Semantic web („machine readable internet“),

• Data analysis, metadata analysis,

• Reporting tools, decision support systems,

• Artificial intelligence.

06 · CONCLUSIONS

1 free and open source research environment for recultivation of a waste deposit dept. of ecosystems...

Documents

research data

open source software

enterprise software

introduction slide

reuse of data

single foss

research activities

data of subprojects