“i’m sorry, but we didn’t know we wanted to know that !”

“I’m sorry, but we didn’t know we wanted to know that!”

Building Frameworks of Organizational Intelligence

Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries

NISO Usage Data ForumNovember 1-2, 2007Dallas, TX

Home, May 2006

New Library Home Page: The “Hindrance” Effect

Use of Electronic Resources, Spring 2005 and 2006 Comparison [local not vendor counts]

1 2 3 4 5 6 7 8 9 10 11 12 13 15 16 17 25 37 41 58 79 166 Total (row)

Bookmark old home 7 2 7 1 1 181 34 5 36 9 8 5 5 6 2 1 1 1 2 1 1 1172 3 5 4 2 1 1 163 5 2 2 2 1 1 134 4 1 1 1 1 85 2 1 36 1 1 1 37 1 1 28 2 2

16 1 122 1 126 1 1

Total (column) 7 36 15 46 19 10 10 7 11 3 2 4 4 3 1 1 1 1 1 1 1 1 185

12,827 sessions logged (this 24-hour snap shoot, minus ‘bots)

185 (1.4%) sessions opted for old home

20 sessions opting for old home involved Safari

135 old home sessions (1.1% of total) -- bookmarks or first clicks on new home: no tolerance

No. of clicks before visitor left new for old home

Total clicks logged

New Library Home Page: User Intolerance

What are the properties of these structures?

How versatile are they?

Are we able to adapt or repurpose them to facilitate

measurement?

What resources (tools, dollars, staff) are required to harvest, transform, and manage the data that now live all around us?

Data live all around us in structures.

Information Loop

Data Farm Environment

Clean | Anonymize Normalize

Data Streams

Integrate Inform

Report Builder

Dashboard

Data Bureau

Service Environment

Catalog

Circulation

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

People and Network Data

Ref|Instruct

Working with data structures

E-Resource Use Reference ContactCirculation

Acquisitions Funds

Holdings

Copier | Printer Use

Gate Swipes

Resolve Resource

Resolve People

Resolve Places

Web Analytics

Image Collection Use

Data Farm Oracle Space-Overview

18+ gb, in 139 tables, for collecting and disseminating management info

Staff Census

Tech Processing Workflow

Digital Library

Voyager-Supported Services

Building Use

Resolution Services

Administration

Reference & Instruction (dynamic)

Consortia ILL/DocDel

70-Member ILL Coop.

Interacting with data: dashboard pages

Interacting with data: report builders

DATA FARM

Submit for asynchronous

processingand delivery

Scheduled reports

Research[rmediated]

[e.g., record consultations,request ID resolution using the library intranet]

Interacting with data: “data bureau”

Auto-survey

Sample Data Structure I - Voyager

Invoice_line_item

invoice_status

purchase_order

line_item

invoice_line_item_funds

invoice

vendor

bib_master

bib_text

Sample Data Structure II - Data Farm Table

Sample Data Structure III – Data Farm Funds Report

“…but we didn’t know we wanted to know that!”

Slide of report by fund and publisher (casalini) deleted

Data Farm: Operational Parameters

Raw Data In | Minimally Processed Data Out

Modules to Normalize, Resolve, Anonymize, and Format Data

Self-Executing—Dashboards, Cron’d Processes

Mediated Services: Report Builders, Resolvers, Research

Synchronous & Asynchronous Processing

Backup and Security

Data Harvest, Retention, and Storage Policies

Data Farm: Example Applications

Reference & instruction measures: • assess “market penetration”,• track changes in the modality and focus of service• account for liaison activities in annual reviews

Web page analytics: navigation, use frequencies, browser functionality, search functionality

Fund tracking and collection metrics, current and historical, for:• annual budget allocation, • stacks management,• storage decisions

E-resource tracking: monitor customer interest, use analysis

ILL consortial traffic: facilitate local collection analysis

Proxy log analysis, current study of interdisciplinary research behavior

A different take on a management information framework

xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

Sample Data Structure: EZ-Proxy Log

xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

xxx.xx.xxx.xxx = .edu | on-campus | Van Pelt Library | staff office

July 26, 2007: 3:41 p.m.

Device= Mac | OSX Browser= Safari

Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer

zucca [Penn authentication key] = Provost cntr | LIBRARY | staff

SessionID 10335905=PsycInfo (resource identifier 7014)

sfx_session_id=Journal of Experimental Child Psychology,

“Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children.”

xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

TRANSLATION:

• Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.

• Logged into PsychInfo (CSA)

• Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library

• A library staff (Provost’s center affiliate)

• July 26, 2007 at 3:41 pm

and in the same session,

Org|ProgramStaff

ServiceGenre

LibraryProgram

CampusLocation

Date|Time

IP-Domain

Environment

Budget

Restricted

Unrestricted

Expnd Amt

Fund Code

Events: a Structure for

Library Decision Metrics

SchoolClient

Biblio-graphicContent

School

Reqmnt

LevelCourseDescriptor

ClientProgram

Service Environment

Catalog

Circulation

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct

Data Farm Silos

DATA STORE

query (xsql)parse, resolve,

anonymize,secure!

store asmetridoc.xml

Data Farm Framework

oracle

Sources

Repository processes

Analysis

Service Environment

Catalog

Circulation

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct

Event Elements Articulated in an XML Schema

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

</ENVIRONMENTAL>

</CLIENT>

</LIBRARY PRGRM>

</CONTENT>

METRIDOC

</ENVIRONMENTAL>

</CLIENT>

</LIBRARY PRGRM>

</CONTENT>

CampusLocation

Date|Time

IP-Domain

Environment

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

METRIDOC

School

Client

</ENVIRONMENTAL>

</CLIENT>

</LIBRARY PRGRM>

</CONTENT>

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

METRIDOC

</ENVIRONMENTAL>

</CLIENT>

</LIBRARY PRGRM>

</CONTENT>

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

Org|Program

Service Genre

LibraryProgram

METRIDOC

</ENVIRONMENTAL>

</CLIENT>

</LIBRARY PRGRM>

</CONTENT>

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

Biblio-graphicContent

METRIDOC

Data Source

instructions

Eventschema

metridoc.xml

voyager

Penn Community

Staff db

Java-based

processes

Data Store

</ENVIRONMENTAL>

</CLIENT>

</LIBRARY PRGRM>

</CONTENT>

Schematic Workflow

Summary:

Exploring new frameworks to achieve greater data integration.

Taking advantage of xml extensibility to enrich the descriptive power of library data resources.

Aligning management information technology with the broader direction in digital library design.

Evaluating the potential for shared, open-source solutions thatmight promote collaborative data gathering and assessment.

Joe Zuccazucca@pobox.upenn.edu 215-573-4643

University of Pennsylvania Library Office of Planning and Communication

Questions?

“i’m sorry, but we didn’t know we wanted to know that !”

Documents

how do we know what we know? neuroscience methods

“ … because as we know, there are known knowns; there...

creative prayer ideas - the church of scotland · for the...

what do we know when we know a person

we didn’t know what we didn’t know

how do we know what we know?

on what we know we don’t know - csli...

information and support for grandparents aw...6 we are very...

don’t be sorry! join the smart shoppers who know …

prime numbers: what we know, and what we know we...

on what we know we don't know

what do we know when we know a language?

shale gas what we know what we know we do not know what do...

we know what we like and we like what we know

norms: things we do not know we don’t know

why do we think we know what we know? a metaknowledge...

sorry shouldn’t be the hardest word · state of the...

if money rules the world who rules money? - … · „we...

how we know what we know about climate change

the iphone: what we know, what we don't know