atod organizations: how to assess impact and success judit h. ward, phd, mlis william bejarano,...

32
ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August 31, 2015

Upload: trevor-fisher

Post on 29-Jan-2016

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

ATOD organizations: How to assess impact and success

Judit H. Ward, PhD, MLIS

William Bejarano, MLIS, MA

ICARA Conference, Budapest, August 30 – August 31, 2015

Page 2: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Agenda

Our story: “I failed” Words, words, words (definitions) Assessment: Where are we now? Cherry-picking: Best practices Where are we going?

Page 3: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Our Story

• SALIS values1

stats w/wordcounterMembers’ Corner)information sharing, access to current info, networking, professional support, listserv, conference, newsletter

• Past conferences – topics2

networking, change, challenges, knowledge-sharing, creating partnerships, innovation, technolog

1Ward, J. (2015). The long run: Making a difference for decades. SALIS News, 34(4), 8-9.2Ward, J, Bejarano, W., & Geary, D. (2014). Making a difference: Past SALIS conferences from 1978 to present. Substance Abuse Library and Information Studies, 1, 138-141.

Page 4: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Chair’s Report: “I failed”

Page 5: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Our story “I failed” Words, words, words (definitions) Assessment: Where are we now? Cherry-picking: Best practices Where are we going?

Page 6: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Success: Definitions• the accomplishment of an aim or purpose

(Oxford Dictionaries)• the correct or desired result of an attempt

(Merriam-Webster)• the favorable or prosperous termination of

attempts or endeavors; the accomplishment of one's goals (dictionary.com)

• the achievement of something that you planned to do or attempted to do (MacMillan Dictionary)

• not sucking (Urban Dictionary)

Page 7: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Impact: Definitions

• an effect; or an influence (Oxford Dictionaries)• influence; effect (dictionary.com)• a significant or major effect (Merriam-Webster)• a qualitative measure for how much effect

something will have over time. Usually refers to how shocking, thought-provoking or memorable some given item is (or likely to be) (Urban Dictionary)

Page 8: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Common in definitionsSuccess• Purpose, aim, goal• Plan, path• Attempt• Accomplishment,

achievement

Impact

• Influence• Scale• Measurability

• Mission statement• Activities• Accreditation

• Publishing (journals)• Databases (PsycINFO)• Citation style (APA, MLA)

Impact/success: Scholarly societies

Page 9: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Our story “I failed” Words, words, words (definitions) Assessment: Where are we now? Cherry-picking: Best practices Where are we going?

Page 10: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Assessment: Where are we now?

Similarities

• Roles• Significance• Multidisciplinary scope• Activities

Varieties

• National, single • National, one of many• International, monolingual• International, multilingual

Cultural diagnostics – assessing the landscape (11 articles – 11 organizations)• Edwards, G. (2001). National Scientific Societies: what are our

friends and neighbours doing? Addiction, 96(9), 1239.• Edwards, G. & Babor, T. (2008). Closing remarks: Addiction

societies as valuable assets. Addiction,103(1), 9–12.

Page 11: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Assessment: Where are we now?

Field mapping of addiction science • Babor, T. (2015). Infrastructure in addiction science: The

emergence of an interdisciplinary field (SALIS Conference, San Diego, May 1, 2015).

Past trends

Megatrends

Troubling trends

Page 12: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Classification

Babor, T. (2015). Infrastructure in addiction science: The emergence of an interdisciplinary field (SALIS Conference, San Diego, May 1, 2015).

Page 13: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Societies in the current structure of addiction studies

Babor, T. (2015). Infrastructure in addiction science: The emergence of an interdisciplinary field (SALIS Conference, San Diego, May 1, 2015).

Page 14: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Societies: The member’s angle• Symbolic: social identity, self-definition• Career advancement (cv, networking, peer

pressure, cont. ed., committee work)• Life-long learning (collaborating, sharing,

professional development)• Giving back to the profession (advocacy,

values, mentoring, footprint)• Financial (saving on events, conference

tourism, etc.)Source: common sense, no date

Page 15: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

“What’s in it for me?”

Survey of 1,980 members of a large accounting association

Highlights:• Most influential: “Membership value” – tangible benefits• The more involved, the more satisfied • The younger, the less concerned with benefits

“Nonprofit entities should be managed in the same rigorous manner as business ventures.”

Markova, G., Ford, R. C., Dickson, D. R., & Bohn, T. M. (2013). Professional associations and members' benefits: What's in it for me?. Nonprofit Management and Leadership, 23(4), 491-510.

Page 16: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Early-career members

Benefits for the member: staying current and in touch, building cv and networks

– Networking (mentors, consultations, jobs)– Developing new skills & competencies

Benefits for the organization: – New members bring fresh ideas and opinions

Finding your professional home: – Membership in more than one organization– Different types of support from each

Escoffery, C., Kenzig, M., & Hyden, C. (2015). Getting the most out of professional associations. Health Promotion Practice, 16(3), 309-319.

Page 17: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Forces behind changes

• Deregulation and competition

• Technological development

• Globalization of services

Brock, D. M. (2006). The changing professional organization: A review of competing archetypes. International Review of Management Reviews, 8(3),157-174.

Page 18: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Kent, Bloom, & Murphy, 2014Survey of 75 accounting educators in New York• Nearly all above asst prof• Two-thirds tenured• Two-thirds w/PhD• High awareness of

organizations

Non-membership reasons:• Cost of dues• Not meet educators’ needs• Time constraint (only 25%)

Current members:High rates of satisfaction

Opinions:• Important to belong• Opportunities to interact with others• Active involvement (serve on boards)• Role model for students

Kent Jr, D. D., Bloom, P., & Murphy, S. L. (2014). An investigation of professors’ views on membership in professional organizations. BRC Journal of Advances in Business, 2(1), 13-24.

Page 19: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Our story “I failed” Words, words, words (definitions) Assessment: Where are we now? Cherry-picking: Best practices Where are we going?

Page 20: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Evaluating sources: The CRAAP test

• Currency: the timeliness of the information

• Relevance: the importance of the information for your needs

• Authority: the source of the information.

• Accuracy: the reliability, truthfulness and correctness of the content

• Purpose: the reason the information exists

PDF: http://www.csuchico.edu/lins/handouts/eval_websites.pdfONLINE: https://www.gettysburg.edu/library/research/tips/webeval/index.dot

Page 21: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Medical Library Association

• 1972: Hires its first full-time executive director.• 1988: A new credentialing program, the Academy of Health

Information Professionals is established.• 1991: Participates in 2nd White House Conference on

Library and Information services & Joint Commission on Accreditation of Healthcare Organizations – developing new standards on hospital information management.

• 1992: Platform for Change, MLA's educational policy statement, is published.

• 1994: Adopts a code of ethics for professional practice.

https://www.mlanet.org/about/history/milestones.htm

TransparencyContinuity

Page 22: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Standardizing

https://www.mlanet.org/academy

• credentials• accomplishments• interests • work experience • professional

development

across organizations and professions

Relevance

Page 23: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Conflict of interestIntegrity Transparency

Page 24: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Making amendsIntegrity Transparency

Page 25: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Citation Reward Program?!?

http://retractionwatch.com/2015/08/14/researchers-need-100-just-mention-cyagen-in-your-paper/

30 pieces of silver = $100?

Page 26: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

If you believe that your work has been copied in a way that constitutes copyright infringement and is accessible via the Service, please notify our copyright agent as set forth in the DMCA*.*Digital Millennium Copyright Act of 1998

http://www.openculture.com/copyright_policy

Page 27: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Our story “I failed” Words, words, words (definitions) Assessment: Where are we now? Cherry-picking: Best practices Where are we going?

Page 28: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Pre-ICARA (2000)

“The success of addiction studies during the last quarter of the 20th century is due to its ability to develop an underlying framework of organizational structures, funding support and communication processes that mimics the framework of the modern scientific enterprise in many countries”.

Babor, T. F. (2000). Past as prologue: the future of addiction studies. Addiction, 95(1), 7-10.

Page 29: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

Pre-ICARA (2008)

• “The need to share further experiences and generate mutual support […]”

• “The need to support addiction societies in the developing world […]”

• “The need for some self-reflection […]”

Edwards, G. & Babor, T. (2008). Closing remarks: Addiction societies as valuable assets. Addiction,103(1), 9–12.

Page 30: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

ICARA (2012)

Definition of ‘The Successful Association’ • What does it take to keep a research

association going strong?• What are the potential funding

possibilities?• How do you recruit – and keep –

members?

Stenius, K. (2012). ICARA – a global forum for research associations. Nordic Studies on Alcohol and Drugs, 29(5), 439.

Page 31: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

ICARA (2015)

VALUES• Transparency• Relevance• Integrity• Continuity• …• …• …

SURVEY?• Collaborative• Comprehensive• Inclusive• …• …

Example from the LIS world:

Hufford, J. R. (2013). A review of the literature on assessment in academic and research libraries, 2005 to August 2011. portal: Libraries and the Academy, 13(1), 5-35.

Page 32: ATOD organizations: How to assess impact and success Judit H. Ward, PhD, MLIS William Bejarano, MLIS, MA ICARA Conference, Budapest, August 30 – August

Center of Alcohol Studies Library

QUESTIONS?