the new abcs of research - cra · the new abcs of research new technologies immense problems raised...
TRANSCRIPT
![Page 1: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/1.jpg)
The New ABCs of Research �
Ben Shneiderman [email protected] @benbendc
Distinguished University Professor, Dept of Computer Science
Founding Director (1983-2000), Human-Computer Interaction Lab
Member, Institute for Advanced Computer Studies
Photo: BK Adams
![Page 2: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/2.jpg)
Tools for Governance in Cyber Social Systems:
Community Formation/Management,
Deliberation, Conflict Resolution
Ben Shneiderman, August 28, 2016 University of Maryland NSF CRA CCC Workshop: Cyber Social Systems
![Page 3: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/3.jpg)
CSS Framing Document • Transform all major sectors of our society:
• Healthcare delivery, education, community services, transportation, • Justice, civil rights, environment, • Homeland & international security, bio-security, • Business & commerce
• Novel syntheses of computer & information science & engineering
with human & social sciences: • Human cognition and communication; collaboration & teamwork;
mechanism design, including social reward & recognition; • Ethics; behavioral, social, and organizational design; behavior change;
social psychology; practice culture; implementation science; complexity & network science;
• Online community design; motivation & persuasion; behavioral economics; sociology; political science; humanistic thinking; ethnographic methods
![Page 4: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/4.jpg)
Cyber-Social System Participants
Journalists
Concerned Users/Stakeholders: Patients, Customers, Passengers, Students
Professionals, Managers,
Researchers, Designers, Analysts,
Staff
Governments
Provide Service
Provide Feedback
Review/ Report
Regulate
Threaten
Malicious Actors
![Page 5: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/5.jpg)
Cyber-Social System Activities
Action Data
Knowledge
Analysis Discussion Decision Persuasion
![Page 6: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/6.jpg)
Example CSS Great successes • Air Traffic Control System • American College of Cardiologists • World Wide Web: W3C, ICANN, etc. • Linux/Apache, Mozilla, R, etc. • Wikipedia
![Page 7: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/7.jpg)
Example CSS Great successes • Air Traffic Control System • American College of Cardiologists • World Wide Web: W3C, ICANN, etc. • Linux/Apache, Mozilla, R, etc. • Wikipedia
BUT 98% failure rate • NASA’s EOSDIS • NCI’s CaBIG • Open source projects • Wikis
![Page 8: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/8.jpg)
Reader Contributor Collaborator ` All Users
From Reader to Leader: Motivating Technology-Mediated Social Participation
Preece & Shneiderman, AIS Trans. Human-Computer Interaction1 (1), 2009 aisel.aisnet.org/thci/vol1/iss1/5/
Leader
![Page 9: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/9.jpg)
Governance Tools in CSS
1) Deliberative systems design 2) Large-scale teamwork monitoring systems 3) Collaboration toolkits & remote teamwork 4) Online dispute or conflict resolution tools
![Page 10: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/10.jpg)
1) Deliberative systems design
How to engage large numbers of people in: • Sharing ideas • Refining ideas into plans • Developing consensus • Obtaining & allocating resources • Getting commitment to shared goals
![Page 11: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/11.jpg)
2) Large-scale teamwork monitoring systems
• Enabling 1000+ people to work together towards a common goal
• Assigning tasks (Linux-like strategies for posting tasks that members take on)
• Sharing of critical path diagrams to monitor progress • Evaluating peers & mentoring for improvement • Bug reporting schemes (e.g. Bugzilla) • Repairing problems as they emerge
(github-like posting of issues and closing them) • Collecting guidelines for future use
![Page 12: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/12.jpg)
3) Collaboration toolkits
• Checklists • Communications tools • Shared documents, calendars • Task lists & schedules • Remote work support
![Page 13: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/13.jpg)
4) Online dispute or conflict resolution tools
• Ebay, PayPal, Amazon, etc. • Online mediation services • Modern Delphi methods
![Page 14: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/14.jpg)
Science, Engineering & Design
• Scientific Method • Controlled Laboratory Tests • Reductionist Thinking
• Engineering Process • Iteratively refine prototypes • Guided by measurable criteria • Modular design, interdependent components
• Design Thinking • Challenge the goals/requirements • Empathize with users • Divergent/Convergent thinking • Celebrate teamwork & diverse viewpoints
![Page 15: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/15.jpg)
Science, Engineering, Design
https://books.google.com/ngrams
![Page 16: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/16.jpg)
Scientist, Engineer & Designer NY Times articles
http://chronicle.nytlabs.com/
![Page 17: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/17.jpg)
Applied & Basic Combined
• Teams that follow SED & ABC Principles are more likely to produce breakthroughs
• New collaboration technologies empower research groups
• Greater ambition to take on societal challenges • Healthcare delivery • Environmental sustainability • Energy conservation • Community safety • Education, Housing, Transportation, …
![Page 18: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/18.jpg)
Applied & Basic Combined
• Teams that follow SED & ABC Principles are more likely to produce breakthroughs
• New collaboration technologies empower research groups
• Greater ambition to take on societal challenges • Healthcare delivery • Environmental sustainability • Energy conservation • Community safety • Education, Housing, Transportation, …
www.cs.umd.edu/hcil/newabcs
![Page 19: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/19.jpg)
Interdisciplinary research community - Computer Science & Info Studies - Psych, Socio, Educ, Jour & MITH
www.cs.umd.edu/hcil vimeo.com/72440805
![Page 20: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/20.jpg)
Designing the User Interface
• Guidelines & Theories • Input devices & strategies
• Keyboards, pointing, voice • Direct manipulation • Menus, forms, commands
• Output devices & formats • Windows, color, sound • Text, tables, graphics • Instructions, messages, help
• Social Media • Visualization
http://bit.ly/1T5UGn0
Sixth Edition: 2016
• Search • Design
![Page 21: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/21.jpg)
The New ABCs of Research (Oxford, 2016)
Guide for Junior researchers Manifesto for
Senior researchers Academic administrators Business leaders Funding agencies
www.cs.umd.edu/hcil/newabcs
![Page 22: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/22.jpg)
The New ABCs of Research
Immense Problems
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 23: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/23.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 24: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/24.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 25: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/25.jpg)
ABC Principle
Applied & Basic Combined
Combining applied with basic research produces more rapid progress in both
![Page 26: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/26.jpg)
SED Principle
Blending Science, Engineering & Design
produces higher-impact research
![Page 27: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/27.jpg)
Science, Engineering, Design
https://books.google.com/ngrams
![Page 28: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/28.jpg)
Scientist, Engineer & Designer NY Times articles
http://chronicle.nytlabs.com/
![Page 29: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/29.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 30: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/30.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Choose actionable problems: civic, business
& global priorities
Apply observation, intervention & controlled
experiments
Form teams with diverse individuals & organizations
Test ideas & prototypes with
realistic interventions
Promote adoption & assess impact
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 31: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/31.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Solutions
Theories
Choose actionable problems: civic, business
& global priorities
Apply observation, intervention & controlled
experiments
Form teams with diverse individuals & organizations
Test ideas & prototypes with
realistic interventions
Promote adoption & assess impact
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 32: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/32.jpg)
The New ABCs of Research (Oxford, 2016)
Guide for Junior researchers Manifesto for
Senior researchers Academic administrators Business leaders Funding agencies
www.cs.umd.edu/hcil/newabcs
![Page 33: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/33.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Solutions
Theories
Choose actionable problems: civic, business
& global priorities
Apply observation, intervention & controlled
experiments
Form teams with diverse individuals & organizations
Test ideas & prototypes with
realistic interventions
Promote adoption & assess impact
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 34: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/34.jpg)
The New ABCs of Research
Form teams with diverse individuals & organizations
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 35: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/35.jpg)
The New ABCs of Research
Form teams with diverse individuals & organizations
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 36: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/36.jpg)
Teamwork is the New Norm
Percentage of publications by more than one author
Cooke & Hilton (Eds), Enhancing the Effectiveness of Team Science http://www.nap.edu/catalog/19007/enhancing-the-effectiveness-of-team-science
![Page 37: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/37.jpg)
Teams: Guidelines
• Formation 1. Choose those with previously successful collaborations 2. Create balanced teams: skills, age, gender, personality,…
![Page 38: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/38.jpg)
Teams: Guidelines
• Formation 1. Choose those with previously successful collaborations 2. Create balanced teams: skills, age, gender, personality,… 3. Ensure collaboration readiness
• Willing/eager to work in teams • Fluent with technology • Experienced in working remotely
![Page 39: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/39.jpg)
Teams: Guidelines
• Formation 1. Choose those with previously successful collaborations 2. Create balanced teams: skills, age, gender, personality,… 3. Ensure collaboration readiness
• Willing/eager to work in teams • Fluent with technology • Experienced in working remotely
4. Recruit experienced leadership
![Page 40: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/40.jpg)
Teams: Guidelines
• Management 5. Define goals & roles clearly 6. Make explicit statements of who does what by when
![Page 41: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/41.jpg)
Teams: Guidelines
• Management 5. Define goals & roles clearly 6. Make explicit statements of who does what by when 7. Practice good communication: listening, speaking, writing, etc. 8. Hold regular & open discussions 9. Use effective brainstorming strategies: diverge then converge
![Page 42: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/42.jpg)
Teams: Guidelines
• Management 5. Define goals & roles clearly 6. Make explicit statements of who does what by when 7. Practice good communication: listening, speaking, writing, etc. 8. Hold regular & open discussions 9. Use effective brainstorming strategies: diverge then converge 10. Provide adequate administrative resources & services
![Page 43: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/43.jpg)
Books: Teamwork • Nancy Cooke & Margaret Hilton (Editors), Enhancing the
Effectiveness of Team Science, National Academies Press, Washington, DC (2015). http://www.nap.edu/catalog/19007/enhancing-the-effectiveness-of-team-science
• Walter Isaacson, The Innovators: How a Group of Hackers, Geniuses, and Geeks Created the Digital Revolution, Simon & Schuster, New York (2014).
• Steven Johnson, Where Good Ideas Come From: A Natural History of Innovation, Riverhead Publishers (2010).
• Joshua Shenk, Powers of Two: Finding the Essence of Innovation in Creative Pairs, Houghton Mifflin Harcourt (2014).
![Page 44: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/44.jpg)
Teams: Guidelines
• Formation: • Previously successful collaborations • Balanced teams • Collaboration readiness • Technology readiness for remote teamwork • Technology readiness for collaboration • Trained experienced leadership
![Page 45: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/45.jpg)
Teams: Guidelines
• Formation: • Previously successful collaborations • Balanced teams • Collaboration readiness • Technology readiness for remote teamwork • Technology readiness for collaboration • Trained experienced leadership
• Management • Clearly defined goals & roles • Explicit statements of who does what by when • Good communication • Regular and open discussions • Use of effective brainstorming strategies
• Adequate administrative resources and services
![Page 46: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/46.jpg)
National Academies Report (2015): Enhancing the Effectiveness of Team Science
Dimension Low High
Diversity Homogeneous Heterogeneous
Disciplinary Integration Unidisciplinary Transdisciplinary
Team or group size Small (2-10) Mega (1000s)
Goal alignment Aligned Divergent
Permeable boundaries Stable Fluid
Proximity Co-located Globally distributed
Task interdependence Low High
Cooke & Hilton (Eds), Enhancing the Effectiveness of Team Science http://www.nap.edu/catalog/19007/enhancing-the-effectiveness-of-team-science
![Page 47: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/47.jpg)
Research Project: 2 parents, 3 children
Practical Solutions
Refined Theories
Guidance to Future Researchers
Research Project
Applied Problems
Basic Theories
![Page 48: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/48.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Solutions
Theories
Choose actionable problems: civic, business
& global priorities
Apply observation, intervention & controlled
experiments
Form teams with diverse individuals & organizations
Test ideas & prototypes with
realistic interventions
Promote adoption & assess impact
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 49: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/49.jpg)
The New ABCs of Research
Promote adoption & assess impact
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 50: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/50.jpg)
Promote Adoption & Assess Impact
• Clear writing begets clear thinking • Story-telling trajectories
• Promote adoption • Send Five & Thrive • Papers, websites, videos, tweets, blogs
• Assess impact • Citations, downloads, tweets, blogposts • Best Paper Awards, testimonials, usage reports
![Page 51: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/51.jpg)
• Ideas travel through networks and relationships • Cultivate champions. • Present, Present, Present! • Join relevant committees
& insert your findings into decision making • Don’t wait for publication. Disseminate early
Promoting Adoption: Becker Model
https://becker.wustl.edu/impact-assessment/strategies
![Page 52: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/52.jpg)
Online Services
• Open Research: arXiv.org, PLOS, Open Science
• Community Building Sites: • Academia: platform for academics to share research papers…
to accelerate the world's research (19M users) • ResearchGate: connect researchers
share scientific output, knowledge & expertise • ORCID, VIVO, FORCE11, …
• Research Paper Managers: • Mendeley: The best free way to organize your research • Zotero: free, easy-to-use tool to help you collect, organize,
cite & share your research sources • CiteULike: free service to help you to store, organise & share
the scholarly papers you are reading
![Page 53: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/53.jpg)
The New ABCs of Research
Applied & Basic Combined Achieving Breakthrough Collaborations Analysis Based on Creativity Actively Build Connections Ask Bigger Cuestions
![Page 54: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/54.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Solutions
Theories
Choose actionable problems: civic, business
& global priorities
Apply observation, intervention & controlled
experiments
Form teams with diverse individuals & organizations
Test prototypes with realistic interventions
Promote adoption & assess impact
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 55: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/55.jpg)
Information Visualization & Visual Analytics
• Visual bands • Human percle
• Trend, clus.. • Color, size,..
• Three challe • Meaningful vi • Interaction: w • Process mo
1999
![Page 56: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/56.jpg)
Information Visualization & Visual Analytics
• Visual bandwidth is enormous • Human perceptual skills are remarkable
• Trend, cluster, gap, outlier... • Color, size, shape, proximity...
• Three challenges • Meaningful visual displays of massive da • Interaction: widgets & window coordinati • Process models for discovery
1999 2004
![Page 57: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/57.jpg)
Information Visualization & Visual Analytics
• Visual bandwidth is enormous • Human perceptual skills are remarkable
• Trend, cluster, gap, outlier... • Color, size, shape, proximity...
• Three challenges • Meaningful visual displays of massive data • Interaction: widgets & window coordination • Process models for discovery
1999 2004 2010
![Page 58: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/58.jpg)
Information Visualization: Cultural Meme
![Page 59: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/59.jpg)
Spotfire: DC natality data
![Page 60: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/60.jpg)
http://registration.spotfire.com/eval/default_edu.asp
![Page 61: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/61.jpg)
10M - 100M pixels: Large displays
![Page 62: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/62.jpg)
16M pixels: My New Workstation
![Page 63: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/63.jpg)
100M-pixels & more
![Page 64: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/64.jpg)
1M-pixels & less Small mobile devices
![Page 65: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/65.jpg)
Information Visualization: Mantra
• Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand
![Page 66: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/66.jpg)
Information Visualization: Data Types
• 1-D Linear Document Lens, SeeSoft, Info Mural
• 2-D Map GIS, ArcView, PageMaker, Medical imagery • 3-D World CAD, Medical, Molecules, Architecture
• Multi-Var Spotfire, Tableau, Qliktech, Visual Insight • Temporal EventFlow, TimeSearcher, Palantir, DataMontage • Tree Cone/Cam/Hyperbolic, SpaceTree, Treemap • Network Pajek, UCINet, NodeXL, Gephi, Tom Sawyer
• Text TagClouds, Wordle, ManyEyes, Ngram Viewer
Info
Viz
Sci
Viz
.
flowingdata.com visualcomplexity.com eagereyes.org visual.ly perceptualedge.com datakind.org infosthetics.com visualizing.org infovis.org
![Page 67: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/67.jpg)
EventFlow Project: Temporal Events
hcil.umd.edu/eventflow
![Page 68: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/68.jpg)
EventFlow Project: Incident Analysis
![Page 69: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/69.jpg)
Treeversity: Traffic Bottlenecks
www.cs.umd.edu/hcil/treeversity
![Page 70: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/70.jpg)
@benbendc hcil.umd.edu
![Page 71: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/71.jpg)
Books: Teamwork
• Nancy Cooke & Margaret Hilton (Editors), Enhancing the Effectiveness of Team Science, National Academies Press, Washington, DC (2015). http://www.nap.edu/catalog/19007/enhancing-the-effectiveness-of-team-science
• Walter Isaacson, The Innovators: How a Group of Hackers, Geniuses, and Geeks Created the Digital Revolution, Simon & Schuster, New York (2014).
• Steven Johnson, Where Good Ideas Come From: A Natural History of Innovation, Riverhead Publishers (2010).
• Joshua Shenk, Powers of Two: Finding the Essence of Innovation in Creative Pairs, Houghton Mifflin Harcourt (2014).
![Page 72: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/72.jpg)
Books: Writing
• Mark J. Kuchner, Marketing for Scientists: How to Shine in Tough Times, Island Press (2011).
• Steven Pinker, The Sense of Style: The Thinking Person’s Guide to
Writing in the 21st Century, Viking (2014). • Joshua Schimel, Writing Science: How to Write Papers That Get Cited
and Proposals That Get Funded, Oxford University Press (2011). • Turabian, K. L., Booth, W. C., Colomb, G. G., Williams, J. M., and the
University of Chicago Press Staff, A Manual for Writers of Research Papers, Theses, and Dissertations: Eighth Edition (2013).
![Page 73: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/73.jpg)
The New ABCs of Research
New Technologies
Immense Problems
Raised Ambitions
Solutions
Theories
Choose actionable problems: civic, business
& global priorities
Apply observation, intervention & controlled
experiments
Form teams with diverse individuals & organizations
Test ideas & prototypes with
realistic interventions
Promote adoption & assess impact
Applied & Basic
Combined
Science, Engineering
& Design
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 74: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/74.jpg)
The New ABCs of Research
Apply observation, intervention & controlled
experiments
Guiding Lifecycle New Context Principles Strategies Knowledge
![Page 75: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/75.jpg)
Research Methods à Solutions & Theories
![Page 76: The New ABCs of Research - CRA · The New ABCs of Research New Technologies Immense Problems Raised Ambitions Solutions Theories Choose actionable problems: civic, business & global](https://reader034.vdocuments.mx/reader034/viewer/2022042221/5ec760b73bbec35887430967/html5/thumbnails/76.jpg)
Teams: Winning Strategy
• Powers of Two (End of the Lone Genius) (Shenk, 2014)
• Teams: Difficult to form, hugely effective • Takes practice to gain skills
• Clear goals, clear roles: Who Does What by When • Trust, communication, recognition
• WJU2007: teams à 2.1 times the impact • Large teams need administrative support • FUN!
scienceofteamscience.org www.teamsciencetoolkit.cancer.gov