playing a good game: ethical and methodological issues in researching mmogs heidi mckee, phd,...

Playing a Good Game: Ethical and Methodological Issues in Researching MMOGs

Heidi McKee, PhD, Department of EnglishMiami University, Oxford, Ohio, USA

James E. Porter, PhD, Department of Writing, Rhetoric, & American CulturesWIDE Research Center [Writing in Digital Environments]Michigan State University, East Lansing, Michigan, USA

Who We Are / What We Are Doing

Researchers in the field of rhetoric/composition• using rhetoric as a critical tool• in conjunction with casuistic ethics• to develop procedures and analytic frameworks (heuristics) for helping Internet researchers address ethical issues

Who We Are / What We Are Doing

• We are not gamers• We are not researching gamers or game worlds• We are studying Internet researchers, most of whom are studying online communities (including game worlds)

Presentation Overview

1. Introduction: Overall research project —> theoretical frames, aims, methodology, and participants2. Findings: Interviews with MMOG researchers —> findings, perspectives, themes, and issues3. Analysis: Applying/developing heuristics to assist ethical analysis and problem solving4. Conclusions

1. Introduction: Overall research project —> theoretical frames, aims, methodology, and participants

Frame 1 — Rhetoric

• an art of invention involving procedures for discovery of ideas, content, arguments — aka “heuristics”

• not merely an art of presentation or “packaging” (organization, verbal display)

Rhetoric focuses on• communication media —> writing, speech, visual display• interaction with audience/s —> the impact of text/speech on audiences• specific contexts —> locations, cultures, audiences, moments)• ongoing process —> not just single communication moments

Heuristics

• From rhetoric, not computer science• From Greek “heureka” (“I have found it”) • A set of open-ended questions, prompts, categories, memory devices, or visual grids to aid invention, thinking, discovery, and deliberation; a system prompting invention or discovery of ideas

Visual Heuristics

• Visuals — particularly diagrams — are not merely tools for representation of verbal or quantitative data. • Visual diagrams are tools for invention: they work as “heuristics.”

Frame 2 — Casuistry

• practical art of making ethical decisions based on

- general norms and moral codes (paradigms, presumptions);

- taxonomies of case types (analogy, comparison/contrast, precedent);

and- acknowledgement of human diversity

and the complexity of distinct circumstances• related to legal reasoning

Casuistry — Misconceptions

• moral laxity

• “scholastic sophistry in the service of moral mediocrity” (Miller, 1996, p. 4)

• ad hoc particularism —> every situation is unique (“situation ethics”)

The Process of Casuistry

1. Paradigm Cases —> establish consensus norms and benchmarks

2. Problematic Cases —> identify points of ambiguity, disagreement

3. Deliberation —> collaborative process of ethical decision making

- adapted from Jonsen & Toulmin, 1988

Our Research Project — Aims

• To describe and understand the ethical issues specific to doing Internet-based rhetoric, composition, and communication research; and• To provide case-based analytic frameworks to assist researchers negotiating ethical issues

Methodology

• Collecting published cases• Interviewing Internet researchers to collect stories “behind the scenes” and to understand ethical perspectives• Using rhetorical and casuistical analysis to clarify issues, to taxonomize cases, and to suggest heuristic procedures for ethical decision making

Participants Profile

• N=25 —> Internet researchers interviewed • N=5 —> Researchers working primarily in MMOGs or virtual worlds (e.g., SL)• Disciplines: Rhetoric/composition (6), technical communication (5), communication studies, gender and culture, culture and media, education, anthropology, information technology• Rank/Position: 7 graduate student, 17 faculty, 1 IT professional• Gender: 17 female, 8 male• Researcher Location: 14 working in US universities, 10 working in universities outside US, 1 working in industry outside US[Heidi: I’m not sure about the counts here.]

2. Findings: Interviews with MMOG researchers —> findings, perspectives, themes, and issues

Participants Profile — MMOG Researchers

• N=5 —> Researchers working primarily in MMOGs or virtual worlds (e.g., SL)

• Disciplines: Communication, education, culture and media, anthropology, rhetoric/composition (???)

• Rank/Position: 3 faculty, 2 graduate student(???)• Gender: 4 female, 1 male

• Researcher Location: 4 working in US universities, 1 working in university outside US

3. Analysis: Applying/developing heuristics to assist ethical analysis and problem solving

Heuristics — common topics (topoi)

• comparison/contrast• whole/part• genus/species• cause/effect• essential/accidental

Topos — Whole/Part

• Is informed consent from individuals sufficient?

• Or must consent be obtained from the community at large?- the citizens/members?- the moderators?- the sponsoring agency? (e.g., Linden Labs?

Researcher Values/Beliefs (Givens)

• Researching avatar subject to same ethic as researching person (e.g., consent).

• Virtual does not mean “not real.”

• Game world is not a place for publication. It is not (purely) a fantasy world.

• Game world matters; it is important.

Researchers — Time in World Matters

•

What is a “sensitive topic”?

• Information-based definition: Personal information or individual views that - would expose a person to ridicule, embarrassment, or negative public exposure- that pertain to illegal activity, personal health, sexual activity, religious beliefs, sexual preferences, family background, traumatic or emotionally distressing life experiences (death, injury, abuse), bodily functions, idiosyncratic behaviors

• Participant-based definition: Personal information or individual views that the person regards as sensitive and wants to keep confidential

Views of Internet :: Views of Research

space place/s

medium culture/community

public, publication,“published”

person/stext

researcherrights

communitynorms

Variability of Roles

Player Role

RL Person Role

Researcher Role

X

X

X

X

“murkiness”

OW personalconversation (not usable)

IW “telling othercharacter to fuck off”

IW conductingan interview

Building research credibility

t = time in world

Pla

yer

cre

dib

ilit

y/s

kill

Researcher credibility

Degrees of Interaction(Researcher <—> Participant)

• Case study: in-depth shadowing of key informant, frequent sustained interaction (e.g., interviews, extensive observations)• Interview (formal, whether IW or OW)• Occasional, coincidental contact, collecting ad hoc chatter ("game talk")• In-world “background noise,” “props” (i.e., characters as incidental; third party representation)• Out-of-world writing (e.g., gamers who post in blogs and other online forums)

High

Low

Degrees of Interaction and Consent

• Case study: in-depth shadowing of key informant, frequent sustained interaction (e.g., interviews, extensive observations)• Interview (formal, whether IW or OW)• Occasional, coincidental contact, collecting ad hoc chatter ("game talk")• In-world “background noise,” “props” (i.e., characters as incidental; third party representation)• Out-of-world writing (e.g., gamers who post in blogs and other online forums)

Consent

No Consent

Degrees of Interaction, Consent, and Topic Sensitivity

• Case study: in-depth shadowing of key informant, frequent sustained interaction (e.g., interviews, extensive observations)• Interview (formal, whether IW or OW)• Occasional, coincidental contact, collecting ad hoc chatter ("game talk")• In-world “background noise,” “props” (i.e., characters as incidental; third party representation)• Out-of-world writing (e.g., gamers who post in blogs and other online forums)

Consent

No Consent Not Sensitive

Sensitive

Examples

• Case studies and interviews — whether sensitive or insensitive

• Quoting from blog re techniques for playing game

• Quoting from blog to critique person’s racist or sexist attitudes

• Screen shot of incidental, background toons taken during interview on sensitive topic

Consent required

Consent required

Consent not required

Consent not required

NOT Heuristic

Heuristic — Categories/Questions

“Consent: Is there reason to believe that obtaining consent will be difficult? Will the process of requesting consent itself cause harm? Is it possible to obtain consent in some other way (e.g., create a special chatroom explicitly for the study)? Harm: What are the potential harms in conducting the study? …”

- Hudson & Bruckman, 2004, p. 138

Heuristic — AoIR Ethics Guidelines

Questions to ask when undertaking Internet research:

A. Venue/environment — expectations, authors/subjects, informed consent- Where does the interaction, communication, etc.

under study take place?- What ethical expectations are established by the

venue?- Who are the subjects posters / authors/ creators of

the material and/or interactions under study?- Informed consent — specific considerations

- Ess & AoIR, 2002

Heuristic — AoIR Ethics Guidelines

Informed consent: Specific considerations

- Timing- Medium- Addressees- How material is to be used?

- Ess & AoIR, 2002

Issues of Representation

• When to use pseudonyms?- private conversation- sensitive topic• When to use avatar name / credit

speaker?- clearly public event, public speaking- nonsensitive topic• When to use screen shot / avatar image?• When to use direct quotation?

Heuristic — Grids

- Sveningsson, 2004, p. 56

- McKee & Porter, in press

Harm / Benefit Grid

Low Risk

Low Benefit

High Benefit

High Risk

X X

Real names,quotations

Pseudonyms, no quotations

Aggregateddata only

X

Possible Harm in Research

Focus of public debate — outcome

Focus in our interviews — process

4. Conclusion

Conclusions re Ethical Decisions

• Ethical issues are complex, but not unprecedented, unsolvable, or indeterminate. Use precedent, analogy, and taxonomy to guide decisions (e.g., reference to case types).• Approach ethics as ongoing dialogic process — not as a single isolated decision at the design/approval stage- dialogic with participants, with colleagues, with IRBs. etc. - ongoing set of decisions through design, data collection, and publication/presentation of results

• Be flexible and adaptable over time — within same study, from study to study

Conclusions re IW Research

• Earn credibility through time in world• Respect norms of game community (ies)• Respect privacy of individuals (persons and toons), particularly with (a) high level of interaction, or (b) sensitive topic• Identify yourself as researcher (or when in researcher role)