small group research-2009

Upload: angie-bunea

Post on 04-Apr-2018

223 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/30/2019 Small Group Research-2009

    1/43

    http://sgr.sagepub.com/ Small Group Res earch

    http://sgr.sagepub.com/content/40/2/181The online version of this article can be found at:

    DOI: 10.1177/10464964083288212009 40: 181 originally published online 6 January 2009Small Group Research

    Burke, Rebecca Lyons and Gerald F. GoodwinCameron Klein, Deborah DiazGranados, Eduardo Salas, Huy Le, C. Shawn

    Does Team Building Work?

    Published by:

    http://www.sagepublications.com

    can be found at:Small Group Research Additional services and information for

    http://sgr.sagepub.com/cgi/alertsEmail Alerts:

    http://sgr.sagepub.com/subscriptionsSubscriptions:

    http://www.sagepub.com/journalsReprints.navReprints:

    http://www.sagepub.com/journalsPermissions.navPermissions:

    http://sgr.sagepub.com/content/40/2/181.refs.htmlCitations:

    What is This?

    - Jan 6, 2009OnlineFirst Version of Record

    - Mar 10, 2009Version of Record>>

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/content/40/2/181http://sgr.sagepub.com/content/40/2/181http://sgr.sagepub.com/content/40/2/181http://www.sagepublications.com/http://sgr.sagepub.com/cgi/alertshttp://sgr.sagepub.com/cgi/alertshttp://sgr.sagepub.com/subscriptionshttp://www.sagepub.com/journalsReprints.navhttp://www.sagepub.com/journalsReprints.navhttp://www.sagepub.com/journalsPermissions.navhttp://sgr.sagepub.com/content/40/2/181.refs.htmlhttp://sgr.sagepub.com/content/40/2/181.refs.htmlhttp://sgr.sagepub.com/content/40/2/181.refs.htmlhttp://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://sgr.sagepub.com/content/early/2009/01/06/1046496408328821.full.pdfhttp://sgr.sagepub.com/content/early/2009/01/06/1046496408328821.full.pdfhttp://sgr.sagepub.com/content/40/2/181.full.pdfhttp://sgr.sagepub.com/content/40/2/181.full.pdfhttp://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://sgr.sagepub.com/content/early/2009/01/06/1046496408328821.full.pdfhttp://sgr.sagepub.com/content/40/2/181.full.pdfhttp://sgr.sagepub.com/content/40/2/181.refs.htmlhttp://www.sagepub.com/journalsPermissions.navhttp://www.sagepub.com/journalsReprints.navhttp://sgr.sagepub.com/subscriptionshttp://sgr.sagepub.com/cgi/alertshttp://www.sagepublications.com/http://sgr.sagepub.com/content/40/2/181http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    2/43

    Does Team Building Work?Cameron KleinDeborah DiazGranadosEduardo SalasHuy LeC. Shawn BurkeRebecca LyonsUniversity of Central Florida

    Gerald F. Goodwin Army Research Institute

    This research reports the results of a comprehensive investigation into theeffectiveness of team building. The article serves to update and extend Salas,Rozell, Mullen, and Driskells (1999) team-building meta-analysis by assess-ing a larger database and examining a broader set of outcomes. Our studyconsiders the impact of four specific team-building components (goal setting,interpersonal relations, problem solving, and role clarification) on cognitive,affective, process, and performance outcomes. Results (based on 60 correla-tions) suggest that team building has a positive moderate effect across allteam outcomes. In terms of specific outcomes, team building was moststrongly related to affective and process outcomes. Results are also presentedon the differential effectiveness of team building based upon the team size.

    Keywords: team building; team performance; team development

    Teams of people working together for a common cause touch all our lives.From everyday activities like air travel, fire fighting, and running the UnitedWay drive to amazing feats of human accomplishment like climbing Mt.Everest and reaching for the stars, teams are at the center of how work getsdone in modern life.

    Kozlowski & Ilgen, 2006, p. 78

    This quote, from a recent review of work-team effectiveness, exemplifiesthe central role that teams play in our lives. Although many labels havebeen applied to team-based forms of organizing (i.e., crews, teams, groups,and collectives), these entities are essential to the accomplishment of orga-nizational goals. Indeed, there is ample support in the literature for the

    Small Group ResearchVolume 40 Number 2April 2009 181-222

    2009 SAGE Publications10.1177/1046496408328821

    http://sgr.sagepub.comhosted at

    http://online.sagepub.com

    181

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    3/43

    contention that team-based forms of organizing are beneficial both toorganizations and to individuals. For example, Applebaum and Batt (1994)

    reviewed 12 large-scale surveys and 185 case studies of managerial prac-tices and concluded that team-based work leads to improvements in orga-nizational performance on measures of both efficiency and quality. Theyargued that team-based systems benefit workers because of the higher like-lihood of job enhancement, autonomy, and skill development associatedwith these systems. However, the simple existence of a team-based orga-nizing structure is not enough to ensure that positive outcomes will result.Teams must be nurtured, supported, and developed.

    The Motivation for Understanding theEfficacy of Team Building

    There are three motivations for understanding the efficacy of team-building interventions in organizations. First, team building is one of themost commonly applied group development interventions in organizations

    today. It is widely used and comes in many forms, including outdoor expe-riential activities and indoor group process discussions. However, no one isquite sure how and why these interventions work, or if they even work atall. Considering the vast sum of money directed toward the development of teams in organizations, it is important that practitioners (and researchers)gain a better understanding of the effectiveness and boundary conditions of team building.

    Second, as there are many options available to organizations in thepursuit of improved teamwork, it is important to determine whether teambuilding is a worthy choice. Some of these interventions are organizational

    182 Small Group Research

    Authors Note: This work was partially supported by funding from the U.S. Army ResearchInstitute for the Behavioral and Social Sciences (Contract W74V8H-04-C-0025) and grantSES0527675 from the National Science Foundation, awarded to Glenn Harrison, Stephen M.Fiore, Charlie Hughes, and Eduardo Salas. All opinions expressed in this article are those of the authors and do not necessarily reflect the official opinion or position of the University of Central Florida, the Department of the Army, the Department of Defense, or the NationalScience Foundation. Portions of the article were presented at the 2nd Annual Conference of the Interdisciplinary Network for Group Research (INGRoup) held at Michigan StateUniversity, in Lansing, Michigan. Correspondence concerning this article should be addressedto: Dr. Eduardo Salas, Institute for Simulation & Training, University of Central Florida, 3100Technology Parkway, Suite 132, Orlando, FL 32826, USA. Tel: (407) 882-1325; fax: (407)882-1550; e-mail: [email protected].

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    4/43

    or structural in nature and do not specifically target team member inter-actions (e.g., job redesign, selection systems, and group incentive and

    performance management programs). In contrast, team-development inter-ventionsthose whose quest is to directly impact the functioning andeffectiveness of work teamsprovide the focus for the current researchintegration. These interventions, when properly conducted, can have apositive impact on organizations. Consider a research study conducted byMacy and Izumi (1993), who analyzed 131 studies of organizationalchange. They found that interventions with the largest effects upon finan-cial measures of organizational performance were team-development

    interventions. That is, of all organizational interventions, those that focuson team development had the largest effect on measures of financialperformance.

    Third, beyond financial performance, it is widely understood that teamdevelopmental interventions are key mechanisms that may be used to facil-itate team effectiveness (Noe, 2002). Therefore, it is important to under-stand how these interventions are most effective. At a general level,team-development interventions may include some form of team-training

    or team-building activities. Although both types of team-development inter-ventions are designed to improve team functioning and effectiveness (espe-cially when the science of individual and team training is utilized; Salas &Cannon-Bowers, 1997), team training and team building differ in importantways (Tannenbaum, Beard, & Salas, 1992). Team training is skill-focused(i.e., it is focused on gaining specific competencies), typically includes apractice component, and is done in context. It is generally formal andsystematic. Team building, on the other hand, does not target skill-basedcompetencies, is not systematic in nature, and is typically done in settingsthat do not approximate the actual performance environment. For our pur-poses, we define team building as a class of formal and informal team-levelinterventions that focus on improving social relations and clarifying roles,as well as solving task and interpersonal problems that affect team func-tioning. Team building works by assisting individuals and groups to exam-ine, diagnose, and act upon their behavior and interpersonal relationships(Schein, 1969, 1999).

    In light of the above, this article investigates the efficacy of team building.We begin with a brief review of conceptual issues and methodological issuesin team building. Next, the hypotheses for this research are presented.Finally, the results of several meta-analytic integrations are discussed. First,however, is the rationale for the present research.

    Klein et al. / Team Building 183

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    5/43

    Understanding the Need for an Update

    It is an unfortunate indictment of the literature and practice in this areathat we are still searching for answers to questions posed by Beer (1976)and Salas, Rozell, Mullen, and Driskell (1999). Namely, does team build-ing result in positive outcomes? Why? Under what conditions? Upon acareful review of the extent literature, it is clear that these questions need tobe examined more closely to clarify our understanding of the effectivenessand boundary conditions of team building. Thus, this article reports thefindings from a series of meta-analytic investigations of research on the

    efficacy of team-building interventions to update and extend the currentstate of knowledge in the team-building domain. In total, this research willexamine three moderator variables in addition to making an overall assess-ment of the efficacy of team-building interventions. The current replicationis meant to be systematic, rather than direct in nature (e.g., Aronson,Ellsworth, Carlsmith, & Gonzales, 1990). That is, rather than replicatingthe exact analyses from the study by Salas and colleagues, the currentresearch will replicate and extend the earlier study in an effort to resolve

    ambiguities and provide new insights for organizational stakeholders andacademicians alike concerning the effectiveness of team building.Although the empirical evidence on team-building interventions is lim-

    ited, a critical investigation of the available literature is warranted for sev-eral reasons. First, since the 1990s there has been an increasing incursionof team-building interventions in organizations. Some of the most recenttrends in team building have taken these interventions into the kitchen andeven the wilderness. Second, many practitioners feel that these interven-tions are useful. However, a more careful exploration of the utilities andstrengths of these interventions would benefit practitioners now and wouldbenefit the development of these interventions in the long run. Finally, thereare enough data available to form estimates regarding some of the variablesthat may moderate the impact a team-building intervention may have onteam outcomes.

    There is a general consensus for the idea that the science of team train-ing can be applied to enhance team functioning across organizations (e.g.,Kozlowski & Ilgen, 2006; Salas & Cannon-Bowers, 1997). At the sametime, reviews of team effectiveness have noted the inconsistent findings forthe effectiveness of team-building interventions. Despite these inconsistentfindings, researchers such as Kozlowski and Ilgen have acknowledged thepotential that these interventions may have on shaping team developmentand on improving team effectiveness. Given the increasing frequency of

    184 Small Group Research

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    6/43

    team-building interventions, if researchers do not catch up and start doingthis research, an important window might be missed to constructively shape

    the important practice in this area. Thus, examining team building furthera topic that has not received recent sufficient attention in the literatureiscritical. In the next section, a number of conceptual and methodologicalissues in team building are discussed.

    Team Building

    Conceptual Issues in Team BuildingOriginally designed as a group process intervention (e.g., Schein, 1969,

    1999) for improving interpersonal relations and social interactions, teambuilding has evolved to also include a concern for achieving results, meet-ing goals, and accomplishing tasks (Payne, 2001). In the late 1990s, Salasand colleagues (1999) described team-building interventions as extremelypopular and common. According to Beer (1976), there are four basicapproaches to team building, including: (a) a goal-setting, problem-solvingmodel; (b) an interpersonal model; (c) a role model; and (d) the ManagerialGrid (Blake & Mouton, 1964) model. However, this initial conceptualiza-tion has since been reconsidered.

    Refinements to this four-pronged system began with the Managerial Gridmodel being dropped as a distinct team-building approach. In addition todropping the Managerial Grid model, modern conceptualizations have sep-arated the goal-setting and problem-solving approaches, using Bullers(1986) problem-solving component as a distinct approach. As discussed by

    Buller, team-building models rarely exist in pure form. That is, the interven-tions reported in the literature usually involve elements from several or all of the models. As a result, he proposed a general problem-solving model thatfollows Dyers (1977) problem-solving framework. This model incorporatesa focus on task or interpersonal issues, goal setting, and role clarification,depending on the nature of the specific problems identified for the groupunder investigation. Moreover, the problem-solving approach to team build-ing is said to subsume each of Beers (1976) components, and, as perhaps

    evident by its title, emphasizes the identification of major problems in theteam. All told, these modifications have added clarity to the investigationand implementation of team building. Unfortunately, this newfound concep-tual clarity may not have come soon enough for many investigators who hadpreviously sought to assess the efficacy of team building.

    Klein et al. / Team Building 185

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    7/43

    Perhaps because of the conceptual confusion that existed in this area,many reviews of team building did not include the same articles. For example

    two noteworthy reviews (DeMeuse & Liebowitz, 1981; Woodman &Sherwood, 1980) had only 14 studies in common out of a total of 66 studiesreviewed. A subsequent review by Buller (1986) included only 9 studies, 3 incommon with Woodman and Sherwood (1980) and 6 in common withDeMeuse and Liebowitz. One reason for the apparent lack of consistency inthe articles chosen for reviews is that team building has been an ill-definedconcept (Buller, 1986). At the time of these early reviews there was noagreed-upon operational definition of the intervention. Taken together, there

    is now a consensus position that there exist four distinct models of teambuilding. Although combinations of these approaches are common, themodels include goal-setting, developing interpersonal relations, clarifyingroles, and creating additional capacity for problem solving (Beer, 1976;Buller, 1986; Dyer, 1987; Salas et al., 1999). Table 1 describes each of thefour models or components of team building in more detail.

    Despite the recently established consensus on team-building compo-nents, there have been other problematic issues that have persisted for

    researchers and practitioners of this topic. Specifically, many early effortswere plagued by a number of methodological issues. A few of these are dis-cussed in the next section.

    Methodological Issues in Team Building

    Early reviews of team building described both a lack of extensive researchon the issue and trepidation concerning the methodological rigor of publishedstudies (Buller, 1986; DeMeuse & Liebowitz, 1981; Tannenbaum et al.,1992; Woodman & Sherwood, 1980). That is, even if one could get beyondthe disagreement concerning operational definitions of team building,much of the previous team-building research is characterized by method-ological flaws (i.e., study design and measurement issues). For example,Buller (1982) found that more than half of the reported team-building studiesemployed pre-experimental designsdesigns that do not allow for causalinferences. Also problematic, there was often no attempt to disentangle theeffects of team building from other interventions that may be in processwithin an organization. Although this can be a common problem for fieldresearch in general, it has been particularly problematic in the team-buildingdomain.

    Tannenbaum and colleagues (1992) highlighted another methodologicalflaw in the team-building research. Specifically, they pointed out that there

    186 Small Group Research

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    8/43

  • 7/30/2019 Small Group Research-2009

    9/43

    has been a reliance on measuring the effectiveness of team-building inter-ventions with process measures. Although implicitly appealing, improve-ments in processes can not always be linked to improvements in teamperformance (e.g., Porras & Wilkens, 1980). For example, team perfor-mance is typically fashioned by additional environmental and/or organiza-tional characteristics and contingencies that are out of the volitional controlof team members. Stated differently, team members are active participantsin the enactment of team processes, but must also interact within the larger

    system to produce more distal performance outputs. Team processes mayalso be impacted by the larger organizational environment, but not likely tothe same degree as team performance outputs.

    As a final methodological concern with previous team-buildingresearch, there has been an overreliance on subjective indicators of groupor organizational performance criteria as dependent measures (Tannenbaumet al., 1992). Though this type of information may be interesting and rele-vant to measuring participant satisfaction and other affective outcomes thatmay be impacted by team-building interventions, it is often not concreteenough to allow for accurate predictions of the performance outcomes of team building.

    A Recent Advancement in Team-Building Research

    Despite the conceptual and methodological issues associated with eval-uations of team building, one recent effort has represented advancementover previous reviews by empirically investigating the effectiveness of these interventions. Specifically, Salas and colleagues (1999) responded toa call by Buller (1986) to use the primary focus of the intervention(i.e., goal setting, interpersonal relations, role clarification, and problemsolving) as a potential moderating variable. The results of their study failed

    188 Small Group Research

    Table 1 (continued)

    Salas, Rozell, Mullen, Salas, Priest, &Component & Driskell, 1999 DeRouin, 2005

    and to evaluate those improve organizationalsolutions. characteristics through

    problem-solving tasks.Can have the added benefit of

    enhancing critical-thinking skills.

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    10/43

    to indicate a relationship between the combined set of team-building inter-ventions and team performance ( r = .01, k = 16 effect sizes). Moreover, of

    the four components of team building, only role clarification proved to beeffective, as judged by both objective ( r = .71) and subjective ( r = .75)accounts of performance. Interestingly, for objective and subjective mea-sures there was a nonsignificant effect of goal setting ( r = .06 and .11,respectively), interpersonal relations ( r = .38 and .04, respectively), andproblem solving ( r = .31 and .09, respectively). Also examined in thisstudy were the potential moderating influences of the source of the criterionmeasurement of performance (i.e., objective vs. subjective), team size, and

    training duration. For objective measures of performance, there was no evi-dence of a relationship between team building and performance ( r = .04,k = 8); for subjective measures, there was a small positive relationshipbetween team building and performance ( r = .14, k = 8). Concerning teamsize, the results of their study suggested that the effects of team building onperformance decreased as a function of the size of the team ( r = .34).Finally, there was a slight tendency for the effects of team building todecrease as a function of the duration of the intervention ( r = . 20).

    Taken together, this study enhanced our understanding of the efficacy of team building. However, there were a number of limitations associated withitlimitations that now necessitate the need for additional inquiry. Forexample, the amount of data analyzed in this study was relatively modest.Specifically, the research findings presented were based on only 16 effectsizes, and thus, it is difficult to discern, with any degree of confidence, theactual effectiveness of these interventions. Moreover, the findings derivedfrom the Salas and colleagues (1999) study did not necessarily reflect thefindings from existing narrative reviews. Finally, their study left manyquestions unanswered regarding the potential moderating impact of otherrelevant variables. As an organizing tool provided to summarize the litera-ture in this area, Table 2 provides a summary of five previous investigationsinto the efficacy of team building, and includes the number of articlesreviewed, the years spanned, and other noteworthy features.

    In summary the current research was initiated to provide an updatedmeta-analysis of the team-building literature. Phrased in the form of ques-tions, an examination of these issues will help clarify our understanding of the effectiveness of team building and lead to hypothesized relationshipsinvolving the effectiveness of team building, including an investigation of specific moderators. A model that serves to graphically illustrate thesehypotheses is presented in Figure 1.

    Klein et al. / Team Building 189

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    11/43

    190 Small Group Research

    Table 2Summary of Previous Team-Building Reviews

    Study Summary of NoteworthyReview Details Findings Features

    Woodman & 30 articles TB elicits positive affective Distinguished between teamSherwood reactions. development and T-group(1980) Qualitative The linkage between TB and or sensitivity training.

    data work group performance Made subjective assessmentsremains largely unsubstantiated. of the internal validity

    Years spanned: TB is more commonly of the studies reviewed.19641978 conducted with management

    teams than groups lowerin organizational hierarchies.TB is more commonly conducted

    with intact and establishedwork teams than new groups.

    Affective reactions as dependentmeasures are used more oftenthan objective performance data.

    DeMeuse & 36 articles TB is described as having great Coded studies according toLiebowitz promise for improving employee research design, sample size,(1981) Qualitative attitudes, perceptions, behaviors, multiple dependent variables,

    data and organizational effectiveness. and duration of the TBEighty-seven percent of the 68 intervention.Years spanned: evaluations indicated positive results. a

    19621980 Due to the lack of rigorous researchdesigns, firm conclusionsconcerning the effectiveness of theseinterventions could not be made.

    Buller 9 articles TB must be more carefully defined. Presented and described a(1986) More rigorous experimental general problem solving

    Qualitative designs should be used. approachto TB that added todata There are numerous methodological Beers (1976)

    flaws in previous TB studies. four-component model.Years spanned: Therefore a clear assessment of the Argued that Beers19641981 TB and task performance classification is difficult to

    relationship had yet to emerge. use in practice because TBprograms usually involveelements from each of themodels.

    Tannenbaum, 17 articles The quantity of TB research decreased; Presented a comprehensiveBeard, & however, the quality had improved. model of team effectivenessSalas Qualitative Most studies used multiple components that continues to influence(1992) data in their TB interventions. research and theorizing

    More researchers began using in this field.Years spanned: behavioral and objective measures.19801988 Presented evidence to cast doubt the

    connection between process andperformance; TB is effective, butfor only perceptions and attitudes.

    (continued)

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    12/43

    Klein et al. / Team Building 191

    Table 2 (continued)

    Study Summary of NoteworthyReview Details Findings Features

    Post-intervention strategies may be akey mechanism to ensure thelong-term effectiveness of theseinterventions.

    Salas, Rozell, 11 articles No significant effect of TB on First known attempt toMullen, & performance. empirically summarize theDriskell Quantitative A nonsignificant tendency for TB to effectiveness of TB.(1999) data result in lower performance when Assessed a number of

    measured objectively, but increase moderators, including teamYears spanned: performance when subjective building component, team

    19651990 measures were used. size, training duration, andThe role clarification component was type of performance measure

    more likely to increase performance. b used (i.e., objectiveThe effects of TB decreased as the size versus subjective).

    of the team increased.The effects of TB decreased as the

    duration of the intervention increased.

    Note: TB = team building.a. Many of the 36 studies reported evaluations of multiple dependent variables.b. This result should be interpreted with caution as it was based on a small number of effect sizes (its dif-ficult to determine, but likely only three or four effect sizes were used in this calculation).

    Hypotheses

    Is Team Building Effective?

    We agree with Salas and colleagues (1999) that previous narrativereviews have frequently expressed the benefits that can result from teambuilding (e.g., Buller, 1986; DeMeuse & Liebowitz, 1981; Sundstrom,DeMeuse, & Futrell, 1990, Tannenbaum et al., 1992; Woodman &Sherwood, 1980); however, there has been a lack of definitive, compellingevidence concerning the positive effects of team building on team performance.Specifically, previous qualitative reviews of the team-building domain haveconcluded that evidence of an effect of team building on performance wasinconclusive (Buller, 1986), unsubstantiated (Woodman & Sherwood,

    1980), equivocal (Tannenbaum et al., 1992), and mixed (Sundstromet al., 1990). Meta-analytic results from one study have suggested there isno overall effect of team building on team performance (Salas et al., 1999).However, there was support for the role-clarification component of teambuilding. Theoretically, one would assume that an intervention focused on

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    13/43

    192 Small Group Research

    Figure 1Theoretical Model Depicting Study Hypotheses

    improving team functioning would result in positive (as opposed to nega-tive) outcomes. In addition, the moderate support suggested by severalnarrative reviews (e.g., Tannenbaum et al.) leads us to predict a positiveoverall effect of team building on team functioning. Thus, we present ourfirst hypothesis:

    Hypothesis 1: Team building interventions will result in enhanced team out-comes.

    The result from testing this hypothesis will provide for a baseline judg-ment concerning the efficacy of this particular form of team-developmentintervention. The omnibus test will therefore allow for an overall assess-ment of the efficacy of team building, with all independent outcomes fromprimary studies combined for this analysis.

    Is Team Building More Effective for SomeOutcomes Than Others?

    This framing question asks whether the combined set of team-buildinginterventions is shown to be more useful for improving certain team outcomesthan others. Specifically, does team building work better for cognitiveoutcomes (e.g., declarative knowledge of teamwork competencies), team

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    14/43

  • 7/30/2019 Small Group Research-2009

    15/43

    building for improving affective or attitudinal outcomes. Finally, to ourknowledge there have been no reviews citing the correlation between team-

    building interventions and improvements in cognitive outcomes.The mixed results found in the literature concerning the effect of team-

    building interventions on team outcomes lead us to believe that moderatorsmay exist. Therefore, team building impacts certain outcomes more thanothers. Based on the general characteristics of team building, (e.g., thatteam building develops interpersonal relations, mutual trust, and open com-munication between team members), it is likely that team building willhave a greater effect on affective outcomes than any on other type of out-

    comes. As a process intervention, it makes theoretical sense that teambuilding would result in enhanced team member affective outcomes.Finally, although the findings of more distal reviews of team building weretaken into consideration, a decision was made to place more credence onrecent research, which more often reported positive findings. These find-ings, along with a complete consideration of the expected benefits of teambuilding, led us to Hypotheses 2a and 2b:

    Hypothesis 2a: Team building interventions will result in improved outcomesacross each of the four outcome types.

    Hypothesis 2b: Team building will be most effective for improving affectiveoutcomes.

    Does the Focus of Team Building Moderate Its Effectiveness?

    It is certainly important to be able to identify whether team buildingresults in enhanced team functioning, but it is perhaps more informative toknow which forms or components of team building are most effective.Advancements in theory in the last quarter century (e.g., Buller, 1986; Salaset al., 1999; Salas, Priest, & DeRouin, 2005) have allowed for the parcel-ing of team-building interventions into four distinct foci (see Table 1).Unfortunately, the single existing empirical integration on the relative effi-cacy of different components of team building (i.e., Salas et al.) did notprovide encouraging results. Combining subjective and objective estimates,there was a slight (nonsignificant) tendency for goal-setting ( r = .16),interpersonal relations ( r = .06), and problem-solving ( r = .05) modelsof team building to result in decreased performance. It was only therole-clarification component that appeared to be effective for improvingperformance ( r = .76). However, upon examination of their data set, it

    194 Small Group Research

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    16/43

    appears this positive finding for role clarification was supported by theresults from only three studies and three effect sizes. Thus, caution and further

    investigation are warranted before concluding that the role-clarificationcomponent of team building is superior to the other forms.

    Nonetheless, because the role-clarification component of team buildingis designed to relieve role stress as created by role ambiguity or role con-flict, it is reasonable to anticipate that a significant improvement in teamfunctioning should result. In addition, the role-clarification component of team building emphasizes communication among team members, andthus it is likely that an increase in the level and quality of communication

    between team members will impact their effectiveness. Unlike the otherforms of team building, improvements in role clarity and communicationare expected to produce more lasting benefits in terms of team function-ing (as assessed through an analysis of the combined set of team outcomes).Combining this theoretical rationale with the preliminary findings of Salas and colleagues (1999) concerning the role-clarification componentof team building, it is our belief that a team-building intervention thatutilizes a role-clarification focus will provide the most benefit to team

    functioning. At the same time, it is our view that any carefully thought outteam-building intervention should have at least some positive impact onteam members. Thus, we also expect that team building that focuses oninterpersonal relations, goal setting, or problem solving will also proveuseful, at least for the short-term benefits that are typically assessed.Taking these dual considerations into perspective, we present our next setof hypotheses:

    Hypothesis 3a: Each of the four components of team building will demon-strate a moderate level of effectiveness for improving team functioning.

    Hypothesis 3b: The role clarification component of team building will bemost effective for improving team functioning.

    Is the Effectiveness of Team BuildingModerated by Team Size?

    This research will also investigate whether the effectiveness of teambuilding is moderated by the size of the team. At a basic level, the resourcesavailable on a team result from how many people are on it (Hambrick &DAveni, 1992, p. 1449). Sundstrom, McIntyre, Halfhill, and Richardss(2000) review of 83 field studies and experiments conducted with work

    Klein et al. / Team Building 195

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    17/43

    groups suggested that the average group size was 11 members. Moreover,Halebian and Finkelstein (1993) have suggested that team size is synony-

    mous with cognitive capability. Providing support for this assertion, Banteland Jackson (1989) found that larger teams generally have a greater reservoirof cognitive resources than smaller teams. There is little doubt that there arebenefits to having medium- to large-sized teams available to perform work tasks rather than smaller teams. However, research has also found that largerteams can facilitate the enactment of other, less desirable, group phenome-non, including the participation leadership effect, the in-group bias effect, thecohesiveness performance effect, and the well-known groupthink effect (cf.

    Mullen, Anthony, Salas, & Driskell, 1994; Mullen, Brown, & Smith, 1992;Mullen & Copper, 1994; Mullen, Salas, & Driskell, 1989).

    From other research, we know that information pooling is critical to team-based decision making. That is, the size of a team may impact the effectivenesswith which a team pools common and unique information. For example, Stasser,Vaughan, and Stewart (2000) discussed the tendency for group members to dis-cuss shared information rather than the unique information that is held by teammembersan issue that becomes more problematic as teams increase in size.

    This lack of attention to unique information held by individual team memberscan lead to mal-informed decisions and occasionally even detrimental results.Salas and colleagues (1999) presented the only existing research integration

    that has assessed the relative efficacy of team building for teams of differentsizes. They found that the effects of team building on performance decreasedas a function of the size of the team, both in objective measures and in subjec-tive measures of performance. These authors concluded that any positive effectof team building is most likely to prevail only in small teams. Similarly, othershave argued that as group size increases, members liking for the group (Indik,1965) and performance (Mullen, 1987) tend to decrease. Taking these findingsinto consideration, the current research examined team size as a moderator of the effectiveness of team-building efforts on team performance. In this study,we seek to replicate Salas and colleagues findings. However, rather than sim-ply correlating the database of effect sizes with their associated team sizes, thecurrent research will examine the efficacy of team building for three distinctsubgroup classifications of team size: small teams (i.e., less than 5 members);medium-sized teams (i.e., 5 to 10 members); and large teams (i.e., greater than10 members). In addition, although there is some reason to expect that largerteams have an increased cognitive capacity with which to perform tasks (e.g.,Bantel & Jackson, 1989), the other negative issues often associated withincreased group size are expected to be the overwhelming influences on theperformance of teams. Therefore, it is reasonable to suggest that larger teams

    196 Small Group Research

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    18/43

  • 7/30/2019 Small Group Research-2009

    19/43

    Coding Procedure

    Following the literature review, three authors independently coded each of the relevant studies on 14 categories: (a) nature of the organization and par-ticipant sample; (b) team type; (c) number of teams; (d) average team size;(e) predictor reliability; (f) level of analysis of predictor; (g) criterion relia-bility; (h) level of analysis of the criterion; (i) criterion report type(s); (j) cri-terion description(s); (k) focus/component of team building (i.e., goal setting,interpersonal relations, problem solving, role clarification); (l) effect size(s);(m) study design type; and (n) recommendation for inclusion. Concerning thelevel of analysis coding, the initial database consisted of 69 effect sizes60at the team level and 9 at the individual level. However, mixing levels of analysis is not recommended for research integrations for numerous reasons(e.g., Gully, Devine, & Whitney, 1995; Hunter & Schmidt, 1990). Therefore,only the team-level outcomes were analyzed in the current research, reducingour database to the 60 team-level correlations.

    Another point concerning the coding process that bears clarification is theassessment of the focus or component of team building. It was expected thatmany of the interventions being examined would consist of multiple compo-nents of team building. Thus, coders were instructed to allocate a total of 100 percentage points to each of the four components of team building. Forexample, if a coder believed an intervention consisted of equal parts roleclarification and interpersonal relations, each was coded with 50 percentagepoints, whereas problem solving and goal setting were given a 0 for this cod-ing category. For this process, the coders were instructed to closely examinethe effort, intensity, and primary focus of the intervention. They wereinstructed further that they would need to justify the weights they assigned

    during a consensus discussion of the final articles included in the database. Inthis discussion, the three coders came to a consensus concerning the alloca-tion of percentage points to each team-building intervention.

    Rater reliability . Articles were coded by one of three of the authors. Toaid in the consistency of coding, the three authors met early in the processto discuss the 14 pieces of information that were to be extracted from each of the 103 articles. Moreover, the coders had previously pilot tested the coding

    scheme, and possessed satisfactory level of expertise in the substantiveareas being coded. To estimate the reliability with which the coders wereevaluating the primary studies, three authors independently coded the sameset of 20 articles (the reliability sample, representing approximately 19% of the total 103 articles selected for coding) to determine interrater reliability

    198 Small Group Research

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    20/43

    by calculating intraclass correlation coefficients (ICCs; Nunnally, 1978;Shrout & Fleiss, 1979). The coders then each independently coded approxi-

    mately one third of the remaining articles.During the coding process, the decision to include or exclude the article for

    the final analyses was of primary concern. Upon inspection of the 20 studiescoded by each of the three coders, it was revealed that all three coders were inagreement 85% of the time with their global evaluation to include (or not toinclude) particular studies. The ICC for this assessment was satisfactory(3, k ) = .85. Importantly, for the three studies for which there was not completeinitial agreement the authors met to discuss the discrepancies and a consensus

    was reached. The ICCs calculated for seven of the categories ultimately usedin either main or exploratory analyses ranged from ICC (3, k ) = .85 to ICC (3,k ) = 1.0. In addition, the agreement among the three coders across all sevencategories resulted in an ICC (3, k ) = .96. The remaining six categories thatwere utilized for the ICC calculations included: team type, number of teamsin the primary studies under investigation, average team size, focus/compo-nent of the team-building intervention, effect size estimate, and study design.The ICCs for these categories were .94, .94, .97, .94, .91, and 1.0, respectively.

    In conclusion, the consistency and agreement among the raters was very good.

    Meta-Analysis Procedure

    The software for the Hunter-Schmidt meta-analysis methods was used toanalyze the data (Schmidt & Le, 2005). This program provides output thatincludes, but is not limited to: (a) the mean true score correlation, (b) the vari-ance and standard deviation of true score correlations, (c) credibility intervals,(d) estimates of the variance and standard deviation in observed correlationsdue to artifacts, and (e) the percentage of variance attributable to observed cor-relations after the removal of artifacts. In addition, the software employs a ran-dom effects model to combine effect sizes from primary studies. Randomeffects meta-analysis models allow the true effect sizes to vary, in contrast withfixed-effects models that assume the true effect sizes have fixed values.Moreover, the random effects model is considered to be more realistic thanthe fixed-effect model on the majority of occasions (Field, 2001, p. 162).

    Effect-Size Calculations

    Before calculating a meta-analytic estimate of the relationship betweenvariables, effect sizes culled from primary studies must be prepared for

    Klein et al. / Team Building 199

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    21/43

    entry into the database. During this process, effect sizes from primary stud-ies were converted to the common metric r (correlation). Thus, when nec-

    essary, primary study effect sizes reported as other statistics (e.g., t , F , d , 2,or Z ) were transformed using the formulas found in Hunter and Schmidt(2004). Once placed on this common metric of effect size, the results of independent tests found in primary studies can be combined and assessedfor fit with predicted hypotheses in the meta-analysis. However, it iscommon knowledge that when a study contains multiple effect sizes, theyare stochastically dependent (Shadish, Cook, & Campbell, 2002). Thesedependencies violate the statistical assumption of independent effect

    sizes. The recommended solution is to average or combine effect sizesfrom different measures of the same sample within a single study prior tocombining results from multiple studies.

    Corrections for Unreliability and Range Restriction

    It is common in meta-analyses to make attempts to correct obtainedreliability coefficients for measures of the predictor, criterion, or both (e.g.,

    Hunter & Schmidt, 1990; Johnson, Mullen, & Salas, 1995). Unfortunately,original studies often fail to report all of the auxiliary information necessaryto perform corrections for study artifacts. Such was the case with the cur-rent database. As a result, artifact distribution meta-analysis was employed,rather than correcting each effect size individually for unreliability.

    Authors of meta-analytic integrations also make attempts to correct forthe effects of direct or indirect range restriction. Performing corrections forrange restriction will generally result in a combined estimate that is moreaccurate than had no corrections been performed at all (e.g., Hunter,Schmidt, & Le, 2006). However, in the current investigation, primarystudies did not report information on restricted and unrestricted samplesthat would be necessary to perform corrections for range restriction. Wetherefore cannot correct for range restriction in the current meta-analysis.Consequently, our effect-size estimates may be conservative, in the sensethat they may underestimate the true effect of team building if the biasingeffects of range restrictions could be corrected.

    Weighting

    Primary study effect sizes included in the current series of meta-analyticintegrations were weighted by their sample sizes. It is presumed that effectsizes obtained from studies with larger sample sizes are more stable (i.e.,accurate) than those culled from studies with small sample sizes. Although

    200 Small Group Research

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    22/43

    it is important to remember that large sample studies are not necessarilymore valid, recent simulation studies have determined that a very accurate

    combined effect size can be obtained through procedures used to weightprimary studies by sample size (e.g., Field, 2005).

    Results

    Description of the Database

    A total of 60 correlations were obtained from 20 studies. These 60 effectsizes represented 1,562 teams, with a median team size of approximately 9members. Although these 60 effect sizes were not all from independentsamples, every subgroup analysis that was performed included only inde-pendent samples. Otherwise, for the overall assessment of the influence of team building on the combined set of team outcomes, there were 26 inde-pendent samples (see Table 3). Of the studies included in the meta-analyticdatabase, 14 were published and 6 were unpublished. Table 3 provides adescription of the key information derived from each primary study.

    Publication/Availability Bias Detection

    When performing any meta-analysis it is difficult to determine whetherall relevant studies have been located. Existing empirical evaluations thatare elusive to locate and retrieve are commonly referred to as fugitiveliterature (Rosenthal, 1994). To the extent that this fugitive literature repre-sents a substantial proportion of the conducted evaluations in any one area,

    there is a possibility of publication or availability bias. The file drawerproblem in meta-analyses presents itself when there is a concern that thestudies that find their way into publication are simply the ones that showsignificant results, whereas evaluations with nonsignificant findings are rel-egated to file drawers (Rosenthal, 1979). To alleviate this concern,Rosenthals (1979) file drawer analysis can be used to provide an estimateof the number of unpublished studies relegated to file drawers. This analy-sis designates the number of these articles, which average null results, that

    would be required to bring the significance level for a set of studies downto the just-significant level (Hunter & Schmidt, 2004). However, it has beendemonstrated that the widely used fail-safe file drawer analysis is essen-tially irrelevant and can result in incorrect estimates of the size of the filedrawer (Scargle, 2000). Instead, funnel plots can serve as an alternative tofile drawer analysis for the purpose of detecting the possibility of bias.

    Klein et al. / Team Building 201

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    23/43

    202

    T a b l e 3

    M e t a -

    A n a

    l y t i c D

    a t a b a s e

    S t u d y

    D e s i g n

    E f f e c t

    T e a m

    N u m b e r

    A v e r a g e

    C r i t e r i o n

    A u t

    h o r ( s )

    Y e a r

    T y p e

    S i z e , r

    G S

    I R

    P S

    R C

    T y p e

    o f T e a m s

    T e a m

    S i z e

    D e s c r i p

    t i o n

    B o s s

    & M c C o n

    k i e

    1 9 8 1

    S G P P

    0 . 9

    1

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    E x e c u t

    i v e /

    2

    1 0 . 0

    0

    A f f e c

    t i v e

    M a n a g e m e n t

    B o s s

    & M c C o n

    k i e

    1 9 8 1

    S G P P

    0 . 8

    5

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    E x e c u t

    i v e /

    2

    1 0 . 0

    0

    P r o c e s s

    m a n a g e m e n

    t

    B o s s & M c C o n k i e

    1 9 8 1

    S G P P

    0 . 8

    9

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    E x e c u t i v e /

    2

    1 0 . 0

    0

    P e r f o r m a n c e

    m a n a g e m e n

    t

    B r a g g

    & A n d r e w s

    1 9 7 3

    P P W C

    0 . 8

    3

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    3

    3 2 . 0

    0

    P e r f o r m a n c e

    B u l l e r & B e l l

    1 9 8 6

    S G P P

    0 . 8

    6

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c t i o n

    1 2

    1 6 . 0

    0

    P r o c e s s

    B u l l e r & B e l l

    1 9 8 6

    S G P P

    0 . 8

    5

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    P r o d u c t i o n

    8

    1 6 . 0

    0

    P r o c e s s

    B u l

    l e r &

    B e l

    l

    1 9 8 6

    S G P P

    0 . 7

    0

    0 . 5 0

    0 . 0 0

    0 . 5 0

    0 . 0 0

    P r o d u c

    t i o n

    1 2

    1 6 . 0

    0

    P r o c e s s

    B u l

    l e r &

    B e l

    l

    1 9 8 6

    S G P P

    0 . 5

    9

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    8

    1 6 . 0

    0

    P e r f o r m a n c e

    B u l

    l e r &

    B e l

    l

    1 9 8 6

    S G P P

    0 . 5

    7

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    1 2

    1 6 . 0

    0

    P e r f o r m a n c e

    B u l

    l e r &

    B e l

    l

    1 9 8 6

    S G P P

    0 . 6

    6

    0 . 5 0

    0 . 0 0

    0 . 5 0

    0 . 0 0

    P r o d u c

    t i o n

    1 2

    1 6 . 0

    0

    P e r f o r m a n c e

    B u s

    h e & C o e

    t z e r

    1 9 9 5

    P P W C

    0 . 4

    0

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o j e c

    t

    1 6

    4 . 0 0

    A f f e c

    t i v e

    B u s

    h e & C o e

    t z e r

    1 9 9 5

    P P W C

    0 . 3

    6

    0 . 5 0

    0 . 0 0

    0 . 0 0

    0 . 5 0

    P r o j e c

    t

    1 6

    4 . 0 0

    A f f e c

    t i v e

    B u s h e & C o e t z e r

    1 9 9 5

    P P W C

    0 . 2

    8

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o j e c t

    1 6

    4 . 0 0

    P r o c e s s

    B u s h e & C o e t z e r

    1 9 9 5

    P P W C

    0 . 3

    3

    0 . 5 0

    0 . 0 0

    0 . 0 0

    0 . 5 0

    P r o j e c t

    1 6

    4 . 0 0

    P r o c e s s

    B u s

    h e & C o e

    t z e r

    1 9 9 5

    P P W C

    0 . 9

    2

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o j e c

    t

    1 6

    4 . 0 0

    P e r f o r m a n c e

    B u s

    h e & C o e

    t z e r

    1 9 9 5

    P P W C

    0 . 9

    5

    0 . 5 0

    0 . 0 0

    0 . 0 0

    0 . 5 0

    P r o j e c

    t

    1 6

    4 . 0 0

    P e r f o r m a n c e

    C o h e n

    1 9 9 3

    S G P P

    0 . 1

    6

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    A c t

    i o n /

    4

    1 6 . 6

    7

    A f f e c

    t i v e

    p e r f o r m

    i n g

    C o h e n

    1 9 9 3

    P P W C

    0 . 1

    7

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    A c t

    i o n /

    4

    1 6 . 6

    7

    A f f e c

    t i v e

    p e r f o r m

    i n g

    C o h e n

    1 9 9 3

    S G P P

    0 . 1

    3

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    A c t

    i o n /

    4

    1 6 . 6

    7

    P r o c e s s

    p e r f o r m

    i n g

    ( c o n t i n u e

    d )

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    24/43

    203

    T a b l e

    3 ( c o n t

    i n u e

    d )

    S t u d y

    D e s

    i g n

    E f f e c t

    T e a m

    N u m

    b e r

    A v e r a g e

    C r i t e r

    i o n

    A u t h o r ( s )

    Y e a r

    T y p e

    S i z e , r

    G S

    I R

    P S

    R C

    T y p e

    o f T e a m s

    T e a m S i z e

    D e s c r i p t i o n

    C o h e n

    1 9 9 3

    P P W C

    0 . 1

    8

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    A c t

    i o n /

    4

    1 6 . 6

    7

    P r o c e s s

    p e r f o r m i n g

    D i o n n e

    1 9 9 8

    S G P P

    0 . 2

    0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    5 4

    4 . 5 0

    P r o c e s s

    D i o n n e

    1 9 9 8

    S G P P

    0 . 0

    5

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    5 4

    4 . 5 0

    P e r f o r m a n c e

    E d e n

    1 9 8 6

    P P W C

    0 . 1

    3

    0 . 3 3

    0 . 3 3

    0 . 0 0

    0 . 3 3

    A c t i o n /

    1 6

    3 0 . 0

    0

    P e r f o r m a n c e

    p e r f o r m i n g

    E d e n

    1 9 8 6

    P P W C

    0 . 3

    6

    0 . 3 3

    0 . 3 3

    0 . 0 0

    0 . 3 3

    A c t

    i o n /

    1 6

    3 0 . 0

    0

    P r o c e s s

    p e r f o r m

    i n g

    F r i e d l a n

    d e r

    1 9 6 7

    P P W C

    0 . 0

    0

    0 . 0 0

    0 . 5 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    1 2

    1 0 . 0

    0

    A f f e c

    t i v e

    F r i e d l a n

    d e r

    1 9 6 7

    P P W C

    0 . 1

    6

    0 . 0 0

    0 . 5 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    1 2

    1 0 . 0

    0

    P r o c e s s

    F r i e d l a n

    d e r

    1 9 6 7

    P P W C

    0 . 2

    1

    0 . 0 0

    0 . 5 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    1 2

    1 0 . 0

    0

    P e r f o r m a n c e

    G i b s o n

    2 0 0 1

    P P W C

    0 . 2

    4

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    S e r v

    i c e

    7 1

    5 . 0 0

    A f f e c

    t i v e

    G i b s o n

    2 0 0 1

    P P W C

    0 . 1

    2

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    S e r v

    i c e

    7 1

    5 . 0 0

    P e r f o r m a n c e

    H o w a r

    d

    1 9 7 9

    P P W C

    0 . 2

    5

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    S e r v

    i c e

    3

    9 . 6 7

    A f f e c

    t i v e

    H o w a r

    d

    1 9 7 9

    P P W C

    0 . 4

    0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    S e r v

    i c e

    3

    9 . 6 7

    P e r f o r m a n c e

    H u a n g , W

    e i ,

    2 0 0 2

    P P W C

    0 . 9

    7

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    P r o d u c t i o n

    4 8

    5 . 0 0

    A f f e c t i v e

    W a t s o n , & T a n

    H u a n g , W e i ,

    2 0 0 2

    P P W C

    0 . 9

    7

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    4 8

    5 . 0 0

    P r o c e s s

    W a t s o n ,

    & T a n

    H u a n g , W

    e i ,

    2 0 0 2

    P P W C

    0 . 6

    8

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    4 8

    5 . 0 0

    P e r f o r m a n c e

    W a t s o n ,

    & T a n

    H u g

    h e s ,

    R o s e n

    b a c h ,

    1 9 8 3

    S G P P

    0 . 5

    0

    0 . 5 0

    0 . 5 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    2

    7 4 . 0

    0

    A f f e c

    t i v e

    & C l o v e r

    H u g

    h e s ,

    R o s e n

    b a c h ,

    1 9 8 3

    P P W C

    0 . 2

    3

    0 . 5 0

    0 . 5 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    2

    6 8 . 0

    0

    A f f e c

    t i v e

    & C l o v e r

    ( c o n t i n u e

    d )

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    25/43

    204

    T a b l e

    3 ( c o n t

    i n u e

    d )

    S t u d y

    D e s i g n

    E f f e c t

    T e a m

    N u m b e r

    A v e r a g e

    C r i t e r i o n

    A u t h o r ( s )

    Y e a r

    T y p e

    S i z e , r

    G S

    I R

    P S

    R C

    T y p e

    o f T e a m s

    T e a m S i z e

    D e s c r i p t i o n

    H u g h e s , R o s e n b a c h

    ,

    1 9 8 3

    S G P P

    0 . 5

    2

    0 . 5 0

    0 . 5 0

    0 . 0 0

    0 . 0 0

    P r o j e c t

    2

    7 4 . 0

    0

    C o g n i t i v e

    & C l o v e r

    H u g

    h e s ,

    R o s e n

    b a c h ,

    1 9 8 3

    P P W C

    0 . 0

    3

    0 . 5 0

    0 . 5 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    2

    6 8 . 0

    0

    C o g n i

    t i v e

    & C l o v e r

    K i m b e r l e y &

    1 9 7 5

    S G P P

    0 . 4

    8

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c t i o n

    1 8 0

    1 0 . 0

    0

    A f f e c t i v e

    N i e l s e n

    K i m b e r l e y

    &

    1 9 7 5

    S G P P

    0 . 3

    8

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    1 8 0

    1 0 . 0

    0

    P r o c e s s

    N i e l s e n

    K i m b e r l e y

    &

    1 9 7 5

    S G P P

    0 . 1

    4

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    9 0

    1 0 . 0

    0

    P e r f o r m a n c e

    N i e l s e n

    K i m b e r l e y

    &

    1 9 7 5

    S G P P

    0 . 1

    9

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    P r o d u c

    t i o n

    9 0

    1 0 . 0

    0

    P e r f o r m a n c e

    N i e l s e n

    L o n g e n e c k e r ,

    1 9 9 4

    S G P P

    0 . 8

    3

    1 . 0 0

    0 . 0 0

    0 . 0 0

    0 . 0 0

    P r o d u c t i o n

    2

    4 5 . 0

    0

    P e r f o r m a n c e

    S c a z z e r o , &

    S t a n s f i e l d

    M i l l e r

    1 9 9 7

    S G P P

    0 . 1

    8

    0 . 1 0

    0 . 1 0

    0 . 7 0

    0 . 1 0

    A c t i o n /

    1 6

    7 . 3 8

    A f f e c t i v e

    p e r f o r m

    i n g

    M i l l e r

    1 9 9 7

    S G P P

    0 . 0

    6

    0 . 1 0

    0 . 1 0

    0 . 7 0

    0 . 1 0

    A c t

    i o n /

    1 6

    7 . 3 8

    P r o c e s s

    p e r f o r m

    i n g

    M i t c h e l l

    1 9 8 6

    S G P P

    0 . 7

    2

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    1 2

    4 . 5 0

    A f f e c

    t i v e

    M i t c h e l l

    1 9 8 6

    S G P P

    0 . 2

    5

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    1 2

    4 . 5 0

    A f f e c

    t i v e

    M i t c h e l l

    1 9 8 6

    P P W C

    0 . 7

    8

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    P r o j e c

    t

    9

    4 . 5 0

    A f f e c

    t i v e

    M o r r i s o n

    &

    1 9 8 0

    S G P P

    0 . 6

    7

    0 . 0 0

    . 5 0

    0 . 0 0

    0 . 5 0

    E x e c u t

    i v e /

    2

    1 2 . 0

    0

    A f f e c

    t i v e

    S t u r g e s

    m a n a g e m e n

    t

    M o r r i s o n &

    1 9 8 0

    S G P P

    0 . 4

    7

    0 . 0 0

    0 . 5 0

    0 . 0 0

    0 . 5 0

    E x e c u t i v e /

    2

    1 2 . 0

    0

    P r o c e s s

    S t u r g e s

    m a n a g e m e n

    t

    ( c o n t i n u e

    d )

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    26/43

    205

    T a b l e

    3 ( c o n t

    i n u e

    d )

    S t u d y

    D e s i g n

    E f f e c t

    T e a m

    N u m b e r

    A v e r a g e

    C r i t e r i o n

    A u t

    h o r ( s )

    Y e a r

    T y p e

    S i z e , r

    G S

    I R

    P S

    R C

    T y p e

    o f T e a m s

    T e a m

    S i z e

    D e s c r i p

    t i o n

    M o r r i s o n &

    1 9 8 0

    S G P P

    0 . 4

    7

    0 . 0 0

    0 . 5 0

    0 . 0 0

    0 . 5 0

    E x e c u t i v e /

    2

    1 2 . 0

    0

    P e r f o r m a n c e

    S t u r g e s

    m a n a g e m e n

    t

    W e g e n a s t

    1 9 8 3

    S G P P

    0 . 3

    9

    0 . 0 0

    0 . 2 5

    0 . 5 0

    0 . 2 5

    S e r v i c e

    4

    6 . 0 0

    A f f e c t i v e

    W e x

    l e r

    1 9 9 0

    S G P P

    0 . 2

    4

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    S e r v

    i c e

    4

    6 . 0 0

    P r o c e s s

    W e x

    l e r

    1 9 9 0

    S G P P

    0 . 2

    2

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    S e r v

    i c e

    4

    4 . 5 0

    P r o c e s s

    W e x

    l e r

    1 9 9 0

    P P W C

    0 . 3

    9

    0 . 0 0

    0 . 0 0

    1 . 0 0

    0 . 0 0

    S e r v

    i c e

    4

    5 . 5 0

    P r o c e s s

    W e x

    l e r

    1 9 9 0

    P P W C

    0 . 4

    6

    0 . 0 0

    1 . 0 0

    0 . 0 0

    0 . 0 0

    S e r v

    i c e

    4

    4 . 7 5

    P r o c e s s

    W o o

    d m a n

    &

    1 9 8 0

    P P W C

    0 . 1

    0

    0 . 5 0

    0 . 0 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    6 7

    3 . 5 0

    C o g n i

    t i v e

    S h e r w o o

    d

    W o o

    d m a n

    &

    1 9 8 0

    P P W C

    0 . 1

    0

    0 . 5 0

    0 . 0 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    6 7

    3 . 5 0

    A f f e c

    t i v e

    S h e r w o o

    d

    W o o

    d m a n

    &

    1 9 8 0

    P P W C

    0 . 2

    3

    0 . 5 0

    0 . 0 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    6 7

    3 . 5 0

    P r o c e s s

    S h e r w o o

    d

    W o o

    d m a n

    &

    1 9 8 0

    P P W C

    0 . 1

    5

    0 . 5 0

    0 . 0 0

    0 . 5 0

    0 . 0 0

    P r o j e c

    t

    6 7

    3 . 5 0

    P e r f o r m a n c e

    S h e r w o o d

    N o t e :

    G S

    = g o a l - s e

    t t i n g

    t e a m

    b u i l d i n g ;

    I R =

    i n t e r p e r s o n a

    l r e l a t

    i o n s

    t e a m

    b u i l d i n g ;

    P S = p r o

    b l e m - s o l v i n g

    t e a m

    b u i l d i n g ;

    R C = r o

    l e - c

    l a r i f

    i c a t

    i o n

    t e a m

    b u i l d i n g ; P P W C

    =

    p r e p o s t w i t h c o n t r o l g r o u p c o m p a r i s o n ; S G P P

    = s i n g l e - g r o u p p r e p o s t c o m p a r i s o n .

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    27/43

    206 Small Group Research

    Funnel plot. The funnel plot (Light & Pillemer, 1984) is a simple visualtool (i.e., scatterplot) for detecting the presence of publication or other

    availability bias in meta-analysis. To apply this technique, effect sizes aregraphed on the horizontal axis, whereas study sample sizes ( N ) are graphedon the vertical axis. The idea is that, in the absence of bias, the results of small sample studies will scatter widely at the bottom of the graph, with thespread narrowing for larger N studies; thus taking the form of an invertedfunnel (Hunter & Schmidt, 2004). If publication bias is present in the data,the figure will be asymmetrical and often truncated in the lower left-handportion of the scatterplot. As seen in Figure 2, the data from primary stud-

    ies included in the current meta-analysis form a somewhat regular funnel.Thus, it appears that the small sample studies are spread rather evenlyacross the effect-size continuum, making the possibility of publication oravailability bias less of a concern in this research.

    Meta-Analytic Results

    The meta-analytic results for the hypotheses investigated in this research

    are presented in Tables 4 through 6. These tables show a number of piecesof information, including: the number of teams in each analysis ( N ); thenumber of independent effect sizes (correlations) in each analysis ( k ); themean weighted observed correlation ( r ); the 80% confidence interval forthat correlation; the estimated true score correlation ( ); the standarddeviation of this true score correlation ( SD ); the 80% credibility interval(10% CV and 90% CV); and the percentage of variance accounted for bystatistical artifacts. Confidence and credibility intervals are useful as aids inproviding the best estimate of the true nature of the relationships betweentwo variables (Whitener, 1990). Confidence intervals are applied to observedscores, center on a single mean score, and reflect the effects of samplingerror. Credibility intervals, on the other hand, are particularly meaningfulbecause they take into account information about the distribution of effectsizes after other research artifacts have been taken out. Credibility intervalscan also be useful for determining whether moderators are operating(Whitener, 1990). Similarly, the percentage of variance estimate providesinformation concerning the variance in observed correlations that is theresult of statistical artifacts. In general, the higher the percentage, the morecertain we can be that additional moderators are not operating. The followingsections more closely examine the results for the individual hypotheses thatwere put forward in this research.

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    28/43

    Team-building effectiveness. The omnibus test representing all team-

    building interventions and outcomes resulted in a significant tendency forthese interventions to improve team outcomes. Specifically, the mean truescore correlation of .31 represents a moderate effect (10% CV = .11; 90%CV = .52) and provided support for Hypothesis 1. This analysis included 26independent effect sizes and was based on a total sample size of 579 teams.

    Klein et al. / Team Building 207

    Figure 2Funnel Plot for Detecting the Possibility of

    Publication or Availability Bias

    0.500 0.250 0.000 0.250 0.500 0.750 1.000

    Effect Size

    0

    20

    40

    60

    80

    100

    N

    u m

    b e r o

    f T e a m s

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    29/43

    Here, cognitive, affective, process, and performance outcomes were aver-aged for each primary study before figuring into the combined estimate. Theonly exception was for six of the primary studies that reported the results of team-building interventions for separate samples within the same study. For

    these instances only, there were multiple correlations from single studiesthat contributed to the combined estimate. However, care was taken toensure the assumption of independent effect sizes was not violated.

    Investigation of separate outcomes. From the overall database of 60 effectsizes, this research also assessed the impact of team building on distinct

    208 Small Group Research

    Table 4Analysis of the Effectiveness of Team Building

    Based Upon Outcome Type

    Outcome CI r CI r 10% 90% % Var.Type N k r 10% 90% SD

    b CV CV Acct. c

    Cognitive 71 3 .11 .06 .17 .13 .00 .13 .13 1,394.24Affective 482 19 .41 .34 .49 .44 .18 .21 .66 55.42Process 485 20 .39 .31 .46 .44 .20 .18 .69 54.04Performance 524 18 .25 .16 .33 .26 .23 .03 .55 45.11All 579 26 .28 .22 .29 .31 .16 .11 .52 69.35

    outcomesAll 1,562 60 .34 .29 .38 .37 .21 .10 .64 50.64

    outcomes a

    Note: k = number of correlations coefficients on which each distribution was based; r = meanobserved correlation; CI r 10% = lower bound of the confidence interval for observed r ; CI r 90% = upper bound of the confidence interval for observed r ; = estimated true correlationbetween the predictor construct and the relevant criterion (fully corrected for measurementerror in both the predictor and the criterion); SD = estimated standard deviation of the truecorrelation; 10%CV = lower bound of the credibility interval for each distribution; 90% CV =

    upper bound of the credibility interval for each distribution; % var. acct. = percentage of observed variance accounted for by statistical artifacts.a. This result represents the entire database and patently violates the assumption of indepen-dent effect sizes as many studies contributed more than one effect size. It is shown here forillustrative purposes only.b. The SD being zero indicates that the real variance of the true correlation is zerothere isonly one value of the true correlation underlying all the studies. It is a consequence of thepercentage of variance accounted for estimate being greater than 100%. This result also indi-cates that there should be no additional moderators operating for this analysis.c. The percentage of variance explained estimate being greater than the theoretical maximum

    value of 100% indicates that sampling error and other study artifacts explain all of theobserved variation in the effect sizes (correlations) across studies. The estimated value isgreater than 100% because of second-order sampling error.

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    30/43

  • 7/30/2019 Small Group Research-2009

    31/43

    suggested an estimated true score correlation of .44 ( k = 20 correlations; N = 485 teams). The 80% credibility interval for this finding ranged from.18 to .69. Finally, for the analysis on performance outcomes, the resultsindicated an estimated true score correlation of .26 ( k = 18; N = 52).

    All told, the results of the analyses focused on the influence of teambuilding on separate outcomes provided moderate support for Hypothesis 2a.Specifically, team building appeared to be effective for improving each of the four outcomes. However, it should be pointed out that the credibilityinterval for performance outcomes barely included 0 (10% CV = .03; 90%CV = .55). At the same time, Hypothesis 2b received only partial support.Although it was posited that team building would be most effective forimproving affective outcomes, the results from this study suggested thatteam building was slightly more effective for improving process outcomes( = .439 vs. .437). However, given the considerable overlap in both confi-dence and credibility intervals for these analyses (see Table 4), it is difficultto determine with any certainty which outcome type is most greatly affectedby team-building interventions. Moreover, team building did appear to be

    210 Small Group Research

    Table 6Analysis of the Effectiveness of Team Building Based Upon Team Size

    Team CI r CI r 10% 90% % Var.Size N k r 10% 90% SD

    a CV CV Acct. b

    Small 178 7 .26 .15 .37 .28 .12 .12 .44 74.22Medium 340 10 .25 .14 .36 .27 .21 .00 .54 45.72Large 61 9 .54 .44 .64 .66 .00 .66 .66 197.54

    Note: k = number of correlations coefficients on which each distribution was based; r = meanobserved correlation; CI r 10% = lower bound of the confidence interval for observed r ; CI r 90% = upper bound of the confidence interval for observed r ; = estimated true correlationbetween the predictor construct and the relevant criterion (fully corrected for measurementerror in both the predictor and criterion); SD = estimated standard deviation of the true cor-relation; 10% CV = lower bound of the credibility interval for each distribution; 90% CV =upper bound of the credibility interval for each distribution; % var. acct. = percentage of observed variance accounted for by statistical artifacts.a. The SD being zero indicates that the real variance of the true correlation is zerothere isonly one value of the true correlation underlying all the studies. It is a consequence of the per-centage of variance accounted for estimate being greater than 100%. This result also indicatesthat there should be no additional moderators operating for this analysis.b. The percentage of variance explained estimate being greater than the theoretical maximumvalue of 100% indicates that sampling error and other study artifacts explain all of theobserved variation in the effect sizes (correlations) across studies. The estimated value isgreater than 100% because of second-order sampling error.

    at Uni Babes-Bolyai on January 13, 2013sgr.sagepub.comDownloaded from

    http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/http://sgr.sagepub.com/
  • 7/30/2019 Small Group Research-2009

    32/43

    more effective for improving affective outcomes than either cognitive orperformance outcomes ( s = .13 and .26, respectively).

    Focus of team building. A total of 39 correlations were meta-analyzed toassess the differential impact of various team-building components. For thisanalysis, the interventions described in primary studies were closely scruti-nized to determine which component(s) of team building was the majorfocus. In some instances it was determined that the intervention had amultiple focus on two or more separate components. Therefore, in accu-mulating the study results, correlations from primary studies were some-

    times included in multiple categories for the purposes of analysis so thatthere was some degree of overlap regarding the analysis of team-buildingcomponents. Table 5 presents the results of these analyses.

    Ten effect sizes, representing 258 teams, were meta-analyzed for theinvestigation into the efficacy of the goal-setting component of team building.The estimated true score correlation was .37, indicating a moderate effect onthe combined set of team outcomes. The remaining team-building compo-nents, namely, interpersonal relations, problem solving, and role clarification,

    also resulted in moderate effect sizes. The estimated true mean score cor-relations were .26 ( k = 13, N = 140), .24 ( k = 11, N = 326), and .35 ( k = 5, N = 54), respectively. The credibility intervals for these analyses were alsocalculated (see Table 5). All calculated intervals o