educational management administration & leadership-2014-orphanos-learning leadership matters

Upload: alanz123

Post on 07-Jul-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    1/21

     Article

    Learning leadership matters:The influence of innovative

    school leadership preparationon teachers’ experiencesand outcomes

    Stelios Orphanos and Margaret Terry Orr 

    Abstract

    School leadership has been shown to exert a positive but mostly indirect influence on school andstudent outcomes. Currently, there is great interest in how quality leadership preparation isrelated to leadership practice and improved teacher outcomes. The purpose of the study was tounderstand the moderating influence of leadership preparation on leadership practices andteachers’ job collaboration, leadership and satisfaction. The study features a non-experimentaldesign that combined data from a US study of exemplary leadership preparation and a nationallyrepresentative sample of elementary school principals. The sample consists of 175 teachers whoseprincipals were prepared in an exemplary leadership program and 589 teachers whose principals

    were traditionally prepared. Data were analyzed with structural equation techniques and resultshave shown that innovative leadership preparation exerts a statistically significant direct effecton principalship leadership practices and a significant indirect effect on teacher collaboration andsatisfaction. The results provide important policy implications. Investments in leadership prepara-tion influences leadership practices that yield more positive teacher work conditions, which areessential for improve student learning and as a result leadership preparation program design andimprovement can play an important role in district reform and school improvement.

    Keywords

    leadership effects, leadership preparation, program evaluation teacher outcomes

    Introduction

    In the USA and elsewhere, educators and policymakers strive to make a connection between lead-

    ership preparation and school outcomes (Shelton, 2009; Wallace Foundation, 2006). The reason is

    to consider whether investments in preparation – through policy requirements, guidelines and 

    Corresponding author:

    Stelios Oprhanos, Department of Primary Education, Frederick University, Cyprus.Email: [email protected]

    Educational Management

    Administration & Leadership

    2014, Vol. 42(5) 680–700ª The Author(s) 2013

    Reprints and permission:

    sagepub.co.uk/journalsPermissions.nav

    DOI: 10.1177/1741143213502187

    emal.sagepub.com

    680

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://www.sagepub.co.uk/journalsPermissions.navhttp://emal.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://emal.sagepub.com/http://www.sagepub.co.uk/journalsPermissions.nav

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    2/21

    funding – can be instrumental, along with other related policies, in improving schools and student

    learning. In recent years, many new US federal policies, often aimed at improving low-performing

    schools, focus attention on the quality and effectiveness of leadership preparation (US Department

    of Education, 2009, 2010).

    As discussed below, a large and growing body of research demonstrates how effective lead-ership practices influence teacher effectiveness and, together, how these influence school out-

    comes. To unpack the influence of leadership preparation on improved school outcomes, the

    ways in which leadership preparation influence the principal–teacher relationship must be inves-

    tigated first.

    How School Leaders Influence Teachers

    Various researchers have tried to sort out the influence path in the principal–teacher–student

    achievement relationship to identify essential principal practices and teacher experiences, as

    well as to identify potential moderating and mediating factors (Bryke et al., 2010; Leithwood and Jantzi, 2008; Thoonen et al., 2011). Critically, such research identifies how leader prac-

    tices influence teachers and, together, how teachers and leaders influence school outcomes.

    Over the past 20 years, research in the USA and elsewhere has consistently shown that school

    leaders, by exercising instructional and transformational leadership practices, have a positive

     but indirect influence on school and student outcomes (Hallinger and Heck, 1996; Hoy et al.,

    2002; Jacobson and Bezzina, 2008; Leithwood and Jantzi, 2008; Marzano et al., 2005; Robin-

    son et al., 2008). Specifically, effective instructional and transformational leadership practices

    are strongly associated with improved teacher engagement and commitment and organiza-

    tional culture and effectiveness, which in turn are positively associated with improved student

    outcomes. While the size of this effect has been debated among these studies, the existence of leadership’s contribution to student outcomes has not. While measured in different ways,

    there is strong agreement that principal practices combining transformational and instructional

    leadership – direction-setting, individual teacher support and encouragement and organiza-

    tional support – are most influential for teacher engagement and effectiveness (Geijsel

    et al., 2001; Leithwood and Jantzi, 2008; Thoonen et al., 2011). Among the teacher outcomes

    and experiences most commonly affecting student learning and influenced by leadership qual-

    ity are teacher collaboration, professional learning, distributed leadership, efficacy, instruc-

    tional practices and satisfaction.

    Leithwood and Jantzi (2008), drawing on a large-scale study of principals, teachers and student

    outcomes, explored the influence of leadership practices on teachers and student outcomes. Their findings validate the nature of effective transformational leadership practices, their direct effect on

    school (which includes teacher decision-making, opportunities for professional development, and 

    a collaborative culture, among other factors) and classroom conditions, and their indirect influence

    on student achievement outcomes.

    Geijsel et al. (2001) conducted a survey of Dutch teachers about conditions fostering the imple-

    mentation of large-scale innovation, focusing on the principal–teacher relationship. They found 

    that teachers’ perceptions of their principals’ transformational leadership, their participation in

    decision making, their sense of uncertainty and professional development activities influenced 

    how much they changed their practices. Similarly, Thoonen et al. (2011), in a study of Dutch teach-

    ers, examined the relationship between these teacher factors and teachers’ use of constructivist and differentiated instructional practices, and the mediating influence of transformational leadership

    Orphanos and Orr: Learning leadership matters   681

    681

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    3/21

     practices. Their results were positive, demonstrating that transformational leadership practices

    directly affect teachers’ professional learning, teacher collaboration and teacher participation in deci-

    sion making, and through these, teachers’ sense of well-being and quality instructional practices.

    The Role of Leadership Preparation

    To improve leadership quality, policymakers, researchers and educators have turned to leader-

    ship preparation in order to understand how and in what ways preparation programs are influ-

    ential. In the USA, licensure for public school leaders (typically termed principals) usually

    requires completion of an approved advanced degree program in educational leadership, a

    teaching degree and at least three years’ teaching experience (Anthes, 2004). Other countries

    vary widely in the nature of their school leader requirements (Huber, 2004). In recent years,

    concern has grown internationally over how best to define quality leadership preparation and 

    improve its effectiveness, as a means of developing better school leaders (Huber, 2004; Jacob-son et al., 2002, 2011; Wallace Foundation, 2003).

    While policymakers and educators have been frustrated by the limited research on exemplary

    leadership preparation and its impact on leadership practices and schools (Lumby et al., 2008;

    McCarthy and Forsyth, 2009), recent results have been promising. First, researchers have docu-

    mented innovative program models (Bush and Jackson, 2002; Copland, 2001; Earley and Evans,

    2004; Glasman, 1997; Jacobson et al., 2011; Twale and Kochan, 2000; Walker and Dimmock,

    2006), and synthesized research on quality program features (Davis et al., 2005; Jackson and Kel-

    ley, 2002). Such research has shown that exemplary, innovative programs share common features.

    These include: having a well-defined theory of leadership for school improvement that frames and 

    integrates the program features around a shared vision, philosophy or set of principles; beingstandards-based; recruiting and selecting candidates based on leadership potential; having a coher-

    ent curriculum that addresses effective instructional leadership and school improvement; using

    adult learning theory, developmental learning principles or active learning strategies; offering

    quality internships and other field-based experiences that provide intensive leadership develop-

    ment; using cohort structures or other supports to enhance learning; utilizing assessments for 

    candidate and program continuous improvement; engaging knowledgeable faculty with relevant

    field-based experiences; and engaging in collaborations or partnerships with local districts in pro-

    gram development and delivery.

    Until recently, only scant research existed on program outcomes (Orr, 2009). The investigation

    of the relationship between leadership preparation and graduate and school outcomes has beenmethodologically challenging, primarily because of the time lag between preparation, career 

    advancement to a principalship position and school change. Moreover, programs typically prepare

    small numbers of candidates who become dispersed across different districts as they advance to

     principal positions. Finally, most programs lack resources to track graduates and compile evidence

    of their graduates’ effects on their schools or to compare the effects of different preparation

    approaches (Orr, 2009). Available research has been promising, showing positive relationships

     between innovative, research-based leadership preparation approaches and graduate outcomes

    (Darling-Hammond et al., 2010; Milstein and Kruger, 1997; Orr, 2011; Orr and Barber, 2007),

     principal hiring practices (Fuller et al., 2011), and principal practices and school improvement

    work (Orr and Orphanos, 2011). Such studies, however, have been based on principals’ perceptionsof both their preparation and their leadership practices and school improvement.

    682   Educational Management Administration & Leadership 42(5)

    682

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    4/21

    A recent promising body of work has begun to examine the relationship between principals’

    graduate preparation and teachers’ perceptions of their leadership practices (Korach et al., 2011;

    Leithwood et al., 1996; Newman and Osterman, 2011). Leithwood et al. (1996) were able to

     positively associate teacher feedback with selected preparation program features, where their prin-

    cipals had been prepared. Specifically, they found that some innovative program features – instruc-tional strategies, cohort membership and program content – were most predictive of teacher 

     perceptions of principals’ leadership effectiveness. The other studies used teacher ratings of prin-

    cipals as feedback on leadership preparation program features and design, and found similar pos-

    itive results. Korach et al. (2011) and Newman and Osterman (2011) similarly found that teachers’

     perceptions of areas of effective principal practices were positively associated with the principals’

     perceptions of the strengths of their preparation content and experiences. Thus, from the percep-

    tions of both principals and teachers, preparation appears to positively influence the nature of lead-

    ership practices.

    Other Influences on Teacher Outcomes

    While principal leadership has a strong, direct influence on teacher collaboration and job satisfac-

    tion, other in-school factors, which principals can influence, have been found to contribute to these

    outcomes as well. These are opportunities for professional development and teacher leadership

    (Leithwood and Mascall, 2008). These relationships have been studied in a variety of ways, both

    for how they influence each other and how they contribute to student learning. In their large-scale

    study of schools’ influence on student achievement, Leithwood and Mascall (2008) found that col-

    lective leadership – engaging teachers, parents and students as well as principals – explained a sig-

    nificant proportion of variation in student achievement across schools. Hallinger and Heck (2010)

    also found in their large-scale study in one USA state that there were significant direct effects of collaborative leadership (defined as both principal leadership and distributed teacher leadership)

    on change in the schools’ academic capacity and indirect effects on rates of growth in student read-

    ing achievement. Wahlstrom and Seashore-Louis (2008), in their US national study of teachers and 

    schools, found that the presence of shared leadership (among teachers and their principal) and pro-

    fessional community (reflecting teacher cooperation and collaboration) explains the strength of 

    effective teacher practice (based on three types of instructional behavior). Similarly, based on sur-

    veys of secondary school teachers in Belgium, Hulpia et al. (2011) found that teachers’ commit-

    ment was strongly influenced by the quality of supportive leadership, cooperation within the

    leadership team and opportunities for participative decision making. How principals structure pro-

    fessional learning opportunities for teachers also contributes to their improved effectiveness(Youngs and King, 2002). In their qualitative study of urban elementary schools, Youngs and King

    (2002) found that effective principals can sustain high levels of capacity by establishing trust, cre-

    ating structures that promote teacher learning, and supporting learning by engaging external exper-

    tise or helping teachers work cooperatively. Finally, Pashiardis et al. (2011), in their multi-case

    study analysis of five effective rural Cyprus principals, found that successful principals both

    strongly promoted professional learning and networked leadership for school improvement.

    Parental Support

    The role of parents in the principal–teacher–student relationship is less well understood in researchon school improvement and in-school factors that influence student learning. In his review of 

    Orphanos and Orr: Learning leadership matters   683

    683

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    5/21

    research on effective school correlates, Edmonds (1979) drew attention to the quality of parental

    involvement (among other factors) for improving schools, as confirmed in other correlational stud-

    ies (Lezotte, 1991). Recent large-scale Chicago school research found that the quality of parent and 

    community relationships positively complements other school-related supports in improving stu-

    dent achievement (Bryk et al., 2010; Sebring et al., 2006). Specifically, Sebring et al. (2006) found that schools with strong parent involvement were much more likely to improve in students’ math

    and reading performance than were schools weak on this measure.

    Other researchers have begun to explore how the quality of parental involvement contributes to

    teacher and leader effectiveness. For example, in surveying teachers from 80 mid-Atlantic schools,

    Tschannen-Moran (2009) found that their perceptions of colleagues’ professionalism were influ-

    enced by perceptions of principal trust and professionalism moderated in part by their trust in parents.

    Implications

    Given the importance of school leadership to improving teacher quality and effectiveness for improved student learning, closer study is needed of the relationship between quality leadership

     preparation, leadership practices and improved teacher outcomes. Prior research points to the pos-

    itive influence of the positive relationship among teacher engagement in professional develop-

    ment, teacher collaboration, teachers’ role in decision making and job satisfaction – all of 

    which are likely to be influenced by quality leadership practices. Drawing on the above research,

    it appears that quality leadership preparation programs would have a positive, but indirect influ-

    ence on teacher participation in professional development, teacher collaboration, participation

    in decision making and job satisfaction in schools led by program graduates, as mediated through

     principals’ greater use of transformational leadership practices. It is also likely that the quality of 

    teacher-perceived parental involvement would have a separate, mediating influence on the princi- pal–teacher relationship.

    Study Purpose, Conceptual Model and Hypotheses

    The purpose of this study was to understand the moderating influence of leadership preparation on

    leadership practices and teachers’ cooperation, distributed leadership and job satisfaction. The

    hypothesized model is shown in Figure 1.

    This investigation is adapted from two earlier studies. One is Leithwood and Jantzi’s (2008)

    mediating-effects framework for transformational leadership, in which specific leadership prac-

    tices influence student learning outcomes through their effects on teachers, specifically teacher engagement and commitment; the other is Thoonen et al. (2011) model, as applied to teacher 

    instructional practices. We limited our investigation to two teacher outcomes: job satisfaction and 

    teacher collaboration. Drawing on the work of Geijsel et al. (2001) and Thoonen et al. (2011), we

    modified our investigation further to include, as mediating effects, leadership influences on these

    two teacher outcomes through the extent of teacher-distributed leadership and teacher engagement

    in professional development. We extended this model to include the moderating influence of inno-

    vative leadership preparation, as shown in the early research of Leithwood et al. (1996) on prin-

    cipal practices and the principal–teacher relationship. Finally, we extended the model further to

    include the external influence of parent support of teachers’ work, as suggested by previous

    research (Bryk et al., 2010; Sebring et al., 2006; Tschannen-Moran, 2009), suggesting that it would influence principal leadership practices as well as teacher satisfaction.

    684   Educational Management Administration & Leadership 42(5)

    684

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    6/21

    Taken together, this investigation tested four research hypotheses.

    Hypothesis 1:  The more positive teachers’ rating of principal leadership, the greater their 

     perceived job satisfaction and teacher leadership and collaboration.

    Hypothesis 2: Whether principals had innovative preparation experiences will have a mod-erating influence on the effects of perceived leadership practices on selected teacher out-

    comes (teachers’ perceived job satisfaction and teacher leadership and collaboration).

    Hypothesis 3: The extent of participation in different types of professional development and 

    of distributed leadership in the school will mediate the effects of perceived leadership pr-

    actices on teachers’ perceived job satisfaction and collaboration.

    Hypothesis 4: The extent of positive working conditions (parental support) will mediate the

    effect of perceived leadership practices on teachers’ perceived job satisfaction, engagement,

    and collaboration.

    Method

    We used a nonexperimental research design, drawing on quantitative survey research methods and 

    structural equation modeling techniques. Data were collected as part of a national study of lead-

    ership preparation and its impact on leadership practices and school improvement (Darling-

    Hammond et al., 2009). The study (referred to here as the Stanford Leadership Study) documented 

    six exemplary preparation and in-service programs and used national samples of principals and 

    national survey data of teachers as comparisons for programs’ graduates and their teachers.1 The

    teacher survey data provided an opportunity to investigate and compare the experiences of the sam-

     ple of the graduates’ teachers with other teachers nationally on how their principals’ preparationand development impacted their work and professional experiences.

    INNOV

    PDEV

    PSUPP

    DISLEAD

    PLEAD

    TCOLL

    TSAT

    Figure 1. Hypothesized model of the relationship between participation in an innovative leadership pre-

    paration program and teacher satisfaction.Notes: INNOV ¼ participation in an innovative preparation program; PLEAD ¼ principals’ perceived lead-ership; PSUPP ¼ parental support to school; PDEV ¼ extent of teachers’ participation of teachers’ in pro-fessional development opportunities; DISLEAD ¼ teachers’ distributed leadership; TCOLL ¼ teachercollaboration; TSAT¼ teacher satisfaction.

    Orphanos and Orr: Learning leadership matters   685

    685

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    7/21

    Sample

    This study integrated three groups of teachers collected from two different studies to investigate

    the leadership–teacher outcome relationship. The first two groups were drawn from all teachers

    in 16 schools selected four cities and one rural (but population-dense) area as part of the Stanford 

    Leadership Study. These schools were selected based on their principals’ recent completion of one

    of six innovative leadership preparation program or leadership development programs (or ones that

    reflect a continuum of preparation and development). The leadership programs had been selected 

     based on their professional reputation for having the quality program features described above, the

    existence of which were confirmed by the study (Darling-Hammond et al., 2010), and program

    effectiveness information. Principals who completed these programs were more likely than a

    national sample of principals to rate their preparation highly for having purposeful, targeted 

    recruitment; a coherent curriculum; active, problem-based learning; a cohort structure and mentor-

    ing and advising to support candidate learning; well-designed and supervised internships; and 

    strong relationships between local districts and universities.

    The innovative in-service programs were selected through a similar process, with attention to

     programs that were part of a district-supported continuum of leadership preparation and develop-

    ment and the availability of information on program effectiveness. Study results showed that new

    and experienced principals who had participated in these programs were more likely than a

    national sample of principals to report improved organizational outcomes and teacher effective-

    ness, and to have a stronger commitment to the principalship (Darling-Hammond et al., 2010).

    The principals at the selected schools also had at least one year’s experience as principal; only

    elementary schools were included. Some had participated in only the innovative preparation pro-

    gram and some only the innovative in-service leadership development program. The teachers at

    their schools were surveyed in 2005 during faculty meetings or other means of distributing surveys

    on site. Based on the schools’ estimates of the number of teachers in these schools and our response

    rates, the majority of classroom teachers had responded. The first group of teachers in the Stanford 

    Leadership Study consisted of 165 teachers in schools led by graduates of an innovative prepara-

    tion program, while the second group consisted of 75 teachers in schools led by graduates who only

    had innovative in-service leadership development (see Table 1).

    The third group of teachers was drawn from the 1999–2000 teacher survey of the federal School

    and Staffing Survey (SASS) (NCES, 2006). SASS uses a stratified probability sample design based 

    on teachers’ race, teaching assignment, and professional experience. In all, there are 8432 schools

    and approximately 42,000 teachers in the SASS sample, selected to represent all schools and teach-

    ers nationwide. To make this sample comparable to our study sample (based on school type, loca-

    tion and principal experience), we significantly restricted this sample further to teachers employed in urban elementary schools (of the five states from which the Stanford sample was drawn), who

    taught full-time and had at least a temporary teaching credential, and whose principals had no more

    than five years’ principalship experience. This yielded an SASS sample of 524 teachers from 14

    schools. The combined sample of this study was 764 teachers, which was appropriately weighted 

    during the analysis using the SASS weights provided by NCES.

    Table 2 shows the demographic and educational characteristics of the three groups of teachers.

    The Stanford sample teachers were primarily female (85–88%), White (65–67%), with a master’s

    degree or higher (65–77%). They averaged 38–42 years of age, with 11–13 years’ teaching expe-

    rience overall. The SASS sample teachers were primarily female (92%), White (93%), with a mas-

    ter’s degree or higher (33%). They averaged 38 years of age, with 11 years’ teaching experience

    686   Educational Management Administration & Leadership 42(5)

    686

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    8/21

          T    a      b      l    e      1  .     N   u   m     b   e   r   o     f   s   c     h   o   o     l   s   a   n     d    t   e   a   c     h   e   r   s     b   y     l   o   c   a    t    i   o   n ,     S    t   a   n     f   o   r     d     S    t   u     d   y   s   a   m   p     l   e   a   n     d     S     A     S     S    t   e   a   c     h   e   r   s   a   m   p     l   e .

         N   u   m     b   e   r   o     f

       e     l   e   m   e   n    t   a   r   y

       s   c     h   o   o     l   s

         T   o    t   a     l

       n   u   m     b   e   r   o

         f

        t   e   a   c     h   e   r   s

         N   u   m     b   e   r   o     f   p   r    i   n   c    i   p   a     l   s    i   n

        i   n   n   o   v   a    t    i   v   e   p   r   e  -   s   e   r   v    i   c   e

       p   r   e   p   a   r   a    t    i   o   n

         N   u   m     b   e   r   o     f   p   r    i   n   c    i   p   a     l   s

        i   n    i   n   n   o   v   a    t    i   v   e    i   n  -

       s   e   r   v    i   c   e   o   n     l   y

         N   u   m     b   e   r

       o     f    t   e   a   c     h   e   r   s   w     h   o   s   e

       p   r    i   n   c    i   p   a

         l   s     h   a     d   p   r   e  -   s   e   r   v    i   c   e

        i   n   n   o   v   a

        t    i   v   e   p   r   e   p   a   r   a    t    i   o   n

         N   u   m     b   e   r   o     f    t   e   a   c     h   e   r   s   w     h   o   s   e

       p   r    i   n   c

        i   p   a     l   s     h   a     d    i   n  -   s   e   r   v    i   c   e

        i   n   n   o

       v   a    t    i   v   e   p   r   e   p   a   r   a    t    i   o   n

         S     A     S

         S

       s   a   m   p     l   e

         1     4

         5     2     4

       n     /   a

       n     /   a

       n     /   a

       n     /   a

         S     L     S   s   a   m   p     l   e

         1     4

         2     4     0

         1     0

         6

         1     6     5

         7     5

         T   o    t   a     l

         2     8

         7     7     4

         P   r   o   g   r   a   m   s

        i   n

         S     L     S

       s   a   m   p     l   e   :

         M

      -     D     R

         2

         5     1

         3

         0

         5     1

         0

         H

      -     C     T

         3

         2     3

         1

         2

         0

         2     3

         J     C

      -     K     Y

         2

         2     2

         1

         1

         8

         1     4

         N

         Y     C

         3

         7     3

         2

         1

         4     6

         2     7

         S     D

         4

         4     7

         3

         2

         4     7

         0

         U

         C

         2     4

         0

         0

         1     3

         1     1

          N    o     t    e    s   :     M  -     D     R   ¼

         M    i   s   s    i   s   s    i   p   p    i     D   e     l    t   a     R   e   g    i   o   n   ;

         H  -     C     T   ¼

         H   a   r    t     f   o   r     d ,     C   o   n   n   e   c    t    i   c   u    t   ;     J     C  -     K

         Y   ¼

         J   e     f     f   e   r   s   o   n     C   o   u   n    t   y ,     K   e   n    t   u   c     k   y   ;     N     Y

         C   ¼

         N   e   w     Y   o   r     k     C    i    t   y   ;     S     D   ¼

         S   a   n     D    i   e   g   o   ;     U     C   ¼

         U   n    i   v   e   r   s    i    t   y   o     f

         C   o   n

       n   e   c    t    i   c   u    t     ’   s     A     d   m    i   n    i   s    t   r   a    t   o   r     P   r   e   p   a   r   a    t    i   o   n

         P   r   o   g   r   a   m

         (     U     C     A     P     P     ) .

          S    o    u    r    c    e   :     T     h   e     S    t   a   n     f   o   r     d     U   n    i   v   e   r   s    i    t   y     S   c     h   o   o     l     L   e   a     d   e   r     S    t   u     d   y    t   e   a   c     h   e   r   s   u   r   v   e   y     f    i     l   e   s ,     N     D   ;

         S   c     h   o   o     l   a   n     d     S    t   a     f     f    i   n   g     S   u   r   v   e   y     (     N     C     E     S ,     2     0     0     6     ) .

    687

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    9/21

    overall. The comparison of the two samples via  t -tests showed that the three teacher groups dif-

    fered somewhat demographically. The two groups of Stanford teachers were statistically different

    (0.05 level of significance) in terms of race and teacher credentials: teachers in the Stanford Lead-

    ership Study were more likely to be non-White and somewhat more likely to have a postgraduate

    degree (possibly reflecting state certification requirement differences in the samples).

    We combined all three groups of teachers in this analysis and only differentiated the teachers’

     principals based on whether or not they had been in an exemplary leadership preparation program.

    Consequently, for teachers whose principals only had an innovative in-service preparation, we

    decided to include the Stanford in-service only group of teachers with the SASS group of teachers;

    the benefit of this was reducing some of the sample-related differences due to school district

    affiliation, particularly with regard to teachers’ gender, race and credentials.

    Instruments

    The sample teachers were surveyed through two different but parallel survey instruments. The

    study sample teachers were asked to complete the Stanford University School Leader Study sur-

    vey. This survey has 115 items designed to assess teachers’ assessments of: (1) the principal’s lead-

    ership practices; (2) their school improvement practices and recent accomplishments; (3)

    organizational contexts in the schools; and (4) their own demographic and educational experi-

    ences. Survey items were drawn heavily from the federal SASS (NCES, 2006) and Leithwood and Jantzi’s (1999, 2000) studies of effective school leadership practices. The comparison sample

    teachers completed the SASS survey conducted in 1999–2000. The School Teacher Questionnaire

    contained information about general employment, certification and training, teachers’ classroom

    organization, teachers’ resources and student assessment, working conditions, and decision mak-

    ing and the principal’s leadership practices.

    This article drew only on those common survey items, restricting the extent to which leadership

     practices and school outcomes can be investigated to only those measures included in the SASS

    survey. These common items were about teachers’ demographic characteristics (gender, race/eth-

    nicity, age, teaching experience, advanced preparation); their principals’ leadership practices; their 

    schools’ improvement climate (based on extent of teachers’ role in decision making, extent of pro-fessional development experiences in the last 12 months and parental support); and teacher 

    Table 2. Teachers’ demographic and educational characteristics, by sample.

    Characteristic

    SLS: InnovativePreparation

    (n ¼165)

    SLS: In-serviceonly innovative

    preparation

    (n ¼ 75)

    TraditionalPreparation

    (SASS)

    (n ¼ 524)

    Female 0.88b 0.85a 0.92Percent White 0.67b 0.65a 0.93Age 42.8b 38.8 38.4Total teaching experience 13.4b 11.6 10.7Percent of postgraduate degree holders 0.65b 0.77a 0.33

    Notes:   aDifferences between traditional (SASS) and innovative preparation are significant at the 0.05 level of significance.bDifferences between traditional (SASS) and innovative preparation are significant at the 0.05 level of significance. SLS:Stanford Leadership Study.

    688   Educational Management Administration & Leadership 42(5)

    688

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    10/21

    outcomes (teacher collaboration and job satisfaction). Table 3 presents the survey items used in

    this study along with normality statistics for each item.

    Both surveys were linked to their schools’ principal survey data (the Stanford Principal Survey[Darling-Hammond et al., 2007] and the SASS Principal Survey [NCES, 2006], respectively) to

    identify which teachers’ schools were associated with principals who had completed an innovative

     preparation program, to eliminate the teachers from high schools in the samples, and – in the SASS

    sample – to eliminate teachers from nonurban schools whose principals had more than five years’

    experience.

    Dependent Measures

    The study used two dependent measures: (1) teacher job satisfaction; and (2) teacher cooperation.

    Using five-point Likert agreement rating scales, teachers rated the degree of cooperation at their school, based on three items. The survey items asked teachers to indicate whether colleagues

    Table 3. Survey items used in the study.

    On a scale from ‘No influence’ (1) to ‘A great deal of influence’ (5), how much actual influence do you think teachers have over school policy AT THIS SCHOOL in each of the following areas?

    Items Description Skewness Kurtosis

    q7b Influence of teachers in establishing curriculum   0.12 2.11q7c Influence of teachers in determining the content of in-service professional

    development programs0.01 2.15

    q7d Influence of teachers in evaluating teachers 1.09 3.28q7e Influence of teachers in hiring new FT teachers 0.85 2.58

    On a scale from Not at all effectively (1) to Extremely effective (5), indicate how effectively the schoolprincipal performs each of the following at your current school.

    Items Description Skewness Kurtosis

    q9a Principal communicates respect to teachers   0.72 2.76q9b Principal encourages teacher to change teaching methods   0.59 2.87q9c Principal works with staff to develop and attain curriculum standards   0.75 2.98q9d Principal encourages professional collaboration   0.82 2.99q9e Principal works with teaching staff to solve school or department problems   0.62 2.50q9f Principal encourages staff to use student evaluation results in planning lessons   0.78 3.08q9g Develops broad agreement among the teaching staff about the school’s or

    department’s mission0.64 2.82

    q9h Principal develops broad agreement among the teaching staff about school goals   0.76 2.96

    On a scale from Strongly disagree (1) to Strongly agree (5), to what extent do you agree or disagree with each

    of the following statements?

    Items Description Skewness Kurtosis

    q8l In this school, staff members are recognized for a job well done   0.52 2.51q8i Most of my colleagues share my beliefs and values about school mission   0.74 3.63q8k Great deal of cooperative effort among staff    0.77 3.05

    Orphanos and Orr: Learning leadership matters   689

    689

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    11/21

    shared beliefs and values about the school’s central mission, the extent of collaborative effort

    among staff members in this school and if staff members are recognized for a job well done. Teach-

    ers’ job satisfaction was based on a single item, which asked teachers about their level of satisfac-

    tion with being a teacher at their school.

    Independent, Moderating and Mediating Measures

    The study used one independent measure – principal leadership. Teachers rated the extent of their 

    agreement on eight statements about their principals, using a five-point Likert agreement rating

    scale (1 ¼ strongly disagree to 5 ¼ strongly agree). These statements reflect highly recommended 

    attributes of transformational/instructional leadership of direction setting, support and encourage-

    ment, and organizational support. Their scale reliability was very satisfactory (alpha ¼ 0.86).

    The study used three mediating measures: (1) teacher-distributed leadership; (2) teacher partic-

    ipation in different types of professional development; and (3) extent of parent support. To mea-

    sure teacher-distributed leadership, teachers were asked to rate the extent to which teachers had influence in five school policy areas (setting performance standards, establishing curriculum, eval-

    uating teachers, budget, and content of in-service professional development). The alpha coefficient

    for the perceived teacher influence construct was 0.773.

    Teachers were asked to indicate participation in six types of professional development (university

    courses for re-certification or advanced certification, observational visits to other schools, individual

    and collaborative research, regularly scheduled collaboration with colleagues, mentoring and attend-

    ing workshops). The extent of professional development participation was the summation of partic-

    ipation in the various types of professional development. Perceived parental support was measured 

    using a single item: ‘I receive a great deal of support from parents for the work I do.’ In all, approx-

    imately 20% of sample teachers agreed or strongly agreed that parents support the work they do.The study used one moderating measure: whether the principal was in an exemplary leadership

     preparation program. Here, 23% of the teachers in the combined sample had principals who had 

     participated in one of the innovative leadership preparation programs. The five innovative leader-

    ship preparation programs2 were similarly strong by having: (1) a comprehensive, standards-based 

    and coherent curriculum; (2) a philosophy and curriculum emphasizing leadership of instruction

    and school improvement; (3) active, student-centered instruction that integrates theory and practice

    and stimulates reflection; (4) knowledgeable faculty and practitioners; (5) targeted recruitment and 

    selection to seek out expert teachers with leadership potential; and (6) well-designed and super-

    vised internships that give candidates leadership responsibilities for substantial periods of time.

    The Stanford Leadership Study also included teachers whose principals had participated in oneof the five innovative in-service training programs, which were primarily district-led and com-

     bined seminars, mentoring, coaching and other forms of leadership development, but had not par-

    ticipated in the innovative preparation program. The comparison principals also included the

    national SASS sample, for whom preparation and in-service program information was unavailable

    and assumed to be primarily conventional in nature.

    Evaluating the Quality of the Data

    The relationship among the measures was investigated using structured equation modeling (SEM)

    techniques, which allow the simultaneous testing of relationships among multiple variables. Thus,we were able to study indirect effects (mediating variables), moderating effects as well as direct

    690   Educational Management Administration & Leadership 42(5)

    690

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    12/21

    effects (independent variables) on multiple outcome variables of interest. First, we assessed the

    quality of the data set by evaluating the scale items for individual and joint normality because the

    validity of the SEM approach rests on first meeting the assumption of multivariate normality of the

    variables used. We found that the assumption of univariate normality was rejected for all variables,

    and therefore the assumption of multivariate normality did not hold either. However, the dataexhibited moderate non-normality since skewness was less than 2.0 for all variables while kurtosis

    was less than 4.0 for all but one variable (see Table 3). According to the literature, this normality

    assessment showed moderate non-normality that was not very problematic. Therefore, we con-

    cluded that we should use an estimation method that would take the moderate non-normality of 

    the variables into consideration. We first estimated the model with the asymptotic distribution free

    (ADF) method, which is a form of weighted least squares and makes no assumption of joint nor-

    mality. However, since the data were moderately non-normal, we also estimated the SEM model

    with the maximum likelihood (ML) method. The conclusions drawn from the estimates from the

    two methods were very similar in the sense that all designated relationships were of the same sign

    and, in some cases, magnitude (even though individual estimates for certain paths of the structuralmodel naturally differed). Therefore, given the familiarity of most readers with ML, we present

    estimates from both methods, but make use of the estimates from the ML solution.

    Specifying and Testing the Measurement Model: Confirmatory Factor Analysis.  Before fitting and esti-

    mating the statistical model, we tested the hypothesized measurement (factorial) model using con-

    firmatory factor analysis with STATA 12.0. Fifteen indicator variables were loaded on three

    different latent variables that were left to be freely correlated (see Table 4). According to the con-

    firmatory factor analysis results, the data fitted the model well.

    Validity of latent variables was measured in two different ways: standardized loadings and aver-

    age variance extracted per latent variable. According to Bollen (1989), the indicator loadings for each latent variable can serve as a measure of validity. The standardized loadings in Table 3 rep-

    resent the correlation between each observed variable and the corresponding latent variable. The

    loadings for the latent variable principal leadership (PLEAD) ranged from 0.76 to 0.87. The load-

    ings for the latent variable teachers’ distributed leadership (DISLEAD) ranged from 0.60 to 0.69

    and the range of loadings for the latent variable teacher collaboration (TCOLL) were in the range

    of 0.51 to 0.89. All loadings were statistically significant. The composite reliability value is an

    overall measure of each latent variable’s reliability. According to Table 3, the reliability for the

    three latent variables was satisfactory because all three latent variables had composite reliability

    values well above 0.60, which is considered the lowest acceptable value (Bagozzi and Yi,

    1988). The average variance extracted (AVE) value shows the amount of variance captured by thelatent variable in relation to the amount of variance due to measurement error (Fornell and Larcker,

    1981). As such, it served as a second appropriate measure of construct validity. AVE values should 

    exceed 0.50, which means that the underlying latent variable accounts for a greater amount of var-

    iance in the indicators than does the measurement error (Diamantopoulos and Siguaw, 2000). The

    AVE value for the PLEAD was 0.75, while the AVE for DISLEAD and TCOLL were very close to

    the 0.50 threshold. The information garnered from the indicator loadings and the AVE values

    showed an adequate, but not ideal, validity for the latent variables in the study.

    To assess the fit of the measurement model as a whole, we used a number of fit indexes. The  x2

    statistic (87, n ¼ 764) as a measure of absolute fit was equal to 415.33 ( p < 0.01) and significant

    enough to reject the model. Using a cut-off rule of 0.90 for all indexes (Hu and Bentler, 1999), itwas found that adjunct fit indexes indicated a good fit to the data: the RMSEA was 0.072 with a

    Orphanos and Orr: Learning leadership matters   691

    691

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    13/21

    90% confidence interval of (0.065, 0.078), the comparative fit index ¼ 0.948, and the Tucker– 

    Lewis index ¼ 0.938.

    Results: Assessing the Structural Equation Model

    The relationships among the measures were investigated using structural equation modeling (SEM).We investigated model fit using selected goodness-of-fit statistics which collectively showed a satis-

    factory model fit. All fit indexes (excluding x2) were above the recommended cut-off points. The

    RMSEA was under 0.05 (0.065 with a 90% confidence interval of 0.066–0.077), while compara-

    tive fit index and Tucker–Lewis index were are above 0.90 (0.92 and 0.91, respectively). At this

     point, it should be noted that even though the model fit was satisfactory, we cannot claim that this

    model is a totally accurate representation of the data, nor that it is the only possible model that

    fits with the structure of the data. Given the fit assessment, we can safely say that our proposed 

    model could be one model that possibly explains the structure of the survey data (Bollen, 1989).

    Also, we decided against modifying the model based on modification indexes because any

    changes in a structural model should be grounded on theoretical considerations and not on fitstatistics.

    Table 4. Measure analysis of measurement model.

    Measured variables Latent variables

    ItemsFactorloading z-value

    Stderror

    Itemreliability Name of variable

    Compositereliability

    Average

    Varianceextracted

    q7b 0.60 18.85 0.03 0.36 Distributed leadership 0.75 0.43q7c 0.69 23.45 0.03 0.48q7d 0.67 21.99 0.03 0.44q7e 0.61 19.35 0.03 0.37q9a 0.82 61.68 0.01 0.67 Principalship leadership 0.95 0.75q9b 0.82 61.36 0.01 0.66q9c 0.87 86.08 0.01 0.76q9d 0.86 79.19 0.01 0.74q9e 0.87 88.44 0.01 0.76

    q9f 0.76 45.82 0.02 0.58q9g 0.86 79.37 0.02 0.74q9h 0.82 61.07 0.02 0.66q8l 0.51 13.58 0.04 0.26 Teachers’ collaboration 0.70 0.46q8i 0.56 14.71 0.04 0.31q8k 0.89 19.39 0.05 0.79

    Notes: Q7b ¼ influence of teachers in establishing curriculum; q7c ¼ influence of teachers in determining the content of in-service professional development programs; q7d ¼ influence of teachers in evaluating teachers; q7e ¼ influence of teachersin hiring new FT teachers; q9a ¼ principal communicates respect to teachers; q9b ¼ principal encourages teacher to changeteaching methods; q9c ¼ principal works with staff to develop and attain curriculum standards; q9d ¼ principal encouragesprofessional collaboration; q9e ¼ principal works with teaching staff to solve school or department problems; q9f ¼ principal

    encourages staff to use student evaluation results in planning lessons; q9 h ¼ principal develops broad agreement among theteaching staff about school goals; q8 l ¼ in this school, staff members are recognized for a job well done; q8i ¼ most of mycolleagues share my beliefs and values about school mission; q8 k ¼ great deal of cooperative effort among staff.

    692   Educational Management Administration & Leadership 42(5)

    692

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    14/21

    Parameter Estimates

    The completely standardized solution for the structural portion of the model is given in Figure 2.

    The estimates measure the expected change in a dependent variable in standard deviation units that

    accompanies a one standard deviation change in an explanatory variable while holding constant the

    other explanatory variables. Direct, indirect and total effects are given in Table 5. All reported 

    effects were statistically significant at the 0.05 level of significance. The signs of the estimates

    were in the expected direction based on what theory and prior literature suggests.According to the estimates, innovative leadership preparation appeared to positively influence

    the perceived quality of leadership practices. Principals who were trained through an innovative

    leadership preparation program (INNOV) were rated more highly on positive leadership practices

    than principals who went through a conventional preparation program or had innovative in-service

    training coupled with their conventional preparation. Participation in an innovative leadership pre-

     paration program was associated with a 0.14 standard deviation increase in the quality of perceived 

    leadership practices. Parental support towards teachers also had a positive effect on PLEAD. A one

    standard deviation increase in parental support was associated with a 0.12 of a standard deviation

    increase in teacher-perceived quality of leadership practices. Such an effect may be in part captur-

    ing the overall supportive climate of the larger school community which reinforces principal lead-ership practices for school improvement. However, it should be noted that parental support, along

    with innovative program participation, as the two direct effects on principal leadership explain

    only a small (as expected) portion of variation in leadership practices (around 9%). Parental sup-

     port was also positively associated with teachers’ satisfaction, with 0.24 standard deviation

    increase in satisfaction for a one standard deviation increase in parental support. This finding is

    consistent with other school improvement research (Sebring et al., 2006) that underscores the con-

    tributing influence of parent support on teachers’ work.

    According to our model, principalship leadership had positive and significant effects on teach-

    ers’ degree of professional development, teachers’ influence on school policies (distributed lead-

    ership), teachers’ collaboration and satisfaction. The area of showing leadership practices’ greatestimpact was teacher satisfaction and collaboration. A one standard deviation increase in the

    INNOV

    PDEV

    PSUPP

    TSAT

    DISLEAD

    PLEAD

    TCOLL

    .14

    .14

    .12

    .25

    .23

    .28

    .09

    .52

    .26

    .19

    Figure 2. Completely standardized weighted least squares solution for the structural model. All estimates

    shown are statistically significant at the 0.05 level of significance.Note: see Figure 1.

    Orphanos and Orr: Learning leadership matters   693

    693

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    15/21

          T    a      b      l    e      5  .     D    i   r   e   c    t   a   n     d    i   n     d    i   r   e   c    t   e     f     f   e   c    t   a

       n   a     l   y   s    i   s .

         I   n     d   e

       p   e   n     d   e   n    t   v   a   r    i   a     b     l   e   s

         D   e   p   e   n     d   e   n    t   v   a   r    i   a     b     l   e   s

         D    i   r   e   c    t   e     f     f   e

       c    t

         (     M     L     )

         I   n     d    i   r   e   c    t   e     f     f   e   c    t

         (     M     L     )

         O   v   e   r   a     l     l   e

         f     f   e   c    t

         (     M     L     )

         D    i   r   e   c    t   e     f     f   e   c    t

         (     A     D     F     )

         I   n     d    i   r   e   c    t

       e     f     f   e   c    t

         (     A     D

         F     )

         O   v   e   r   a     l     l   e     f     f   e   c    t

         (     A     D     F     )

         I   n   n   o

       v   a    t    i   v   e   p   r   e   p   a   r   a    t    i   o   n

         P   r    i   n   c    i   p   a     l   s     h    i   p     l   e   a     d   e   r   s     h    i   p

         0 .     1     4     *

         0 .     1     4     *

         0 .     2     1     *

     .     2     1     *

         I   n   n   o

       v   a    t    i   v   e   p   r   e   p   a   r   a    t    i   o   n

         D    i   s    t   r    i     b   u    t   e     d     l   e   a     d   e   r   s     h    i   p

         0 .     1     2     *

         0 .     1     2     *

         0 .     0     9

         *

     .     0     9     *

         I   n   n   o

       v   a    t    i   v   e   p   r   e   p   a   r   a    t    i   o   n

         T   e   a   c     h   e

       r   s     ’   c   o     l     l   a     b   o   r   a    t    i   o   n

         0 .     0     8     *

         0 .     0     8     *

         0 .     1     0

         *

     .     1     0     *

         I   n   n   o

       v   a    t    i   v   e   p   r   e   p   a   r   a    t    i   o   n

         T   e   a   c     h   e

       r   s   a    t    i   s     f   a   c    t    i   o   n

         0 .     3     3     *

         0 .     3     3     *

         0 .     2     7

         *

     .     2     7     *

         P   r    i   n

       c    i   p   a     l   s     h    i   p     l   e   a     d   e   r   s     h    i   p

         T   e   a   c     h   e

       r   s     ’   c   o     l     l   a     b   o   r   a    t    i   o   n

         0 .     2     8     *

            0 .     0     5

         0 .     2     3     *

         0 .     2     2     *

         0 .     0     0

     .     2     2     *

         P   r    i   n

       c    i   p   a     l   s     h    i   p     l   e   a     d   e   r   s     h    i   p

         D    i   s    t   r    i     b   u    t   e     d     l   e   a     d   e   r   s     h    i   p

         0 .     2     5     *

         0 .     1     2

         0 .     3     7     *

         0 .     3     2     *

         0 .     0     5

         *

     .     3     7     *

         P   r    i   n

       c    i   p   a     l   s     h    i   p     l   e   a     d   e   r   s     h    i   p

         T   e   a   c     h   e

       r   s   a    t    i   s     f   a   c    t    i   o   n

         0 .     2     9     *

         0 .     1     3

         0 .     4     2     *

         0 .     1     6     *

         0 .     1     4

         *

     .     3     0     *

         P   r    i   n

       c    i   p   a     l   s     h    i   p     l   e   a     d   e   r   s     h    i   p

         P   r   o     f   e   s   s

        i   o   n   a     l     d   e   v   e     l   o   p   m   e   n    t

         0 .     0     9     *

         0 .     1     7     *

         P   a   r   e   n    t   a     l   s   u   p   p   o   r    t

         T   e   a   c     h   e

       r   s   a    t    i   s     f   a   c    t    i   o   n

         0 .     2     4     *

         0 .     2     0     *

         P   a   r   e   n    t   a     l   s   u   p   p   o   r    t

         P   r    i   n   c    i   p   a     l   s     h    i   p     l   e   a     d   e   r   s     h    i   p

         0 .     1     2     *

         0 .     0     2

         P   r   o     f   e   s   s    i   o   n   a     l     d   e   v   e     l   o   p   m   e   n    t

         D    i   s    t   r    i     b   u    t   e     d     l   e   a     d   e   r   s     h    i   p

         0 .     1     4     *

         0 .     1     4     *

         P   r   o     f   e   s   s    i   o   n   a     l     d   e   v   e     l   o   p   m   e   n    t

         T   e   a   c     h   e

       r   s   a    t    i   s     f   a   c    t    i   o   n

         0 .     0     4

         0 .     0     2

         D    i   s    t   r    i     b   u    t   e     d     l   e   a     d   e   r   s     h    i   p

         T   e   a   c     h   e

       r   s   a    t    i   s     f   a   c    t    i   o   n

         0 .     2     3     *

         0 .     2     9     *

         T   e   a

       c     h   e   r   s   a    t    i   s     f   a   c    t    i   o   n

         T   e   a   c     h   e

       r   s     ’   c   o     l     l   a     b   o   r   a    t    i   o   n

         0 .     5     2     *

         0 .     5     9     *

          N    o     t    e   :     *     p    <     0 .     0     5 .

    694

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    16/21

     perceived quality of leadership practices was associated with 0.29 of a standard deviation increase

    in teachers’ satisfaction and 0.28 of a standard deviation increase in teacher collaboration. It should 

     be noted that leadership practices, parental support and, to a lesser extent, degree of professional

    development accounted for 16% of the variation in teachers’ satisfaction.

    Teacher collaboration seemed to be dependent on overall teacher satisfaction. A one standard deviation increase in teachers’ satisfaction was associated with 0.52 of a standard deviation

    increase in teachers’ collaboration. Taken together, perceived leadership practices and teachers’

    satisfaction explained almost half of the variation (44%) in teacher collaboration. Finally, the more

    that teachers participate in professional development activities, the more distributed leadership

    they seem to experience at their schools, which is consistent with prior literature (Geijsel et al.,

    2001). A one standard deviation increase in the professional development participation was asso-

    ciated with 0.14 standard deviation increase in distributed leadership.

    DiscussionMajor findings

    Based on the results, we can answer the research questions as posed by hypotheses 1–4. For 

    hypothesis 1, we found that the more positive the perceptions of their principals’ leadership prac-

    tices, the greater the teachers’ job satisfaction and perceived collaboration. Specifically, more

    effective leadership practices have a strong influence on teachers’ job satisfaction and on their col-

    laboration. Principal leadership practices also have a strong indirect influence on teacher colla-

     boration through their influence on job satisfaction. These results confirm prior research

    (Thoonen et al., 2011) that similarly found a positive relationship between transformational lead-

    ership practices and these teacher outcomes. Like Thoonen et al., we also found a strong, positiverelationship among the teacher outcome measures, showing the reinforcing effects when improv-

    ing them.

    For hypothesis 2, the results confirmed that the type of preparation the principals had was a

    moderating influence on the principal leadership–teacher outcome relationship. Teachers whose

     principals had participated in one of the innovative leadership preparation programs under study

    were more likely to rate their principals’ leadership practices highly, and, through that, had higher 

     job satisfaction and teacher collaboration ratings. When we substituted conventional leadership

     preparation as an alternative hypothesis, the model did not fit as well, further confirming this

    hypothesis. Such findings confirm similar research findings drawn from principals’ perspectives

    (Orr and Orphanos, 2011).For hypotheses 3 and 4, the addition of three school improvement conditions – the extent of 

    teacher-distributed leadership, teacher participation in professional development and perceived 

     parental support – provide a fuller account of the variance in teacher job satisfaction. However,

     perceived parental support fit better as a moderating influence on principal leadership, rather than

    as a mediating influence between principal leadership and teacher job satisfaction. Given this, we

    concluded that this measure of perceived parental support may be serving as a measure of district

    and community culture, particularly given the size of its influence, as was found in other school

    improvement research (Bryk et al., 2010)

    Finally, the test of the hypothesized SEM model confirmed that innovative leadership prepara-

    tion has a small but statistically significant influence on teacher collaboration and job satisfactionthrough its influence on effective leadership practices, even when other factors are taken into

    Orphanos and Orr: Learning leadership matters   695

    695

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    17/21

    consideration. Such results were quite positive and confirmed earlier research on innovative pre-

     paration and teacher perceptions (Leithwood et al., 1996). More important, these findings under-

    score the importance of investing in quality leadership preparation. Better preparation yields

    demonstrable benefits for the schools and teachers whom graduates eventually lead as principals.

    Limitations of the Investigation and Directions for Future Research

    The results should be interpreted in light of the study’s context and possible biases. First, we should 

    keep in mind that the two samples were surveyed at somewhat different time periods (early 2000

    and 2005) and this may have biased the results in two possible ways. The first is the policy climate.

    Strong US accountability policies (NCLB) were implemented between these two time periods and 

    led to changes in schools’ accountability and press for academic improvement, particularly for 

    urban schools in the Stanford sample we are using. The second possible bias is that the innovative

     preparation programs, in which 6 of the 16 principals participated, are in three settings – Jefferson

    County, New York City and San Diego – and the programs were part of larger district reforms. Byadding the Stanford in-service-only sample (which included teachers from these same districts) to

    the SASS comparison sample, we tried to reduce possible sample bias.

    Second, measurement conditions limited the degree to which we could explore the relationship

     between innovative preparation and leadership and teacher outcomes for this investigation, sug-

    gesting that the relationship is probably significantly stronger than could be modeled here. For this

    study, we could only use a dichotomous measure of innovative preparation. Moreover, we could 

    not account for the extent of innovative leadership preparation of the principals in the SASS

    teacher sample. Within both samples, the extent to which their leadership preparation featured 

    most of the exemplary program features found to be influential on principals’ reports of their lead-

    ership practices (Darling-Hammond et al., 2010) is likely to vary. Future analyses that can take thisvariation into account may explain more of the variations in leadership and teacher outcomes. As

    well, such analyses could provide insight into which innovative program features contribute most

    to these outcomes.

    Third, as the sample was purposefully restricted to newer principals, the overall relationship

    may differ when examined among all principals as a whole. The difficulty in modeling the rela-

    tionship, however, illustrates how much it is contextualized. Restricting comparison samples to

    similar settings helps to isolate the effects, but limits the scope to which the findings can be gen-

    eralized to other settings. Here, the sample was restricted to urban and small city school districts

    with large numbers of low-performing schools where there is often significant focus, support, and 

    opportunity for change.Fourth, the analysis is limited to just measures available in both survey samples, which in turn

    limited the reliability of certain latent variables. As shown in Table 3, the latent variables of dis-

    tributed leadership, teacher collaboration, parental support and teachers’ participation in profes-

    sional development can be better constructed in future research if different and additional

    variables are used (in the present study, parental support and teachers’ participation in professional

    development were single-item variables). Other explorations of the Stanford teacher sample pro-

    vide a broader scope of how different intensities of leadership preparation and development con-

    tribute to leadership practices and, in turn, to teacher and school improvement outcomes.

    Despite these limitations, the findings confirmed the hypothesized relationships between pre-

     paration and teacher outcomes, as had been modeled from related prior research. How leaders are prepared – particularly through the collaborative university-district programs used in this study – 

    696   Educational Management Administration & Leadership 42(5)

    696

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    18/21

    makes an important difference in the quality of leadership practiced and, through that, in improv-

    ing teachers’ working conditions and collaboration and satisfaction with their work. Finally, the

     present findings serve as an important model for future research in evaluating the effects of lead-

    ers’ preparation on improving the work and working conditions of their staff and their school

    improvement outcomes.

    Implications for Policy and Practice

    The results provide both theoretical and methodological implications. First, they demonstrate that

    more innovative principal preparation has a small but discernible and significant influence on

    teacher outcomes. This confirms the importance of quality leadership preparation as a school

    reform strategy for policymakers to consider. Second, the results confirm that more effective lead-

    ership practices are influenced by the nature and quality of leadership preparation. These findings

    are highly consistent with prior research that was foundational to this work and suggested that such

    a relationship exists, based on the relationship between exemplary preparation and leadership prac-tices (Leithwood et al., 1996; Orr and Orphanos, 2011), and the relationship between transforma-

    tional/instructional leadership practices and teacher outcomes (Geijsel et al., 2001; Leithwood and 

    Jantzi, 2008; Thoonen et al., 2011). These results also importantly show that how principals are

     prepared influences the extent to which they positively support and develop their staff and broadly

    distribute leadership responsibilities in their schools. Through testing the effectiveness of the tra-

    ditional program as an alternative hypothesis, the results also show that adding innovative in-

    service program participation to a traditional preparation experience does not yield the same

     positive effects.

    Given the field’s advancement of better leadership preparation approaches (Jackson and Kelley,

    2002; Orr, 2006) and current policy emphasis on developing quality leaders for better schools

    (Bottoms et al., 2003; Commission on No Child Left Behind [NCLB], 2007), such findings are

    very encouraging and provide important policy direction. The positive benefits for teachers – 

    improving collaboration, participation in decision making, and job satisfaction – show that invest-

    ments in leadership preparation influences leadership practices that yield more positive teacher 

    work conditions, which are essential for improving student learning (Berry et al., 2010)

    Related findings by Darling-Hammond and others (2010) provide an in-depth examination of 

    the innovative preparation programs used in this study. A related article (Orr and Orphanos,

    2011) provides a statistical analysis on the relationship between preparation program features and 

    graduate career outcomes and, as school leaders, their practices and school improvement work,

    thus demonstrating the strong moderating influence of program content, active student learning

    experiences and internship quality. Together, these findings underscore the benefits of a high-

    quality, coherent preparation focus on the leading-learning work of school leaders for school and 

    teacher outcomes. Such results provide strong directions for leadership preparation program design

    and improvement, and stress the role that leadership preparation plays in district reform and school

    improvement work.

    Notes

    1. Descriptions of the six programs and findings on the graduates’ and principals’ experiences are presented 

    in the final report (Darling-Hammond et al., 2007).

    2. Three of the five that were developed as university-district partnerships were tailored to address districtreform priorities and leadership expectations.

    Orphanos and Orr: Learning leadership matters   697

    697

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    19/21

    References

    Anthes K (2004 April) Administrator license requirements, portability, waivers and alternative certification.

    StateNotes.

    Bagozzi RP and Yi Y (1988) On the evaluation of structural equation models.  Journal of the Academy of Mar-

    keting Science  16: 74–94.

    Berry B, Daughtrey A and Wieder A (2010) A Better System for Schools: Developing, Supporting and Retain-

    ing EffectiveTeachers. Hillsborough, NC: Center for Teaching Quality.

    Bollen K (1989)  Structural Equations with Latent Variables. New York: John Wiley & Sons.

    Bottoms G, O’Neill K, Fry B and Hill D (2003)  Good Principals are the Key to Successful Schools: Six stra-

    tegies to Prepare More Good Principals. Atlanta, GA: Southern Regional Education Board.

    Bryk AS, Sebring PB, Allensworth E, Luppescu S and Easton JQ (2010)  Organizing Schools for Improve-

    ment: Lessons from Chicago. Chicago, IL: University of Chicago Press.

    Bush T and Jackson D (2002) A preparation for school leadership: international perspectives.  Educational 

     Management and Administration 30: 417.

    Commission on No Child Left Behind (NCLB) (2007)  Beyond NCLB: Fulfilling the Promise to Our Nation’sChildren. Aspen, CO: The Aspen Institute.

    Copland MA (2001) The reform of administrator preparation at Stanford: an analytic description.  Journal of  

    School Leadership  11: 335–366.

    Darling-Hammond L, LaPointe M, Meyerson D, et al. (2007)  Preparing Leaders for a Changing World . Palo

    Alto, CA: Stanford University, Stanford Educational Leadership Institute.

    Darling-Hammond L, Meyerson D, La Pointe MM, et al. (2010) Preparing Principals for a Changing World .

    San Francisco, CA: Jossey-Bass.

    DavisS, Darling-HammondL, Meyerson D, et al. (2005) Review of Sesearch. School LeadershipStudy. Developing 

    Successful Principals. Palo Alto, CA: Stanford University, Stanford Educational Leadership Institute.

    Diamantopoulos A and Siguaw J (2000)  Introducing LISREL. Thousand Oaks, CA: SAGE.Earley P and Evans J (2004) Making a difference?  Educational Management Administration & Leadership

    32: 325–338.

    Edmonds R (1979) Effective schools for the urban poor.  Educational Leadership  37(1): 15–18, 20–24.

    Fornell C and Larcker DF (1981) Evaluating structural equation models with unobservable variables and mea-

    surement error.  Journal of Marketing Research  18: 39–50.

    Fuller E, Young MD and Baker BD (2011) Do principal preparation programs influence student achievement

    through the building of teacher-team qualifications by the principal? An exploratory analysis.  Educational 

     Administration Quarterly 47: 173–216.

    Geijsel F, Sleegers P, van den Berg R and Kelchtermans G (2001) Conditions fostering the implementation of 

    large-scale innovation programs in schools: teachers’ perspectives.  Educational Administration Quarterly37(1): 130–166.

    Glasman NS (1997) An experimental program in leadership preparation. Peabody Journal of Education72: 42–65.

    Hallinger P and Heck R (1996) Reassessing the principal’s role in school effectiveness: a review of empirical

    research, 1980–1995.  Educational Administration Quarterly 32: 5–44.

    Hallinger P and Heck RH (2010) Leadership for learning: does collaborative leadership make a difference in

    school improvement?  Educational Management Administration & Leadership  38(6): 654–678.

    Hoy WK, Sweetland SR and Smith PA (2002) Toward an organizational model of achievement in high

    schools: the significance of collective efficacy.  Educational Administration Quarterly  38: 77–93.

    Hu LT and Bentler P (1999) Cutoff criteria in fit indexes in covariance structure analysis: conventional cri-

    teria versus new alternatives.  Structural Equation Modeling  6: 1–55.

    698   Educational Management Administration & Leadership 42(5)

    698

     at Universiti Utara Malaysia on March 25, 2016ema.sagepub.comDownloaded from 

    http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/http://ema.sagepub.com/

  • 8/19/2019 Educational Management Administration & Leadership-2014-Orphanos-Learning Leadership Matters

    20/21

    Huber SG (2004)  Preparing School Leaders for the 21st Century: An International Comparison of Develop-

    ment Programs in 15 Countries. London: RoutledgeFalmer.

    Hulpia H, Devos G and Van Kerr H (2011) The relation between school leadership from a distributed 

     perspective and teachers’ organizational commitment.   Educational Administration Quarterly   47(5):

    728–771.Jackson BL and Kelley C (2002) Exceptional and innovative programs in educational leadership. Educational 

     Administration Quarterly 38: 192–212.

    Jacobson SL and Bezzina C (2008) Effects of leadership on student academic/affective achievement. In:

    Lumby J, Crow G and Pashiardis P (eds)   International Handbook on the Preparation and Development 

    of School Leaders. New York: Routledge, 81–103.

    Jacobson SL, Johansson O and Day C (2011) Preparing school leaders to lead organizational building and 

    capacity building. In: Ylimaki RM and Jacobson SL (eds) US and Cross-National Policies, Practices and 

     Preparation. Dordrecht: Springer.

    Jacobson A, O’Neill K, Fry B, Hill D and Bottoms G (2002)  Are SREB States Making Progress? Tapping,

     Preparing and Licensing School Leaders Who Can Influence Student Achievement . Atlanta, GA: SouthernRegional