mock study
TRANSCRIPT
MOCK STUDY 2
Mock Study
One of the primary tasks faced by doctoral learners in
University of Phoenix’s School of Advance Studies is to complete
a dissertation. The dissertation is the culminating work of the
program. The intention of the dissertation, among other things,
is to show the academic growth of the student, mastery of
research skills, and to add to the body of knowledge in the
student’s chosen field of study.
As part of the student’s development, they must develop
research skills. One exercise aimed at this endeavor is the
completion of a mock study. The mock study provides the doctoral
learner with the opportunity to learn and practice the skills
necessary for the completion of his or her dissertation. Over a
period of eight weeks, the student completes various tasks and
gains insight into the components that make up a sound
dissertation study. What follows is the beginning of one such
exercise
Research Topic & Purpose
MOCK STUDY 3
Before beginning to utilize the tools and skills necessary,
the student must first select a research topic to form the basis
of the mock study. For this series of exercises, this doctoral
learner has selected a topic focused on understanding the impact
that transformational leadership has on driving employee
engagement. Much literature exists about the value of employee
engagement. Soieb, Othman, and D’Silva (2013) found that
leadership has a significant role in driving the level of
employee engagement. Robertson and Cooper (2011) found that
employee engagement levels are a direct result of the environment
that exists within an organization. . Jauhari, Sehgal, and
Sehgal (2013) found that higher levels of employee engagement
improved the performance of the organization. In all of these
cases, the authors found that the higher the measure of employee
engagement, the better the overall performance of the
organization. Engaged employees are willing to give extra effort
towards the achievement of the organization’s goals.
Transformational leadership’s roots extend from the work of
Burns who introduced the concepts of transformational and
MOCK STUDY 4
transactional leadership (Burns, 1978). Bass, thought by many as
one of the fathers of transformational leadership theory,
continued this work (Zahari & Shurbagi, 2012). Bass’s theory of
transformational leadership defines transformational behaviors
as: (1) idealized influence (charisma), (2) individualized
consideration, (3) intellectual stimulation, and (4)
inspirational motivation (Clawson, 2006). Transformational
leadership encompasses the leader moving followers past immediate
self-interests towards a higher purpose (Bass, 1999).
Leadership has a responsibility to maximize organizational
performance. Even with the knowledge about leadership practices
and employee engagement, there is opportunity to understand
deeper how leadership drives employee engagement. Davidson,
Azziz, Morrison, Rocha, and Braun (2012), found that leadership
practices correlate directly with organizational success.
Nevertheless, there is little emphasis in developing competencies
since leaders often do not understand the value of investing in
self-development. Ahmed, Shields, White, and Wilbert (2010)
found that a measure of successful leadership is employee
MOCK STUDY 5
commitment. High levels of commitment result in improvements in
organizational performance.
The purpose of this quantitative correlational design study
is to discover the relationship of transformational leadership
practices to employee engagement. To carry out this study, the
researcher will observe participants in their natural
surroundings to establish the relationship transformational
leadership has on driving higher levels of employee engagement.
Research Design
According to Christensen, Johnson, and Turner (2011), a
correlational design is the best design to utilize if the goal of
the study is to show the relationship between two variables. In
a correlational design, the researcher measures levels of the
variables and then utilizes statistics to illustrate the patterns
and relationships in the data. For the proposed study, the
design must support measuring the variables transformational
leadership and employee engagement.
The correlational study is a non-experimental quantitative
design (Christens, Johnson, & Turner, 2011). The purpose of the
MOCK STUDY 6
study is to describe the relationships between variables and then
use this relationship to predict future performance. The
correlational design is the most appropriate design for
description and prediction. While the design does not allow the
researcher to establish cause and effect relationships, it still
provides valuable information regarding the presence of one
variable and the ability to predict the second variable.
The correlational design is appropriate for evaluating
variables in their natural settings (Christensen, Johnson, &
Turner, 2011; Black, 1999). Often the researcher is unable to
control and manipulate the independent variable. Instead, the
researcher measures independent and dependent variables in their
natural settings. The researcher establishes patterns and
relationships from these measurements. This allows the
researcher to conduct his or her study without the need to try to
reproduce the natural environment in a laboratory setting, which
is often not possible.
Christensen, Johnson, and Turner (2011) shared that random
samples of study participants enhance the external validity of
MOCK STUDY 7
the study. Random samples tend to be more representative of the
general population then purposeful samples. As such, any changes
observed in a study with random sampling would likely apply to
the population at large.
The proposed study will utilize two groups of participants.
One group, will have leaders that exhibit high levels of
transformational leadership characteristics. The other group
will utilize leaders with low to normal transformational
leadership characteristics. Each group will have engagement
levels measured. In this way, the impact of transformational
leadership on employee engagement should be isolated. While the
study sample is not truly random, because of the size of the
samples, and the nature of the selection, they should be
representative of the population at large. This will enhance the
external validity of the proposed study.
The purpose of this study is to identify the relationship
between transformational leadership and employee engagement. The
correlational study design is an excellent choice for this study.
This design has known and acceptable internal and external
MOCK STUDY 8
validity. As such, the results should be reliable and may be
generalizable. In addition, since the purpose of the study is to
identify the relationships, a correlational design is the
appropriate choice. Finally, the environment will support
executing the selected study design. There are numerous
participants and leaders from which to choose. This means there
are enough people from which to identify the required participant
population.
Defining the Variables
Establishing the operational definition of the study
variables is a critical step in research design (Black, 1999).
Operational definition of the variables ensures alignment with
the research purpose and questions. In addition, operational
definition helps to identify the appropriate measurement
instruments. The operational definition of the variables
provides the researchers and any reviewers with a clear
understanding of what the variables are measuring. An
operational definition of the variables provides a description of
MOCK STUDY 9
exactly what the variables are, as well as how the researcher
proposes to measure them.
When measuring variables, it is important to understand the
level of measurement appropriate (Black, 1999; Christensen,
Johnson, & Turner, 2011). The level of measurement refers to
quantitative scale of the variable. There are four levels of
measurement for quantitative variables: nominal, ordinal,
interval, and ratio. A nominal level of measurement is the
simplest and most basic type of measurement. It uses words,
symbols, or numbers to classify data. These tags serve as
markers. There is no implied order, rank, or magnitude. The
ordinal level is a rank-order scale with an implied order to the
variables. However, there is no sense of the distance between
each variable. An ordinal scale gives a sense of which value is
higher or lower, but not a sense of the magnitude between values.
The next level is interval scale. This scale has equidistance
between adjacent values on the scale as well as ordering.
However, there is no absolute zero on an interval scale. A ratio
level scale is one in which there is order, equidistance adjacent
MOCK STUDY 10
members, and an absolute zero point. The levels of measurement
build in that nominal scale is the least quantitative and ratio
scale is the most quantitative level. As such, each level has
the characteristics of the previous level and adds a higher level
of quantification.
The proposed study includes a number of variables, which the
researcher will monitor and measure. The main study variables
are transformational leadership and employee engagement.
Transformational leadership is the independent variable and
employee engagement is the dependent variable. In addition, the
study will include some other demographic variables. Gender of
the leader will be included in the study variables. Furthermore,
the researcher will look at length of service of the leader as
another demographic study variable. Below is a further
examination of each of the study variables and their operational
definition.
Transformational Leadership. For the proposed study, the
researcher will measure transformational leadership
characteristics of the leaders. This will be the independent
MOCK STUDY 11
variable in this correlational study. To accomplish this, the
researcher will measure Idealized Attributes, Idealized
Behaviors, Inspirational Motivation, Intellectual Stimulation,
and Individualized Consideration of each leader using a survey
instrument. The overall assessment of these characteristics
provides a strong indication of transformational leadership
capabilities. The researcher will be able to look at each
measurement individually as well as the aggregate score.
Transformational Leadership is an interval level variable.
As such, it is highly quantifiable. To analyze the
transformational leadership variable, the researcher will use
descriptive statistics. The researcher will use measures of
central tendency, including the mean and the median. Central
tendency provides a sense of the typical values of a pool of
research data (Christensen, Johnson, & Turner, 2011). The
researcher will also calculate the standard deviation. Standard
deviation is a measure of variability of the data. This value
provides the researcher with a sense of how spread out the data
may be.
MOCK STUDY 12
These measures will help to divide the leaders into
quartiles (Q1 – Q4). Quartiles are a way of segmenting samples
into equal quarters by performance (Christensen, Johnson, &
Turner, 2011; Black, 1999). Leaders from quartile groups Q1 – Q3
will form the “low to normal transformational” leader group.
Leaders from Q4 will form the “high transformational” leader
group.
Inferential statistics allow researchers to make inferences
about a sample population (Christensen, Johnson, & Turner, 2011).
There are two types of inferential statistics, those used for
estimation, and those used for hypothesis testing. The
researcher will use a t-test for the two sample leadership groups
to establish statistical significance in the difference of the
scores on transformational leadership. This will provide an
understanding of the difference in transformational leadership
characteristics of the two selected populations.
Employee Engagement. The researcher will measure the level
of employee engagement as the dependent variable in this study.
Work engagement will provide an assessment of the level of
MOCK STUDY 13
employee engagement. For the purposes of this study, work
engagement is a positive attitude, characterized by vigor,
dedication, and absorption using the Utrecht Work Engagement
Scale (Schaufeli & Bakker, 2003). This scale provides an
effective and statistically significant measure of work
engagement.
Employee engagement, measured in this fashion, is a interval
level variable. The researcher will use measures of central
tendency to evaluate the mean, mode, and median scores of
employee engagement. Understanding the central tendency measures
of employee engagement for each of the tested populations is the
first step in looking for relationships between transformational
leadership and employee engagement. Once again, the researcher
will use a t-test to evaluate the statistical significance of any
difference in performance.
To understand the relationship that transformational
leadership has on driving employee engagement, the researcher
will utilize inferential statistics. Cohen’s d is a measure to
evaluate the difference between means (Christensen, Johnson, &
MOCK STUDY 14
Turner, 2011). This is an effect size indicator, which will show
the difference in performance between the two populations. The
researcher proposes that there is a linear relationship between
transformational leadership and employee engagement. Therefore,
the researcher intends to use Pearson’s Correlation Coefficient
to evaluate the relationship. Pearson’s Correlation Coefficient
will show the direction and magnitude of the correlation between
two quantitative variables. If a curvilinear relationship is
observed, the researcher will employ curvilinear regressions to
establish the correlation.
Gender. For the proposed study, the researcher will collect
gender and evaluate it as a moderating variable. Gender is a
nominal scale variable. The researcher is interested in
understanding the role that gender plays in driving
transformational leadership behaviors and the corresponding
impact on employee engagement. A moderating variable is one that
affects the strength of performance on another quantitative
variable (Christensen, Johnson, & Turner, 2011). To evaluate the
effect of gender on performance, the researcher will use a two
MOCK STUDY 15
dimensional contingency table. The researcher will create a
table with gender as one dimension, and the mean employee
engagement of each of the groups as the second dimension.
Applying a t-test to these measures will allow the researcher to
evaluate whether there is a significant difference in mean
performance of the groups. This will identify whether gender is
a moderating variable.
Length of Service in Leadership. The researcher will
collect and evaluate length of service in leadership as a
demographic variable. The purpose is to understand if this
variable is a mediating variable in driving employee engagement.
For example, do leaders who have been in leadership longer drive
higher levels of engagement. To evaluate this variable, the
researcher will divide the leaders, based on length of service,
into quartile groups. Using length of service in this fashion
makes this variable an interval scale variable. The researcher
will create a two dimensional contingency table with quartile
group as one dimension and mean employee engagement as the second
dimension. The researcher will use a t-test to obtain a
MOCK STUDY 16
statistical significance in performance based on length of
service in leadership.
Research Question
The area of focus for this quantitative correlational study
is the role that leadership plays in driving employee engagement.
The research aims to explore the relationship that leadership has
on employee engagement. The research question guiding this study
is:
1. What is the relationship of leadership practices and
employee engagement?
To discover the answer to the study’s research questions, the
researcher will examine the following hypotheses:
H01: There is no significant relationship between
leadership practices and employee engagement.
Ha1: There is a significant relationship between
leadership practices and employee engagement.
The study hopes to answer this question to fill the current gaps
in knowledge about how leadership practices affect levels of
employee engagement. By conducting the study, the researcher
MOCK STUDY 17
should be able to identify any statistically significant
relationships that may exist between the study variables.
Association of the leadership practices with corresponding
changes in employee engagement should yield deeper understanding.
Although it is the hope of the researcher to identify
leadership practices that will enhance the levels of employee
engagement, the study hypothesis Ha1 is non-directional. A non-
directional hypothesis is one in which the direction of the
relationship, positive or negative, is not specified (Black,
1999; Vogt, 2007). Because the study may just as likely identify
leadership practices that inhibit as well as enhance employee
engagement, the researcher posed the hypothesis in a non-
directional fashion.
Because the hypothesis is non-directional, the researcher
intends to use two-tailed correlational statistical tests. A
two-tailed test is one in which the researcher looks for
correlation of the study variables as shown by either an increase
or a decrease (Black, 1999; Vogt, 2007). Although the
statistical power of a one-tailed test is stronger, the nature of
MOCK STUDY 18
the research question and hypothesis is such that a positive or
negative relationship may exist. Therefore, the research must
use two-tailed tests for correlation. With the use of two tailed
tests, there is a lower probability of making a Type I error,
rejecting a true null hypothesis. However, there is an increased
probability of making a Type II error, failure to reject a false
null hypothesis. To account for this, the researcher will need
to pay special attention to confounding variables as well as
sample size and selection.
Research Instrument
Research instruments must meet certain criteria to be valid
for use in a study. One of the most important criteria is
internal consistency reliability. Christensen, Johnson, and
Turner (2011) wrote that internal consistency reliability is a
measure of how well the items on a test measure a single
construct. For a test to be valid, it must have a high degree of
reliability. Therefore, it is generally accepted practice to
utilize published and tested assessments.
MOCK STUDY 19
For this study, two such instruments are required. The
first instrument will measure the level of transformation
leadership in the leadership population. The Multifactor
Leadership Questionnaire (MLQ) is the accepted standard for
measuring transformational leadership (Harazd, & van Ophuysen,
2011). The work of Bass and Avolio form the basis for the
instrument. The test typically shows a Cronbach's alpha from .63
to .94. Cronbach’s alpha is a measure of the internal validity
of the instrument. These scores represent a high degree of
internal consistency, which makes the MLQ an appropriate
instrument to utilize for the proposed study,
The second instrument needed for the study is one that can
measure employee engagement. The Utrecht Work Engagement Scale
(UWES) is an accepted measure of employee engagement (Fong & Ng,
2012). The UWES-9 version of the questionnaire exhibits high
levels of internal consistency and reliability. Using this test,
researchers are able to arrive at a measure that accurately
represents the level of engagement.
MOCK STUDY 20
Utilizing these two assessments, the proposed study will
ensure internal validity. The selected instruments are both
well-known and exhibit high levels of consistency and
reliability. This makes these two assessments appropriate
selections for the study, which will increase the acceptance of
the study results among the academic community.
Sampling and Data Collection
Sampling and data collection are two very important aspects
of any research study. Sampling is a process whereby the
researcher selects a number of elements from a list of possible
elements in the population (Shaughnessy, Zechmeister, &
Zechmeister, 2002). For study results to be accurate, it is
imperative that the selected sample is representative of the
general population (Christensen, Johnson, & Turner, 2011; Black,
1999; Vogt, 2007; Shaughnessy, Zechmeister, & Zechmeister, 2002).
Generalizability of study results is critically dependent on
the representativeness of the sample population (Christensen,
Johnson, & Turner, 2011; Black, 1999; Vogt, 2007; Shaughnessy,
Zechmeister, & Zechmeister, 2002). Another way of stating
MOCK STUDY 21
generalizability of study results is external validity. For a
researcher to draw conclusions for the population at large based
on the study results, the researcher must apply rigor in sample
selection.
Sample selection is important as well for controlling for
confounding variables (Black, 1999). By carefully selecting the
sample, the researcher minimizes the chances of introducing new
and previously unidentified variables into the study. Since
hidden extraneous variables can corrupt study results by
influencing the independent variables, researchers must control
for unknowns. This would affect the internal validity of the
study. Internal validity is a representation of the relationship
between independent and dependent variables (Christensen,
Johnson, & Turner, 2011).
For the proposed study, the researcher intends to use a
probability sampling method. A probability sample is one in
which each member of the population has equal probability of
being selected into the sample (Vogt, 2007). There are four
different types of probability samples: random, systemic,
MOCK STUDY 22
stratified, and clustered. A random sample is one in which there
is equal probability of selecting each member of a population
into the sample group. A stratified sampling method is one in
which one first sub-divides the group and then use random
sampling techniques to select from this smaller population. A
cluster sample is one in which a researcher will cluster the
participants and then randomly select from those clusters. A
systemic method is an approximated random sample. To utilize
this method, a researcher will list the population, and then
select every “nth” person. The purpose of a probability sample
is to increase the likelihood of selecting participants that are
representative of the population at large. This increases the
generalizability (external validity) of the study results
(Christensen, Johnson, Turner, 2011; Black, 1999; Vogt, 2007;
Shaughnessy, Zechmeister, & Zechmeister, 2002).
The population for the proposed study consists of call
center employees for a large California based media company. The
population size is 20,000 front line employees. The ratio of
employees to leaders is 15:1. This means that there are
MOCK STUDY 23
approximately 1,300 leaders and 19,000 employees. The researcher
will utilize systemic sampling design. The researcher will
select systemically from a list of leaders. This should provide
a random representation of the population.
Statistical power is important for a researcher to address
in study design (Black, 1999). Statistical power is a
representation of both the strength and validity of study
results. Sampling procedures and measurement procedures (data
collection) are two components that influence statistical power.
When determining the sampling protocol, a researcher must
consider sample size and sample quality (Black, 1999;
Shaughnessy, Zechmeister, & Zechmeister, 2002). Larger sample
sizes generally reduce the chance of error. Sample quality
pertains to the homogeneity and representativeness of the sample
population with respect to the designated traits. Casually
selecting sample populations will increase error variance.
Because the researcher intends to study the correlation of
leadership on employee engagement, sample size is an important
consideration. When calculating sample size one must consider
MOCK STUDY 24
the desired confidence level, confidence interval, and
population. The confidence level and confidence interval work
together to determine the accuracy of results (Vogt, 2007; Black,
1999). The confidence interval is the plus or minus range on a
given data point. Another name for this is the margin of error.
For example, a confidence interval of 5 says that the answer is
between x-5 and x+5. The confidence level is a percentage that
tells how sure the answer is. It represents how often the answer
lies within the confidence interval. For example, a 95%
confidence level states that 95% of the time the answer is
between x-5 and x+5.
For studies to be statistically accurate, it is generally
acceptable to have a confidence level of 95%. For the proposed
study, the confidence interval for leadership scores is five.
Given the population size of 1300 leaders, and the aforementioned
confidence level and confidence interval, the study requires a
sample size of 297 leaders ("Sample size calculator," 2012).
Given the ratio of 15:1 employees to leaders, this yields
approximately 5000 employees in the sample population. With a
MOCK STUDY 25
95% confidence level, and a population of 19,000 total employees,
the confidence interval for the employee sample will be 1.19.
With respect to data collection, two important
considerations influencing statistical power are reliability of
the instrument and instrument design (Black, 1999). Reliability
refers to the consistency of scores from the measurement
instrument (Christensen, Johnson, & Turner, 2011). To ensure
accuracy of the study results, the instrument must report
consistent results in similar populations and situations.
Validity pertains to the appropriateness of the instrument for
collecting data regarding the study variables. Instrument design
ensures validity. Instrument design determines the level of
measurement of the variables, and thereby the statistical tests
used to make inferences.
The proposed study utilizes to well-known and widely
accepted instruments for data collection, the MLQ and the UWES-9.
Both instruments possess high degrees of reliability and
validity. Each instrument has a history of use in many studies
for purposes similar to those in the proposed research. As such,
MOCK STUDY 26
there are no concerns related to statistical power stemming from
data collection as related to the instruments. Each leader will
be administered the MLQ. Each employee will be administered the
UWES-9. To facilitate collection and analysis of the data
administration of the tests will occur electronically. SPSS
statistical software will provide analysis of the collected data.
Exploring the Instruments
Understanding the critical contribution that data collection
makes to a study justifies further exploration of the survey
instruments. Black (1999) shared that a researcher must
critically consider the appropriateness of an instrument to
achieving the study’s goals. What is clear is that a researcher
must understand the basis of instrument construction, such as the
variables measured, the instrument validity, as well as the
reliability (Christensen, Johnson, & Turner, 2011). There must
be alignment between the study’s goals, the construct of the
instrument, and the population studied.
The Multifactor Leadership Questionnaire (MLQ), based on the
work of Bass and Avolio, is one of the most often used
MOCK STUDY 27
instruments for measuring leadership style (Den Hartog, Van
Muijen, & Koopman, 1997). The MLQ finds its roots in Full Range
Leadership Theory (Garg & Ramjee, 2013). Full Range Leadership
Theory (FRLT) is an effective way to explain leadership and show
its multidimensional nature (Antonakis & House, 2002). FRLT
represents leadership behaviors in tangible and empirically
measurable behaviors that predict leadership outcomes.
The FRLT is an integrative approach to leadership, which
explains the leader’s ability to drive follower performance
(Antonakis & House, 2002). The leadership scales of the FRLT
hierarchically relate to leadership outcomes in that
transformational constructs and contingent rewards are positive
predictors of effectiveness. As well, the passive constructs are
negative predictors. “There is substantial and consistent
support for this hierarchy of effects of leader behaviors based
on the results of numerous studies” (p.10).
The MLQ has been improved and tested over time (Antonakis &
House, 2002). This instrument is the best-validated instrument
representing the FRLT. The MLQ is a strong predictor of leader
MOCK STUDY 28
performance across many different types of organizations (Garg &
Ramjee, 2013). Because of this rich history, the MLQ is a
reliable measure of the components of transformational,
transactional, and non-transactional leadership. Bass and Avolio
showed that the test is valid and reliable. The instrument
provides consistent and statistically valid results across
cultures, raters, and regions. Therefore, no modification is
required for use in the proposed study.
The MLQ contains 45 questions focused on transformational
and transactional leadership styles (Golla & Johnson, 2013). The
test, developed by Avolio and Bass, is licensed for use through
Mindgarden.com. The current version of the MLQ instrument is the
MLQ5X (Bass & Avolio, 2013). The MLQ5X is the benchmark
assessment for Transformational leadership. The license grants
the researcher the right to reproduce and administer the test
electronically.
The MLQ has been the subject of much debate in the academic
community with respect to validity and reliability. Some have
questioned the representative value of the instrument with
MOCK STUDY 29
respect to transformational leadership characteristics. Much
debate exists around the factorial validity of the instrument
(Heinitz, 2006). Factorial validity is a part of construct
validity. Construct validity addresses the appropriateness of an
instrument for the measurement of the variables in question
(Black, 1999; Christensen, Johnson, & Turner, 2011).
Evidence shows a high correlation between transformational
scales. Some debate exists as to whether a reduced set of
factors would provide a better representation of transformational
leadership behaviors (Heinitz, 2006). Even critics admit the
test shows statistically valid and correlated results. Bass and
Avolio addressed the concerns and modified the instrument. The
MLQ5X is valid and reliable (Antonakis & House, 2002). “Avolio
et. al. demonstrated that the MLQ5X is reliable and valid, and
offered evidence for its discriminant validity using the full
nine-factor model” (p. 18) This makes the MLQ an appropriate
choice for measuring leadership in the proposed study.
The UWES-9 is a highly reliable and consistent measure of
employee engagement (Fong & Ng, 2012). The UWES-9 measure stems
MOCK STUDY 30
from the work done to create the Utrecht Work Engagement Scale
(UWES) (Seppälä, Mauno, Feldt, Hakanen, Kinnunen, Tolvanen, &
Schaufeli, 2009). The UWES has been used in many different
regions, locales, and cultures. Translations exist for many
different languages. In addition, many studies with different
types of workers, from blue-collar to professional, have used the
assessment. The UWES measures work engagement across three
scales: vigor, dedication, and absorption. These factors are a
positive and stable indication of occupational well-being.
The UWES-9 is a nine-question test and takes an average five
to ten minutes to complete. (Schaufeli & Bakker, 2003).
Respondents complete the assessment by evaluating each statement
about work attitude. Each statement is rated on a scale of 0
(never) to 6 (always) with respect to job satisfaction. The
test is easy to administer and can be given in a standalone
version, or as part of a larger assessment.
The UWES scale has its roots in the work of Schaufeli and
Bakker at Utrecht University in the Netherlands (Schaufeli &
Bakker, 2003). The authors sought a measurement of true
MOCK STUDY 31
engagement and developed the scale as an alternative to the
traditional views, which evaluated employee burnout. The UWES-9
instrument benefits from extensive psychometric testing. The
instrument has undergone tests for factorial validity, inter-
correlation, cross-national invariance, internal consistency, and
stability.
Factorial analysis has demonstrated that the UWES’s three-
factor analysis of employee engagement is superior to the
previous one factor model (Schaufeli & Bakker, 2003). The three
dimensions of the UWES are closely correlated (correlation
coefficient = .65, with latent variable correlation between .80
and .90). The test is largely invariant across multiple
languages and cultures. The UWES has a high degree of internal
consistency (all tests yield Cronbach’s alpha values greater than
.70, with typical scores ranging between .80 and .90). The
instrument also has a high degree of stability with two-year
stability coefficients of .30, .36, and .40 for vigor,
dedication, and absorption respectively.
MOCK STUDY 32
Validation of the UWES instrument occurred in several
countries (Bakker & Demerouti, 2008). A confirmatory factor
analysis of the results from the various studies utilizing the
UWES scale shows the three-factor model is superior to that of
any of the alternative factor structures. The UWES-9 is valid,
captures the three-factor dimensionality of engagement, and
yields reliable scores (Mills, Culbertson, & Fullagar, 2012).
The UWES-9, with high degrees of reliability and validity and
consistency across cultures and populations, will provide strong
indications of employee engagement in the proposed study. Given
this, no modifications to the UWES-9 are required for the
proposed study.
Conclusion
Dissertations are a critical component of the doctoral
learning experience. As such, being able to successfully design
and execute a study is an important skill for the doctoral
learner to develop. The execution of a mock study provides the
student with the opportunity to hone these important skills. As
illustrated, identifying the research purpose is the first step
MOCK STUDY 33
towards executing a study. From there the researcher selects a
design. The design must be appropriate to address the research
problem and questions. The researcher then develops an
operational definition of the study variables. The researcher
formulates research questions and hypotheses driving the study.
With the design selected and operational definition complete, the
researcher must select instruments to measure the variables.
These critical components of executing a research study are
important to address correctly. From the choices made at this
juncture, the rest of the study will unfold. Spending time
developing these skills is time well invested by the doctoral
learner.
MOCK STUDY 34
References
Ahmed, Z., Shields, F., White, R., & Wilbert, J. (2010).
Managerial communication: The link between frontline
leadership and organizational performance. Journal of
Organizational Culture, Communication and Conflict, 14(1), 107-120.
Retrieved ProQuest.
Antonakis, J., & House, R.J. (2002). The full-range leadership
theory: The way forward. Transformational and Charismatic
Leadership, 2(1), 3-33.
Bakker, A.B., & Demerouti, E. (2008). Towards a model of work
engagement. Career Development International 13(3), 209-223.
Bass, B.M. (1999), Two decades of research and development in
transformational leadership. European Journal of Work and
Organizational Psychology, 8(1), 9-32.
Bass, B.M., & Avolio, B.J. (2013). MLQ for researchers. Retrieved
from http://www.mindgarden.com/products/mlqr.htm#mlq3605x.
Black, T. R. (1999). Doing quantitative research in the social sciences: An
integrated approach to research design, measurement, and statistics.
London, England: Sage Publications.
MOCK STUDY 35
Burns, J. M. (1978). Transactional and transforming leadership.
In Wren (Ed.), The leader's companion - insights on leadership through the
ages. (pp. 100-101). New York: The Free Press.
Christensen, L. B., Johnson, R. B., & Turner, L. A. (2011).
Research methods, design, and analysis. Boston, MA: Allyn & Bacon.
Clawson, J. G. (2006). Level three leadership: Getting below the surface. (3rd
ed.). Upper Saddle River, NJ: Pearson.
Davidson, P. L., Azziz, R. R., Morrison, J. J., Rocha, J. J., &
Braun, J. J. (2012). Identifying and developing leadership
competencies in health research organizations: A pilot
study. The Journal of Health Administration Education, 29(2). Retrieved
from ProQuest.
Den Hartog, D.,N., Van Muijen, J.,J., & Koopman, P. L. (1997).
Transactional versus transformational leadership: An
analysis of the MLQ. Journal of Occupational and Organizational
Psychology, 70, 19-34. Retrieved from PqoQuest.
Fong, T. C., & Ng, S. (2012). Measuring engagement at work:
Validation of the Chinese version of the Utrecht work
MOCK STUDY 36
engagement scale. International Journal of Behavioral Medicine, 19(3),
391-7. doi:10.1007/s12529-011-9173-6.
Garg, A. K., & Ramjee, D. (2013). The relationship between
leadership styles and employee commitment at A Parastatal
company in south Africa. The International Business & Economics
Research Journal (Online), 12(11), 1411. Retrieved from ProQuest.
Golla, E., & Johnson, R. (2013). The relationship between
transformational and transactional leadership styles and
innovation commitment and output at commercial software
companies. The Business Review, Cambridge, 21(1), 337-343.
Retrieved from ProQuest.
Harazd, B., & van Ophuysen, S. (2011). Transformational
leadership in schools: The use of the "multifactor
leadership questionnaire" (MLQ 5 x short). Journal for Educational
Research Online, 3(1), 141-167. Retrieved from ProQuest.
Heinitz, K. (2006). Assessing the validity of the multifactor leadership
questionnaire: discussing new approaches to leadership. (Unpublished
doctoral dissertation, University of Berlin). Retrieved
from
MOCK STUDY 37
http://www.diss.fu-berlin.de/diss/servlets/MCRFileNodeServle
t/FUDISS_derivate_000000001975/00_Heinitz.pdf?hosts=.
Jauhari, V., Sehgal, R., & Sehgal, P. (2013). Talent management
and employee engagement: Insights from Infotech Enterprises
LTD. Journal of Services Research, 13(1), 161-186. Retrieved from
ProQuest.
Mills, M. J., Culbertson, S. S., & Fullagar, C. J. (2012).
Conceptualizing and measuring engagement: An analysis of the
Utrecht work engagement scale . Journal of Happiness Studies, 13(3),
519-545. doi:10.1007/s10902-011-9277-3.
Pruijn, G.H.J. & Boucher, R.J. (1995). The relationship of
transactional and transformational leadership to the
organisational effectiveness of Dutch national sports
organisations. European Journal of Sport Management (2)1, 72-87.
Robertson, I. & Cooper, C (2011). Well-being: Productivity and happiness
at work. Houndmills, Basingstoke, Hampshire, England:
Palgrave Macmillan.
Sample size calculator. (2012). Retrieved from
http://www.surveysystem.com/sscalc.htm
MOCK STUDY 38
Schaufeli, W., & Bakker, A. (2003). UWES: Utrecht work engagement
scale - Preliminary manual. Informally published manuscript,
Occupational Health Psychology Unit Utrecht University,
Retrieved from
http://www.beanmanaged.com/doc/pdf/arnoldbakker/articles/art
icles_arnold_bakker_87.pdf.
Seppälä, P., Mauno, S., Feldt, T., Hakanen, J., Kinnunen, U.,
Tolvanen, A., & Schaufeli, W. (2009). The construct
validity of the Utrecht work engagement scale: Multisample
and longitudinal evidence. Journal of Happiness Studies, 10(4), 459-
481. doi:10.1007/s10902-008-9100-y.
Shaughnessy, J.J., Zechmeister, E.B., & Zechmeister, J.S. (2002).
Research methods in psychology. New York, NY: McGraw-Hill
Higher Education.
Soieb, A. Z. M., Othman, J., & D'Silva, J. L. (2013). The
effects of perceived leadership styles and organizational
citizenship behaviour on employee engagement: The mediating
role of conflict management. International Journal of Business and
Management, 8(8), 91-99. Retrieved from ProQuest.
MOCK STUDY 39
Vogt, P. R. (2007). Quantitative research methods for professionals.
Boston, MA: Pearson.
Zahari, I.B., & Shurbagi, A. M. A. (2012). The effect of
organizational culture and the relationship between
transformational leadership and job satisfaction in
petroleum sector of Libya. International Business Research, 5(9),
89-97. Retrieved from
http://search.proquest.com/docview/1040716425?
accountid=35812.