testing the circular structure and importance hierarchy of ... · the hierarchy of value states...

33
1 Testing the Circular Structure and Importance Hierarchy of Value States in Real-Time Behaviors Ewa Skimina, Cardinal Stefan Wyszyński University in Warsaw, Poland Jan Cieciuch, Cardinal Stefan Wyszyński University in Warsaw, Poland and University of Zurich, Switzerland Shalom H. Schwartz, The Hebrew University of Jerusalem, Israel Eldad Davidov, University of Cologne, Germany and University of Zurich, Switzerland René Algesheimer, University of Zurich, Switzerland

Upload: others

Post on 20-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

1

Testing the Circular Structure and Importance Hierarchy of Value States

in Real-Time Behaviors

Ewa Skimina,

Cardinal Stefan Wyszyński University in Warsaw, Poland

Jan Cieciuch,

Cardinal Stefan Wyszyński University in Warsaw, Poland

and University of Zurich, Switzerland

Shalom H. Schwartz,

The Hebrew University of Jerusalem, Israel

Eldad Davidov,

University of Cologne, Germany

and University of Zurich, Switzerland

René Algesheimer,

University of Zurich, Switzerland

Page 2: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

2

Highlights for “Testing the Circular Structure and Importance Hierarchy of Value States in

Real-Time Behaviors”

We distinguish value traits from value states.

Value states for volitional acts reproduce the circular structure of value traits.

Value states for non-volitional acts do not reproduce the circular structure.

The hierarchy of value states differs from the hierarchy of value traits.

Page 3: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

3

Testing the Circular Structure and Importance Hierarchy of Value States

in Real-Time Behaviors

Abstract

This research is the first to assess directly Schwartz’s claim that the circular structure of

values derives from value compatibilities or conflicts experienced in real-time behaviors. We

differentiate two types of values: value traits guide perception and behavior over time and

situations and value states guide real-time behavioral acts. We measured the value states of

374 participants for 13,873 behavioral acts with experience sampling, distinguishing

volitional from non-volitional acts. As hypothesized, value states for volitional acts, but not

for non-volitional acts reproduced the circular value structure. The importance hierarchies of

value states differed substantially from the importance hierarchy of value traits, suggesting

that the importance of value states depends more on situations than on the hierarchy of value

traits.

Keywords: value states, value traits, value structure, value priorities, experience sampling

Page 4: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

4

1. Introduction

The Schwartz (1992) theory of basic values defines values as decontextualized life

goals that vary in importance as guides to perception and behavior. The more important a

value, the more likely it is to serve as a guide. Voluntary acts that promote attainment of the

goals of a value express the importance of that value to the actor.

The theory postulates that relations among values take the form of a circular

motivational continuum (Schwartz 1994, 2015). Relations between values and actions are a

major source of this circular structure, according to the theory (Schwartz, 1992, 2015). The

theory assumes that real-time acts that express or promote attainment of each value also

simultaneously inhibit or undermine attainment of other values. For example, skydiving

promotes the goals of stimulation values but undermines security values. Similarly,

manipulating others promotes the goals of power values but undermines benevolence values.

And criticizing one’s boss promotes the goals of self-direction values but undermines

conformity values. These three examples identify behaviors with opposing implications for

attaining the goals of particular pairs of competing values, stimulation versus security, power

versus benevolence, and self-direction versus conformity.

When many real-time acts consistently promote the goals of one value while

frustrating the goals of another, the two values can be seen as competing or conflicting. The

choice to enact behaviors that promote one value will usually entail sacrificing the other

value. The conflicts between pairs of values when enacting single, real-time acts give rise to

their opposing positions in the motivational circle of values.

Across time and circumstances, people are more likely to choose to enact behaviors

that promote their more important values. However, on some occasions they may choose to

act in ways that promote less important or competing values, depending on circumstances.

Page 5: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

5

But, the theory argues, people cannot choose to promote competing values simultaneously in

any single act.

Single, real-time acts may express or promote attainment of more than one value. For

example, criticizing one’s boss as prejudiced expresses self-direction values but also

universalism values. It may also promote attainment of stimulation values. If various single

acts tend to express the importance of a set of values simultaneously, those values are

compatible. Adjacency of values in the motivational circle signifies their compatibility. Thus,

self-direction values are adjacent to universalism values on one side and to stimulation values

on the other. Similarly, tradition and security values are adjacent to conformity values

because many acts that promote the goals of conformity values also promote the goals of

tradition and security values.

In sum, according to the theory, the circular continuum of values captures the

conflicts and compatibilities among the values. Although people can and do pursue the goals

of competing (i.e., opposed) values, the theory postulates that they cannot do so in the same,

single act. Surprisingly, this central assumption of the theory—the basis of the circular

structure of values in real-time behavioral acts—has not been subject to a direct test.

Numerous studies, both within and across persons, including self- and other-reports,

and spanning multiple cultures, have confirmed the circular structure of basic values (Bilsky,

Janik, & Schwartz, 2011; Borg, Bardi, & Schwartz, 2015; Borg, Dobewall, & Aavik, 2016;

Schwartz, 2015; Skimina & Cieciuch, 2017). All of these studies used global measures of

value importance; they asked people how important different values are to them in general,

that is, values as dispositions or traits. None of the studies asked people which values are

more or less important to them in their current, real-time behavior. Our research addresses

this crucial gap in the literature. Thus, the first aim of this research is to examine the structure

Page 6: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

6

of values as reflected in their importance in single behavioral acts, the presumed basis of the

circular structure of values.

Although people differ in the importance they attribute to basic values, there is

substantial consensus across almost all societies regarding the hierarchical order of values.

Questionnaire-based studies in which people report their general preferences for values reveal

that benevolence, universalism, and self-direction are the most important values and that

power and stimulation are the least important values both for adults and children (Döring, et

al. 2015; Schwartz & Bardi, 2001). To date, however, no research has asked which values are

most and least important in guiding real-time, everyday behavioral acts. The second aim of

this research is to address this question.

2. Value traits and value states

Our approach to studying the importance of the values that guide behavioral acts is

analogous to Fleeson’s (2001) approach to personality states. He defined personality states as

very short duration expressions of personality traits with the same affective, behavioral, and

cognitive content as the corresponding trait (Fleeson & Gallagher, 2009). For example,

consider extraversion. To measure the state, respondents report the degree to which a given

real-time behavior expresses extraversion (or other traits). In this approach, traits are density

distributions of states.

We make a similar differentiation with regard to values. Values are like traits when

understood as decontextualized life goals that vary in importance as guides to perception and

behavior over time and situations (Schwartz, 1992). Values are like states when understood

as goals that vary in importance as guides to real-time behavioral acts. Thus, according to the

value theory, a circular structure of values can derive from the conflict and compatibility

among values experienced through value states. Self-reports of general trait-like value

preferences reflect the accumulation of these experiences over time and situations.

Page 7: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

7

The experience sampling method (ESM) we used enabled us to measure values as

states experienced in real-time behavioral acts. The ESM permits assessment of value states

experienced in natural settings, in real time, and across repeated occasions (Hektner, Schmidt,

& Csikszentmihalyi, 2007). Participants report on their experiences multiple times per day for

multiple days (Conner, Feldman Barrett, Tugade, & Tennen, 2007).

Studies of personality states have implemented ESM (Fleeson, 2001; Fleeson &

Gallagher, 2009), but this is its first application for studying value states. Using ESM for

studying values provides a perspective that differs from the usual questionnaire approach.

Value questionnaires probe the importance of each value to individuals as general, guiding

dispositions. ESM probes the importance of each value to individuals as guiding states for

particular single, real-time behavioral acts. Thus, our application of ESM enables us to test

whether the circular structure of relations among values emerges from real-time measures of

the relative importance of different values in single behavioral acts. In the methods section,

we describe the way we adapted ESM to measure the importance of values in real-time

behavioral acts.

3. Volitional versus non-volitional behavioral acts

In studying real-time behavior, we distinguished between volitional and non-volitional

behavioral acts. We defined volitional acts as self-chosen and non-volitional acts as coerced

by other people or circumstances. These definitions correspond to the two extreme

motivation types distinguished by Deci and Ryan (2000): autonomous motivation (volitional

acts) and controlled motivation (non-volitional acts). Self-Determination Theory (SDT; Deci

& Ryan, 2000) assumes that autonomy—defined as perception that one’s activity was self-

chosen—is one of three psychological needs essential for understanding of goal-directed

behavior and for achieving well-being. This basic assumption has served as the theoretical

basis for numerous experience sampling studies. These studies have examined associations

Page 8: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

8

between perceived autonomy during real-time activities and well-being (e.g., Grund,

Grunschel, Bruhn, & Fries, 2015; Reis, Sheldon, Gable, Roscoe, & Ryan, 2000), mood (e.g.,

Weinstein & Mermelstein, 2007) and optimal experience (e.g., Bassi & Delle Fave, 2012).

SDT further assumes that people express their traits differently in various situations as a

function of how much their need for autonomy is satisfied (La Guardia & Ryan, 2007).

Experience sampling studies have built on this assumption to investigate within-person

personality variability (Ching et al., 2014; Church et al., 2013).

Distinguishing volitional from non-volitional behavioral acts is especially important

for investigating relations of value states to action. Reis et al. (2000) highlighted the link

between autonomy and values by defining autonomy as feeling that what one is doing

expresses one’s true values.

Values guide people’s choices, explicitly or implicitly, to act one way or another. The

less an action is the product of choice, the less likely it is to be influenced by one’s personal

value priorities. For example, people’s value priorities substantially predicted how religious

people chose to be but not how much positive affect they said they experienced (Roccas,

Sagiv, Schwartz, & Knafo, 2002; Schwartz, 2015). If strong situational circumstances coerce

various actions, virtually eliminating choice, those actions will not reflect the importance of

individuals’ unique personal values. Consequently, the actions and the reasons given for

enacting them will provide little information about individuals’ actual values. These non-

volitional acts and their reported motivations are unlikely to reflect the structure of relations

among personal values because that structure derives from actions chosen to pursue the goals

of particular values at the expense of opposing values.

Another understanding of the relationship between values and actions also suggests

that volitional acts are more relevant to the value structure. Values and actions have a

reciprocal relationship. Not only do values guide actions, but actions influence values

Page 9: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

9

(Fischer, 2017). Both consistency (Heider, 1958) and self-perception theories (Bem, 1972)

provide rationales for this claim. After enacting a behavior, people are likely to modify their

value priorities, to change the importance they ascribe to different values in order to make

their priorities more consistent with their actions and the goals implied by taking those

actions. This process of changing cognitions consequent upon actions occurs primarily for

volitional behavior.

4. The current study

The current study addresses two main questions. (a) Does the importance of value

states in real-time behavioral acts reproduce the circular structure of values observed with

measures of value traits? (b) Is the importance hierarchy of the values expressed in real-time

behavioral acts (value states) similar to the hierarchy obtained when individuals report their

value preferences in a value questionnaire (value traits)?

Based on the reasoning presented above we formulated two hypotheses.

Hypothesis 1: The structure of relations among value states assessed as important in real-

time, volitional behavior is consistent with the circular motivational continuum

postulated by the theory of basic values.

Hypothesis 2: The importance hierarchy of value states assessed in real-time, volitional

behavior is more similar to the hierarchy in self-reports of value importance on

questionnaires (i.e., traits) than is the hierarchy assessed in real-time non-volitional

behavior.

5. Method

5.1. Participants

The study was conducted in Poland with a sample recruited by trained, paid research

assistants. The recruited participants took part in a three-wave study including an online self-

report questionnaire and an experience sampling in each wave. The data analyzed in this

Page 10: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

10

study comes from the first wave. After completing all three waves, participants received a

voucher worth 70 PLN (approximately 20 USD). From the sample of 652 participants who

started to participate in the experience sampling phase (ESM), we selected 445 participants

who responded to the prompts in their device at least 20 times. The final sample consisted of

374 persons, who both filled in the value inventory before participating in the ESM, and who

responded at least 20 times to the prompts in their device during the ESM phase of the study.

Their age ranged from 17 and 53 (M = 23.72, SD = 4.67), 78.9% were female, all Caucasian.

We confirm that we made an effort to report all measures and data exclusion

procedures in the manuscript. If any further details about the design are unclear, they may be

provided by the first author upon request.

5.2. Procedure

Participants first completed a value questionnaire online. They then downloaded a

mobile app (RealLife Exp) to their own mobile device and activated it. For the next seven

days, the app sent participants a prompt seven times per day, at random times between 9.30

a.m. and 9.30 p.m. with a minimum of 60 minutes between prompts. The prompts provided a

link to the ESM questions and remained active for 45 minutes. Each question in the ESM

appeared on a separate screen. Responding to the questions did not require an internet

connection. Responses were sent to the server when the participant’s device was connected to

the internet.

5.2.1. Experience sampling

To identify the values important in real-time behavioral acts, the prompt presented 16

questions to participants (including five, closed-ended, not relevant to this study). A first,

open-ended question asked, “What have you been doing during the past 15 minutes?” The

second question measured whether the activity was volitional or not. It presented two options:

“This activity was imposed by another person or by the circumstances” or “This activity was

Page 11: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

11

my choice—I could either do or not do it.” Next, participants were asked, “When you were

engaging in this activity, how important was it to you to…?” This question appeared on the

screen of their device nine times, each time ending with a different value (e.g., enjoy

yourself, avoid danger). Table 1 presents all endings, the values they measured, and short

value definitions. The value questions appeared one at a time, in random order. Participants

responded on a scale from 1 (not important at all) to 4 (very important). We selected the

values from the refined theory of 19 basic values (Schwartz, et al. 2012; Schwartz, 2017).

Responding to a question on each of the 19 values several times a day in unexpected

situations would doubtless be exhausting. We therefore selected only nine values, two from

each higher order value (plus hedonism). The items included one value from each of the

original ten basic values (except tradition, which we excluded based on the belief that people

pursue it infrequently in everyday behavior).

Table 1

5.2.2. Value questionnaire

We used the Portrait Values Questionnaire – Revised (PVQ-RR; Schwartz, 2017) to

measure general value priorities. The PVQ-RR consists of 57 items that index the 19 values

in the refined theory of basic values (Schwartz et al., 2012; Schwartz 2017). Each item

describes a different person in terms of his or her values. Respondents report how similar the

person described in each item is to themselves on a 6pt scale (from 1 – not like me at all to 6

– very much like me).

5.2.3. Pool of behaviors

Participants provided responses for 13,873 separate behavioral acts. Of these, 9,592

were described as volitional, 4,254 as non-volitional, and 27 were not classified. The average

number of acts per person was 37.1, with a range from 19 to 49.

Page 12: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

12

From the non-volitional pool, we excluded observations if there were less than four of

them provided by the same person. The final analyzed pool of responses associated with

volitional behaviors was 9,592, provided by 374 participants (a mean of 25.6 responses per

person). The final analyzed pool of responses associated with non-volitional behaviors was

4,181, provided by 324 participants (a mean of 12.9 responses per person). The data had a

multilevel structure (Hox, 2002) because there were several value states measured within

each respondent. Based on Maas and Hox (2005), one can conclude that all multilevel

estimates can be treated as unbiased and accurate because of the large number of participants

in both pools, despite the low number of observations provided by some participants.

6. Results

6.1. Descriptive statistics

Descriptive statistics for items measuring value states in ESM were computed using

two packages for R: multilevel (means and standard deviations; Bliese, 2016) and psych

(ICC(1) and ICC(2); Revelle, 2017). Table 2 presents descriptive statistics computed on the

entire sample of 13,873 responses. The standard deviation for the importance of each value

state was always higher within-persons than between-persons. This indicates that the intra-

individual variance in value importance for different behaviors was larger than the between-

person variance in average importance of the values pursued across situations. Table 2 also

presents two intraclass correlation coefficients (ICC). ICC(1) shows the total variance

attributable to persons. These value state results are similar to the personality state results

measured with ESM (cf. Fleeson & Gallagher, 2009). ICC(2) shows that the between-person

variance, all >.9, is sufficient to differentiate between persons (Bliese, 2016).

Table 2

Table 3 presents descriptive statistics for items measuring value importance in ESM

computed separately on the pools of volitional and non-volitional behaviors. The standard

Page 13: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

13

deviation of the values within person was always higher than between persons for both

volitional and non-volitional behaviors. The within-person variance was slightly higher for

volitional behaviors, whereas the between-person variance was slightly higher for non-

volitional behaviors. ICC(2) was slightly lower in the pool of non-volitional behaviors,

perhaps due to the smaller number of observations per person in this pool.

Table 3

Table 4 presents descriptive statistics for the value traits, measured with the PVQ-RR

questionnaire, together with zero-order correlations between the values and their Cronbach’s

alpha coefficients. Scores were mean-centered before computing the correlations (i.e.,

individuals’ average rating of all values was subtracted from each value score). The

Cronbach’s alpha coefficients of the nine value indexes were adequate, especially considering

that each was based on only three items. The signs of the correlation coefficients were

congruent with the theory (Schwartz et al., 2012).

Table 4

6.2 The structure of value states assessed in real-time, behavioral acts

We tested the circular structure of value states with two-dimensional, ordinal,

multidimensional scaling (MDS), using SPSS 22. We analyzed the structure of values

assessed for importance in volitional and non-volitional behaviors separately. Figures 1a (for

value states expressed in behaviors tagged by participants as volitional) and 1b (for value

states expressed in behaviors tagged by participants as non-volitional) present the results.

Page 14: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

14

Figure 1. Multidimensional scaling of nine value states measured via ESM in current (A)

volitional and (B) non-volitional behavior. Abbreviations for value names are presented in

Table 1.

The structure of values important in real-time, volitional behaviors was consistent

with the theorized order around the motivational circle. The nine values formed the typical

two-dimensional structure that opposes Conservation values (security-personal and

conformity-rules) to Openness to change values (self-direction-thought, hedonism, and

stimulation) and Self-enhancement values (achievement and power-resources) to Self-

transcendence values (benevolence-caring and universalism-concern). The data for non-

volitional behavior did not replicate this structure. For those data, the values expected to be in

the same quadrants according to theory were located in different quadrants for Conservation,

Openness to change and Self-Transcendence.

6.3. Comparison of the importance hierarchy of value traits and of value states.

We computed four different hierarchies of values. Column a in Table 5 presents the

average ratings of the value traits across all persons, based on responses to the PVQ-RR.

Following the recommended procedure, we centered each person’s responses on his or her

Page 15: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

15

average response to eliminate individual differences in response tendencies (Schwartz et al.,

2012). Column b presents the average ratings of the value states across all persons, based on

the ESM responses. We also centered these ratings within person before averaging them

(column b). Columns c and d present the average ratings of each value state for volitional and

non-volitional behavioral acts, respectively, averaged across acts, not people. These averages

reveal differences in the importance of value states as a function of whether the acts were

volitional or non-volitional, regardless of variation in response tendencies across people. We

therefore did not center these ratings within person. These averages are based on means

calculated for each variable for each person, so that each participant’s scores are weighted

equally.

Table 5

The hierarchy of value traits based on the PVQ-RR (column a) is consistent with that

found across the majority of samples studied with questionnaires. Benevolence and self-

direction values are highly important and power and stimulation values are unimportant

(Schwartz & Bardi, 2001). The hierarchy based on the mean ratings of the value states from

ESM (column b) differs markedly. Power and hedonism values are most important and

benevolence and universalism are unimportant. The Spearman rank correlation between the

two hierarchies is −.30. The hierarchies based on mean ratings of the importance of each

value in both volitional (column c) and non-volitional (column d) behavioral acts, averaged

across acts, also differed substantially from the PVQ-RR hierarchy. For volitional acts, the

Spearman rank correlation was −.23; for non-volitional acts, it was −.36.

Two differences between the trait and state hierarchies are especially striking.

Benevolence-caring is at the top of the trait hierarchy but relatively unimportant as a

motivator of real-time behavioral acts. In contrast, power-resources is very important as a

motivator of real-time behavioral acts but at the bottom of the trait hierarchy. The hierarchies

Page 16: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

16

for behavioral acts also reveal noteworthy differences between the values that motivate real-

time volitional and non-volitional behavior. Hedonism and stimulation values are important

motivators of volitional but not of non-volitional behavior. In contrast, conformity-rules is a

much more important motivator of non-volitional than of volitional behavior.

Because the comparison of hierarchies presented above does not take into account the

multilevel structure of the data, we conducted additional analyses to examine the hierarchies

on the within- and between-person levels. Using multicon package for R (Sherman & Serfass,

2015), we computed hierarchy (profile) agreement and value-level agreement between the

importance of value traits and value states, separately for volitional and non-volitional acts.

We based the analyses on person-centered means from ESM for states and from the PVQ-RR

for traits. For value hierarchies, we calculated the agreement between each person’s

importance hierarchy (profile) of nine value traits and importance hierarchy (profile) of nine

value states. We then averaged across all persons to obtain the mean hierarchy (profile)

agreement. At the value-level, we calculated the agreement for pairs of state and trait

measures of each value separately (e.g., the achievement state-trait pair, the power-resources

state-trait, etc.). The results portray the average within-person agreement regarding each

value across the whole sample.

Because the list of ICCs for each participant would be troublesome to interpret, we

calculated descriptive statistics of ICCs that show the distribution of within-person profile-

level agreement in the whole sample. We reported ICC(1,1) based on Shrout and Fleiss’ (1979)

recommendations. Table 6 reveals near zero average within-person hierarchy (profile)

similarity of the importance of value traits and of value states both for volitional and non-

volitional real-time behaviors. Although the mean and median coefficients were near zero,

agreement varied substantially among participants. Some were characterized by high profile

Page 17: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

17

similarity (>.6) between their trait and state importance hierarchies whereas others were

characterized by low profile similarity (<−.7).

Table 6

Table 7 reports average within-person agreement between each value trait and its

corresponding value state across the sample. The comparison of the ICCs for each value

indicates that agreement between the importance of value traits and corresponding value

states varied across values. For volitional acts, security-personal and hedonism exhibited the

highest average within-person agreement whereas benevolence-caring and power-resources

exhibited the least agreement. For non-volitional acts, security-personal and stimulation

exhibited the highest average within-person agreement whereas benevolence-caring, power-

resources, and conformity-rules exhibited the least agreement. These results strengthen the

evidence for discrepancies between hierarchies presented in Table 5.

Table 7

In sum, the additional analyses of profile similarity confirmed the conclusions from

comparison of value hierarchies: During everyday activities, people pursue different values

than they report as important in a value questionnaire. The importance hierarchies of value

traits reported in questionnaires and of value states from ESM differ substantially. This is the

case for volitional as well as non-volitional acts. As expected, the value states that motivated

volitional acts were related structurally in a manner fairly consistent with the well-established

value circle of value traits. However, the hierarchies of value states were unrelated to those of

value traits, contrary to our expectation for value states that guide volitional behavior.

7. Discussion

We sought to test a central assumption of the values theory, that a major source of the

circular structure of values is the conflict or compatibility between values experienced in

real-time behavioral acts. For this purpose, we examined the structure of relations among the

Page 18: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

18

values as important motivators of real-time behavioral acts. We also sought to compare the

importance hierarchy of values experienced as important guides in real-time behavior (value

states) with the hierarchy of values assessed as generally important in value questionnaires

(value traits). This was the first values study to use the experience sampling method (ESM)

and to measure the importance of values in real-time behavior.

We adapted Fleeson’s (2001) ESM approach to studying personality states in

everyday behavior to the study of values. Using ESM, we measured values as states, not as

general dispositions. We assumed that individuals are able to assess how important different

values are to them as guides when they perform single behavioral acts.

We found that the within-person variability in value states across everyday activities

is high and comparable to the within-person variability in personality states (Fleeson &

Gallagher, 2009). Also, the between-person variance in value states was high enough to

differentiate between persons. This indicates that values, like personality traits, are not only

dispositions, but are also states that fluctuate from occasion to occasion.

We hypothesized that the structure of relations among values assessed as important in

real-time, volitional behavior is consistent with the circular motivational continuum

postulated by the theory of basic values (Schwartz, 1992, 2017; Schwartz et al., 2012). This

follows from the assumption of the theory that the conflicts between pairs of values, when

enacting single, real-time behaviors, give rise to their opposing positions in the motivational

circle of values. Schwartz postulated that competing values cannot both drive an individual’s

real-time behavioral acts. If one value is important as a motivator of a behavioral act, the

values opposing that value in the motivational circle should be unimportant.

This first study of the structure of values important in real-time volitional behavior

confirmed our hypothesis and supported the basic assumption of the values theory. The

structure we observed was consistent with the theorized order of values around the circle. Our

Page 19: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

19

findings suggest that, in real-time volitional behavioral acts, the values that simultaneously

drive behavior are values located in close proximity in the circle. Moreover, the values that

do not drive or may even inhibit the behavior are those located on the opposite side of the

circle.

As expected, we did not observe a structure consistent with the theorized value circle

for the value states related to non-volitional behavioral acts. If participants feel they have not

chosen what they are doing, the values that drive their behavior, if any, are likely to reflect

responses to external pressure. The emergence of conformity-rules as the most important

value for non-volitional behaviors supports this idea. That power-resources was second most

important may reflect the fact that material resources are extrinsic goals whose pursuit may

be experienced as externally controlled (contingent on external rewards; Ryan & Deci, 2006).

For non-volitional behavior, the inherent conflicts or compatibilities among the values that

give rise to the value circle may have little relevance.

Our second goal was to compare the importance hierarchy of values experienced as

important guides in real-time behavioral acts with the hierarchy of values assessed as

generally important in value questionnaires. For this purpose, we compared the value state

hierarchies assessed with experience sampling of volitional and non-volitional behavior with

the value trait hierarchy assessed with the PVQ-RR. We hypothesized that the hierarchy of

values expressed in volitional behavior is more similar to the PVQ-RR hierarchy than the

hierarchy expressed in non-volitional behavior is. This hypothesis was not confirmed. Both

hierarchies of value states in real-time behavior differed substantially from the hierarchy of

value traits assessed by the PVQ-RR. Indeed, both hierarchies correlated negatively with the

hierarchy of general values.

Additional analyses confirmed these findings. Average within-person similarity

between importance hierarchies (profiles) of value states and of value traits, measured with

Page 20: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

20

ICC, was close to zero for both volitional and non-volitional behavioral acts. This is

consistent with the results of Ching et al. (2014) for personality traits. They reported that the

level of autonomy people felt in everyday situations did not moderate the strength of the trait-

state relationship.

However, Ching et al. (2014) found that the level of perceived autonomy did

influence the degree to which people manifested certain traits. Similarly, the results of current

study indicate that importance of value states depends on the level of volition. The

importance hierarchies of value states differed not only from the hierarchy of value traits, but

the value state hierarchies for volitional and non-volitional behavioral acts differed from one

another. Hedonism and stimulation were substantially more important guides of volitional

than of non-volitional acts whereas conformity-rules and achievement were substantially less

important guides of volitional than of non-volitional acts.

These findings suggest that the relative importance of values to individuals measured

by various questionnaires does not reflect the relative importance of values as guides to

everyday, real-time behavior. Does this mean that the indexes of value importance based on

questionnaires are necessarily inaccurate? We think not. First, there is ample evidence that

such indexes relate in expected ways to a wide variety of attitudes, behaviors, and personality

traits (e.g., Fischer & Boer, 2015; Schwartz, 2015, 2017; Strus & Cieciuch, 2017). Second,

the frequency with which a given value is expressed in real-time behaviors depends not only

on its general importance to the individual. It also depends on whether the value is relevant to

the behaviors that the individual has opportunities or is constrained to enact in the normal

course of daily activity. Particular values can be expressed only in specific situations. In this

study, the prompts to report the importance of the values may have come while eating

breakfast, commuting to work, or reading the news. In such situations, benevolence and

Page 21: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

21

universalism values, for example, despite their general importance, are unlikely to be relevant

to behavioral choices.

We suggest that the importance hierarchy of values assessed in real-time behavioral

acts reflects two factors: (a) the frequency with which particular values are relevant in the

situations sampled and (b) the general importance of those values to the individual. The

general importance of the values comes into play by influencing the choice of which relevant

values are more or less important as motivators of behavior. The current findings imply that

the frequency with which particular values are relevant in daily situations has more influence

on the hierarchy of values expressed in real-time behavior. Future research should compare

how value importance expressed in real-time behavior versus in questionnaires predicts

behavior across time and situations. Relations between value states and behavior per se was

beyond the scope of the present report.

In sum, this study supports three conclusions. (a) The circular structure of values

postulated by the theory of basic values (Schwartz, 1992; Schwartz et al., 2012) is replicable

with real-time values data. This supports the central assumption of the theory that underlies

the circle—competing values cannot be pursued in the same behavioral act. (b) This

assumption holds for volitional behavior but does not hold for non-volitional behavior. (c)

The hierarchy of values that people report as important to themselves in general differs

substantially from the hierarchy of values expressed in their daily behavior.

Page 22: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

22

References

Bassi, M., & Delle Fave, A. (2012). Optimal experience and self-determination at school:

Joining perspectives. Motivation and Emotion, 36, 425–438. doi:10.1007/s11031-011-

9268-z

Bem, D. (1972). Self-perception theory. In L. Berkowitz (Ed.), Advances in Experimental

Social Psychology (Vol. 6, pp. 1–62). New York, NY: Academic Press.

Bilsky, W., Janik, M., & Schwartz, S. H. (2011). The structural organization of human

values-evidence from three rounds of the European Social Survey (ESS). Journal of

Cross-Cultural Psychology, 42, 759–776. doi:10.1177/0022022110362757

Bliese, P. (2016). Multilevel modeling in R (2.6). A brief introduction to R, the multilevel

package and the nlme package. Retrieved from https://cran.r-

project.org/doc/contrib/Bliese_Multilevel.pdf

Borg, I., Bardi, A., & Schwartz, S. H. (2015). Does the value circle exist within persons or

only across persons? Journal of Personality, 85, 151–162. doi:10.1111/jopy.12228

Borg, I., Dobewall, H., & Aavik, T. (2016). Personal values and their structure under

universal and lexical approaches. Personality and Individual Differences, 96, 70–77.

doi:10.1016/j.paid.2016.02.071

Ching, Ch. M., Church, A. T., Katigbak, M. S., Reyes, J. A. S., Tanaka-Matsumi, J.,

Takaoka, S., … Ortiz, F. A. (2014). The manifestation of traits in everyday behavior

and affect: A five-culture study. Journal of Research in Personality, 48, 1–16.

doi:10.1016/j.jrp.2013.10.002

Church, A. T., Katigbak, M. S., Ching, Ch. M., Zhang, H., Shen, J., Arias, R. M., … Alvarez,

J. M. (2013). Within-individual variability in self-concepts and personality states:

Applying density distribution and situation-behavior approaches across cultures.

Journal of Research in Personality, 47, 922–935. doi:10.1016/j.jrp.2013.09.002

Page 23: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

23

Conner, T. S., Feldman Barrett, L., Tugade, M. M., & Tennen, H. (2007). Idiographic

personality: The theory and practice of experience sampling. In R.W. Robins, R. C.

Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality

psychology (pp. 79–96). New York, NY: The Guilford Press.

Deci, E. L., & Ryan, R. M. (2000). The „what” and „why” of goal pursuits: Human needs and

the self-determination of behavior. Psychological Inquiry, 11, 227–268.

doi:10.1207/S15327965PLI1104_01

Döring, A. K., Schwartz, S. H., Cieciuch, J., Groenen, P. J. F., Glatzel, J., Harasimczuk, J., …

Bilsky, W. (2015). Cross-cultural evidence for universals in value structures and

priorities in childhood. British Journal of Psychology, 106, 675–699.

doi:10.1111/bjop.12116

Fischer, R. (2017). From values to behavior and from behavior to values. In S. Roccas & L.

Sagiv (Eds.), Values and behavior: Taking a cross-cultural perspective (pp. 219–235).

Cham, Switzerland: Springer International Publishing.

Fischer, R., & Boer, D. (2015), Motivational basis of personality traits: A meta-analysis of

value-personality correlations. Journal of Personality, 83, 491–510.

doi:10.1111/jopy.12125

Fleeson, W. (2001). Toward a structure- and process-integrated view of personality: Traits as

density distributions of states. Journal of Personality and Social Psychology, 80, 1011–

1027. doi:10.1037//0022-3514.80.6.1011

Fleeson, W., & Gallagher, P. (2009). The implications of Big Five standing for the

distribution of trait manifestation in behavior: Fifteen experience-sampling studies and

a meta-analysis. Journal of Personality and Social Psychology, 97, 1097–1114.

doi:10.1037/a0016786

Page 24: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

24

Grund, A., Grunschel, C., Bruhn, D., & Fries, S. (2015). Torn between want and should: An

experience-sampling study on motivational conflict, well-being, self-control, and

mindfulness. Motivation and Emotion, 39, 506–520. doi:10.1007/s11031-015-9476-z

Heider, F. (1958). The psychology of interpersonal relations. Hillsdale, NJ: Erlbaum.

Hektner, J. M., Schmidt, J. A., & Csikszentmihalyi, M. (2007). Experience sampling method:

Measuring the quality of everyday life. Thousand Oaks, CA: Sage.

Hox, J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence

Erlbaum Associates.

La Guardia, J. G., & Ryan, R. M. (2007). Why identities fluctuate: Variability in traits as a

function of situational variations in autonomy support. Journal of Personality, 75,

1205–1228. doi:10.1111/j.1467-6494.2007.00473.x

Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling.

Methodology, 1(3), 86–92. doi:10.1027/1614-1881.1.3.86

Reis, H. T., Sheldon, K. M., Gable, S. L., Roscoe, J., & Ryan, R. M. (2000). Daily well-

being: The role of autonomy, competence, and relatedness. Personality and Social

Psychology Bulletin, 26, 419–435. doi:10.1177/0146167200266002

Revelle, W. (2017). An introduction to the psych package: Part II Scale construction and

psychometrics. Retrieved from https://cran.r-

project.org/web/packages/psych/vignettes/overview.pdf

Roccas, S., Sagiv, L., Schwartz, S. H., & Knafo, A. (2002). The Big Five personality factors

and personal values. Personality and Social Psychology Bulletin, 28, 789–801.

doi:10.1177/0146167202289008

Ryan, R. M., & Deci, E. L. (2006). Self-regulation and the problem of human autonomy:

Does psychology need choice, self-determination, and will? Journal of Personality, 74,

1557–1586. doi:10.1111/j.1467-6494.2006.00420.x

Page 25: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

25

Schwartz, S. H. (1992). Universals in the content and structure of values: Theory and

empirical tests in 20 countries. In M. Zanna (Ed.), Advances in experimental social

psychology (Vol. 25, pp. 1–65). New York, NY: Academic Press.

Schwartz, S. H. (1994). Are there universal aspects in the structure and contents of human

values? Journal of Social Issues, 50(4), 19–45. doi:10.1111/j.1540-

4560.1994.tb01196.x

Schwartz, S. H. (2015). Basic individual values: sources and consequences. In T. Brosch &

D. Sander (Eds.), Handbook of value: Perspectives from economics, neuroscience,

philosophy, psychology and sociology.

doi:10.1093/acprof:oso/9780198716600.003.0004

Schwartz, S. H. (2017). The refined theory of basic values. In S. Roccas & L. Sagiv (Eds.),

Values and behavior: Taking a cross-cultural perspective (pp. 51–72). Cham,

Switzerland: Springer International Publishing.

Schwartz, S. H., & Bardi, A. (2001). Value hierarchies across cultures: Taking a similarities

perspective. Journal of Cross-Cultural Psychology, 32, 268–290.

doi:10.1177/0022022101032003002

Schwartz, S. H., Cieciuch, J., Vecchione, M., Davidov, E., Fischer, R., Beierlein, C., …

Konty, M. (2012). Refining the theory of basic individual values. Journal of

Personality and Social Psychology, 103, 663–688. doi:10.1037/a0029393

Sherman, R. A., & Serfass, D. G. (2015). The comprehensive approach to analyzing

multivariate constructs. Journal of Research in Personality, 54, 40–50.

doi:10.1016/j.jrp.2014.05.002

Shrout, P. E., & Fleiss, J. L. (1979). Interclass correlations: Uses in assessing rater reliability.

Psychological Bulletin, 86, 420–428. doi:10.1037/0033-2909.86.2.420

Page 26: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

26

Skimina, E., & Cieciuch, J. (2017). Value structure and priorities: Other-report account.

Current Issues in Personality Psychology. Advance online publication.

doi:10.5114/cipp.2018.72259

Strus, W., & Cieciuch, J. (2017). Towards a synthesis of personality, temperament,

motivation, emotion and mental health models within the Circumplex of Personality

Metatraits. Journal of Research in Personality, 66, 70–95.

doi:10.1016/j.jrp.2016.12.002.

Weinstein, S. M., & Mermelstein, R. (2007). Relations between daily activities and

adolescent mood: The role of autonomy. Journal of Clinical Child & Adolescent

Psychology, 36, 182–194. doi:10.1080/15374410701274967

Page 27: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

27

Table 1

Items measuring value importance in real-time behavior (ordered randomly)

When you were engaging in this activity,

how important was it to you to …

Value name Value definition in terms of

motivational goal (Schwartz et al.,

2012)

- be better at something than others are achievement (AC) success according to social

standards

- gain some advantage for yourself power-resources (POR) power through control of material

and social resources

- avoid danger security-personal (SEP) safety in one’s immediate

environment

- do what someone else expected conformity-

interpersonal (COI)

avoidance of upsetting or harming

other people

- help people you care about benevolence-caring

(BEC)

devotion to the welfare of in-group

members

- help someone you did not know universalism-concern

(UNC)

commitment to equality, justice,

and protection for all people

- understand something or form an opinion

on your own

self-direction-thought

(SDT)

freedom to cultivate one’s own

ideas and abilities

- experience something new or exciting stimulation (ST) excitement, novelty, and change

- enjoy yourself hedonism (HE) pleasure and sensuous gratification

Page 28: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

28

Table 2

Descriptive statistics for items measuring value states (volitional and non-volitional acts

combined), Nlevel1 = 13,873; Nlevel2 = 374

Value M Between-person SD Within-person SD ICC(1) ICC(2)

AC 1.83 0.56 0.85 .26 .93

POR 2.76 0.57 0.92 .24 .92

SEP 2.11 0.72 0.85 .37 .96

COI 2.11 0.53 0.97 .19 .90

BEC 1.89 0.61 0.88 .29 .94

UNC 1.60 0.52 0.74 .27 .93

SDT 2.13 0.57 0.93 .24 .92

ST 2.05 0.55 0.90 .23 .92

HE 2.23 0.53 1.00 .19 .90

Note. Abbreviations of value names are presented in Table 1.

Page 29: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

29

Table 3

Descriptive statistics for items measuring value states, separately for volitional (Vol, Nlevel1 =

9,592; Nlevel2 = 374) and non-volitional (Nvol, Nlevel1 = 4,181; Nlevel2 = 324) behaviors

Value M Between-person SD Within-person SD ICC(1) ICC(2)

Vol Nvol Vol Nvol Vol Nvol Vol Nvol Vol Nvol

AC 1.73 1.98 0.57 0.71 0.80 0.75 .28 .36 .91 .88

POR 2.82 2.61 0.58 0.72 0.90 0.82 .25 .37 .90 .89

SEP 2.05 2.26 0.74 0.78 0.82 0.82 .40 .41 .95 .90

COI 1.85 2.63 0.55 0.65 0.85 0.86 .25 .29 .90 .84

BEC 1.92 1.88 0.62 0.71 0.88 0.75 .28 .40 .91 .90

UNC 1.49 1.81 0.53 0.66 0.63 0.73 .33 .35 .93 .87

SDT 2.12 2.16 0.59 0.69 0.93 0.82 .24 .33 .89 .86

ST 2.13 1.83 0.59 0.61 0.92 0.72 .24 .32 .89 .86

HE 2.47 1.69 0.56 0.58 0.99 0.68 .20 .32 .87 .86

Note. Abbreviations for value names are presented in Table 1.

Page 30: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

30

Table 4

Descriptive statistics and zero-order correlations between value traits measured by the PVQ-

RR questionnaire

Scale

Descriptive

statistics Pearson zero-order correlations between PVQ-RR centered scores

M SD AC POR SEP COI BEC UNC SDT ST HE

AC 4.90 0.86 .72

POR 3.58 1.10 .31*** .83

SEP 4.67 0.90 −.10* .01 .66

COI 3.75 1.07 −.29*** −.26*** .12* .79

BEC 5.22 0.72 −.05 −.26*** .06 .01 .73

UNC 4.54 1.02 −.27*** −.42*** .08 .02 .03 .75

SDT 4.90 0.74 .12* −.16** −.27*** −.19*** .00 −.07 .63

ST 4.06 1.06 .27*** .16** −.40*** −.33*** −.19*** −.28*** .18** .74

HE 4.78 0.84 .25*** .21*** −.16** −.47*** .01 −.20*** .04 .36*** .72

Note. Abbreviations of value names are presented in Table 1. Cronbach’s alpha coefficients

in bold.

* p < .05; ** p < .01; *** p < .001.

Page 31: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

31

Table 5

Comparison of the importance hierarchy of value states and value traits

Individual-level Means

Centered within Person

Act-level Means for Value States

(a)

Value Traits

from PVQ-RR

(b)

Value States

From ESM

(c)

Single Volitional

Acts

(d)

Single Non-

volitional Acts

Value M Value M Value M Value M

BEC .87 POR .68 POR 2.82 COI 2.64

SDT .56 HE .15 HE 2.47 POR 2.61

AC .55 SDT .06 ST 2.13 SEP 2.26

HE .44 COI .03 SDT 2.12 SDT 2.16

SEP .32 SEP .03 SEP 2.05 AC 1.99

UNC .20 ST −.03 BEC 1.92 BEC 1.88

ST −.28 BEC −.18 COI 1.85 ST 1.83

COI −.59 AC −.25 AC 1.73 UNC 1.80

POR −.76 UNC −.48 UNC 1.49 HE 1.69

Note. Abbreviations for value names are presented in Table 1.

Page 32: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

32

Table 6

Within-person agreement (ICC(1,1)) between each person’s profile (hierarchy) of value traits

and of value states, averaged across persons

n M SD Median Min Max Skew Kurtosis SE

Volitional

behaviors 374 −.03 .30 −.03 −.72 .76 −0.07 −0.58 0.02

Non-volitional

behaviors 325 −.09 .31 −.07 −.86 .67 −0.03 −0.52 0.02

Page 33: Testing the Circular Structure and Importance Hierarchy of ... · The hierarchy of value states differs from the hierarchy of value traits. 3 ... Abstract This research is the first

33

Table 7

Average within-person agreement between the importance of value traits and corresponding

value states

Value

ICC(1,1)

Volitional

Behaviors

Non-volitional

behaviors

AC −.29 −.11

POR −.41 −.32

SEP .14 .11

COI .02 −.31

BEC −.41 −.38

UNC −.21 .02

SDT −.04 −.05

ST .09 .12

HE .16 −.25

Note. Abbreviations for value names are presented in Table 1.