customer satisfaction measurement: comparing four methods ... · showalter. 19991. higher...

16
Customer Satisfaction Measurement: Comparing Four Methods of Attribute Categorisations BORIS BARTIKOWSKI and SYLVIE LLOSA The issue of how to weight and categorise service attributes has attracted great attention from academics as well as practitioners. The application of an inappropriate method could lead to mis- leading interpretations and useless or costly actions. We first review several streams of literature concerning the theoretical background of attribute categorisations in relation lo customer satisfaction. We then identify four methods that have been devel- oped to categorise attributes into four classes. In the next step we apply the.se methods in an empirical study. Criteria for distinguishing the considered approaches conceptually and meth- odologically are proposed, and implications for future research are discus.sed. INTRODUCTION Cuslomer satisfaction (CS) has been the object of numerous discussions, and recent trends indicate that CS remains in the limelight, especially in the service field. Customer satisfaction is typically defined as an overall assess- ment of the performance of various attributes that constitute a product or a service [e.g. Swan and Combs. 1976; Johnston, 1995; Sampson and Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and, by extension, a firm's profitability {for a meta-analysis see Szymanski and Henard [2001]). As a consequence, practitioners need to understand how satisfaction is engendered and how it can be influenced. A promising approach is to work out, first, which attributes should be improved to increase satisfaction and, second, which attributes Boris Bartikow.ski is at the EUROMED Marseille Ecole de Managemeni and Sylvie Llosa is at ihe lAE d'Aix en Provence. CEROG, Universile de Droii, d'Econoniie ct dcs Sciences d'Aix- Marseille III. The Service Industries Journal. Vol.24. No.4. July 20()4. pp.67-«2 ISSN 0264-2069 print/1743-9507 online DOl: 10.l08(V0264206{M2aH)27.'il90 . 2004 Taylor & Francis Lid.

Upload: others

Post on 03-May-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

Customer Satisfaction Measurement:Comparing Four Methods of

Attribute Categorisations

BORIS BARTIKOWSKI and SYLVIE LLOSA

The issue of how to weight and categorise service attributes hasattracted great attention from academics as well as practitioners.The application of an inappropriate method could lead to mis-leading interpretations and useless or costly actions. We firstreview several streams of literature concerning the theoreticalbackground of attribute categorisations in relation lo customersatisfaction. We then identify four methods that have been devel-oped to categorise attributes into four classes. In the next step weapply the.se methods in an empirical study. Criteria fordistinguishing the considered approaches conceptually and meth-odologically are proposed, and implications for future researchare discus.sed.

INTRODUCTION

Cuslomer satisfaction (CS) has been the object of numerous discussions, andrecent trends indicate that CS remains in the limelight, especially in theservice field. Customer satisfaction is typically defined as an overall assess-ment of the performance of various attributes that constitute a product or aservice [e.g. Swan and Combs. 1976; Johnston, 1995; Sampson andShowalter. 19991. Higher satisfaction increases customer loyalty, positiveword of mouth, customer retention and, by extension, a firm's profitability{for a meta-analysis see Szymanski and Henard [2001]). As a consequence,practitioners need to understand how satisfaction is engendered and how itcan be influenced. A promising approach is to work out, first, which attributesshould be improved to increase satisfaction and, second, which attributes

Boris Bartikow.ski is at the EUROMED Marseille Ecole de Managemeni and Sylvie Llosa is at ihelAE d'Aix en Provence. CEROG, Universile de Droii, d'Econoniie ct dcs Sciences d'Aix-Marseille III.

The Service Industries Journal. Vol.24. No.4. July 20()4. pp.67-«2ISSN 0264-2069 print/1743-9507 onlineDOl: 10.l08(V0264206{M2aH)27.'il90 . 2004 Taylor & Francis Lid.

Page 2: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

68 THE SERVtCE INDUSTRIES JOURNAL

should be reduced because high performance on them is costly or offers noincrease in satisfaction. To achieve such business intelligence, 'an importantstep is to recognise that the links in the satisfaction-profit chain are asym-metric and nonlinear' [Anderson and Mittal. 2000]. Taking this into accountdelivers attribute categorisations that allow the efficient organisation of per-formance improvements and resource allocations.

This article treats such considerations theoretically and empirically. Wefirst review relevant literature. We then present four methodologicalapproaches that are based on the idea of asymmetric and nonlinear linksbetween attribute performance and overall CS. The objective of thesemethods is to categorise attributes according to their relationship with CS.The empirical part of the article is designed to study the convergence ofsome of these methods. This allows a better interpretation of the results,brings about theoretical and managerial conclusions and provides suggestionsfor future research.

THEORETICAL CONSIDERATIONS

The expectation disconfirmation paradigm is probably the best known frame-work for satisfaction studies [Engel, Kollat and Blackwell, 1968; Oliver,1977]. It proposes that customers maintain a standard of reference to whichthey compare perceived performance. Satisfaction results if performance ishigher than expected, dissatisfaction results if it is lower. In this sense, onemight argue that all attributes do not have the same impact on CS when com-pared to one and the same standard. Two general cases can be distinguished.

First, the concept of invariant attribute weights proposes that CS isstrongly affected, whether the attribute performs well or badly. Forexample, the taste of food in a restaurant should always have a strongimpact on CS, whether it is good or bad.

Second, the concept of variant attribute weights proposes that the weightsof several attributes are performance related. Consider the following examples:a clean restaurant engenders no satisfaction, but a dirty restaurant stronglyattracts negative feelings; receiving a free drink in a restaurant is pleasantlysurprising but there is no reason for dissatisfaction if it is not delivered forfree. The two-factor theory, developed in the field of job satisfaction, is afamous approach arguing in favour of variant attribute weights: Herzberg,Mausner and Snyderman 119591 conclude that the opposite of job satisfactionis not job dissatisfaction, but no job satisfaction. They furthermore concludethat certain factors operate only to increase satisfaction (motivators) whileothers only increase dissatisfaction (hygiene factors). This suggests that a nega-tively (positively) perceived attribute could have a stronger impact on overallCS than if the same attribute has been perceived positively (negatively).

Page 3: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISEACTION MEASUREMENT 69

Several authors support indirectly the concept of variant attribute weights byarguing that standards of reference are not always pre-established le.g. West-brook and Reiliy, 1983; Kahneman and Miller, 1986; Cadotte and Turgeon,1988; McGill and Iacobucci, 1992; Ngobo, 1997; Llosa, 1997]. Results ofVoss. Parasuraman and Grewal 11998] point in the same direction: theseauthors show that the effect of performance expectations depends on price/performance consistency, which could vary depending on the service exchange.Such reasoning is especially pertinent for services, as attributes contributing toCS could work differently according to how a service encounter takes place.For example, the interior of a hotel's reception hall is more salient if guestshave long waiting times, while it is relatively less important if the staff is verycourteous. This suggests that each service encounter creates its own standards.

To sum up, the concept of variant and invariant weights proposes fourattribute categories: dissaiisfiers influence CS strongly only in case of low per-formance, salisfiers only in case of high performance, criticals impact CSstrongly in case of low as well as high performance, and the impact of neutralson CS is generally weak. These basic considerations are illustrated in Figure 1.

The managerial implications of this concept are described as follows. It isquite difficult to satisfy customers through dissatisfiers, but bad performancesstrongly diminish satisfaction. For this reason, dissatisfiers should be as stan-dardised as possible, at the performance level expected by the client. On theother side, firms should provide high performances on several well-chosensatisfiers. These are satisfaction boosters if they are specifically includedinto the oifer. Firms stand to win bonus points for providing high performance

FIGURE 1VARIANT AND INVARIANT IMPACT OF ATTRiBUTti PERFORMANCES

ON OVRRALL CS

Impact of iltribulc pfrfomann on oTtmll rusUimer wtuAulion

Source: Adapted Irom Llosa [1999].

Page 4: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

70 THE SERVICE INDUSTRIES JOURNAL

on criticals, to which clients react very sensitively. They risk demerits if lowperformance is delivered on them. Finally, improving performance on neutralsis of no priority. Some of these attrihutes may even be a source for redirectingresources so as to save money.

METHODOLOGICAL CONSIDERATIONS

The ahove described concept has been treated in numerous theoretical andempirical studies [e.g. Leavitt, 1977; Maddox, 1981; Rust and Zahorik,1993; Johnston, 1995]. The reported empirical results are mostly hased onthe assumption that the applied method is a valid measure of the underlyingeoncept of variant and invariant weights (Figure I), The following sectionsprovide a brief description of four methods.

Direct Approaches

There are several techniques for attribute categorisation that are said to he•'direct approaches", because respondents are directly asked ahout attributesweights. We now review two direct approaehes.

Dual Importance Mapping (DIM). DIM is an advanced version of the classi-cal importance-performance analysis as proposed hy Martilla and James[1977]. The measures used for DIM are 'stated importance", which corre-sponds to a respondent's direct assessment of an attrihutes importance, and'derived importance', which corresponds to the strength of correlationbetween attribute performance and overall CS |e.g. Vavra. 1997; Oliver,1997: 59]. Plotting these scores on a x-y graph allows categorising attributesinto four classes.

An attribute hfiat if its stated importance is high and if its derived import-ance is weak. Such attributes correspond to common or expected quality stan-dards that must be reached [Venkitaraman and Jaworski, 1993]. An attrihutewith both strong stated and strong derived importance is key, which meansthat customers react extremely sensitive to its higher or lower performances.An attrihute with strong derived but weak stated importance is value-added.This corresponds to unexpected or pleasantly surprising aspects. Finally, ifhoth importance measures are weak the attribute is said to he of no concernto the customer (low yield attribute).

Simulation Method (SM). SM was developed in the field of tangible products,particularly for the development of new products [Kano, 1984; Berger et al.,1993; Matzler et al., 1996). As a managerial tool, the approach is often inte-grated into so-called six sigma programs for continual business improvements

Page 5: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISFACTION MEASUREMENT 71

[e.g. Mazur, 20011. The proposed Define-Measure-Analyze-Improve-Control (DMAIC) process is based on categories of critical quality character-istics that are obtained through SM. Kano [1984] takes into account that somelinks between performance and overall CS are nonlinear and asymmetric: badperformances on must-be attributes lead to dissatisfaction while good per-formances on these attributes cannot engender satisfaction. One dimensionalattributes lead to higher dissatisfaction/satisfaction the lower/higher the per-formance on these attributes is. Attractive attributes engender satisfaction,but dissatisfaction cannot result even if performance is low.

The empirical categorisation relies on answer combinations to two questions.The functional question refers to a respondent's reaction in case of good per-formance and the dysfunctional question refers to his reactions if the same attri-bute performs badly. It is proposed that the combination of the resultingresponses permits categorising attributes into six classes, as shown in Table 1.

TABLE IKANO'S EVALUATION RULES

Functional question: If xperforms well, how do you feel?

I234

Dysfunctional questinn:lf \ performs badly.

I

QRRRR

2

AIIIR

you Iccl?

3

AIIIR

4

A1IIR

how do

5

OMMMQ

Answers: I = I like it that way; 2 = It must be ihat way; 3 = I am neutral; 4 = I can live with thatway, 5 = I dislike it that way.Interpretation of answer combinations: A — Attractive; O — One dimensional; M — Must-be; 1 —IndifferenI; R = Reverse; Q = Questionable.Source: Kano 11984|,

Besides the three principal categories described above. Table 1 reveals afourth category called indifferent. These are attributes that engender neithersatisfaction nor dissatisfaction, whether they perform well or badly. So-called reverse and questionable represent unclear results that must betreated subtly differentiated.

Indirect Weights Assessments

While the above described techniques for attribute categorisations are largelybased on direct questioning, the following approaches are said to be indirectbecause attribute weights are statistically determined from observed associ-ations with CS. We now review two indirect approaches.

Page 6: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

72 THE SERVICE INDUSTRIES JOURNAL

Penalty Reward Contrast Analysis (PRCA). Brandt [1988], and with methodo-logical variations Vanhoof and Swinnen [1998], Mittal, Ross and Baldasare11998] or Anderson and Mittal 12000], propose very similar approaches for attri-bute categorisations. These authors compare relationships between overall CSand attribute performances. For example Brandt and Scharioth 11998] firstcarry out a recoding of attributes Into dummy variables, as shown in Table 2.

TABLE 2RECODING ATTRIBUTE PERFORMANCE INTO DUMMY

VARIABLES

Performance of attribute x Dl D2

P: positive, better than expectedE: equal, expeclations are met

N: negative, worse than expected

100

001

Regression analysis is then performed with the dummies as predictivevariables and with global satisfaction as the dependent variable. The meandifferences indicate the impact of negative or positive performances onoverall CS. Table 3 summarises rules that are adopted for categorising attri-butes into four classes.

TABLE 3CATEGORISATION RUI.HS FOR PRCA

An attribute is:

Basic if (CS/N) < (CS/E) and (CS/E) =^ (CS/P)One-dimensional if (CS/N) < (CS/E) and (CS/E) < (CS/P)Attractive if (CS/N) ^ (CS/E) and (CS/N) < (CS|P)Low impact if (CS/N) s (CS/E) and (CS|E) ^ (CS/P)

Correspondence Analysis (CA). Llosa [1997, 1999] proposes one more indir-ect method (Tetraclasse model) for attribute categorisations. The authorapplies factorial analysis of correspondences to a contingency table. Thistable contains the number of high/low attribute performances in the linesand two levels of CS in the columns, as shown in Table 4.

TABLE 4CONTINGENCY TABLE

LowCS HighCS

Attribute 1:Attribute 1:Attribute 2:Attribute 2:

low performancehigh performancelow performancehigh performance

Overall satisfaciion

n l .n l .n2,jn2ij

n 2 - n

Page 7: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISFACTION MEASUREMENT 73

CA allows figuring both CS and the two modalities of attribute perform-ances on a single factorial axis. This explains obligatory 100 per cent ofvariance (Figure 2).

FIGURE 2ATTRIBUTES SCORES ON ONE FACTORIAL AXIS OBTAINED THROUGH

CORRESPONDENCR ANALYSIS

Stroog negalive Weak negadve or weak Strong posilivtconiribulion positive cuairibution cantribuiion

Low CS High CS

-^ -h rh ' *-ZONE A / V ZONE B and C y - ZONE D +

Source: Adapted from Llosa

The adopted logic for attribute categorisations is that the nearer an attri-bute is positioned (row points of factor scores) to the extremities of theaxis, the stronger is its influence on CS: an attribute is basic if it scoreshigh in case of low performance and if it scores low in case of high perform-ance. An attribute is plus if these facts are turned around. If an attribute scoreshigh, whether the level of performance is low or high, it is said to be key. It issecondary if both scores are low. The two factor scores of CS itself (columnscores) draw up frontiers tbat allow distinguishing four attribute categories.

RESEARCH QUESTIONS

While the conceptual background of the exposed methods is largely based onthe same literature, the methodological approaches differ considerably.The attributes categories are given various names, but the proposed interpret-ations are essentially equal (c.f. Table 5).

If marketers are interested in such attribute categorisations for supportinginvestment decisions and resource allocations, they are certainly eager toobtain meaningful results. But are the attributes always equally classifiedthrough the different methods? For example Brandt and Scharioth |I998]report that only 67 per cent, or 16 of 24 considered attributes, were equallyclassified for PRCA and for DIM. To expand this assessment to fourmethods, we conducted the following empirical study.

ResearchThe empirical study was carried out in the field of insurance consultation inGermany. Establishing an efficiently operating sales organisation is importantfor an insurance company. Learning about determinant attributes during theservice encounter could be helpful for sales training, for example.

Page 8: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

u

tl

|i

a. w c

1

u:= "tfl T5T " 'CC 'C >iO U I

2 >c E <"

< >

CO CT^

j -ji ra —I S 2 ' ^

pa > - j

Page 9: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISFACTION MEASUREMENT 75

Attributes were identified through 15 in-depth interviews with customers ofan insurance company who recently encountered a representative of thiscompany. We asked these individuals to relate their experiences during theencounter and to point out if they perceived pmblems or pleasantly surprisingaspects. Additional attributes were generated during a round table discussionwith five executives of the same company. The exploratory phase produced anexhaustive list of 52 attributes likely to influence CS. We then asked the executivepanel to synthesise the list to 20 attributes they considered most relevant {seeAppendix). However, because Kano's [1984] metb(xl produces long question-naires, only four attributes were taken into account for this method (see Table 6).

TABLE 6FOUR RELEVANT ATTRIBUTES

Attribute Description

Situation Consultant lakes inio account clienl's personal siluation.Information Consultant left information (leaflet etc)Presentation Consultant presents clearlyGift Consultant left a gift (pen, diary etc.)

Insurance customers may hold different expectations when insuring a car orwhen signing a long-term life insurance policy. It was therefore concluded thatthis type of service encounter is particularly heterogeneous. In order to hom-ogenise the sample of our empirical study, we decided to interview onlythose customers of a specific German insurance company that encountered asales representative of this company who proposed certain types of low-budget policies (accident insurance, supplementary health insurance). As custo-mers' perceptions may considerably change in time, it was furthermore requiredthat the encounter took place within the previous 14 days. The company forwhich this study was conducted delivered a list of 225 customers who metthese criteria. In order to maximise the return rate, these individuals were firstcontacted by telephone and asked to take part in the study. The 195 personswho agreed received a questiontiaire together with a stamped and addressedreturn envelope. As insurance services contain sensitive personal data and inorder to avoid response bias, respondents were asked to send back their ques-tionnaire anonymously. Our sample consists of 123 persons who sent backIheir questionnaires within a delay of ten days (63 per cent response).

The following measures were used (see Appendix for details). Satisfac-tion was measured with four five-point rating scales that record emotionaland intentional reactions |e.g, Westbrook and Oliver, 1981; Hausknecht,1990]. These built a cumulative measure of overall CS (variance accountedfirst factor = 80.5 per cent; a = 0,92.) We also used five-point rating scalesfor measuring the 20 attribute performances. For measuring declared

Page 10: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

76 THE SERVICE INDUSTRIES JOURNAL

importance, we first asked respondents to choose the five most importantattributes and then to rank them according to their importance. This pro-cedure facilitates the respondent's task, as it is less difficult than ranking20 attributes in one go. Finally, for SM, eight additional questions wereformulated.

Data Analysis

DIM. Derived importance was defined as the strength of correlation (R^)between CS and perceived attribute performances. Declared importance(DI) was defined as the probability tbat an attribute is the most, thesecond,... the fifth important. This was obtained as follows: DI — P(x/firstrank) x 5 + P(x/second rank) x 4 + • • • + P(x/fifth rank) x 1. The meanscores of declared and the mean scores of stated importance separate four attri-butes categories.

SM. This analysis requires cumulating the responses of the combinations offunctional and dysfunctional questions and then examining the resultingdistribution. In this study, ambiguous categorisations were produced.Results suggest that several customer segments yield different preferences.For example, the attribute gift could be interpreted as attractive as well asindifferent.

PRCA. For each attribute, perceived performance was divided into threegroups that were interpreted as high, normal and low. As proposed byBrandt and Scharioth [1998], a dummy variable regression, with overall satis-faction as the dependent variable, was conducted. This allows determining ifCS in case of low or high performance is statistically different from CS in caseof normal performance. For example for the attribute punctuality it was foundtbat CS is significantly higher in case of high (DI), than incase of normal per-formance. There was however no significant difference in CS from normal tolow performance (D2). Punctuality was therefore classified a satisfier.

CA. Correspondence analysis is a non-parametric method that requires choos-ing the type of distance among the rows and the columns of the correspon-dence table and to set up a kind of normalisation. In this study chi-squaredistances and symmetrical normalisation were used. The two factorial rowscores for each attribute are compared to the two column scores for CS. Forexample the attribute information affects CS strongly if it performs low,while it has little impact if it performs well.

Page 11: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISFACTION MEASUREMENT

SUMMARY OF RESULTS

77

Table 7 summarises how the four central attributes were categorised throughthe four methods.

TABLE 7RESULTS

Attribute

PresentationSituationInformationGiftPolitenessPunctualityTimeFameClothesExpressionPassionPropositionExplicationsPreparationObjeciivityProcessDurationUtililyObtrusivenessQuestions

SM

DissatisfierDissatisfierDissatisfierSatisfier

—_—-_------————-

PRCA

CriticalCriticalCritical

--

SatisfierSatisfierDissatisfierSatisfierSatisfierCriticalCriticalCriticalCriticalCrilicalSatisfierSatisfierCriticalSaiisfierCritical

DIM

CriticalCriticalNeutralNeutralSatisfierNeutralDissatisfierNeutralNeutralNeutralSatisfierSatisfierCrilicalSatisfierCriticalSatisfierNeulralSatisfierCriticalCritical

CA

CriticalCriticalDissatisfierSatisfierDissatisfierNeutralSatisfierNeutralSatisfierSaiisfierCriticalDissatisfierDissatisfierCriticalSatisfierDissatisfierNeutralDissatisfierCriticalCritical

It is evident that these results are far from converging, in spite of themethods' largely identical theoretical background. This is not too surprising,as the measures and the applied data analysis differ considerably. But whichmethod should then be used for supporting investment decisions and resourceallocations? Each method produces results that lead to different conclusions.The next section clears up this ambiguity and develops arguments for usingone or another method.

CONCLUSIONS AND DIRECTIONS EOR FUTURE RESEARCH

An important theoretical advantage of the two indirect approaches (PRCA andCA) is that their results are derived from actually perceived performancesinstead of using hypothetical experiences. For example Brandt and Scharioth[1998] state that SM is 'based on how people say they would respond to agiven level of attribute performance'. These attitudinal reactions could bedifferent from satisfaction judgements, which are by definition post experi-

Page 12: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

78 THE SERVICE INDUSTRIES JOURNAL

ence (one cannot be satisfied with a hotel room without having stayed there,for example). For these reasons, it is questionable, from a conceptual perspec-tive, whether the results obtained from SM are meaningful in a satisfactioncontext. SM might nevertheless be used to gain initial insights into themeaning of new product or service features.

PRCA and SM allow categorising each single attribute independentlyfrom other attributes (absolute categorisation) while CA categorisations (aswell as DIM) depend among other things on the type and the number of theconsidered attributes (relative categorisation). An advantage of SM is that itallows predicting even on an individual level to which category an attributebelongs, while DIM, PCRA and CA are based on the hypothesis of homoge-neity of the sample. To strengthen their meaningfulness, these three methodsshould be applied as prognostic tools to clearly pre-^determined customer seg-ments. Such segments are nowadays often accessible through data warehouseapplications within customer relationship programmes. Attribute categoris-ations could be worked out for well-chosen segments and be transmittedinto actions. But benchmarking customer segments through attribute categor-isations also provides fruitful implications.

Some criticism can be addressed to SM, as collecting the required data iscumbersome if many attributes are considered. In contrast, collecting data forDIM, PRCA and CA is easily implemented, even for numerous attributes. Afurther critical point is that the proposed rules for SM categorisations (Table 1)are arbitrary and lack solid theoretical reasoning. But DIM categorisations arealso somewhat arbitrary, as the applied rules are defined on the basis of theresults' distribution and not on theoretically developed arguments (in thisstudy, mean scores of 'stated importance' and 'derived importance' wereused to separate four categories). PRCA. as a parametric method, suggestsclarity for attribute categorisations because levels of significance are con-sidered; however, the likelihood of finding significant differences is directlyrelated to sample size. In contrast, CA is based on the idea that an attributebelongs to a certain category if its factor scores are lower or higher than thescores of each of the two satisfaction levels. This brings about some clarityand comparability of the results because the frontiers between attribute cat-egories are determined a priori and independent of any sample size.

PRCA and CA include somewhat arbitrary decisions associated withcoding: PRCA requires three modalities of performance and CA requirestwo modalities of performance and two modalities of CS. This study usedrating scales and the median of the obtained answer distributions was usedas a statistical criterion for receding performance into two classes. It isobvious that attribute categorisations could change if performance and CSwere coded differently. One might even argue that almost any result couldbe produced as a function of the applied coding scheme. This problem

Page 13: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISFACTION MEASUREMENT 79

could be solved by replacing interval scales for performance and CS (in thecase of CA) with ordinal scales that measure the modalities directly. Theadvantage is then that the resulting attribute categorisations depend clearlyon theoretical reasons that can be developed a priori.

These arguments suggest six criteria for evaluating how the four con-sidered methods work and how their results can be interpreted. These criteriaare summed up in Table 8.

TABLE 8CRITERIA FOR DISTINGUISHING BETWEEN FOUR METHODS FOR ATTRIBUTE

CATEGORISATIONS

DIM SM PRCA CA

Respecif, the nature of CS as a posi Yes No Yes Yesexperience evaluation (no performancesimulations)

Permits categorising each single attribute No Yes Yes Nowithout taking into account otherattributes Cabsoluie categorisation")

Works on an individual level (not only on an No Yes No Noaggregated level)

Data can be easily collected (large numbers Yes No Yes Yesof attributes can be studied)

Rules for attribute calegorisations are No No Yes Yestheoretically developed (not arbitrarilychosen)

Clearly established rules for attribute No Yes No Yescalegorisations (always the same rules canbe applied, independent of the obtainedresults or the sample size)

This article addresses tbe concept of attributes variant and invariantweight in relation to overall customer satisfaction. The empirical studyshows that similar approaches for attribute categorisations lead to differentresults. This brings to light qualities and possible applications of theconsidered techniques. Further efforts should take into account that thesemethods work fundamentally different. Developing suggestions as tohow the construct validity of the methods can be assessed would be a fruitfuldirection for future research.

REFERENCES

Anderson, E.W. and V. Mittal, 2000, 'Strengthening the Satisfaction Profit Chain'. Journal ofService Research. VolJ. No.2. pp.107-20.

Page 14: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

8 0 THE SERVICE INDUSTRIES JOURNAL

Berger. C . R, Blaulh. D. Boger, C. Bolster, G. Burchill, W. Du Muchel. F. Pouliout, R. Richter. A.Rubinoff, D. Shen, M. Timko and D. Walden, 1993, 'Kano s Method for UnderstandingCustomer-defined Of^lity". The Journal of the Japanese Society for Quality Control, Fall,pp.3-35.

Brandt. D.R., 1988, 'How Service Marketers Can Identify Value-Enhancing Service Elements',The Journal of Services Marketing, Vol.2, No.3, pp.35-41.

Brandt, D.R. and J. Scharioth, 1998, 'Attribute Life Cycle Analysis. Alternatives to theKano-method", in Proceedings of the 51th ESOMAR-Congress. Berlin, 13-16 September,pp.413-29.

Cadotte, E.R. and N, Turgeon, 1988, 'Dissatisfiers and Saiisfiers. Suggestions from ConsumerComplainls anti Compliments", Journal of Consumer Satisfaction. Dissatisfaction andComplaining Behavior. Vol.I, pp.74-9.

Engel, J.F,, D.T. Kollal and R.D. Biackweli, 1968, Consumer Behavior. New York: Holt, Rinehartand Winston.

Hausknecht, D,R., 1990, 'Measurement Seales in Consumer Satisfaction/Dissatisfaction", y^wma/of Consumer Satisfaction/Dissatisfaction and Complaining Behavior, Vol.3, pp.1-11.

Herzberg, F., B. Mausner and B.B. Snyderman, 1959. The Motivation to Work. 2nd ed. New York:John Wiley & Sons.

Johnston, R., 1995, 'The Determinants of Service Quality: Satisfiers and Dissatisfiers", Inter-national Journal (if Service Industry Management, Vol.6, No.5, pp.53-71.

Kahneman, D, and D.T. Miller, 1986. 'Norm Theory: Comparing Reality to its Alternatives',Psychological Review. Vol.93, No.2, pp.136-.53.

Kano, N., 1984, 'Attractive Quality and Must-be Quality', The Journal of the Japanese Society forQuality Control. April, pp.39-48.

Leavitt, C . 1977. Consumer Satisfaction and Dissatisfaction; Bi-polar or Independent?', in H.K.Hum (ed.). Conceptualization and Measurement of Consumer Satisfaction and Dissatisfac-tion. Cambridge: Marketing Science Institute, pp.132-49.

Llosa, S., 1997, 'L'analyse de la contribution des elements du service a la satisfaction: Un modeletetraclasse". Decisions Marketing. No. 10, pp.81-8.

Llosa, S., 1999, 'Contributions to the Study of Satisfaction in Services', Proceedings of the AMASERVSiG Ser\'ice Research Conference. 10- 12 April. New Orleans, pp.121 - 3 .

Maddox, R.N., 1981. "Two-faclor Theory and Consumer Satisfaction. Replication and Extension',Journal of Consumer Research, Vol.8, pp.97- 102.

Martilla, J.A, and J.C. Jame.s, 1977, 'Importance Performance Analysis', Journal of Marketing.Vol.41. No.l,pp.77-9.

Matzler, K., H.H. Hinterhuber. F. Bailom and E. Sauerweln, 1996, 'How to Delight your Custo-mers', Journal of Product and Brand Management. Vol.2, pp.6-17.

Mazur, G.H. 2(X)1, 'QFD and Design for Six Sigma: Customer Driven DFSS", paper presented atthe 45th Congress of ihe European Organization for Quality (EOQ), Islanbtil.

McGill, A. and Iacobucci, D. 1992, 'The Role of Post-experience Comparison Standards in theEvaluation of Unfamiliar Services', in J. Sherry and B. Stemthal (eds). Advances in Consu-mer Research. Vol.19, pp.570-78.

Mittal, V,, W.T. Ross and P.M. Baldasare, 1998, 'The Asymmetric impact of Negative and Posi-tive Attribute-level Performance on Overall Satisfaction and Repurchase Intentions", Journalof Marketing. Vol.62, No,l, pp.33-47.

Ngobo, P.V., 1997, 'The Standards Issue: An Accessibility-Diagnosticity Perspective", rAf7w«r/ia/of Consumer Satisfaction, Dissatisfaction und Complaining Behavior, Vol.10, pp.61-79.

Oliver. R.L., 1977, 'The Effects of Expectations and Disconfirmation on Posl-exposure ProduciEvaluations', Journal of Applied Psychology. Vol.62. No.2, pp.246-50.

Oliver, R.L., \991, Satisfaction. A Behavioral Perspective on the Consumer.New York: McGraw-Hill International Editions.

Rusi, R.T. and A.J. Zahorik. 1993. 'Customer Satisfaction, Customer Retention, and MarketShare', Journal of Retailing, Vol.69, pp.192-215.

Sampson, S.E. and MJ. Showalter, 1999, 'The Performance-Importance Response Function:Observations and Implications', The Service Industries Journal, Vol.19, No.3, pp.1-25.

Page 15: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

CUSTOMER SATISFACTION MEASUREMENT 81

Swan, J. and J. Combs, 1976, 'Product Performance and Consumer Satisfaction: A New Concept",Journal of Marketing, Vol.40, No.2, pp.25-33.

Szymanski, D.M. and D.H. Henard. 2(X)I, 'Customer Satisfaction: A Meia-analysis of the Empiri-cal Evidence', Journal of the Academy of Marketing Science. Vol.29, No.], pp. 16-35.

Vanhoof, K. and G. Swinnen, 1998, 'Attribute Importance - Assessing Nonlinear Patterns ofFactors Contributing to Customer Satisfaction", ESOMAR Publication Series. Vol.204,pp. 160-71.

Vavra, T.G., 1997, Improving Your Measurement of Customer Satisfaction. A Guide to Creating,Conducting, Analyzing, and Reporting Customer Satisfaction Measurement Programs, Mil-waukee: American Society for Quality.

Venkitaraman, R.K. and C, Jaworski, 1993, 'Restructuring Customer Satisfaction Measurementfor Better Resource Alligation Decisions: An Integrated Approach', paper presented at tbeFourth Annual Advanced Research Techniques Forum of the American Marketing Associ-ation, Chicago, June,

Voss, G.B., A. Parasuraman and D. Grewal, 1998, 'The Roles of Price, Performance, and Expec-tation in Determining Satisfaction in Service Exchanges', Journal of Marketing, Vol.62,No.4, pp.46-61.

Westbrook, R.A. and R.L. Oliver, 1981, 'Developing Better Measures of Consumer Satisfaction:Some E*reliminary Results', in K.B. Monroe (ed.). Advances in Consumer Research. Vol.8,pp.94-99.

Westbrook, R.A. and M.D. Reilly, 1983, "Value-percept Disparity. An Alternative to the Discon-firmation of Expectations Theory of Satisfaction', in R.P. Bagozzi and A.M. Tybout (eds).Advances in Consumer Research, Vol.10, pp.256-6l.

APPENDIX

Satisfaction Measures

1. How satisfied are you with the service of the insurance consultant you met recently? (very sat-isfied/satisfied/neither satisfied nor dissatisfied/very dissatisfied);

2. How would you describe your emotions towards this service encounter (very pleasant/plea-sant/neither pleasant nor unpleasant/very unpleasant);

3. If a good friend of yours needed insurance consultations, would you recommend that consult-ant? (surely/maybe yes/don"l know/maybe no/certainly not);

4. Would you again engage the same insurance consultant you recently met? (surely/maybe yes/don't know/maybe no/certainly nol)

Performance Measures

5-point rating scales: 'entirely true/mostly true/neither, nor/mostly wrong/entirely wrong', usedfor 20 attributes formulated as assertions:

1. [time) the appointment fit in my time schedule;2. (punctuality) the consultant was punctual;3. (reputation) I know him for a long lime;4. (clothes) he was appropriately dressed;5. (expression) he expressed himself appropriately;6. (politeness) he was polite and kind;7. (presentation) he presented things clearly;8. (passion) he took time for listening and was patient;9. (situation) he took into account my personal situation (partner, family etc.);

10. {proposition) he made meaningful suggestions to me;11. (explication) he explained the details clearly;12. (preparation) he was well-prepared well the meeting;13. (objectivity) the advice proceeded objectively;

Page 16: Customer Satisfaction Measurement: Comparing Four Methods ... · Showalter. 19991. Higher satisfaction increases customer loyalty, positive word of mouth, customer retention and,

82 THE SERVICE INDUSTRIES JOURNAL

14. (process) he informed me aboul ihe process in case of a claim;\5. {duration) The conversation didn'l last lixj long;16. iuiility) he clearly showed how to use Ihc products:17. {ohlrusivenes.s) he wa.sn't obtrusive;18. (question) he could answer all my questions to my satisfaction;19. (information) he left meaningful and informative material to me;20. {gift) he gave me a litile present (e.g, ballpoint pen).