assessing the impact of integrating business planning and is planning

13
ELSEVIER Information & Management 30 (1996) 309-321 Research Assessing the impact of integrating business planning and IS planning a* S.H. Teo ', William R. King b Thompson aDepartment of Decision Sciences, Faculty of Business Administration, National University of Singapore, 10 Kent Ridge Crescent, Singapore 0511, Singapore bKatz Graduate School of Business, University of Pittsburgh, Pittsburgh, PA 15260, USA Abstract One of the key elements of strategic planning for information systems (IS) is the integration of IS planning (ISP) and business planning (BP). Although this issue has received significant attention in recent years, empirical research focusing specifically on it is still relatively sparse. Here, BP-ISP integration is considered in four ways (administrative, sequential, reciprocal, and full integration), reflecting various degrees of BP-ISP integration. The relationships between these and organizational impact (measured in terms of the extent of ISP problems and the extent of IS contributions to organizational performance) are investigated through the analysis of data gathered in a "matched pair" field survey of business planners and IS executives. The results empirically validate the importance of BP-ISP integration, since it was found to have a significant positive relationship with IS contributions to organization performance and a significant negative relationship to the extent of ISP problems. Keywords: Alignment; Business planning; Information systems planning; Integration; IS planning problems; Performance impact 1. Introduction Strategic planning for information systems (IS) has been consistently ranked among the top issues facing information system executives [30]. Generally, IS researchers believe that for strategic IS planning to be effective, it must involve the integration between IS planning (ISP) and business planning (BP), which will here be referred to as "BP-ISP integration". BP-ISP integration can be defined as the alignment of IS strategies with business goals and business strategies gained through coordination between the * Corresponding author. E-mail: [email protected] 0378-7206/96/$15.00 @~ 1996 Elsevier Science B.V. All rights reserved PII S0378-7206(96)01076-2 business and IS planning functions and activities. If ISP activities are not coordinated with BP activities, it is likely to be very difficult for IS to support business strategies and to contribute to the achieve- ment of business value. In addition, it is only through such efforts that technical issues can be effectively integrated with business issues [1]. Although the concept of BP-ISP integration has received significant attention in recent years, it is primarily conceptual in nature. Empirical research focusing on BP-ISP integration is relatively sparse; most has focused on identifying ISP issues (e.g., problems, benefits, and management), rather than on assessing the level and impact of BP-ISP integration.

Upload: thompson-sh-teo

Post on 04-Jul-2016

214 views

Category:

Documents


2 download

TRANSCRIPT

ELSEVIER Information & Management 30 (1996) 309-321

Research

Assessing the impact of integrating business planning and IS planning a *

S.H. Teo ' , William R. King b Thompson aDepartment of Decision Sciences, Faculty of Business Administration, National University of Singapore, 10 Kent Ridge Crescent,

Singapore 0511, Singapore bKatz Graduate School of Business, University of Pittsburgh, Pittsburgh, PA 15260, USA

Abstract

One of the key elements of strategic planning for information systems (IS) is the integration of IS planning (ISP) and business planning (BP). Although this issue has received significant attention in recent years, empirical research focusing specifically on it is still relatively sparse. Here, BP-ISP integration is considered in four ways (administrative, sequential, reciprocal, and full integration), reflecting various degrees of BP-ISP integration. The relationships between these and organizational impact (measured in terms of the extent of ISP problems and the extent of IS contributions to organizational performance) are investigated through the analysis of data gathered in a "matched pair" field survey of business planners and IS executives. The results empirically validate the importance of BP-ISP integration, since it was found to have a significant positive relationship with IS contributions to organization performance and a significant negative relationship to the extent of ISP problems.

Keywords: Alignment; Business planning; Information systems planning; Integration; IS planning problems; Performance impact

1. Introduction

Strategic planning for information systems (IS) has been consistently ranked among the top issues facing information system executives [30]. Generally, IS researchers believe that for strategic IS planning to be effective, it must involve the integration between IS planning (ISP) and business planning (BP), which will here be referred to as " B P - I S P integration".

BP- ISP integration can be defined as the alignment of IS strategies with business goals and business strategies gained through coordination between the

* Corresponding author. E-mail: [email protected]

0378-7206/96/$15.00 @~ 1996 Elsevier Science B.V. All rights reserved PII S0378-7206(96)01076-2

business and IS planning functions and activities. If ISP activities are not coordinated with BP activities, it is likely to be very difficult for IS to support business strategies and to contribute to the achieve- ment of business value. In addition, it is only through such efforts that technical issues can be effectively integrated with business issues [1].

Although the concept o f B P - I S P integration has received significant attention in recent years, it is pr imari ly conceptual in nature. Empirical research focusing on BP- ISP integration is relatively sparse; most has focused on identifying ISP issues (e.g., problems, benefits, and management), rather than on assessing the level and impact of BP-ISP integration.

310 T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321

1.1. BP-ISP integration

King [16] was among the first IS researchers to recognize and emphasize the importance of BP-ISP integration. He emphasized that the MIS strategy set (system objectives, system constraints, and system design strategies) should be directly derived from the organizational strategy set (business mission, objec- tives, strategy and other strategic organizational attributes).

This conceptualization of one-way sequential integration (from BP to ISP) has been refined by King and Zmud [20] to a two-way reciprocal integration between BP and ISP. This change was brought about by the realization that ISP can be used not only to support, but also to influence, business strategies. This concept of two-way reciprocal integration has formed the basis for subsequent work in this area.

1.1.1. BP-ISP Taxonomies Synnott [37] conceptualized ISP in terms of the

extent of BP-ISP integration as:

(1) No planning: (2) Stand-alone planning: (3) Reactive planning:

(4) Linked planning:

(5) Integrated planning:

No formal BP or ISP. Presence of either business plan or IS plan, but not both. IS function reacts to business plans and has no input in the BP process. BP is "interfaced" with ISP. System resources are matched against business needs. BP is indistinguishable from ISP. They occur simultaneously and interactively.

A noteworthy feature of this taxonomy is that in the first and second forms of planning, BP-ISP integration is virtually absent. Other features of Synnott's conceptualization bear some similarities to earlier conceptualizations of BP-ISP integration by other researchers.

In another taxonomy of the levels of BP-ISP inte- gration, Jang [14] proposed that there are four forms of ISP based on the extent of BP-ISP integration:

1. Pre-planning, when there is no link between BP and ISP.

2. Separate planning, when there is a weak integra- tion between BP and ISP. ISP is therefore primarily non-strategic (similar to stand alone planning).

3. Linked planning, when ISP is guided by BP and has no opportunity to influence BP (similar to one- way sequential integration).

4. Integrated planning, when there is a two- way reciprocal relationship between BP and ISP, i.e., ISP is not only guided by BP, but it can also influence business strategies.

Yet another conceptualization of integrated plan- ning was offered by Goldsmith [7] who illustrated how BP-ISP integration was carried out at Simon Engineering (England). Both the value chain and competitive forces framework [27] were incorporated into the Information Engineering methodology [26] for ISP. Goldsmith emphasized that rather than separating ISP from BP (and aligning them through linkages), ISP should be integrated within BP. He further argued that in order for competitive advantage to be secured from IT applications, information strategies need to be developed in the same process and at the same time as business strategies.

1.2. The Impacts of BP-ISP Integration

The benefits of increasing the extent of BP-ISP integration has been emphasized in both prescriptive [36] and empirical studies [34, 39]. These studies suggest that a greater extent of BP-ISP integration helps to ensure that the IS function supports organizational goals and activities at every level by identifying critical applications for development and ensuring that adequate resources are allocated to critical applications. BP-ISP integration also helps to ensure that the IS function becomes an integral part of the organization, and is not merely appended to it, by facilitating information sharing, and feedback between top management, and IS management during strategy formulation and implementation [2].

Although many researchers have emphasized the importance of BP-ISP integration, very few attempt to link BP-ISP integration to performance measures. Instead, researchers commonly focus on conceptual and organizational issues, e.g., Powell [33] examines the extent to which the relationship between IT and

T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321 311

business strategy has changed over time. Lederer and Mendelow [21 ] conducted interviews to examine why coordination between IS plans and business plans are often plagued with difficulties. Similarly, Nath [28] identified organizational factors perceived to be important in aligning IS with business goals.

In terms of the empirical evaluation of the impact of BP-ISP integration, Das et al. [5] cited an A.T. Kearney study which shows that organizations that integrated business plans and IS plans generally outperform those who do not. Chan and Huff [3] found that IS strategic alignment was consistently related to various dimensions of IS effectiveness. However, mixed results with respect to IS strategic alignment and various dimensions of IS performance were obtained.

Type 2: One-way linked planning with sequential integration; Type 3: Two-way linked planning with reciprocal integration; and Type 4: Integrated planning with full integration.

Each successive type reflects an increased strategic potential for IT and enables more effective alignment between IS and business strategies. The role of the IS function for Types l and 2 are essentially reactive in nature, since the IS function has negligible influence on business strategies. Conversely, the role of the IS function for Types 3 and 4 are more proactive in nature, since the IS function plays a role in both supporting and influencing business strategies.

2.2. Impact of BP-ISP Integration

2. Operafionalizing the measures

In this study, the independent variable of interest is the "extent of BP-ISP integration". The dependent variable is the "impact of BP-ISP integration" which is operationalized in terms of the extent of ISP problems and the "extent of IS contributions to organizational performance".

2.1. Extent of BP-ISP Integration

The taxonomies of BP-ISP integration serve as a basis for operationalizing the extent of BP-ISP integration. We have chosen to use a four-stage approach. It omits the "no integration level" of some of the previous taxonomies because that level is neither as prevalent nor significant as it once was and because it is unlikely that it can be distinguished from a weak form of administrative integration-e.g., that in which overall IS budgets depend on the outcomes of business planning. This difficulty in distinguishing between "no integration" and "administrative inte- gration" became apparent during pretesting of the measurement instrument. Hence, we decided that a four-stage taxonomy would be sufficiently parsimo- nious without omitting any significant form of BP- ISP integration.

The four-stage taxonomy [19, 38] is: Type 1: Separate planning with administrative integration;

Two varieties of organizational impacts can be usefully considered-intermediate and overall. Inter- mediate impacts pertain to ISP itself, while overall impacts pertain to the organization as a whole. Intermediate impacts have been treated in terms of "ISP problems" [23]. Overall impacts relate to the impact of IS on organizational performance.

2.2.1. ISP Problems More extensive and sophisticated BP-ISP integra-

tion should affect the business relevance and quality of ISP. Problems associated with ISP can undermine the quality of ISP, thereby resulting in wasted resources and lost opportunities [17]. It appears that such ISP problems can be mitigated by greater BP- ISP integration.

ISP problems have been widely discussed in the IS literature and have been classified in terms of input, process and output problems [22], organizational, commitment/contractual, outcome/expectations, ex- pertise/technical and implementation problems [13], leadership, implementation and resource problems [24], organization, implementation, database, hardware, and cost problems [25]. Since, the last categorization of ISP problems is the most compre- hensive and has been rigorously derived by Lederer and Sethi, it will form the basis for our measurement of ISP problems.

The extent of ISP problems can be readily operationalized in terms of:

312 ZS.H. Teo, W.R. King~Information & Management 30 (1996) 309-321

1. Organization problems 2. Implementation problems 3. Database problems 4. Hardware problems 5. Cost problems.

Organization problems concern the failure of ISP to sufficiently consider organizational strategies and characteristics, the needs of users, IS objectives and the IS applications portfolio. Implementation pro- blems concern the difficulty of carrying out the plan due to poor communication with top management and poor ISP output documents. Database problems concern the failure to set priorities for databases, and plan for an overall data administration and data architecture for the organization. Hardware problems concern the failure to plan for overall hardware and data communications for the organization. Cost problems deal with the excessive duration and associated costs of ISP.

2.2.2. IS Contributions to Organizational Performance

Since BP-ISP integration facilitates a common frame of reference that is essential for the internal consistency and the external validity of plans [12], it can lead to the more effective deployment of IT to serve business needs and to better exploitation of opportunities to use IT for the creation of business value. The contribution of IS to organizational performance is perhaps the oldest and most com- monly used form of assessing the impact of planning systems. However, the link between ISP and organizational performance is elusive [4, 6] and often controversial [9, 10]. Similar difficulties have been found in the strategy literature which reported mixed findings regarding the effects of BP on organizational performance (e.g., [32]). The basis for this conclusion is that any planning system should ultimately have an impact on the firm's financial performance (e.g., improvement in ROI) and/or nonfinancial performance (e.g., increased customer satisfaction).

IS contributions to organizational performance can also be assessed in terms of increased market share, improved internal efficiency of the firm's operations, increased annual sales revenue, etc.

3. Research Propositions and Hypotheses

The literature suggests that greater BP-ISP inte- gration will influence the organization in terms of ISP problems and IS contributions to organizational performance.

3.1. Impact of BP-ISP Integration

3.1.1. 1SP Problems ISP problems tend to be less severe when planning

is strategic rather than financial or tactical. Greater BP-ISP integration is most likely to be associated with planning that is strategic rather than financial or tactical; this aids communication between IS and top management and cultivates better understanding and a more realistic expectation of the role of the IS function.

The first proposition to be addressed is that there is an inverse relationship between the extent of BP-ISP integration and the extent of various kinds of ISP problems in an organization. The first hypothesis is therefore:

Hypothesis 1: The greater the extent of BP-ISP integration, the lesser the extent of"

1. Organization problems. 2. Implementation problems. 3. Database problems. 4. Hardware problems. 5. Cost problems.

3.1.2. IS Contributions to Organizational Performance

In order for the IS function to contribute to overall organizational performance, it is necessary to estab- lish integration between BP and ISP. When the integration between BP and ISP is weak, the role of IS is likely to be supportive rather than salient in the creation of business value.

The second proposition is that there is a positive relationship between the extent of BP-ISP integration and the level of overall organizational performance. The second hypothesis is therefore:

Hypothesis 2: The greater the extent of BP-ISP integration, the greater will be the extent of IS contributions to organizational performance.

T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321 313

4. Research Methodology

4.1. The sample

A random sample of 600 firms was obtained from the Corporate 1000 book: this source generally lists medium to large US corporations, and consequently are likely to use and have experience with IT. This is important, as we wanted the sample to include firms practicing all four types of integration.

The development of the instrument involved a series of pretests using doctoral and MBA students, IS practitioners, and graduate business school faculty members over a period of about three months. The pretests resulted in changes in the wordings of certain items and the rearrangement of the order of some of the items to improve clarity and mini- mize ambiguity. In particular, some of the items pertaining to ISP problems were reverse coded to minimize bias due to the negative connotation of the construct.

Questionnaires were prepared and sent directly to the CEO with instructions requesting him/her to forward the questionnaires to the Senior Business Planner and the Senior Information Systems Execu- tive. The directions for distribution directed that if ISP is carried out centrally at the corporate level for most business segments (i.e., divisions or business units), the questionnaires should be forwarded to the Senior Business Planner and the Senior Information Systems Executive responsible for BP and ISP at the corporate level respectively. Conversely, if ISP is carried out independently in each business segment (i.e., division or business unit), the CEO was asked to select a core business segment, and forward the questionnaires to the Senior Business Planner and the Senior Information Systems Executive responsible for that core business segment. As a validation check, both respondents were asked to state and briefly describe the business segment for which they were responsible.

4.2. The instrument

The four types of BP-ISP integration (adminis- trative integration, sequential integration, reciprocal integration, and full integration) were described and respondents were asked to indicate the type that best

described their firm's current BP-ISP integration (see survey instrument in the Appendix).

Since the IS executives are involved in ISP, they were asked questions relating to the current type of BP-ISP integration and also the extent of ISP problems in their organizations. The Busi- ness Planners were asked to evaluate the extent of IS contributions to organizational perfor- mance. Note that since the current type of inte- gration and IS contributions to organizational performance are measured using different respon- dents, the problem of common source variance is reduced.

4.3. Response and non-response analysis

A primary mailing and two follow-up mailings were made; the first and second follow-ups were made about three and seven weeks from the date of initial mailings. Forty-five firms declined participa- tion citing one or more of the following reasons: company policy not to respond to any questionnaire, lack of manpower, company currently undergoing restructuring. Useable "matched pairs" were re- turned by 157 firms (26.2%). This response rate is adequate but somewhat lower than that usually achieved. This may be explained by the high level of the respondents and the fact that two responses per firm were required. Previous research using the matched-pair design usually involved an IS Executive and a user who might or might not be senior executives (e.g., [35]).

A summary of the characteristics of respondents is shown in Table 1. They come from a wide range of industries with a predominance of manufacturing finns. The annual sales revenue is widely distributed, in the anticipated medium to high range. The number of employees in each firm varies. Both the job titles of Business Planners and IS Executives confirm that respondents are almost exclusively Senior Executives in the firm since more than 70% of respondents are at the Director level or higher.

Comparisons (using chi-square tests at p =0.05) between respondents and non respondents were made in terms of industry representation, annual sales revenue, and the number of employees. The results suggested the absence of non-response bias.

314 ZS.H. Teo, W.R. King/Information & Management 30 (1996) 309-321

Table 1 Characteristic of respondents a

Characteristics of respondents a

1. Industry %

Oil/Petroleum 3.8 Manufacturing 31.2 Medicine/Health 5. l Utilities 14.6 Transportation 5.7 Wholesale/Retail 11.5 Restaurant/Hotel 1.9 Finance/Insurance/Real Estate 2.5 Publishing/Information/News 5.1 Computers/Communications 8.9 Others 9.6

2. Annual Sales ($ Million) Below 300 8.9 300 - - Less than 600 12.7 600 - - Less than 1000 10.8 1000 - - Less than 2000 19.7 2000 - - Less than 3000 10.8 3000 - - Less than 5000 15.2 Above 5000 21.7

3. Number of Employees 100 - - Less than 300 0.6 300 - - Less than 1000 6.4 1000 - - Less than 2000 9.6 2000 - - Less than 5000 18.5 5000 - - Less than 10000 21.0 Above 10000 43.9

4. Respondent's Hierarchical Level Business IS Planner Executive

President/Sr. or Exec. VP 19.1 19.1 Vice President 35.7 38.9 Director 24.2 22.3 Manager 15.9 14.6 Asst. VP/Dir/Mgr 1.9 1.3 Others 0.6 1.9 Missing Data 2.5 1.9

a n =157; all numbers indicate percentages

4.4. Assessing validity and reliability

Since a single i tem might not fully tap a construct or might be subject to misinterpretat ion by the respondents , mul t ip le i tems were used for each construct. The reliabil i ty of the scales was assessed using Cronbach Alpha, which are an indicat ion of the internal consis tency of the i tems measur ing the same

construct. High values indicate high internal consis- tency of the mul t ip le i tems measur ing each construct, hence indicat ing high rel iabil i ty of the individual

constructs. Each i tem should add to the rel iabil i ty of the construct. Based on this criteria, one i tem from

organizat ion problems and two i tems from imple- menta t ion problems were dropped. In general, the reliabil i ty coefficients are equal to or above the

recommended value of 0.60 for exploratory research [31 ] (see Table 2).

For statistical analyzes, the mult iple i tems com- prising a construct were summed together into a

single score. This assumes that each i tem contributes equally, and this assumpt ion has been used success- fully in previous research examin ing ISP and the strategic use of IT (e.g., [29]).

Since the exist ing state of integrat ion was mea-

sured by asking respondents to place a check-mark beside one of the four descriptions of the types of integration, it was important that respondents were able to unders tand and dist inguish among the four

types. As a validity check, te lephone calls were made to respondents to determine whether they had any difficulty in unders tanding or dis t inguishing among the descriptions of the four types of integration. The

results of these interviews showed that none of the respondents had any difficulty in unders tanding or

dis t inguishing among them. In fact, one respondent commented that the four types of integrat ion are "n ice concepts" for unders tanding B P - I S P integra-

tion. As another validity check, we also examined the

relat ionships be tween the types of integrat ion and

c o m m o n l y accepted measures of growth, namely

Table 2 Reliability of constructs

Construct No. of Cronbach Items Alpha

Information Systems Planning (ISP) Problems (a) Organization Problems 4 0.70 (b) Implementation Problems 4 0.60 (c) Database Problems 3 0.79 (d) Hardware Problems 2 0.88 (e) Cost Problems 2 0.62 IS Contributions to Organizational 5 0.87 Performance

T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321 315

number of years of formal ISP. This method of validation has been commonly used in organizational research to assess the validity of the self-typing paragraph measure [15]. As expected, the results show an increasing trend in the number of years of formal ISP with greater extent of BP- ISP integration (F =2.85, p <0.05). Hence, the self-typing paragraph measure of the extent of integration is deemed valid.

5. Analyses and results

The results show that sequential integration (n =65) and reciprocal integration (n =65) occur most often, fol lowed by administrative integration (n = 17) and full integration (n =10) . This distribution of the types of integration is not surprising if we make the assumption that firms generally move in the direction toward greater levels of BP- ISP integration (i.e., generally from administrative toward full integra-

Table 3 Correlations with extent of BP-ISP integration

Performance Measures r

ISP Problems (a) Organization Problems -0.39 a (b) Implementation Problems -0.36 ~ (c) Database Problems -0.32 a (d) Hardware Problems -0.29 a (e) Cost Problems -0.06 IS Contributions to 0 . 3 5 a

Organizational Performance

ap <0.001

tion). However, very few firms have indicated that they have reached full integration.

5.1. Hypotheses testing

Table 3 shows the Pearson correlations between the extent of BP- ISP integration and performance measures. With the exception of cost problems, all the correlations were significant. Hence all hypoth- eses, with the exception of HI(e) , were supported.- Table 4 shows the means and standard deviations of the performance measures grouped by the successive types of integration. A one way ANOVA test was carried out to further analyze each of the performance measures. As expected, the results showed that the group means for organization (ORG), implementa- tion (IMPLMN), database (DBASE), and hardware (HWARE) problems, as well as IS contributions to organizational performance (PERFORM) differed significantly.

In order to determine which types of integration differ, a post-hoc analysis using Scheffe procedure was carried out. Table 5 presents the significant pairwise comparisons for each of the five significant variables. It is interesting to note that significant differences typical ly arise between reactive types (i.e., administrative or sequential integration) and proactive types (i.e., reciprocal and full integration). This is perhaps not surprising, since reactive types are l ikely to have similar characteristics with each other, but dissimilar characteristics with proactive types due to the different roles of the IS function. On the advice of a reviewer, we repeated the analysis using one-way

Table 4 Means (standard deviations) of performance measures grouped by types of integration

Performance Administrative Sequential Reciprocal Full F Measures Integration Integration Integration Integration

Impact of BP-ISP Integration ISP Problems a. ORG 3.54 (1.25) 2.75 (0.95) 2.27 (0.69) 2.28 (0.72) 10.76 c b. IMPLMN 4.22 (1.26) 3.73 (0.96) 3.22 (0.90) 2.83 (1.10) 7.55 c c. DBASE 4.29 (1.81) 3.28 (1.34) 2.95 (1.18) 2.30 (0.71) 6.43 c d. HWARE 3.71 (2.27) 2.72 (1.43) 2.35 (0.83) 2.05 (0.83) 5.57 b e. COST 3.76 (1.63) 3.85 (1.31) 3.59 (1.25) 3.75 (1.55) 0.42 PERFORM 4.09 (1.03) 4.08 (1.00) 4.87 (0.97) 5.14 (1.23) 9.00 c

a p <0.05 b p<0.01 ¢ p <0.001 Note: The scales used are from 1 to 7. For ORG, IMPLMN. DBASE, HWARE and COST problems, higher values signify greater ISP problems whereas for PERFORM, higher values signify greater IS contributions to organizational performance.

316 T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321

Table 5 Post-hoc comparisons using Scheffe tests

Performance Measures Pairwise Comparisons (p <0.05)

ORG Administrative >> Sequential Administrative >> Reciprocal Administrative >> Full Sequential >> Reciprocal

IMPLMN

DBASE

HWARE

PERFORM

Administrative >> Reciprocal Administrative >> Full Sequential >> Reciprocal

Administrative >> Sequential Administrative >> Reciprocal Administrative >> Full

Administrative >> Reciprocal Administrative >> Full

Reciprocal >> Administrative Reciprocal >> Sequential Full >> Sequential

>> signifies significantly greater than (at p =0.05)

Kruskal-Wallis and Mann-Whitney tests. The results are similar to those reported above.

The data are plotted in Figure 1 to determine whether there are any distinct trends among the performance measures. It is apparent that ISP problems are generally less severe at reciprocal or full integration. With the exception of COST, other ISP problems show a distinct decreasing trend across the types of integration.

As expected, the extent of IS contributions to organizational performance increases as the firm moves toward greater integration. However, there appears to be a pronounced increase in the extent of IS contributions to organizational performance as the firm moves from reactive types (i.e, administrative or sequential integration) to proactive types. This is perhaps due to a more proactive role of the IS function in supporting and influencing the firm's strategy at reciprocal or full integration. More importantly, this result provides empirical evidence for the beneficial impact of proactive BP-ISP integration in increasing the extent of IS contributions to organizational performance.

The extent of IS contributions to organizational performance was measured in terms of increased ROI, increased market share of products/services,

improved internal efficiency of operations, increased annual sales revenue, and increased customer satis- faction.

The contributions of IS to improve internal efficiency reflect the traditional role of IS in automating work processes. However, in recent years, the focus has shifted from routine automation to business process reengineering in order to reap dramatic rather than incremental improvements in productivity from the use of IT [ll].The contribu- tions of IS to increase customer satisfaction, perhaps reflect the increased use of IT to provide better services. Recent research (e.g., [18]) has shown that strategic applications of IT are commonly directed at improving internal operations and providing better services to customers; e.g., easy access to accurate and timely order information. These enhanced services usually improve customer satisfaction and help to encourage customer loyalty, thereby also contributing to improved organizational performance.

5.2. Comparisons o f ISP Problems at Various Integration Levels

In order to seek greater insight into the meaning of these statistical results, comparisons of ISP problems among the four types of BP-ISP integration were made, as shown in Figure 2.

ORG, IMPLMN, DBASE and HWARE problems can be seen to generally show a decreasing trend, as expected, across the successive types of integration due to the presence of greater coordination between BP and ISP at later types of integration. COST problems generally did not vary much across the types of integration. COST problems are relatively low at administrative integration, probably because minimal attention is paid to ISP. Since IS applications at administrative integration are generally routine and non-strategic, less time and resources are required. As the firm begins to leverage IT to support business strategies, there is a resulting dominance in COST problems, relative to other ISP problems.

IMPLMN problems are dominant in administrative integration and remained dominant, though decreas- ing in magnitude, at each successive types of integration. This implies that although there is a reduction in the extent of IMPLMN problems across the successive types of integration due to better

T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321 317

(a) (b)

ORG IMPLMN

ifiiill 2

1

0 Admln Sequential Reciprocal Full Admln

Types of Integration

Sequential Reciprocal

Types of Integration

Full

(d) (c)

(f)

DBASE HWARE 7r

Admln Sequantlal Reciprocal Full

Types of integration

i

t/I/III.YlI///II I IIII/I III iii/ i/iii

Adrnln Sequential Reciprocal Full

Types of Integration

(e)

PERFORM COST

Admln Sequential Reciprocal Full Admln Sequential Reciprocal Full

Types of Integration Types of Integration

Fig. 1. Bar charts showing variations of performance measures with types of integration.

coordination between business and IS, IMPLMN problems remain a key issue. One possible reason is that the elusive link between investments in IT and organizational performance may result in the lack of top management support and commitment for implementing IS plans.

DBASE problems are more dominant than HWARE problems across the successive types of integration, probably because hardware planning is less complex than database planning, probably due to the difficulty of finding the appropriate balance between the cost (e.g., decreased flexibility due to

318 T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321

ISP Prob lems 7j 1

I / ~ ORG - - IMPLMN -~ DBASE ~- HWARE -~ COST L /

6t

Admin Sequential Reciprocal Full

Types of In tegrat ion

Fig. 2. Comparisons of ISP problems.

greater interdependence among units) and benefits (e.g., reduced data redundancy) of increased data integration [8].

ORG problems are reduced significantly at each successive type of integration, since problems such as those relating to a failure to take into account organizational goals and strategies, and assess the current IS applications portfolio, are more likely to be resolved when there is greater BP-ISP integration. As well, problems relating to the failure to involve users, and make appropriate and realistic planning assump- tions, can be mitigated.

The decreasing trends in ORG, IMPLMN, DBASE and HWARE problems reinforce the suggestion that ISP problems are less severe when ISP is strategic (as in reciprocal or full integration) than when ISP is financial/tactical and that COST remained constant regardless of the orientation of ISP.

6. C o n c l u s i o n s

Despite the presumed importance of BP-ISP integration, there is relatively little empirical research focusing specifically on it. This research builds on

and expands existing research literature on BP-ISP integration, and hence helps to establish a cumulative tradition.

The significant positive relationship that was found between the extent (type) of BP-ISP integration and the extent of IS contributions to organizational performance provides empirical evidence of the importance of BP-ISP integration. This evidence is reinforced by the fact that the type of integration and IS contributions to organizational performance are measured using different respondents in the same firm, thereby reducing common source variance.

This result also suggests that the notion of IS contributions to organizational performance might only be applicable when there is proactive BP-ISP integration (as in reciprocal or full integration). The extent (type) of integration also was found to have a significant negative relationship with the extent of organization, implementation, database and hardware problems, and a negligible relationship with cost problems. This confirms the benefits of greater BP- ISP integration in mitigating ISP problems possibly by facilitating greater communication and under- standing between top management and IS manage- ment.

ZS.H. Teo, W.R. King/Information & Management 30 (1996) 309-321 319

Appendix A. Sample Questionnaire

BP-ISP Integration Please indicate with a check mark (~/) the

description that most closely fits your current BP- ISP integration

( ) Administrative Integration

Business Information )

Planning systems planning

In this type of integration, there is a weak relationship between Business Planning (BP) and Information Systems Planning (1SP) as shown by the arrow given above. Generally there is little significant effort to use Information Technology (e.g., compu- ters, telecommunications) to support business plans.

( ) Sequential Integration

Business Information >

Planning Systems Planning

In this type of integration, a sequential relationship exists between Business Planning (BP) and Informa- tion Systems Planning (ISP). BP provides directions for ISP. This relationship is denoted by a unidirec- tional arrow flowing from BP to ISP. ISP primarily focuses on providing support for business plans.

( ) Reciprocal Integration

Business , Information Planning Systems Planning

In this type of equation, there is a reciprocal and interdependent relationship between Business Plan- ning and Information Systems Planning (ISP). There are therefore two arrows shown above; one arrow flowing from BP to ISP, and the other from ISP to BP. ISP plays a role in both supporting and influencing business plans.

( ) Full Integration

Integrated Planning

In this type of equation, there is little distinction between the Business Planning and the Information Systems Planning (ISP) process. Business and information systems strategies are developed con- currently in the same integrated planning process.

The following items are on a 7-point scale: '1' Strongly Disagree, '2' Disagree, '3' Mildly Disagree, '4' Neutral, '5' Mildly Agree, '6' Agree, '7' Strongly

Agree. Actual items are interspersed in questionnaire. (R) represents items which are reverse coded.

ISP Problems (adapted from Lederer and Sethi [23, 25])

Organization Problems

1. Information Systems Planning (ISP) adequately takes into account organizational goals and strategies. (R)

2. ISP fails to adequately assess the current informa- tion systems applications portfolio.

3. ISP fails to adequately involve users. 4. Appropriate and realistic assumptions are made

during ISP. (R) 5. The Information Systems (IS) plan provides a

statement of objectives for the information systems department. (R) [Dropped]

Implementation Problems

1. ISP fails to adequately involve top management. 2. It is very difficult to secure top management

commitment for implementing the IS plan. 3. Implementing the objectives identified in the IS

plan requires substantial further analysis. 4. The IS plan is in accordance with the expectations

of top management. (R) 5. The IS plan is very useful. (R) [Dropped] 6. ISP adequately takes into account issues related to

plan implementation. (R) [Dropped]

Database Problems

1. The IS plan adequately addresses the need for data/database administration. (R)

2. The IS plan provides priorities for developing specific databases. (R)

3. The IS plan includes an overall data architecture plan. (R)

Hardware Problems

1. The IS plan includes an overall hardware plan. (R).

2. The IS plan includes an overall data communica- tions plan. (R)

Cost Problems

1. The ISP process takes a significantly longer time than expected.

320 T.S.H. Teo, W.R. King~Information & Management 30 (1996) 309-321

2. The ISP process is very expensive.

IS Contributions to Organizational Performance (adapted from Premkumar and King [34])

In our organizational unit, the information systems function has contributed significantly to: a. increased ROI. b. increased market share of products/services. c. improved internal efficiency of operations. d. increased annual sales revenue. e. increased customer satisfaction.

Note: (R) signifies reverse coding.[Dropped] signifies item has been eliminated to improve reliability.

References

[1] Bryd, T.A., Sambamurthy, V. and Zmud, R.W., "An examination of IT planning in a large, diversified public organization", Decision Sciences, 26(1), 1995, 49-73.

[2] Calhoun, K.J. and Lederer, A.L., "From strategic business planning to strategic information systems planning: The missing l ink", Journal of Information Technology Management, 1(1), 1990, 1-63.

[3] Chan, Y.E. and Huff, S.L., "Investigating information systems strategic alignment", Proceedings of the 14th International Conference on Information Systems, Orlando, FL., 1993, 345-363.

[4] Crowston, K. and Treacy, M.E., "Assessing the impact of information technology on enterprise level performance", Proceedings of the Seventh International Conference on Information Systems, San Diego, CA., 1986, 299-310.

[5] Das, S.R., Zahra, S.A. and Warkentin, M.E., "Integrating the content and process of strategic MIS planning with competitive strategy", Decision Sciences 22, 1991, 953-984.

[6] DeLone, W.H. and McLean, E.R., "Information systems success: The quest for the dependent variable", Information Systems Research, 3(1), 1992, 60--95.

[7] Goldsmith, N., "Linking IT planning to business strategy", Long Range Planning, 24(6), 1991, 67-77.

[8] Goodhue, D.L., Wybo, M.D. and Kirsch, L.J., "The impact of data integration on the costs and benefits of information systems", MIS Quarterly, 16(3), 1992, 293-311.

[9] Hamilton, S. and Chervany, N.L., "Evaluating information system effectiveness - Part I: Comparing evaluation approaches, MIS Quarterly 5(4), 1981, 55-56.

[10] Hamilton, S. and Chervany, N.L,, "Evaluating information system effectiveness - Part II: Comparing evaluator viewpoints", MIS Quarterly 5(4), 1981, 79-86.

[11] Hammer, M., "Reengineering work: Don't automate, obliterate", Harvard Business Review, 68(4), 1990, 104-112.

[12] Henderson, J.C. and Sifonis, J.G., "The value of strategic IS planning: Understanding consistency, validity, and IS markets", MIS Quarterly, 12(2), 1988, 187-199.

[13] Hoffer, J.A., Michaele, S.J and Carroll, J.J., "The pitfalls of strategic data and systems planning: A research agenda", Proceedings of the 22nd Annual Hawaii International Conference on System Sciences, Los Alamitos, CA., IEEE Computer Society Press, 1989, 4, 348-356.

[14] Jang, S.Y., Influence of organizational factors on infor- mation systems planning, Ph.D. Dissertation, Katz Graduate School of Business, University of Pittsburgh, PA., 1989.

[ 15] Kazanjian, R.K. and Drazin, R., "An empirical test of a stage of growth progression model", Management Science, 35(12), 1989, 1489-1503.

[16] King, W.R., "Strategic planning for management informa- tion systems", MIS Quarterly, 2(1), 1978, 27-37.

[17] King, W.R., "How effective is your information systems planning?", Long Range Planning, 21(5), 1988, 103-112.

[18] King, W.R. and Teo, T.S.H., "Facilitators and inhibitors for the strategic use of information technology", Information and Management 27, 1994, 71-87.

[19] King, W.R. and Teo, T.S.H., Integration between business planning and information systems planning: Validating a stage hypothesis, Working Paper, 1995.

[20] King, W.R. and Zmud R.W., "Managing information systems: Policy planning, strategic planning and operational planning", Proceedings of the Second International Con- ference on Information Systems, Boston, MA., 1981, 299- 308.

[21] Lederer, A.L. and Mendelow, A.L., "Coordination of information systems plans with business plans", Journal of Management Information Systems, 6(2), 1989, 5-19.

[22] Lederer, A.L. and Sethi, V., "The implementation of strategic information systems planning methodologies", MIS Quarterly, 12(3), 1988, 445461.

[23] Lederer, A.L. and Sethi, V., "Critical dimensions of strategic information systems planning", Decision Sciences 22, 1991, 104-119.

[24] Lederer, A.L. and Sethi, V., "Meeting the challenges of information systems planning", Long Range Planning 25(2), 1992, 69-80.

[25] Lederer, A.L. and Sethi, V., "Root causes of strategic information systems planning implementation problems, Journal of Management Information Systems" 9(1), 1992, 25--45.

[26] Martin, J., Strategic data-planning methodologies, Prentice- Hall, Englewood Cliffs, N.J., 1982.

[27] McFarlan, EW., "Information technology changes the way you compete", Harvard Business Review, 62(3), 1984, 98- 103.

[281 Nath, R., "Aligning MIS with business goals", Information and Management 16, 1989, 71-79.

[29] Neo, B.S., Managing information technology for competitive advantage: A contingency perspective, Ph.D. Dissertation, Katz Graduate School of Business, University of Pittsburgh, PA., 1989.

[30] Niederman, E, Brancheau, J.C. and Wetherbe, J.C., "In- formation systems management issues for the 1990s", MIS Quarterly, 15(4), 1991, 475-500.

T.S.H. Teo, W.R. King/Information & Management 30 (1996) 309-321 321

[31] Nunnally, J., Psychometric theory, (2nd edn), McGraw-Hill, New York, N.Y., 1978.

[32] Pearce, J.A., Freeman, E.B. and Robinson, R.B., "The tenuous link between formal strategic planning and financial performance", Academy of Management Review, 2(4), 1987, 658-675.

[33] Powell, P., "Causality in the alignment of information technology and business strategy", Journal of Strategic Information Systems, 2(4), 1993, 320--334.

[34] Premkumar, G. and King, W.R., "Assessing strategic information systems planning", Long Range Planning, 24(5), 1991, 41-58.

[35] Rateb, D.E, The fit between project characteristics and application development methodologies: A contingency approach, Ph.D. Dissertation, Katz Graduate School of Business, University of Pittsburgh, PA., 1992.

[36] Sass, C.J. and Keefe, T.A., "MIS for strategic planning and a competitive edge", Journal of Systems Management, 41(6), 1988, 14-17.

[37] Synnott, W.R., The information weapon: Winning customers and markets with technology, Wiley, N.Y., 1987.

[38] Teo, T.S.H. and King, W.R., Integration between business planning and information systems planning: An evolution- ary-contingency perspective, Working paper, 1995.

[39] Zivran, M., "Relationship between organizational and information systems objectives: Some empirical evidence", Journal of Management Information Systems, 7(1), 1990, 65-84.

Thompson S.H. Teo is a Lecturer in the Department of Decision Sciences at the National University of Singapore. He received his Ph.D. in Management Information Systems from the Univer- sity of Pittsburgh. His current research interests include IS planning, telework-

.... ing, IT personnel, IT adoption and diffusion, and electronic commerce.

. . . . . . His academic work has been published in journals such as Communications of the ACM, Information and Management, and Journal of Management Information Systems.

William R. King is the University Pro- fessor at the University of Pittsburgh. He has served as President of the Association for Information Systems and the Institute of Management Sciences (now IN- FORMS) and the Senior Editor of the MIS Quarterly.