an autonomic service delivery platform for service ... · we assume consumers enter the sdp through...

Service-Oriented NetworkingFederations of Service-Oriented Systems

Autonomic Service Delivery PlatformRemaining Work & Conclusions

An Autonomic Service Delivery Platform forService-Oriented Network Environments

Bob Callaway

North Carolina State UniversityDepartment of Electrical and Computer Engineering

PhD Preliminary Examination

November 2, 2007

Advisory Committee:Dr. Michael Devetsikiotis (Chair), Dr. Yannis Viniotis (Co-Chair),

Dr. Adolfo Rodriguez, Dr. Andy Rindos, Dr. Mihail Sichitiu, Dr. Sharon Setzer

Bob Callaway Network Performance Research Group Slide 1 of 28



Presentation Outline

1 Service-Oriented NetworkingChallenges in Architecting Service-Oriented Network DevicesChallenges in Service-Oriented Network Architectures

2 Federations of Service-Oriented SystemsA Single Autonomous Service-Oriented NetworkInterconnection of Autonomous Service-Oriented Networks

3 Autonomic Service Delivery PlatformOverview of ArchitectureKey AssumptionsIntegrated MethodologiesAnalytical Framework

4 Remaining Work & ConclusionsRemaining WorkContributions of Work




Overview of Service-Oriented NetworkingChallenges in Architecting Service-Oriented Network DevicesChallenges in Service-Oriented Network Architectures

Section Outline









Overview of Service-Oriented Networking

Definition

Service-oriented networking is an emerging network architecturethat gains greater overall IT efficiency by providing intelligentfunctionality in the network fabric that was previously unavailableor impractical to implement.

Details

Application awareness in the network fabric is key

Breaks end-to-end principle of networks (don’t touch the payload)

Assumes that the network can make ”intelligent” decisions based onapplication data

Revisits earlier research in application-aware networks

Next-generation network standards make architecture more flexible





Functions Enabled by SON Devices

What would types of functionswould a SON device enable?

Functional Offloading

Service Integration

Intelligent Routing

ServiceProvider

Encrypted &Signed

SOAP/XML

Decrypted & AuthenticatedSOAP/XML

WS-Security:Decryption & Authentication

ServiceOriginator

SON Appliance

Functional Offloading

ServiceProviders

Unclassified Requests

XPathRouting

SON Appliance

Intelligent Routing

WidgetsRUSServiceProvider

Purchase Order in Widgets, Inc.XML Schema

Purchase Order in WidgetsRUSXML Schema

XSLTransformationWidgets, Inc.

ServiceOriginator

SON Appliance

Service Integration





Challenges Building SON Devices

Challenges in SON Device System Architecture

Robustness

Admission ControlLoad Shedding

Resource Allocation

Concurrency Architectures

Security

Performance Optimization

Effectively leverage hardware coprocessors





Challenges Building Service-Oriented Networks

Challenges

Scalability of the network with regards to network entities

Adaptivity of the network to changes in state of networkentities

Distributed, policy-driven dissemination of networkmanagement data between network nodes

Distributed control of the network to connect consumers andproviders while enforcing appropriate policies




A Single Autonomous Service-Oriented NetworkInterconnection of Autonomous Service-Oriented Networks

Section Outline









Single Federated ESB Deployment





Autonomous Service Domain

Autonomous Service Domain

An Autonomous Service Domain (ASD) is an autonomous grouping of federatedESB deployments; it serves as a logical unit which defines the scope at whichaggregate service information is advertised to other autonomous federations

While each ESB has its own local registry, the federated nodes in the domainalso have a distributed service registry, which is used for routing requestsbetween domain members





Interconnection of Autonomous Service Domains

Interconnected ASDsAn ASD is thefundamental unit withinour hierarchicalarchitecture

ESBs are connectedwithin an ASD usingthe Intra-ASD routingprotocol

Multiple ASDs areconnected using theInter-ASD protocolwhich enforcesinter-domain policies forservice transactions




Overview of ArchitectureKey AssumptionsIntegrated MethodologiesAnalytical FrameworkRelated Work

Section Outline









Architecture of Service Delivery Platform

Architecture Highlights

The SDP enables a self-optimizing infrastructure thatoptimizes the value derived from IT in a SOA.

The architecture is the first of its kind to integrate techniquesfrom networking, microeconomics, and service-orientedcomputing to form a fully-distributed SDP.

The principal component of the SDP is a utility-basedcooperative service routing protocol which uses congestionprices to compute optimal rates and routes.

We believe that our service delivery platform is applicable tothe next-generation of middleware and telecommunicationsarchitectures.





Key Assumptions

Key Assumptions

We create a network topology where all semanticallyequivalent providers of a service are connected via a zero costlink.

This enables us to utilize a multi-path routing algorithmbetween consumers and a logical destination node.

Consumer

Network of Intermediaries

LogicalDestination

Provider #1

Provider #2

Consumer





Key Assumptions (continued)

Key Assumptions

We assume consumers enter the SDP through a singleinterface (intermediary).

We assume the existence of a semantic algorithm to matchrequests to services.

We assume that the intermediaries who are directly connectedto service providers are responsible for collection of providermetrics to compute a cost.

Due to global knowledge of utility functions, we assume thatthe SDP is deployed as a single autonomous system.





Integrated Methodologies

Content-Based Routing

Performing traditional networking functions (routing,throttling, etc) in a service-oriented network requires contentinspection

Optimal Routing & Flow Control

Efficient use of SDP resources requires traffic engineering,which we accomplish by leveraging optimal multipath routingand flow control algorithms





Integrated Methodologies (continued)

Network Economics

In developing the link between the business utility of servicesand the underlying SDP resources used, we leverage theconcept of weighted welfare maximization

Congestion Pricing

Provides a way to influence routing decisions based on severalmetrics (delay, proximity, etc)





Optimization Problem

Optimization Problem

maxR∈R

maxx≥0

∑s∈S

Us(xs)−∑f ∈Fs

f (xs , γf , zf )

s.t. Rx ≤ C

⇓

maxy≥0

∑s∈S

Us

(1Ty s

)−∑f ∈Fs

f (1Ty s , γf , zf )

s.t. Hy ≤ C





Related Work

Related Work

Other attempts at service overlay networks

Focus on bandwidth allocationEconomic attempts make selfish assumptions aboutconsumers, untruthful knowledge of utility functions

Multi-agent service selection algorithms

None consider state of brokers, providersFocus on meeting semantic & QoS goals

Similar work used to optimize supply chains




Remaining WorkContributions of Work

Section Outline









Remaining Work

Proposed Area #1

Implement and evaluate XML-based multipath service routingalgorithms

Consumer

Network of Intermediaries

LogicalDestination

Provider #1

Provider #2

Consumer





Remaining Work (continued)

Proposed Area #2

Analyze impact ofdiscontinuity/non-concavity on serviceutility functions andsubsequentformulation






Proposed Area #3

Integrate trafficprediction algorithm tominimize number ofoptimizationcomputations performed(e.g. use wavelet-basedprediction and filteringtechniques to triggernext iteration ofoptimization algorithmif aggregate service rateexceeds predefinedbound)






Proposed Area #4

Apply simulation andmodeling techniquessuch as responsesurface modeling toonline capacityestimation of servicenodes






Proposed Area #5

Compare different solution methods for underlying optimization problem

Gradient Descent MethodSequential Quadratic Programming. . .

Example of Solution - Gradient Descent Method

pj (t + 1) =

pj (t) + βj

c j −∑s∈S

K s∑i=1

Hsjiy

si (t)

+

y si (t + 1) = max

y si ≥0

Us

(1Ty s

)−∑f∈Fs

f (1Ty s , γf , zf )− y si

J∑j=1

pj (t)Hsji





Conclusions

Conclusions

SON provides exciting new multidisciplinary research opportunitiesin service-oriented computing, hardware, software, and networking

The desire for large scale federated service-oriented systems isgrowing rapidly; our work is some of the first in this area

SDP provides direct link from business value of a service to itspriority in the service-oriented network

Framework of SDP is based on solid, proven concepts frommicroeconomics, supply chain management & networking

Cross-layer, utility-oriented algorithms are being proposed asthe approach for NSF’s Future Internet Design initiative

SDP is first known work to apply the concepts of network utilitymaximization and multipath routing to the services layer





Contributions

Contributions of Work

Three conference papers

R. D. Callaway, A. Rodriguez, M. Devetsikiotis, and G. Cuomo.“Challenges in Service-Oriented Networking”, Proceedings of IEEEGLOBECOM, November 2006.R. D. Callaway, M. Devetsikiotis, Y. Viniotis, and A. Rodriguez. “AnAutonomic Service Delivery Platform for Service-Oriented NetworkEnvironments”, Submitted to IEEE ICC, May 2008.R. D. Callaway, Y. Viniotis, A. Rodriguez, K. Brown, and R. Robinson.“Enabling Federations of Enterprise Service Buses Using a DistributedService Registry”, in preparation for a Service-Oriented Conference inSicily :)

One journal paper

R. D. Callaway, M. Devetsikiotis, Y. Viniotis, and A. Rodriguez. “AnAutonomic Service Delivery Platform for Service-Oriented NetworkEnvironments”, in preparation for submission to IEEE Transactions onNetwork and Service Management.





Contributions (continued)

Contributions of Work

Two patent applications

Methods and protocols for enabling the dynamic and scalable federationof enterprise service busesMethods and protocols for enabling the dynamic and hierarchicalinterconnection of autonomous federations of enterprise service buses

One book chapter

M. Devetsikiotis and R. D. Callaway. “The Role of the Enterprise ServiceBus in IP Multimedia System Architectures”, invited chapter of “The IPMultimedia Systems Handbook”, edited by S. Ahson and M. Ilyas, CRCPress, 2008

One invited presentation

R. D. Callaway and A. Rodriguez. “ Service-Oriented Systems in NextGeneration Middleware and Telecommunications Architectures”, HotTopic Presentation at 1st IEEE Workshop on Enabling the FutureService-Oriented Internet, November 26th, 2007.


an autonomic service delivery platform for service ... · we assume consumers enter the sdp through...

Documents