integrated data environment (ide) using eqube® · 2018-11-01 · – rapid -bi solution for...

© Copyright 2015 eQ Technologic, Inc. All rights reserved.© Copyright 2018 eQ Technologic, Inc. All rights reserved.

Integrated Data Environment (IDE) using eQube®

October 2018

Dinesh Khaladkar

President & CEO

1

© Copyright 2018 eQ Technologic, Inc. All rights reserved.

Some of our Customers…

2


Key business drivers

• Productivity• Lean & Agile• Top & bottom line growth• Market share • Innovation

Executives

• Reduce NVA • Planners need ‘complete info’ • ‘Complete Kits’ are available• Parts, tools, fixtures, EWI, CAM

programs are available

Manufacturing

• Reduce NVA • Need in-context ‘complete info’

available on-demand• Intuitive UI facilitating entire process

Engineering

• Need a unified view of the customer• Holistic performance indicators

Marketing & Sales

• Reduce the # of Systems & complexity• Need to ensure the right info is

available in the appropriate systems • Agile, resilient, & scalable integration

infrastructure

IT

• Intuitive UI that facilitates the entire business transaction

• End users don’t need to learn and suffer through each Systems’ UI

• Improve product and process quality with reduction in costs and cycle time

Common targets 3


Overall requirements◼ Agile, resilient, & scalable integration infrastructure

◼ ‘For-purpose apps’ that federate and aggregate data facilitating the holistic business process for the end-user

◼ Legacy system migration – consolidation / rationalization of systems

◼ Disconnected, Disrupted, Intermittent, and Limited (D-DIL) secure collaboration across networks (with partners, customers, and suppliers)

◼ Solutions incorporating IIOT – Big-data

◼ Comprehensive business process orchestration

◼ Modern BI / analytics capability to timely address organizational decision needs

These are the requirements for an Integrated Data Environment

(IDE)

4


Lockheed Martin –Advanced Development

eQube-MI – Select Customer Case Studies

5

United Launch Alliance

US NavyNAVSEA

eQube-MI – Select Customer Case Studies

GD Mission Systems

Northrop Grumman

Rolls-Royce

B/E Aerospace

BAE SYSTEMS MAI (Typhoon program), UK

Lockheed Martin Aero (F-35 program)

BAE SYSTEMS Marine

L-3 CSWAdient GE Transportation

GE Oil & Gas

US NavyNAVAIR

Spirit Aerosystems


Digital Backbone – Actionable Insight

Enterprise-wide BI

eQube®-MI Digital Backbone

Web Services

Databases

“Hot Data Store”

“Warm Data Store”

“Cold Data Store”

oror

FilesSensors

Data Warehouse

Legacy Systems

Databases

Enterprise Data Lake7


Platform

8

eQu

be®

Pla

tfo

rmeQ

ub

e® O

ffer

ings

Sou

rces

UI services

BI- In Memory OLAP ServerMI Engine

Applications

Event Mgmt. & Scheduling Services

Data Access Services

Data Virtualization Layer

Application Semantics

Security Services (Access control & Governance)

Distributed Cache

Webservices APIs

eQube-BIeQube-MI eQube-TM eQube-DP

Data Ingestion & Transformation Services

Data Model Management

Analytics Server

API Gateway

PLM ERP MES Logistics MRO ALM Planning

SAP Oracle EBS IFS Teamcenter Windchill Primavera DOORS IBM-Rational

Oracle PLM ARAS SharePoint JEDMICSLegacy Systems

DatabasesFiles, Sensors, Big data

Files SensorsObject StorageBig data


eQube based solutionsIntegration, synchronization & migration◼ Enterprise-wide application integration infrastructure

– PLM, ERP, ALM, MES, Planning systems, CAD, Config. systems, ESM, logistics systems, Big-data stores, sensory data etc.

◼ Data Federation with ‘Action’– ‘For purpose apps’ with simple & intuitive UI for dramatic productivity

improvements

◼ Orchestration of enterprise-wide business processes– Fully integrated process execution spanning multiple systems

◼ Secure information collaboration across networks, partners, suppliers, and customers

– Flexible, scalable, and robust infrastructure

– Supports Disconnected, Disrupted, Intermittent, and Limited (D-DIL) operations

◼ Application consolidation / legacy system migration – Application synchronization leading to orderly migration

◼ Executing ‘Action’ based on analytics – insight leading to action

◼ Development of Data Lake and Data Warehouse

◼ Master data management– Common parts, eBOM, etc.

Business Intelligence & Visibility◼ Modern BI platform for enterprise-wide

visibility (Rapid-BI)– Self-serve – sentence based analytics (NLP)

– Information aggregation for actionable insight

– Rapid-BI solution for analyzing Big-data

◼ BI and visibility in PLM– Teamcenter reporting & analytics

◼ Logical data warehouse

Enterprise data quality◼ Data profiling – data quality assessment and

correction / repair– Before and after migration

– Before and after integrations

◼ Continuous health monitoring of critical data– Process & data integrity

9


Digital Backbone Enterprise-wide application integration environment

10


Web Services

Databases




oror

FilesSensors

Data Warehouse

Legacy Systems

Databases

Enterprise Data Lake


eQube® reference architecture for IDEA

pp

licat

ion

s

Files

Data Ingestion & Transformation Services Data Model & Semantics

Sensors“Hot Data

Store”“Warm Data

Store”“Cold Data

Store”

Sou

rces

eQu

be

Pla

tfo

rm

Data Virtualization Layer

Security Services (Access control & Governance) Distributed Cache Event Mgmt. & Scheduling Services

‘For purpose’ Applications

Sentence based analytics

(API Gateway) (With Data Profiling & Analytics Server)

Enterprise Data Lake

or Legacy 1 dB

Legacy 2 dB

Legacy 3 dB

Legacy SystemsData

Warehouse

or

Search, KPIs, dashboards, report & analyze

11


eQu

be®

-MI D

igit

al B

ackb

on

e

Change Notice with Manufacturing Parts goes through PLM Workflow

MI trigger is called for each part from PLM sub-workflow

1 Teamcenter to SAP

Part Number & DescriptionDocument Type/Sub TypeCriticalities

2

SAP creates the Material Master

3

Business process orchestration using the eQube® Platform

Creation of Material masters in SAP from Manufacturing part in Teamcenter

12

SAP to Teamcenter

Plant, Unit Of Measure, Procure TypeMaterial Status

4SAP attributes Updated in Teamcenter

Plant, Unit Of Measure, Procure Type, Material Status

5


Poll

for

stak

eho

lder

re

view

ass

ign

men

ts

1 65

Create visual issues and attach Session Package, Small/Large Images

92 43

Visualization

CN

in w

ork

flo

w r

evie

w

step

JT f

iles

Extr

act

ob

ject

s an

d

attr

ibu

tes

Met

adat

a at

trib

ute

s an

d

PD

Fs

Cal

l ass

y JT

_cre

ato

r t

o

do

wn

load

JT

file

s

Generate session package file and images

Session package

78

Business process orchestration using the eQube® Platform


High Security Network Lower Security Network

Creation of visual issues, session package, and images in SharePoint from data in Teamcenter


File extracts

Access dB

Excel files

Secure collaboration across high & low security networksDisconnected, Disrupted, Intermittent, and Limited (D-DIL) operations

eQu

be®

-MI D

igit

al B

ackb

on

e

eQu

be®

-MI

Rev

erse

Invo

ke S

erve

r

+

Relational dB

ClearCase ClearQuest

Primavera& Unifier

Internet

High Security Network

Rev

erse

Pro

xy S

erve

r (O

pti

on

al)

Lower Security Networks

eQu

be

®-MI D

igital Backb

on

e

eQu

be

®-MI

Reverse In

voke G

ateway

+

Reverse P

roxy Server (O

ptio

nal)

Relational dB

Excel files

Access dB

File extracts

1414

eQu

be

®-MI D

igitalBackb

on

e

eQu

be

®-MI

Reverse In

voke G

ateway

+

Reverse P

roxy Server (O

ptio

nal)

Relational dB

Excel files

Access dB

File extracts


Secure collaboration – Disconnected / Air Gap mode


Network A


Network B

Security Officer

Security Officer

15


Migration / Integration Methodology

16

Enterprise-wide BI - Reporting/Analytics

Transformation Modeling

Data Profiler

Digital Backbone Migration and Integration

V

LTEI


Migration strategies to responsibly retire legacy systems◼ Migration Solution built on eQube-MI provides multiple, proven application migration /

consolidation strategies

– Bulk load + deltas

• Bulk load + one-way sync

– legacy to new sync by program / project

• Migration by domains + one way sync

– New to legacy sync for BOMs, changes, etc.

– Bi-directional synchronization

• Bulk load + On-demand migration

– Once objects are transferred to new system, ownership is changed from legacy to new, and changes to those objects are synched back to legacy

◼ End result: orderly migrations completed without any black-outs on Programs

17


Migration Strategies - Bulk Load with Delta(s)

18

Source System(s)

Size and run-time for delta continues to shrink, allowing shutdown of source systems on a weekend

First bulk migration

Go-live

Target System(s)


Migration Strategies – Bulk Load with One way Sync Legacy to Target – by programs / projects

19

Source System(s)

First bulk migration

Project/Program/Team – Go-live

Delta runs contain data only for programs or projects which have not yet switched to Target System

Target System(s)


Target System(s)

Migration Strategies – Bulk Load with One way Sync Target to Legacy – by Functional Domains

20

Source System(s)

Migration is performed by domains making the Target System the new owner. MI synchronizes in reverse direction till transition is complete

EBOM

Transition Complete

Documents Change

Syn

chro

niz

e

Syn

chro

niz

e

Syn

chro

niz

e


Target System(s)

Migration Strategies – Contd. Bi-directional Synchronization leading to migration

21

Source System(s)

Bulk or Individual objects are transitioned from source to Target. Ownership is changed gradually over a period of time leading to “on Demand” synchronization

Bulk or human initiated Object(s)

Transition Complete

Syn

chro

niz

e


The ‘Hub’ @ work

22


Data Lake Architecture using the eQube® Platform

• Ingest Data• Augment Data models• Build Semantics

Batch

Real time

Stream

Legacy 1 dB

eQu

be

-MI D

igit

al B

ackb

on

eLegacy 2 dB

Legacy n dB

23

“Ho

t Data

Store”

“Warm

Data

Store”

“Co

ld D

ata Store”

or

or

Enterp

rise Data Lake


PLM

Oracle dB

PLM + ERP + Files + dB to MI to Data Warehouse

SQL server dB

File Extracts

Access dB

Excel files

Dashboard

Ad-hoc Self-serveData mash-upsPortal, KPIs, DashboardsSelf-Serve

Legacy System

Data Warehouse and analytics using the eQube® Platform

eQu

be®

-MI D

igit

al B

ackb

on

e

24


Master data management using eQube® platform

◼ Traditional approach – Central MDM store

– ETL processes to populate & maintain central MDM store

– Change controlled in the central MDM store

• Elaborate change process needs to be created and maintained

• Changes need to be propagated back to the source systems.

– Time consuming, slow, and expensive approach

◼ eQ recommended approach for MDM

– ‘Keep data where it belongs – in the Source systems’

– No central repository or store

– For key elements system of record (‘SOR’) is designated

• All changes are managed in that SOR

• MI propagates those changes to other systems as required

– If information from SOR has to be replicated then MI can replicate

– However, in many cases information can be federated on demand, in context, and honoring security rules of the system and SOR

25


eQube-MI – Hybrid Integration platform◼ Next generation Hybrid application integration platform

– ‘Not Only ESB’ architecture

◼ Single platform for

– Application Integration and data federation

– Application synchronization leading to orderly migration

• Application consolidation and application retirement

◼ Supports various integration strategies without having to write code for the “last-mile” connectivity to applications:

– ESB type:

• Message-oriented

• Service orchestration based

• Common (canonical) data model based

– Loosely coupled application-to-application type

– API Gateway type26


eQube platform Key differentiators◼ Single integrated platform that delivers Solutions

– Core common services leveraged by eQube products

◼ Pre-built comprehensive eQube Connectors that honor ACL / security rules of applications

– Maintained by eQ across multiple versions of the underlying application

◼ Innovative Data Virtualization layer

– Easily aggregates data from multiple applications in-memory

– No need to have intermediate data mart or data warehouse

◼ Semantic layer (leverages domain ontologies)

– Further simplifies read & write interactions with the underlying applications

– Key to our vision of ‘Democratizing BI’

◼ No coding required for the “last-mile” connectivity

– To develop interfaces for application integration / synchronization

– To fetch data from multiple sources – data mashups - BI

27



Enterprise-wide BI


Web Services

Databases




oror

FilesSensors

Data Warehouse

Legacy Systems

Databases

Enterprise Data Lake28



© Copyright 2018 eQ Technologic, Inc. All rights reserved. eQube® as well as the graphic representation of the logo of eQube with a drawing of a cube are Registered Trademarks of eQ Technologic, Inc., registered in the United States Patent and Trademark Office. All other logos, trademarks or service marks used herein are the property of their respective owners. Nothing contained herein is intended to claim ownership of, title to, interest in or sponsorship of the owners of product(s) identified by logos, trademarks or service marks, whether or not registered, which are not specifically stated to be owned by eQ Technologic, Inc.


We simply deliver!

© Copyright 2018 eQ Technologic, Inc. All rights reserved. eQube® as well as the graphic representation of the logo of eQube with a drawing of a cube are Registered Trademarks of eQ Technologic, Inc., registered in the United States Patent and Trademark Office. All other logos, trademarks or service marks used herein are the property of their respective owners. Nothing contained herein is intended to claim ownership of, title to, interest in or sponsorship of the owners of product(s) identified by logos, trademarks or service marks, whether or not registered, which are not specifically stated to be owned by eQ Technologic, Inc.