the future of the sas platform - sas 9 & sas viya · following are several examples of sas...

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® USER FORUMDENMARK 2017

The future of the SAS Platform - SAS 9 & SAS ViyaGert Nissen



SAS 9 & SAS Viya

SAS codePhytonJavaRLuaRest API

SAS® Visual Data Mining

and Machine Learning

SAS® Visual Investigator

SAS® Visual Analytics

SAS® Visual Statistics

SAS® Visual Forecasting

SAS® Optimization

SAS® Econometrics

?Torben Juul Astrid Mads

Keld & Daniel

Carl-OlowGert Nissen



SAS Platform Vision

What is going onin the market?

Where are we headed? How do we get there?Where are we today?

Information is subject to change!



Pervasive Access Providing advanced data management capabilities for SAS solutions and beyond.

Comprehensive Governance Managing, monitoring, and controlling data activity on-premises and in the cloud.

Enterprise Ready Building in security, scalability, and flexibility for the most demanding customers.

Intelligent Data Employing new data quality, discovery, and analytic techniques for deeper data insights.


SAS® USER FORUMSWEDEN 2017

SAS® Viya™

Unifying our architecture

SAS®

High-Performance

Architecture

Development Timelines

SAS®

In-Memory

Analytics Server

SAS®

Massively Parallel

Architecture

SAS®

MVA architecture


The Platform Strategy

&


Kun på Cloud

Alle data skal loades tilMemory

SAS Viya Myths

Ingen Metadata

Kun Advanced Analytics, ikkeData Management

Kun Open Source kode, omkodning af gamle SAS programmer

Kun peg-og-klik, ingen SAS kode

Ikke bagud kompabitelmed SAS 9

Copyr ight © SAS Inst i tute Inc. Al l r ights reserved.

In-p

lace

/Em

bed

ded

,P

aral

lel&

Ser

ial,

Web

Ser

vice

s, M

Qs

Source-basedEngines

Microservices

UAA

QueryGen

Folders

CAS Mgmt

Data Source Mgmt

AnalyticsGUIs

etc…

BIGUIs

EnvMgr

ModelMgmt

Log

Audit

UAAUAA

Data Mgmt GUIs

In-Memory Runtime Engine

In-Database

In-Hadoop

In-StreamSolutions

APIs

Platform

Analytics

Data ManagementFraud and Security Intelligence

Business VisualizationRisk Management

!

Customer Intelligence

Cloud Analytics Services (CAS)

The following operating systems are supported now: • Red Hat Enterprise Linux 6.7 (64-bit) and later within 6.x • Red Hat Enterprise Linux 7.1 and later within 7.x • Oracle Linux 6.7 and later within 6.x • Oracle Linux 7.1 and later within 7.x

SAS 9.4



SAS Viya Platform

Cloud ready– But not Cloud only!

– On premise now!

• Resilient, high-availability with failover Protection• Centralized, governed and easy• Automated scaling and elastic processing• Fault tolerant environment crafted for• analytics workload processing• Sophisticated and native search built into

products

Single code portability for enterprise deployment options (e.g. grid, cloud, single cluster, multiple cluster, etc.).



• Fault tolerance on the CAS server detects when a node no longer operates and distributes that node’s work to other nodes.

• Processing occurs in CAS server sessions and not in server processes, enabling CAS session monitoring, resource tracking, and resource management.

• In-memory tables can have local (session) or global scope. • The CAS server is able to continue to process tables when memory capacity is exceeded. • All table operations are performed in a in-memory space (caslib) to hold tables, access control lists,

and data source information. • PROC CASUTIL is a new procedure to manage CAS server tables, including loading and saving tables.

Data in tables can be loaded serially or in parallel. • The CHARACTER data type in SAS 9 uses byte semantics and supports fixed widths. The CAS server

supports the VARCHAR data type, which uses character semantics and varying length variables. • The SAS Analytic procedures and the DATA step have been rewritten for parallel processing in

multiple cores or server nodes. The DATA step has some language element restrictions.

How the CAS server works

http://pubshelpcenter.unx.sas.com:8080/test/?docsetId=whatsdiff&docsetVersion=3.2&docsetTarget=p1gfaswb875orbn1xn4ao8b8jbfq.htm&locale=en



SAS Viya REST API

curl -n -u uID:passwd -X GET http://< machine >:8777/cas/sessions

filename in url 'http://<myserver>:8777/cas/sessions' debug user='userID' pass='password';

filename map '/opt/sas/viya/config/user.map' ;

libname in json map=map automap=replace;

data all;

merge in.root

in.idleTime;

run;

proc print data=all;

title 'display of current sessions, showing length of time since last CAS action';

title2 'and total number of CAS actions run in this session';

var uuid name user actioncount isidle hours minutes seconds;

run;



SAS Viya Authentication

User and group identities are stored and managed by your organization’s identity provider (for example, Microsoft Active Directory). Read-Only access to the provider enables SAS to authenticate users and obtain identity information at sign-in. You can also add users to custom groups that are persisted in SAS Viya.

SAS Environment Manager 2.5 (9.4) uses roles and capabilities to manage authorization to SAS 9.4. SAS Environment Manager 3.1 (SAS Viya) uses rules to manage general authorization (access to objects such as folders and reports) and permissions to manage CAS authorization (access to CAS objects such as caslibs and tables).

Direct LDAP or single sign-on using Integrated Windows Authentication (IWA), Open Authorization (OAuth), or Security Assertion Markup Language (SAML).

Pluggable authentication module (PAM) validates the user’s credentials when accessing SAS Studio



SAS Viya Custom Groups

The following custom groups are provided with your deployment. These groups provide an easy way to give users and groups access to the appropriate data, content, or functionality.

A custom group is a group that exists in SAS Viya but not in your identity provider. Your deployment includes a set of predefined custom groups, which provide an easy way to give users access to specialized functionality. You can also create your own custom groups, which are useful if you don’t want to (or don’t have permission to) create groups in your identity provider.



SAS Viya Logging SAS Viya microservices and web applications

Each microservice and web application used in SAS Viyaproduces its own log. Logging levels for each microservice and web application are set in SAS Environment Manager.

SAS Viya serversSAS Viya servers use the SAS logging facility to generate and process log messages. The logging facility enables you to define aspects of logging such as the level of messages that are written to the log, the message format, and the output destination for the log.



SAS Viya Monitoring

SAS Viya provides monitoring functions through several facilities. Use the monitoring system that matches your needs and your environment:

• SAS Environment Manager is a graphical enterprise web application that provides functions for monitoring the nodes and microservices in a SAS Viya environment. It provides two interfaces for monitoring your environment

• CAS Server Monitor is a graphical web application that is embedded in the CAS server. It provides system-level monitoring for the machines and processes running under the CAS server.

• Grid Monitor provides histograms to view CPU load, memory usage, disk usage, and network performance for each CAS node. Grid Monitor provides a higher level of detail than SAS Environment Manager or CAS Server Monitor



SAS Viya EncryptionEncryption is the aspect of security that protects data by converting it into an unintelligible form in transmission or in storage.

For data in motion in a new deployment, TLS security is provided and follows the highest standards. At installation SAS Viya provides self-signed certificates to provide HTTP and HTTPS access to SASHomeout of the box. You can increase the encryption strength and coverage by completing additional configuration.

For data at rest in a new deployment, encryption is not automatically enabled. You can configure encryption of data that is added to PATH, HDFS, and DNFS caslibs. SAS Cloud Analytic Services supports encryption of SASHDAT files at the file level and at the directory level.

For more information, see the following documents: Encryption in SAS Viya: Data in MotionEncryption in SAS Viya: Data at Rest

http://go.documentation.sas.com/?cdcId=calcdc&cdcVersion=3.2&docsetId=secref&docsetTarget=titlepage.htm&locale=da

http://go.documentation.sas.com/?cdcId=calcdc&cdcVersion=3.2&docsetId=calencryptrest&docsetTarget=titlepage.htm&locale=da



SAS 9 Data to SAS ViyaHere are some approaches to accessing SAS 9 data from the SAS Viya platform: • If you have the SAS Visual Analytics 8.1 web application, you can use self-service

import. • If you have SAS Environment Manager 3.1, you can use that web application to add

caslibs and load data. • If you have the SAS Viya 3.2 programming interfaces, you can write code to load data. • If you have SAS/CONNECT for SAS 9 and SAS Viya, you can move and share data

between SAS 9 and SAS Viya environments. • If you have SAS Enterprise Guide or SAS Add-In for Microsoft Office 7.13 or later, you

can use the Upload to CAS task to move data from SAS 9 to CAS.SAS Viya uses UTF-8 always. Manual conversion might needed if automated conversion fails.



SAS code i SAS Viya

Data-step code runs out of the box in SAS Viya - Distributed automatically in SAS Viya

PROC SORT - Comment out, it is not required for GROUP BY processing

Majority of Proc SQL code can be converted to Proc FedSQL

Today: not every proc etc is available in SAS Viya – that will change!

Extended with CAS actions – proc CAS, proc CASUTIL and new procs


&SAS Viya

SAS 9

one SAS platform

SAS platform strategy


SAS Viya products and UIs

Customer-written code

Customer-written code

SAS 9.4 M4 products and UIs

SAS 9.4 M4

LASR and / or HPA runtimes

Metadata (WIP)-based mid-tier

MVA runtime

(full functionality)

Other runtimes

(ESP, In-Database)

SAS Viya

CAS runtime

Today’s architecture

SAS/CONNECT SAS/CONNECT

Microservices-based mid-tier

Viya MVA runtime(minimal

functionality)

“bridge” to SAS Viya

Copyr i g ht © 2016, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

Following are several examples of SAS 9.4M4 solutions that contain user interface features that you can use to issue SAS/CONNECT statements to bridge the SAS 9.4M4 and SAS Viya environments:

SAS Enterprise MinerFrom your SAS Enterprise Miner process flow diagram running on SAS 9.4, you can remotely submit SAS Data Mining and Machine Learning procedures to run in SAS Viya and then return the results to SAS 9.4 and integrate them into the SAS Enterprise Miner output.

SAS Model ManagerYou can run SAS Data Mining and Machine Learning procedures and train models in your SAS Viya environment, and then upload the models and the models’ metadata to SAS 9.4. From SAS 9.4, you can remote submit code to register the SAS Viya created model and metadata in SAS Model Manager. You can use SAS Model Manager to manage both your SAS 9.4 models and your SAS Viya models. For example, you can use SAS Model Manager to deploy score code derived from both SAS 9.4 and SAS Viya models to a database.

SAS Data Integration StudioYou can use SAS Data Integration Studio on SAS 9.4 to perform tasks such as fetching data from multiple sources and preparing the data for mining. Then, you can use the Data Transfer node to upload the data table to SAS Viya and load it directly into memory.

SAS Enterprise Guide / SAS Add-In for Microsoft OfficeYou can use the custom code nodes in either of these products to upload or download data between the two environments. For example, you could remote submit code to SAS Viya for processing, and then return the computational results back to SAS Enterprise Guide on SAS 9.4.

SAS StudioYou can use the SAS Studio web interface to perform many programming actions in SAS Viya. For example, you could enter code in SAS Studio to access data in your SAS Viya environment, remotely submit SAS Viya procedures to run on the data, and then transfer the results data between the two environments.

SAS Stored ProcessesYou can save SAS/CONNECT SIGNON, RSUBMIT, UPLOAD, and DOWNLOAD statements as SAS Stored Processes, and then use the SAS Stored Processes as another way to bridge your SAS 9.4 and SAS Viya environments.



SAS 9 / Viya Convergence Timeline

17q4

Viya 3.3Viya 3.1

16q3

Viya 3.2

17w12

9.4M5

17q316q4

20189.4M4

WE ARE

HERE

TODAY



Information is subject to change.

ReleaseHighlights

Q3

2017

SAS 9.4 – Products• 9.4M5

– Programming client integration with CAS– New CAS-enabled PROCs

• SAS Studio 3.7– New analytic tasks

• Enterprise Guide 7.15– Support SAS Studio Viya tasks and VA 7.4 reports

• SAS Environment Manager 2.6

• Support for– Advanced Analytics 14.3– SAS Enterprise Miner– SAS Data Integration Server 4.903– SAS Grid Manager– …



Information is subject to change.

H1 | 2017 H2 | 2017 H1 | 2018SAS Viya 3.2

– SAS Visual Analytics 8.1

– SAS Visual Statistics 8.1

– SAS Visual Data Mining & Machine Learning 8.1

– SAS Visual Forecasting

– SAS Econometrics

– SAS Optimization

– SAS Visual Investigator 10.2

– SAS Visual Scenario Designer 10.2

– SAS Event Stream Processing

– In-Database Technologies

– SAS Studio

SAS Viya 3.3

– SAS Data Preparation– SAS Data Quality – SAS Visual Analytics 8.2– SAS Visual Statistics 8.2– SAS Visual Data Mining & Machine Learning 8.2– SAS Office Analytics – SAS Visual Forecasting– SAS Econometrics– SAS Optimization– “SAS Visual Text Analytics” (new)– SAS Model Manager– SAS Visual Investigator 10.3– SAS Visual Scenario Designer 10.3– SAS Event Stream Processing– In-Database Technologies– SAS Studio

SAS Viya 3.4

– SAS Data Preparation– SAS Data Quality– SAS Data Discovery– SAS Data Integration – SAS Visual Analytics 8.3– SAS Visual Statistics 8.3– SAS Visual Data Mining and Machine Learning 8.3– SAS Office Analytics– SAS Visual Forecasting– SAS Econometrics– SAS Optimization– “SAS Visual Text Analytics”– SAS Model Manager– SAS Visual Investigator 10.4– SAS Visual Scenario Designer 10.4– SAS Event Stream Processing– In-Database Technologies– SAS Studio

Technology Portfolio

• Open environment

• Governed analytics in everyday applications

• Optimization and automation

• Deep Learning and Cognitive Computing


Differences in the SAS®9 and SAS® Viya™ 3.2 Platforms

Mere information

SAS® Viya™ 3.2: Platform Overview

SAS® Cloud Analytic Services 3.2: Fundamentals

SAS® Viya™: What It Means for SAS® Administration

http://pubshelpcenter.unx.sas.com:8080/test/?docsetId=whatsdiff&docsetVersion=3.2&docsetTarget=n0htw97d4nsdlbn0zf35mh1q4bz6.htm&locale=en

http://pubshelpcenter.unx.sas.com:8080/test/?docsetId=viyaov&docsetTarget=titlepage.htm&docsetVersion=3.2&locale=en

http://pubshelpcenter.unx.sas.com:8080/test/?docsetId=casfun&docsetTarget=titlepage.htm&docsetVersion=3.2&locale=en

http://support.sas.com/resources/papers/proceedings17/SAS0644-2017.pdf


Tak for i dag

Slides ligger på SAS Communities – kommenter og spørg gerne der

the future of the sas platform - sas 9 & sas viya · following are several examples of sas...

Documents