“reimagine – buy smarter” hhs emerging technology day hhs emerging technol… · advancing...

Advancing Government through Education, Leadership and Collaboration

| Jose Arrieta| Associate Deputy Assistant Secretary for Acquisition in the U.S. Department of Health and Human Services

| Todd Hager| Vice President, Macro Solutions – Industry Chair, ACT-IAC Emerging Technology Community of Interest

HHS Emerging Technology “Reimagine – Buy Smarter” Day


Timing Session Presenters

9:00 – 9:15 Welcome & Introductions Jose Arrieta, Todd Hager & BuySmarter Team

9:15 – 9:55 Intelligent Automation IAWG & GSA/USDA

9:55 – 10:35 DevOps DevOps & USPTO

10:35 – 10:40 BREAK Jose & Todd

10:40 – 11:20 Blockchain BWG & FDA

11:20 – 11:55 Artificial Intelligence CCAIML & HHS

11:55 – 12:00 Wrap Up Jose & Todd

Today’s Agenda


Intelligent Automation Working Group| Ed Burrows| Government Chair, GSA| Sukumar Iyer| Industry Chair, Brillient Corporation


Overview of Artificial Intelligence


Scope of Intelligent Automation

Assistance

Replacement

Co-ExistenceApplication of AI, Machine Learning and other techniques


What is Intelligent Automation

AI Powered Intelligent

AutomationRobotic Process

Automation (RPA)

Using AI techniques to make cognitive decisions and take actions


Goals - Intelligent Automation Working Group

Help agencies to1. Learn – Educate federal agencies on intelligent automation2. Assess – Help assess problems that can be automated3. Implement – Provide a blueprint for full lifecycle

implementation

IA Primer (October 2018) and Playbook under development.


Numerous use case scenarios

Opportunities to automate, reduce costs, improve efficiency1. Documents and forms – procurement, administration,

FOIA, claims processing2. Human interaction – call center/chat bots, help desk,

service desk, travel desk3. Intelligent analytics – fraud/waste/abuse, cyber security,

health care

Two federal agency use cases


| Jeff Lau | Regional Commissioner, Federal Acquisition Service, GSA

Case Study 1:GSA Robotic Process Automation


The Problem

● OMB Memo 17-22

● Multiple Award Schedule New Offer Process


The Solution


Cost Reduction Customer Satisfaction

Employee Satisfaction Error Reduction

Productivity

The Benefits


● Technology vs.

Process Improvement

● Business Process Owner vs.

OCIO

The Procurement Strategy


● Engage Leadership

● Engage OCIO

● Engage Workforce

The Lessons Learned


Thank you, questions?


| Thomas Cook | Branch Chief, Pegasys Financial Services, USDA

Intelligent Automation


What is RPA?

RPA employs and orchestrates a fleet

of robots to manage business workloads.

Robots work together with humans to produce more consistent results.

The term RPA encapsulates the practice of• businesses • setting robots in • action.

RPA is a technology platform that enables a software robot to interact with applications. It is a

Practice.

It is a

Workforce.

It is an

Assistant.

It is a

Technology.


Using RPA to Schedule a Vacation

A member of the team has an upcoming vacation.

Add the vacation to a shared calendar.

Identify tasks with due dates during the vacation time frame.

Re-assign affected tasks based on schedule and workload.


Demo - RPA to Schedule a Vacation


Questions?

Thank you










Today’s Agenda


| Laird Williams| DevOps Practice Lead, Macro Solutions| Simmons Lough| DevOps Evangelist, USPTO

DevOps in Principle and Practice


DevOps is About Organizational Alignment


DevOps and Agile Enhance Alignment


▪ Adopt Cross-Functional (Shared) Responsibility & Transparency

▪ Measure-Inspect-Adapt-Repeat

▪ Many Small (Low Risk) Changes are Better Than One Big Change

▪ Recovery is Expected – not an Aberration

▪ Treat Everything as Code

▪ Automate Everything

▪ Decouple Deployment and Release

▪ Left Shift on Security and Quality

Key Principles

FPNG at a Glance

FPNG is kinda popular

What is DevOps? - Simmons’ Definition

Frequent, quick software installs to production without shortcuts.

Agile and DevOps

• Agile Development• Unknown/Creative• Small Batches• Frequent

• DevOps• Assembly Line• Automated Repetition• Quick

Requirements to Commit Commit to Production

The Challenge…

Dev and Test

Security Testing

Performance Testing

Go Live!

ORR

CodingStandards

Review508

Agenda

• Agile - Definition of Done• MicroServices• Code Quality• Automated Testing• Zero Outage Deployments• Monitoring and Metrics

Agile - Definition of Done

Definition of Done – Actually Doing Agile

✓ Development

✓ Automated Unit Testing

✓ Automated Code Review

✓ Automated Functional Testing

✓ Automated Performance Testing

✓ Database Schema Design Creation

✓ Automated Cyber Security Scans

✓ Product Owner Testing

✓ Section 508 Testing

✓ In Production ☺

MicroServices

Independent Repos

Independent Pipelines

Code Quality

Automated Build Gates

Automated Testing Functional, Security, Performance

Automated Functional Testing

Atomic: Make the tests small and test only one thing

Idempotent: Tests produce the same results every single time

Automate Tests, Performance, Security

Zero Outage Deployments

Zero Outage Deployments

FPNG Active

FPNG Passive

DB

Blue/Green Flip

Monitoring and Metrics

App Team Monitoring

Application Instrumentation

4

High Functioning IT Organizations

DevOps Pilot Policy Signed

FPNG Converts to MicroservicesFPNG Released to

External Users


Questions?

Thank you










Today’s Agenda


System of immutable records distributed among participants of a network

Blockchain Attributes– Trust

– Transparency

– Resiliency

– Traceability

– Automation

Blockchain 101

Smart Contracts

Small computer programs that rely on a distributed ledger system like a blockchain for execution

[NISTIR 8202 Draft]


Almost always blockchain will be a component that integrates in a larger system

Blockchain for acquisition

Acquisition of blockchain

Blockchain and Acquisition


FDA launched the Medical Counter Measures (MCM) initiative– improve the nation’s capacity to respond to CBRN and pandemic

threats

1 of 3 pillars is– Build the necessary science base for MCM regulatory review and

identify clear, efficient regulatory pathways for developing critical MCMs

Solution - Real-time Application for Portable Interactive Device (RAPID)

– will facilitate the real-time collection, analysis, and communication of MCM product and health information during national public health emergencies

– Relies on a robust and trusted network of data providers

FDA Use Case


Blockchain Use Case

Establish a Blockchain connection between 4 partner hospitals and the FDA (Secure Data Broker)

Test data connections in to send synthetic safety information regarding severe respiratory infections using influenza as the case model


Healthcare Facility

FDA Secure Data Broker

FDA, Federal and non-Fed

Healthcare Facility

Healthcare Facility

Healthcare Facility


1

Determine if blockchain is the appropriate technology to solve my problem

Prepare the organization for the use case

Enabling the organization to operationalize the use case

IMPLEMENTATION

Implement the solution

Integrate the solution

2 3 4 5

ASSESSMENT READINESS SELECTION INTEGRATION

Blockchain Playbook


Key Activities

ASSESSMENT

READINESS

SELECTION

• Reinforce schedule, governance and budget

• Confirm DLT Participants

• Identify skill gaps

• Validate scope• Test ConOps for

target state• Develop Change

Management Plan

• Choose technology platform

• Define business architecture

• Define Operating model

• Define Performance Metrics

• Develop Acquisition model and milestones

• Define initial schedule, budget and governance

• Identify the key end users and DLT network participants

• Define scope

• Validate impact and develop target ConOps

• Assess readiness for risks related to nascent DLT technology, security and decentralization

• Establish Consensus on DLT Governance Model

• Baseline target KPIs

• Choose the use case for review to achieve mission goals

• Identify potential stakeholders and collaborators

• Know the use case and the value proposition

• Understand the attributes

• Prepare for ATO

• Determine the options

Management People Process Technology Acquisition


Retrospective using the Blockchain Playbook

Critical Points– use case involves a business network, which spans

multiple organizations/agencies

– organizations benefit from a shared governance and data standards approach

– use case benefits from using distributed ledgers and a decentralized authority approach

– need of a vehicle to securely share reference data among members of the business network

– there is not an existing system that could serve as a trusted source of the truth for all parties

Blockchain Attributes– [1] Trust

– [5] Transparency

– [2] Resiliency

– [4] Traceability

– [3] Automation


Special Thanks

▪ Dr. Henry Francis

▪ Rashedul Hasan

▪ Tara Hobson

▪ Gregory Jackson

▪ Dr. Abhivyakti Sawarkar

▪ Dr. Alfred Sorbello


Questions?

Thank you










Today’s Agenda


| Michael Bruce| Leidos| Earl Pinto| HHS

Artificial Intelligence & Machine Learning: Commercially Proven Methods - RecommendersHHS Acquisitions Results


6919 July 2018

• Artificial Intelligence is a capability that is still in its operational infancy• Our focus today is to discuss the “Big Data” aspects of this topic• Discuss how such systems analyze data and recommend actions• Show are real-life scenario related to HHS acquisitions data

Identify “Hidden” Patterns & Meaning

Decision Support and Recommendations

ReplaceCurrent

Procedures

Artificial Intelligence / Machine Learning Pyramid


The Challenges

▪ Leveraging scalable and intelligible analytics to tackle the data deluge

▪ Implementing commercially proven methods to detect new patterns and to assist with decision making

▪ Developing an evolving model using commercially proven technology– Converting vast amounts of data into actionable knowledge

– Identifying patterns of interest

▪ Mining for patterns of interest is difficult

▪ Comparing known activities to patterns in the data is easier

– Demanding processing requirements

– Feedback & Improvement

▪ Keeping the activities up to date

7016 July 2018


7116 July 2016

What is a recommender system? Amazon/Netflix: Item-to-Item Collaborative FilteringInputs:

What has a user bought/watched in the past?Which items are in your shopping cart/watch list?Your past item/movie ratings?

Outputs:Items of interest based on a prioritized order

2/3 of Movies watched were recommended

35% of purchases are from recommendations

Commercial Recommender Systems


7216 July 2018

MovieWatcher

Movie

Features ofMovie Watcher

Features ofMovie

MoviesWatched

Extract Movie Features

Extract PersonFeatures

Movies WatchedSimilar People

Similar Movies

RecommenderRanking

INPUTS

HIDDENOBSERVATIONS

OUTPUTS

CHALLENGES• Initiating the system• Processing requirements• Making quality recommendations• Ongoing improvements

Recommender Overview


7316 July 2018

Pro-active reviews

Background

Analyst Feedback

Past comparisons

Past selections

Audit Data

Analytic reports

What I knowComputations

Successful Customer Implementation


7416 July 2018

Data

Exploration

Analyze

Modeling

Observe

EnhanceLeverage existing and develop

new data sets

What data is the most useful Data Reduction

Automate data extraction

Model DesignTime Scaling

Provide results toend users

End user feedback enriches future results

Constantly Evolving Model


Identify persons of interest for analyst review based upon “Recommender” matching Clusters of Interest

7516 July 2018

Hypothetical Scenario – Security Threat


Artificial IntelligenceThe capability of a machine to imitate intelligent human

behavior

Blockchain Technology

Robotic Process

Automation

Big Data Analytics

Natural Language

Processing

Internet of Things

Micro-Services

Examples of Enabling

Technologies

A Machine’s ability to

understand written and

spoken human speech

Software that can be

programmed to do basic tasks

across applications just

as human workers do

The process of examining large and varied data sets to uncover

hidden

patterns, unknown

correlations

A decentralized, distributed and

immutable digital ledge used to record actions across many

computers in a consensus dependent

environment

Interconnection via the Internet of computing

devices embedded in

everyday objects, enabling

them to send and receive data

An approach to application

development in which a large application is

built as a suite of modular

components or services


An A.I. Proof of Concept

What We Did


▪ In January 2018, the Program Support Center uploaded a comprehensive 18 months worth of HHS-wide Spend Data from all four instances of PRISM and CDC’s ICE System into IBM’s Watson as a Proof of Concept

▪ The hardest part was getting department-wide participation and getting the data out of the PRISM and ICE systems

What We did - Spend Analysis Proof of Concept

Over 1 Million Pages

All of FY16 Data

FY17 Q1 and

FY17 Q2 Data

97,4000 Contracts

All HHS OpDivs

and StaffDivs


▪ This form of A.I. (Watson) uses Natural Language Processing and Machine Learning to take PDFs, Word Files, Excel Files, Handwritten notes, and other “paper” information and translate it into pure data that can be compared and analyzed in a unified manner

▪ Once the data had been imported in to the A.I. system, a number of acquisitions SMEs coupled with a Solution Architect (SA), worked together for several weeks to teach Watson to understand the structure of the data

• What is important in a contract

– Vendor

– Period of Performance

– Pricing and Units of Measure

– Terms and Conditions

• The SMEs and the SA helped the A.I. system learn the different ways to say the same thing

• The machine learned through the process so it became easier and easier during the process



▪ By end of March, 2018, Watson was ready to report significant information on our HHS-Wide spend habits

• How many of each commodity or service was purchased across the department

• Lowest price paid

• Highest price paid

• Average price paid

• Total savings if 100% were purchased

• Terms and Conditions

• Brand Names and Vendors

• Product Service Codes and SKUs

• Etc…



Our Results


A.I Proof of Concept97,400 Contracts Reviewed = ~1,000,000 Pages

HHS Wide Contract Data for 18 Months (FY ’16 - ’17)

PRODUCT/SERVICE HIGH LOW % DIFFERENCE

$ 1,028.00 $ 571.00 80%VMware vSphere

$ 59.41 $ 27.00 102%Case Copy Paper

$ 2,627.00 $ 946.00 178%AED Defibrillator

$ 96.20 $ 42.00 129%RN Services

$ 18,149.00 $ 4,309.00 322%Adobe Connect (500 Seats)


Lessons Learned


• That one must teach the AI tool to deal with unstructured data

• Humans have to be involved

• This process requires an interdisciplinary approach – no one person or organization can be successful without collaboration

• Many people view these technologies as a threat to their job or way of life

• New and emerging technologies offer significant opportunity to remove the mundane and boring tasks, freeing people up to focus on the more critical aspects of their jobs

• There has never been a better time in federal government to embrace technology and modernize the way we do business

Lessons Learned


Questions?

Thank you