rstudio in aws 16 9

Rstudio Server on Amazon EC2

Liad Shekel

[email protected]

June 2015

Liad Shekel Rstudio Server on Amazon EC2 1 / 72

Rstudio Server on Amazon EC2Outline

1 Amazon Web Services (AWS)HistoryServicesAmazon EC2Create an AWS Account

2 SSH and Asymmetric CryptographyBasic terminologyLaunch an EC2 instanceConnect to EC2 instance via SSH

3 Install R on Ubuntu ServerLinux basicsInstall R on Ubuntu ServerInstall Rstudio on Ubuntu Server


History

1994-20061994: Jeff Bezos founded Amazon2002: AWS was developed for Amazon’s internal infrastructure2003: AWS started building an "infrastructure service for the world.”2006: Amazon launched “Amazon Simple Storage Service” (Amazon S3) and a virtual computingenvironment called “Amazon Elastic Compute Cloud” (Amazon EC2)


How big is Amazon Web Services?

Today

About 1.4 million servers working around the globe158k − 450k servers1/3 of all internet users will access an AWS cloud site at least once a day (2012)1% of all internet traffic (2012)


Amazon Web Services (AWS)Services


Amazon Web Services (AWS)Amazon Elastic Compute Cloud (EC2)


Amazon Web Services (AWS)Amazon Simple Storage Service (S3)


Amazon Web Services (AWS)Amazon Relational Database Service (RDS)


Amazon Web Services (AWS)NoSQL database service (DynamoDB) * Petabyte-scale data warehouse (RedShift)


Amazon Web Services (AWS)Analytics (Hadoop, ML as a service)


Amazon EC2Next: EC2 instances


Amazon Elastic Compute Cloud (EC2)Introduction

Marketing lines

Scale to your needs - Amazon EC2 provides re-sizable compute capacity which allows to quicklyscale capacity, both up and down, as your computing requirements change.Pay per hour - Amazon EC2 allows you to pay only for capacity that you actually use.

Buttom lineEC2 instance is a remote

{server / machine / virtual machine / instance / computer / host }

with flexible and changeable specifications.


Create an AWS Account

Link: www.aws.amazon.com


www.aws.amazon.com

Create an AWS AccountLogin credentials


Create an AWS AccountContact information


Create an AWS AccountPayment information


Create an AWS AccountIdentity verification (1)


Create an AWS AccountSupport plan


Create an AWS AccountConfirmed


Create an AWS AccountWait...


Create an AWS AccountDone!


Create an AWS AccountNext: EC2 instances


Amazon Elastic Compute Cloud (EC2)First glance

Link: https://console.aws.amazon.com


https://console.aws.amazon.com

Amazon Elastic Compute Cloud (EC2)Instances


Launch EC2 InstanceChoose Amazon machine image (AMI)


Launch EC2 InstanceChoose an instance type


Launch EC2 InstanceHow much does it cost? (1)


Launch EC2 InstanceHow much does it cost? (2)


Launch EC2 InstanceInstance details


Launch EC2 InstanceSSD / Magnetic Storage (30GB in free tier)


Launch EC2 InstanceAdd tags


Launch EC2 InstanceSecurity groups


Launch EC2 InstanceReview and launch!


Launch EC2 InstanceOh. Wait... Key pair? SSH?


Kay Pair and Asymmetric CryptographyPublic-key encryption

Public-key encryption and authentication

The “message“ is encrypted on the remote machine using the client’s public keyThe “message” can be decrypted only with the matching private keyRSA is one example of a public-key algorithm. RSA is based on the practical difficulty of factoring theproduct of two large prime numbers.


Secure Shell (SSH)What is an SSH protocol?

BasicsA shell is a user interface for access to an operating system’s servicesA Secure Shell (SSH) is an encrypted network protocol for initiating text-based shell sessions onremote machines in a secure way

Client side requires SSH client (such as Putty or MobaXterm)Remote side require SSH server (build-in Ubuntu server)

The Secure File Transfer Protocol (SFTP) is an SSH extension that provides file access, file transfer,and file management functionalitiesUsually, SSH uses port 22SSH uses Asymmetric cryptography


Asymmetric cryptographyIn practice

How? What? Where?On the remote server there should be a list of authorized public keys. The corresponding private keysare authorized for connection.The authorized_keys file is located in

/home/<user_name>/.ssh/authorized_keys

To connect to the remote server, make sure that your public key appears in the authorized_keys file(on the server)Choose your private key file on the SSH client configurationsThat’s it


Launch EC2 Instance (Cont’d)We’re back!


Launch EC2 Instance (Cont’d)Download your new private key


Launch EC2 Instance (Cont’d)Congrats!

Download here: https://goo.gl/k8VSS2

My new PRIVATE key!

What are we missing?

The matching public key is stored in the authorized_keys file on the instance.


https://goo.gl/k8VSS2

Launch EC2 Instance (Cont’d)Launch you first EC2 instance


Launch EC2 Instance (Cont’d)


Launch EC2 Instance (Cont’d)Instance State: Pending


Launch EC2 Instance (Cont’d)Instance State: Running!


Use SSH ClientIntroducing MobaXterm


Use SSH ClientNew session


Use SSH ClientSession settings


Use SSH ClientSSH session


Use SSH ClientSSH settings

Remote host: IP addressUse private key: downloaded private key file


Use SSH ClientLogin: ubuntu (default user)


Use SSH ClientThe IP address is now a known host.


Use SSH ClientWelcome to Ubuntu 14.04.2


Linux basicsCommand line

The Linux command structure: command OPTIONS ARGUMENTS

Command: This is the base of the command.

To show top lines of a file, use the head commandTo to create new directory use the mkdir command

OPTIONS: Alter the behavior of the command.

To show 5 or 10 top lines of a file, use the head command with option -n 5 or -n 10

ARGUMENTS: Typically file names or other data that is needed by the command.

head -n 5 file_name


Linux basicsSuper User DO

First Thing to know:

sudo = Super User DO.

Example:To delete the file ’a.txt’ type: rm a.txt

However, if it doesn’t work, try: sudo rm a.txt

Example:


Linux basics

List of files and directories:ls, ls -l, ls -l dir_path.

Navigate between directories:cd, cd .., cd ~, cd /, cd dir_name

Edit/create file (using nano or vim)nano file_name.R, vim file_name.R

open file in view mode (read only)nano -v file_name.R

Display Linux processes:top, htop (sudo apt-get install htop)


Linux basicsAdd user

ubuntu is the default AMI (Amazon Machine Image) user.RStudio require password authenticated user.Add user:sudo adduser <username>

you will be asked for a new password (twice) and then for an optional additional information.Make yourself a sudoer (optional):sudo adduser <username> sudo


Install R on Ubuntu Server

In Linux, like in R, we can download packages (≈software) from repositories.

For example, to install R run:sudo apt-get install r-base-core

Download package lists from the repositories:sudo apt-get update

Upgrade packages according to the updated information:sudo apt-get upgrade

The default repositories install old R version (3.0.2), In order to download the latest version we needto manually add repository.


Install R on Ubuntu ServerAdd repository and install latest R version

Edit the sources.list file and add the R repository locationsudo nano /etc/apt/sources.list

Add this line to the end of the file:deb http://cran.rstudio.com/bin/linux/ubuntu trusty/ .To get permissions to the new repository run:sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys 51716619E084DAB9

Download new package lists:sudo apt-get update

Install the latest R version (3.2.0):sudo apt-get install r-base-core


Install Rstudio on Ubuntu ServerOnly a few seconds away...

Rstudio installationgdebi lets you install local deb packages:sudo apt-get install gdebi-core

Download rstudio’s deb package:wget http://download2.rstudio.org/rstudio-server-0.99.446-amd64.deb

Use gdebi to install the deb package:sudo gdebi rstudio-server-0.99.446-amd64.deb

Open web browser and enter url: <server_ip>:8787Use your username and password.Do crazy things with Rstudio.



Thank you!

Liad Shekel

[email protected]


Or... Rstudio AMI!

Google “Rstudio AMI” and follow the first link:http://www.louisaslett.com/RStudio_AMI/

Choosing one of the AMI would take you again to “Launch instance” screensThe new instance is created with R (3.2.0) and Rstudio-server (0.98.1103) installed (make sure youopen port 80 in the security group!)Username: rstudioPassword: rstudioSorry for not telling this earlier :-)


http://www.louisaslett.com/RStudio_AMI/

Rstudio AMICommunity AMI



Thank you!

Liad Shekel

[email protected]


rstudio in aws 16 9

Internet