mitate: mobile internet testbed for application traffic ...utkarsh goel, ajay miyyapuram, mike p....

30
1 Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed for Application Traffic Experimentation March 26, 2014 Workshop on Active Internet Measurements (AIMS’14)

Upload: others

Post on 01-Oct-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

1

Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang

Montana State University - Bozeman

MITATE: Mobile Internet Testbed

for Application Traffic Experimentation

March 26, 2014

Workshop on Active Internet Measurements (AIMS’14)

Page 2: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

2

Motivation

APP SERVER

USER

Page 3: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

3

Motivation

APP SERVER

USER

DEVELOPER

Measure

end-to-end

delays

Page 4: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

4

Motivation

APP SERVER

USER

DEVELOPER RESEARCHER

Measure

end-to-end

delays

Evaluate new

network

mechanisms

Page 5: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

5

Motivation

APP SERVER

USER

DEVELOPER RESEARCHER

Measure

end-to-end

delays

Evaluate new

network

mechanisms

Page 6: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

6

MITATE

• A new platform for mobile application prototyping in live mobile networks.

• Allows experimentation with custom mobile application traffic between

mobile devices and cloud infrastructure endpoints.

• A collaborative framework, in which participants contribute their mobile

network resources and are allowed, in turn, to run their traffic

experiments on others’ devices.

• Open to the public and being deployed on Google’s Measurement Lab

(M-Lab).

Page 7: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

7

Measurement without MITATE

//app codeint main()

App Traffic//srvr codeint main()

Mobile Devices Back-end ServersApplication Implementation

//app codeint main()

App Traffic//srvr codeint main()

Security concerns over untested code

Restrictive APIs

Want to measure traffic delays. Have to deploy code to do so.

Small number of volunteered devices

Downsides of code deployment

Page 8: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

8

How does MITATE help measurement?

MITATE separates traffic generation from application logic

MITATE App Traffic MITATE

Mobile Devices Back-end ServersApplication Implementation

//app codeint main()

//srvr codeint main()

App Traffic

App TrafficXML:

Page 9: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

9

MITATE’s traffic definition

• Generate traffic definitions in a form of well structured XML that defines

– what the traffic looks like?

– where the traffic is going?

– when the traffic is to be sent?

– which mobile device should execute the experiment?

Page 10: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

10

Defining a transfer

other parameters include:

• Transmission delay

• No. of packets

• Explicitly defined content

<transfer>

<id>transfer1</id>

<src>client</src>

<dst>1.2.3.4</dst>

<protocol>UDP</protocol>

<dstport>5060</dstport>

<bytes>20</bytes>

<response>0</response>

</transfer>

Page 11: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

11

Defining transfers with explicit content

<transfer>

<id>dns_req</id>

<src>client</src>

<dst>DNS</dst>

<dstport>53</dstport>

<prot>UDP</prot>

<bytes><![CDATA[0x0100be07de55...]]></bytes>

<response>1</response>

</transfer>

Page 12: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

12

Defining a criteria

<criteria>

<id>criteria1</id>

<latlong>"45.666 -111.046"</latlong>

<radius>5000</radius>

<networktype>cellular</networktype>

<starttime>12:00</starttime>

<endtime>13:30</endtime>

</criteria>

other parameters include:

• Network carrier

• Minimum battery power

• Minimum signal strength

• Device model name

Page 13: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

13

Summing up all the definitions

<transaction count=“10”>

<criteria>

<criteriaid>criteria1</criteriaid>

</criteria>

<transfers>

<transferid delay=“10” repeat=“1”>transfer1</transferid>

<transferid delay=“20” repeat=“2”>transfer2</transferid>

<transferid delay=“10” repeat=“1”>transfer1</transferid>

</transfers>

</transaction>

Page 14: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

14

How does MITATE help developers?

MITATE separates traffic generation from application logic

MITATE App Traffic MITATE

Mobile Devices Back-end ServersApplication Implementation

//app codeint main()

//srvr codeint main()

App Traffic

App TrafficXML:

Page 15: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

15

How does MITATE help developers?

MITATE separates traffic generation from application logic

MITATE App Traffic MITATE

Mobile Devices Back-end ServersApplication Implementation

//app codeint main()

//srvr codeint main()

App Traffic

App TrafficXML:

No mobile code – only traffic description shipped to mobiles

Flexibility in traffic generation logic

Large number of volunteered devices

Upsides of using MITATE

Page 16: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

16

How does MITATE help developers?

MITATE separates traffic generation from application logic

MITATE App Traffic MITATE

Mobile Devices Back-end ServersApplication Implementation

//app codeint main()

//srvr codeint main()

App Traffic

App TrafficXML:

No mobile code – only traffic description shipped to mobiles

Flexibility in traffic generation logic

Large number of volunteered devices

Upsides of using MITATE

Page 17: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

17

How does MITATE help developers?

MITATE separates traffic generation from application logic

MITATE App Traffic MITATE

Mobile Devices Back-end ServersApplication Implementation

//app codeint main()

//srvr codeint main()

App Traffic

App TrafficXML:

No mobile code – only traffic description shipped to mobiles

Flexibility in traffic generation logic

Large number of volunteered devices

Upsides of using MITATE

Page 18: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

18

How does MITATE help developers?

MITATE separates traffic generation from application logic

MITATE App Traffic MITATE

Mobile Devices Back-end ServersApplication Implementation

App TrafficXML:

No mobile code – only traffic description shipped to mobiles

Flexibility in traffic generation logic

Large number of volunteered devices

Upsides of using MITATE

where performance of intermediate solutions are

the reported metrics in each experiment round

Page 19: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

19

Challenges in deploying large scale testbed

• Assure sufficient resource capacity for scheduled experiments.

(Limiting resource is mobile data, subject to monthly caps)

– Entice users to contribute resources

– Prevent abuse of contributed resources

• MITATE jointly addresses both problems using a data credit exchange system inspired by BitTorrent tit-for-tat mechanisms

• Avoid DDoS attacks configured as MITATE experiments.

– A MITATE user may request that multiple devices send data simultaneously, the user’s credit will be rapidly depleted.

– So even if the transmissions are malicious, they will be short-lived.

Page 20: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

20

Measure of application performance

• What is the largest game state update message that can be reliably

delivered under 100 ms?

• Does my application traffic need to contend with traffic shaping

mechanisms?

• Which CDN provides fastest downloads through a particular mobile

service provider's peering points?

Page 21: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

21

Message delay vs. message size at 10AM on

CSP 1 to a CA datacenter

Page 22: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

22

Measure of application performance

• What is the largest game state update message that can be reliably

delivered under 100 ms?

• Does my application traffic need to contend with traffic shaping

mechanisms?

• Which CDN provides fastest downloads through a particular mobile

service provider's peering points?

Page 23: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

23

Effect of payload on CSP1

Page 24: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

24

Effect of choice of transport protocols

Page 25: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

25

Measure of application performance

• What is the largest game state update message that can be reliably

delivered under 100 ms?

• Whether the delays are due to network allocation timeouts or due to the

device entering power save mode?

• Does my application traffic need to contend with traffic shaping

mechanisms?

• Which CDN provides fastest downloads through a particular mobile

service provider's peering points?

Page 26: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

26

Measurement based CDN selection

Page 27: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

27

Conclusions

• MITATE is the first public testbed that supports prototyping of application

communications between mobiles and cloud datacenters.

• MITATE separates application logic from traffic generation, which

simplifies security and resource sharing mechanisms.

• We have presented data collected with MITATE experiments that affects

mobile application message delay.

Page 28: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

28

Requests to the audience

• Beta testers and collaborators within the mobile development and

research communities to test MITATE

• Feedback on MITATE’s functionality before making the tool public on

M-Lab.

Page 29: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

29

Learn more

• Details in our Mobiquitous’13 paper:

http://www.cs.montana.edu/mwittie/publications/Goel13MITATE.pdf

• Web URL: http://mitate.cs.montana.edu

• Email: [email protected]

• Code Repo: https://github.com/msu-netlab/MITATE

Thank you

Questions?

Page 30: MITATE: Mobile Internet Testbed for Application Traffic ...Utkarsh Goel, Ajay Miyyapuram, Mike P. Wittie, Qing Yang Montana State University - Bozeman MITATE: Mobile Internet Testbed

30

Why “MITATE”

• Mitate is a technique used in ukiyo-e images, as

well as in other creative forms, in which many

layers of meaning are layered atop one another

• MITATE allows the discovery of multiple types of

mobile network performance data

A mitate-e painting by Hokusai, depicting a courtesan

juxtaposed with Daruma, the founder of Zen.

http://wiki.samurai-archives.com/index.php?title=Mitate