lempel-ziv-markov chain algorithm modeling using models of ... · lempel-ziv-markov chain algorithm...

20
FT 2019 Bonna, R. Introduction Background Case Study Summary Ack Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe 10th Aerospace Technology Congress, Stockholm Augusto Horita, Ricardo Bonna, Denis Loubach, Ingo Sander, Ingemar Söderquist [email protected], [email protected], [email protected], [email protected], [email protected] Advanced Computing, Control & Embedded Systems Laboratory / University of Campinas - UNICAMP October 8-9, 2019

Upload: others

Post on 10-Oct-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Lempel-Ziv-Markov Chain Algorithm Modeling using Models ofComputation and ForSyDe

10th Aerospace Technology Congress, Stockholm

Augusto Horita, Ricardo Bonna, Denis Loubach,Ingo Sander, Ingemar Söderquist

[email protected], [email protected], [email protected], [email protected], [email protected]

Advanced Computing, Control & Embedded Systems Laboratory / University of Campinas - UNICAMP

October 8-9, 2019

Page 2: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Outline

1 Introduction

2 Background

3 Case Study

4 Summary

5 Acknowledgments

2/20

Page 3: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Outline

1 Introduction

2 Background

3 Case Study

4 Summary

5 Acknowledgments

3/20

Page 4: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Introduction

Aircraft data link optimization trough data compression

LZMA: widely used lossless compression algorithm (Benchmark by SPEC)

Model-Based Design (MBD) to cope with the avionics safety-critical systems standards(DO-331)

Synchronous dataflow: adequate to model the dataflow behavior of compression algorithms

4/20

Page 5: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Introduction

We present the formal model and simulation of Lempel-Ziv Markov Chain algorithm(LZMA) using the synchronous dataflow (SDF) model of computation (MoC)

5/20

Page 6: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Outline

1 Introduction

2 Background

3 Case Study

4 Summary

5 Acknowledgments

6/20

Page 7: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Background

Model of Computation (MoC)According tagged signal model (TSM)1 framework, systems can be modeled as compositionsof processes acting on signals

Signal: a set of events ei = (ti, vi), which are elementary units of information composedby a tag ti ∈ T and a value vi ∈ V

Process: a set of possible relations between input signals SI and output signals SO.The set of output signals is given by the intersection between the input signals and theprocess SO = SI ∩ P

1Lee1998a. 7/20

Page 8: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Background

Synchronous dataflow (SDF) MoC

Dataflows are untimed MoCs

Directed graphs where each node represents a process and each arc a signal path2

Each input and output port is associated with a token rate

An actor can fire only if the input signal paths have enough tokens to supply the amountneeded

2Lee1987a. 8/20

Page 9: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Background

Lempel-Ziv Markov Chain Algorithm (LZMA)

Compression algorithm based on Lempel-Ziv 1977 (LZ77)3

Higher compression rate, faster decompression, controlled necessary memory4

Open source, implemented in many languages (C, C++, Java)

3Ziv1977a.4Salomon2007a. 9/20

Page 10: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Background

LZMA

Input DataStream

UncompressedData

Delta Encoding Delta Decoding

Sliding

Dictionary

Encoding (LZ77)

Sliding

Dictionary

Decoding (LZ77)

Range Encoding Range Decoding

CompressedData

LZMA Flowchart5

5Leavline2013a.

10/20

Page 11: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Outline

1 Introduction

2 Background

3 Case Study

4 Summary

5 Acknowledgments

11/20

Page 12: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Lempel-Ziv-Markov Chain Modeling

LZMA formal model - SDF MoC

ForSyDe framework

It was used the following tools’ versions:

ForSyDe v3.3.2.0

Glasgow Haskell Compiler v8.0.1

12/20

Page 13: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Lempel-Ziv-Markov Chain Modeling

Aswe Are

Sis 1 1 Sfc

[LZtok]

1 1

Hdr

Scs

1

[SWEFBtok]

1 1

[REFBtok]

1

LZMA SDF model

Inputs: stream to be compressed Sis

Processes: Aswe and Are

Output: compressed stream Scs

13/20

Page 14: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Lempel-Ziv-Markov Chain Modeling

LZMA signatures and definitions

1 -- LZ (Sliding Window) Encoding actor definition2 -- Input is the lzma input stream Sis3 -- Output is the first step compressed stream Sfc4 lzA :: Signal Char -> Signal (Maybe (Maybe Int , Char))5 lzA Sis = Sfc6 where (Sfc , fb) = actor22SDF (1,1) (1,1) lzF Sis fb’7 fb ’ = delaySDF [([],"" ,0)] fb89 -- Range Encoding actor definition.10 -- Input is the first step compressed stream Sfc11 -- Output is the compressed LZMA stream output Scs12 rgA :: Signal (Maybe (Maybe Int , Char))13 -> Signal [Char]14 rgA sFc = sCs ’15 where (sCs ,sFb) = actor22SDF (1,1) (1,1) rangeFunc sFc sFb ’16 sCs ’ = delaySDF initHdr sCs17 sFb ’ = delaySDF [(rangeInit ,0, chr 0)] sFb18 initHdr = [([ dictsize] ++ [inpLen ])]19 inpLen = (intToDigit (lengthS sFc))

14/20

Page 15: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Lempel-Ziv-Markov Chain Modeling

LZMA model process network

1 lzmaSdf :: Signal Char -> Signal [Char]2 lzmaSdf sLzmaIs = sLzmaOut3 where sLzmaOut = rgA (lzA sLzmaIs)

Input: sLzmaIsProcess: lzmaSdfOutput: sLzmaOut

15/20

Page 16: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Outline

1 Introduction

2 Background

3 Case Study

4 Summary

5 Acknowledgments

16/20

Page 17: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Summary

Our paper presented

a simplified LZMA modeling based on the SDF MoC using the ForSyDe framework

Some configurations and behaviors assumptions were adopted towards the definition of actorsports fixed token rates

Future work: model LZMA based on the scenario-aware dataflow (SADF) MoC, which supportsvariable token rates

17/20

Page 18: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Outline

1 Introduction

2 Background

3 Case Study

4 Summary

5 Acknowledgments

18/20

Page 19: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack

Acknowledgments

Research Development Foundation (Fundacao de Desenvolvimento da Pesquisa) -FUNDEP/MCTIC/MDIC

19/20

Page 20: Lempel-Ziv-Markov Chain Algorithm Modeling using Models of ... · Lempel-Ziv-Markov Chain Algorithm Modeling using Models of Computation and ForSyDe - 10th Aerospace Technology Congress,

FT 2019

Bonna, R.

Introduction

Background

Case Study

Summary

Ack Thank you for your attention

Email: [email protected] page: http://www.fem.unicamp.br/∼acceslab/

20/20