FINCoS Framework Tutorial
FINCoS Framework TutorialMarcelo R.N. Mendes
1What is FINCoS?A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;Main Characteristics:Flexible;Independent of particular workloads;Not bound to any specific CEP product;Scalable.2CISUC, University of Coimbra - [email protected], 20122
FINCoS: Architecture3CISUC, University of Coimbra - [email protected], 20123FINCoS: ComponentsDriverSimulates external sources of events;Submits load to the SUT;Includes data generation mechanism;SinkReceives query results from CEP engine;Stores output events in log files for subsequent validation.
4CISUC, University of Coimbra - [email protected], 2012
4FINCoS: ComponentsControllerMain Interface with the user. Allows to:Create reusable test setups;Control Drivers and Sinks (e.g., load, start, stop);Alter workload parameters on-the-fly (e.g., event submission rates, switch phases)
5CISUC, University of Coimbra - [email protected], 2012
5FINCoS: ComponentsPerformance MonitorCollect Metrics of Performance RunsTwo Modes:Online (integrated into FINCoS Controller);Offline (log files).
6CISUC, University of Coimbra - [email protected], 2012
6Lesson 1: Creating a Test SetupConfigure a DriverDecomposable WorkloadSynthetic vs. Thirdy-Party DatasetData Generation OptionsEvent Arrival ProcessConfigure a SinkJuly, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]
8July, 2012CISUC, University of Coimbra - [email protected]
9July, 2012CISUC, University of Coimbra - [email protected]
unique identifiernumber of threads used for load generationsave generated data to disk?to where Driver send the eventsmachine that hosts the Driver10July, 2012CISUC, University of Coimbra - [email protected]
Workload can be split in independent phases 11July, 2012CISUC, University of Coimbra - [email protected]
12July, 2012CISUC, University of Coimbra - [email protected]
Chooses the type of workload for this phaseSets events arrival processEvent MixEvents are generated in a ordered wayWhen data generation happensTo ensure repeatability13July, 2012CISUC, University of Coimbra - [email protected]
Configure event types14July, 2012CISUC, University of Coimbra - [email protected]
15July, 2012CISUC, University of Coimbra - [email protected]
16July, 2012CISUC, University of Coimbra - [email protected]
Configure Event Type Schema17July, 2012CISUC, University of Coimbra - [email protected]
18July, 2012CISUC, University of Coimbra - [email protected]
19July, 2012CISUC, University of Coimbra - [email protected]
Column Name
20July, 2012CISUC, University of Coimbra - [email protected]
Column Type
21July, 2012CISUC, University of Coimbra - [email protected]
Data Generation Options
22July, 2012CISUC, University of Coimbra - [email protected]
Add Values23July, 2012CISUC, University of Coimbra - [email protected]
24July, 2012CISUC, University of Coimbra - [email protected]
25July, 2012CISUC, University of Coimbra - [email protected]
26July, 2012CISUC, University of Coimbra - [email protected]
27July, 2012CISUC, University of Coimbra - [email protected]
28July, 2012CISUC, University of Coimbra - [email protected]
29July, 2012CISUC, University of Coimbra - [email protected]
30July, 2012CISUC, University of Coimbra - [email protected]
31July, 2012CISUC, University of Coimbra - [email protected]
32July, 2012CISUC, University of Coimbra - [email protected]
33July, 2012CISUC, University of Coimbra - [email protected]
34July, 2012CISUC, University of Coimbra - [email protected]
35July, 2012CISUC, University of Coimbra - [email protected]
36July, 2012CISUC, University of Coimbra - [email protected]
unique identifierList of event types this Sink subscribes tofrom where Sink receive eventsmachine that hosts the Sinksave generated data to disk?37July, 2012CISUC, University of Coimbra - [email protected]
38July, 2012CISUC, University of Coimbra - [email protected]
39July, 2012CISUC, University of Coimbra - [email protected]
40July, 2012CISUC, University of Coimbra - [email protected]
Done!41Lesson 2: Configuring a new ConnectionConfigure a reusable connection with a CEP engine or JMS ProviderJuly, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]
43July, 2012CISUC, University of Coimbra - [email protected]
44July, 2012CISUC, University of Coimbra - [email protected]
45July, 2012CISUC, University of Coimbra - [email protected]
unique identifiername of the CEP engine (out-of-the-box support for Esper)Properties used to connect with the CEP enginetype of the connection46July, 2012CISUC, University of Coimbra - [email protected]
* supporting new CEP engines requires coding47July, 2012CISUC, University of Coimbra - [email protected]
Done!48Lesson 3: Running TestsLoad Drivers and SinksStart Load SubmissionControl Load Submission
NOTE: At this point the following steps must have been completed:Creation of a test setup;Initialization of the FINCoS Daemon Service at the machines where Drivers and Sinks are intended to run;July, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]
Load components50July, 2012CISUC, University of Coimbra - [email protected]
51July, 2012CISUC, University of Coimbra - [email protected]
Start Load Submission52July, 2012CISUC, University of Coimbra - [email protected]
Sent/Received counts53July, 2012CISUC, University of Coimbra - [email protected]
54July, 2012CISUC, University of Coimbra - [email protected]
55July, 2012CISUC, University of Coimbra - [email protected]
56Lesson 4: Collecting Performance MetricsOnline Performance MeasurementDuring tests
Offline Performance MeasurementAfter test completion, use FINCoS Performance Monitor to process log files
July, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]
58July, 2012CISUC, University of Coimbra - [email protected]
July, 2012CISUC, University of Coimbra - [email protected]
60Lesson 4: Collecting Performance Metrics (...cont)Online Performance MeasurementDuring tests
Offline Performance MeasurementAfter test completion, use FINCoS Performance Monitor to process log files
July, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]
July, 2012CISUC, University of Coimbra - [email protected]
July, 2012CISUC, University of Coimbra - [email protected]
Configure M.I. here:Optionally, save collected metrics to a fileJuly, 2012CISUC, University of Coimbra - [email protected]
July, 2012CISUC, University of Coimbra - [email protected]
Select the stream66July, 2012CISUC, University of Coimbra - [email protected]
Select the metric67July, 2012CISUC, University of Coimbra - [email protected]
Select exhibition scale68July, 2012CISUC, University of Coimbra - [email protected]
Add Metrics to the Chart69July, 2012CISUC, University of Coimbra - [email protected]
Change Visualization Options70Lesson 5: Setting Test OptionsResponse Time MeasurementJuly, 2012CISUC, University of Coimbra - [email protected], 2012CISUC, University of Coimbra - [email protected]
72July, 2012CISUC, University of Coimbra - [email protected]
73July, 2012CISUC, University of Coimbra - [email protected]
74Response Time Measurement ModeJuly, 2012CISUC, University of Coimbra - [email protected] ENGINESINKADAPTER234sendconvertinputconvertoutputprocessinputforwardgenerate resultforwardsend175Response Time Measurement ModeJuly, 2012CISUC, University of Coimbra - [email protected] ENGINESINKADAPTERsendconvertinputconvertoutputprocessinputforwardgenerate resultforwardsendt = t4 t1End-to-end:From Driver up to Sink 234176Response Time Measurement ModeJuly, 2012CISUC, University of Coimbra - [email protected] ENGINESINKADAPTERsendconvertinputconvertoutputprocessinputforwardgenerate resultforwardsendt = t3 t2Process Time:From immediately before the input event is forwarded to CEP engine to immediately after the result is received.234177Download and FeedbackFINCoS is available at:http://code.google.com/p/fincos/
Any suggestions or bug reports:[email protected]
July, 2012CISUC, University of Coimbra - [email protected]