complete reference to informatica_ identification of bottlenecks
TRANSCRIPT
-
7/25/2019 Complete Reference to Informatica_ Identification of Bottlenecks
1/2
5/31/2016 C om pl ete r efer ence to Infor mati ca: ID EN TIFIC ATION OF BOTTLEN EC KS
http://informaticatutorials-naveen.blogspot.in/2011/04/identification-of-bottlenecks.html
Home DataW areHousing Unix-Shell Scripts PL SQL Contact Us
PERFORMANCE TUNING
Necessity Of Performance-tuning
Identification Of bottle Necks
Optimization of Bottle necks
Performance tuning of Lookup
Push Down Optimization
TESTING
Unit Testing
Integration Testing
UAT
Informatica Testing
Debugger
Constraint Based loading
Target Load Plan
INTERVIEW ZONE
Informatica Real Time Interview Questions
Informatica Experienced Interview
Questions - part1
Informatica Experienced Interview
Questions - part2
Informatica Experienced Interview
Questions - part3
Informatica Experienced Interview
Questions - part4
Data Warehousing concept Based Interview
Questions
17
TOTAL VISITS
FEEDS
DISCUSSION FORUM
Discussion Forum
SUBSCRIBE TO LEARN INFORMATICA
512 people
like this.Like Share
Sunday, 17 April 2011
IDENTIFICATION OF BOTTLENECKS
IDENTIFICATION OF BOTTLENECKS
Performance of Informatica is dependant onthe performance of its several c omponents
like database, network, transformations, mappings, sessions etc. To tune the performance
of Informatica, we have to identify the bottleneck first.
Bottleneck may be present in source, target , transformations, mapping, session,database
or network. It is best to identify performance issue in components in the order source,
target, transformations, mapping and session. After identifying the bottleneck, apply the
tuning mechanisms in whichever way they are applicable to the project.
Identify bottleneck in Source
If source is a relational table, put a filter transformation in the mapping, just after source
qualifier make the condition of filter to FALS E. So all records will be filtered off and none
will proceed to other parts of the mapping.In original case, without the test filter, total time
taken is as follows:-
Total Time = time taken by (source + tran sformations + target load)
Now because of filter, Total Time = time taken by source
So if source was fine, then in the latter case, session should take less time. Still if the
session takes near equal time as former case, then there is a source bottleneck.
Identify bottleneck in Target
If the target is a relational table, then substitute it with a flat file and run the session. If the
time taken now is very much less than the time taken for the session to load to table, then
the target table is the bottleneck.
Identify bottleneck in Transformation
Remove the transformation from the mapping and run it. Note the time taken.Then put the
transformation back and run the mapping again. If the time taken now is significantly more
than previous time, then the transformation is the bottleneck.
But removal of transformation for testing can be a pain for the developer since that might
require further changes for the session to get into the working mode.
So we can put filter with the FALSE condition just after the transformation and run the
session. If the session run takes equal time with and without this test filter,then
transformation is the bottleneck.
Identify bottleneck in sessions
We can use the session log to identify whether the source, target or transformations are
the performance bottleneck. Session logs contain thread summary records like the
following:-
MASTER> PETL_24018 Thread [READER_1_1_1] created for the read stage of partition
point [SQ_test_all_text_data] has completed: Total Run Time =[11.703201] secs, Total Idle
Time = [9.560945] secs, Busy Percentage =[18.304876].
MASTER> PETL_24019 Thread [TRANSF_1_1_1_1] created for the transformation stage
of partition point [SQ_test_all_text_data] has completed: Total Run Time = [11.764368]
secs, Total Idle Time = [0.000000] secs, Busy Percentage = [ 100.000000].
If busy percentage is 100, then that part is the bottleneck.
INTRODUCTION
ETL Life Cycle
What Is Informatica
Client Components
Services Behind Scene
Try U R Hand's on Admin-
Console
Difference Between 7.1
and 8.6
Informatica 8.6
Installation
ADVANCED CONCEPTS
Mapping Parameter's &Variable
Mapplets
Partitioning
Working with links
Scheduler
Types of Task's- 1
Types of Task's- 2
Indirect Method for
Loading
SCD - Type 1
SCD - Type 2
SCD - Type 3
Incremental Aggregation
Mapping Templates
Grid Processing
Frequently Used
Functions
Work Flow Variables
TRANSFORMATION
Filter
Expression
Router
Sorter
Rank
Transaction Control
Source Qualifier
Stored Procedure
SQL Transformation
Normalizer
Sequence Generator
Aggregator
Union
Joiner
Update Strategy
Look Up
Complet referenc t Informatic
http://informaticatutorials-naveen.blogspot.com/2011/04/transaction-control_21.htmlhttp://www.histats.com/viewstats/?sid=1468134&ccid=406http://www.histats.com/http://informaticatutorials-naveen.blogspot.com/2011/05/data-warehousing-concepts-based.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview_26.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-real-time-interview.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/user-acceptance-test.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/integration-testing_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/optimizing-bottlenecks.htmlhttp://unixshellscripts.blogspot.com/http://naveen-plsql.blogspot.com/http://informaticatutorials-naveen.blogspot.com/2011/04/contact-us.htmlhttp://informaticatutorials-naveen.blogspot.in/http://informaticatutorials-naveen.blogspot.com/2011/04/expression-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/workflow-variables_25.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/07/functions-in-informatica.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/mapping-templates.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/type-2_21.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/indirect-loading-for-flat-files.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/working-with-tasks-part-1.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/working-with-links.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/mapping-parameters-variables.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/steps-to-install-informatica-power.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/difference-between-71-and-86.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/etl-life-cycle_20.htmlhttp://informaticatutorials-naveen.blogspot.in/http://naveen-datawarehousing.blogspot.com/http://informaticatutorials-naveen.blogspot.in/http://informaticatutorials-naveen.blogspot.in/http://informaticatutorials-naveen.blogspot.in/http://informaticatutorials-naveen.blogspot.com/2011/04/lookup-transformation.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/update-strategy-transformation.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/joiner-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/union-transformation_21.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/aggregator-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/sequence-generator-tf_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/normalizer-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/sql-transformation_21.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/stored-procedure-tf.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/source-qualifier-tf_21.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/transaction-control_21.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/rank-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/sorter-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/router-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/expression-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/filter-transformation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/workflow-variables_25.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/07/functions-in-informatica.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/grid-processing.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/mapping-templates.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/incremental-aggregation_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/scd-type-3.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/type-2_21.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/scd-type-1.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/indirect-loading-for-flat-files.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/working-with-tasks-part-2.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/working-with-tasks-part-1.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/schedulers.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/working-with-links.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/partitioning.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/mapplets.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/mapping-parameters-variables.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/steps-to-install-informatica-power.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/difference-between-71-and-86.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/try-u-r-hand-on-admin-console.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/services-behind-scene.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/powercenter-client.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/what-is-informatica_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/etl-life-cycle_20.htmlhttp://www.feedburner.com/http://feeds.feedburner.com/CompleteReferenceToInformaticahttp://complete-reference-to-informatica.1049239.n5.nabble.com/http://www.histats.com/viewstats/?sid=1468134&ccid=406http://www.histats.com/http://informaticatutorials-naveen.blogspot.com/2011/05/data-warehousing-concepts-based.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview_26.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview_23.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-experienced-interview.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/05/informatica-real-time-interview.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/target-load-order.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/constraint-based-loading-in-workflow.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/debugger.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/informatica-power-center-testing.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/user-acceptance-test.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/integration-testing_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/unit-testing_20.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/push-down-optimisation.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/performance-tuning-of-lookup.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/optimizing-bottlenecks.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/identification-of-bottlenecks.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/performance-tuning-overview.htmlhttp://informaticatutorials-naveen.blogspot.com/2011/04/contact-us.htmlhttp://naveen-plsql.blogspot.com/http://unixshellscripts.blogspot.com/http://naveen-datawarehousing.blogspot.com/http://informaticatutorials-naveen.blogspot.in/ -
7/25/2019 Complete Reference to Informatica_ Identification of Bottlenecks
2/2
5/31/2016 C om pl ete r efer ence to Infor mati ca: ID EN TIFIC ATION OF BOTTLEN EC KS
http://informaticatutorials-naveen.blogspot.in/2011/04/identification-of-bottlenecks.html
Enter your email address:
Subscribe
Delivered by FeedBurner
Basically we have to rely on thread statistics to identify the cause of performance issues.
Once the Collect Performance Data option (In session Properties tab) is enabled, all the
performance related information would appear in the log created by the session.
Posted by Naveen at Sunday, April 17, 2011
No comments :
Post a Comment
Enter your comment...
Comment as: Google Accou
Publish
Preview
Links to this post
Create a Link
https://www.blogger.com/blog-this.ghttp://informaticatutorials-naveen.blogspot.in/2011/04/identification-of-bottlenecks.htmlhttps://www.blogger.com/profile/01892407690516075293http://feedburner.google.com/