Tuesday 12 February 2013

Dareware House Testing Observation

I got chance to do the Dataware house testing  (BI) in my company.

In Data Integrity testing, I have used below approach : 

I have used VBExcel comparer (Macro) to validate the column values or data between source and destination.
It is useful for me to validate/compare large number of records in both source and destination.
 

Few observations (Issues) found while doing the Performance testing,

While executing the ETL with huge volume of date, Out of Memory exception occurred. For BI Testing, mainly focused to avoid the memory related issues...

 After some extent of analysis to provide the solution that,
  1. Release the the memory object through garbage collector after inserting the large volume of data. So Memory level has maintained at the same level if inserting huge data to the database.
  2. Avoid to use more connection to open and close. Since every connection takes memory to initialization. So that is also taking some memory. Reduce the connections.


Note : I have used SQL Monitor 3.2 to analysis the performance of the server. It has been used generating various reports like CPU Usage, Disk Read, Disk Write, Disk Transfer, SQL Server Total Memory...etc.

No comments:

Post a Comment