Answer to Question #212524 in Databases | SQL | Oracle | MS Access for mak

Question

You are a manager of Data Warehouse, how you keep the data validate in terms of secure data of validation?

Answer 1

Step 1

strategy for data cleansing:

• data quality check :

it is like object or rule which will be integrated into the flow of information for monitoring and also report each and every error which occur during the data processing.  

• data mapping :

it is very important to correctly map the data from source to transformation and then to destination to make the data cleaned with accuracy. data mapping is used to ensure the usability of the data scrubbing.

• automation of work flow :

automating the entire data cleansing service is right from the profiling of the data incoming to its validation, loading and conversion to the preferred destination

• data profiling and cleansing capabilities :

it is an end to end cleansing solution included in data profiling and features of cleansing that will automatically identify the meta data to provide the visibly clean data source to pinpoint the discrepancies.

Step 2

how you keep the data Validate in term of secure data of Validation.

data validation:

a method to check the both quality and accuracy of the data, it is performed before the prior as that will improve the processing, it is a form of data cleansing. it is used to make sure your data will not hold any duplicated data, the range will be consistent.

steps in data validation:

1. data sample is determined
2. database is validated
3. data format is validated

how you keep the data Validate in term of secure data of Validation:

• enterprise tool : this is used to perform validation of data FME a tool used for data validation that will perform both validation and repairing of data.
• scripting : most data validation is performed by scripting language including python to write the script.
• open source tool: it is more cost efficient and as it is cloud based so it helps in saving money on infrastructure.