Data Quality Engineer

SUMMARY:
We are currently looking for an experienced Data Quality Engineer to join one of our projects related to data validation built on the data coming from the data store or data lake.

POSITION INFO:

Phase 1: data validation between MSSQL and SalesForce, ensuring the volumes are aligned after several rules and transformations have been implemented. Rules in SalesForce have been applied. Rules in MSSQL will need to built using Stored Procs. Error handling will need to be considered using Elasticsearch / Kibana.

Phase 2: validation of SalesForce data fields, ensuring data entities are correct, accurate and complete. Data will need to be pulled from SalesForce to Hadoop, and processed using Map Reduce and/or Spark. Error handling will need to be considered using Elasticsearch / Kibana.

Required experience:

• Defining test cases / test plans
• Design, develop, document, execute data checks, test cases, test plans
• Reporting and dashboarding (preferably PowerBI)
• DevOps (CI / CD)

Preferred experience:

• Autonomous testing
• SalesForce
• Data lifecycle management
• Metadata management (including lineage, provenance)
• Atlassian tools (Bamboo, BitBucket, Sonar)

NB! This job is now closed. You can apply for other jobs by uploading your CV.