Data Quality Engineer

Recruiter:

Praesignis (Pty) Ltd

Job Ref:

JHB000361/JD

Date posted:

Tuesday, January 5, 2021

Location:

Johannesburg, South Africa

Salary:

Hourly

SUMMARY:
We are currently looking for an experienced Data Quality Engineer to join one of our projects related to data validation built on the data coming from the data store or data lake.

POSITION INFO:

Phase 1: data validation between MSSQL and SalesForce, ensuring the volumes are aligned after several rules and transformations have been implemented. Rules in SalesForce have been applied. Rules in MSSQL will need to built using Stored Procs. Error handling will need to be considered using Elasticsearch / Kibana.

Phase 2: validation of SalesForce data fields, ensuring data entities are correct, accurate and complete. Data will need to be pulled from SalesForce to Hadoop, and processed using Map Reduce and/or Spark. Error handling will need to be considered using Elasticsearch / Kibana.

Required experience:

Defining test cases / test plans
Design, develop, document, execute data checks, test cases, test plans
Reporting and dashboarding (preferably PowerBI)
DevOps (CI / CD)

Preferred experience:

Autonomous testing
SalesForce
Data lifecycle management
Metadata management (including lineage, provenance)
Atlassian tools (Bamboo, BitBucket, Sonar)

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

IAG Engineer for Grading
Location: Johannesburg
Salary:
5 days ago

Quality Engineer
Location: Johannesburg
Salary:
quality engineer VacancyType: ContractorLocation: Johannesburg - Southern Suburbs
5 days ago

Microsoft Fabric Specialist (Data Engineering, Governance & DWH) (Onsite – JHB) (Contract)
Location: Johannesburg
Salary:
6 days ago

Sales & Service Engineer (CNC & Milling)
Location: Johannesburg
Salary: Market-related
This role involves working on the CNC Lathe and Milling product range within a dynamic team. Spartan, Kempton Park, Gauteng. R40K - R75K + comm.
6 days ago

Senior Full Stack Software Developer (C# & Python)
Location: Midrand
Salary: Annually
Seeking a Full Stack Software Developer with experience in C# and the Python program. You will be responsible for a collaborative environment and need to have a comprehensive understanding of the entire software development lifecycle, designing and developing both front-end and back-end components of applications, focusing on performance, scalability and maintainability.
6 days ago

Senior Technical Consultant
Location: Johannesburg
Salary: Monthly
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.We are looking for a Senior Technical Consultant (Storage, Backup & Infrastructure) to join our financial services client based in Sandton on a 12-month contract.
7 days ago

Business Intelligence Engineer/Data Scientist (Remote)
Location: Johannesburg
Salary:
8 days ago

Quality Assurance Engineer
Location: Johannesburg
Salary: Market Related
quality Assurance engineer
11 days ago

Full Stack Software Engineer
Location: Johannesburg
Salary: Market Related
Full Stack Software engineer
11 days ago

System Analyst Engineer (Business Analyst)
Location: Johannesburg
Salary: Market Related
System Analyst engineer (Business Analyst)
11 days ago

Data Quality Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Quality Engineer in Johannesburg