Data Quality Engineer

Recruiter:

Praesignis (Pty) Ltd

Job Ref:

JHB000361/JD

Date posted:

Tuesday, January 5, 2021

Location:

Johannesburg, South Africa

Salary:

Hourly

SUMMARY:
We are currently looking for an experienced Data Quality Engineer to join one of our projects related to data validation built on the data coming from the data store or data lake.

POSITION INFO:

Phase 1: data validation between MSSQL and SalesForce, ensuring the volumes are aligned after several rules and transformations have been implemented. Rules in SalesForce have been applied. Rules in MSSQL will need to built using Stored Procs. Error handling will need to be considered using Elasticsearch / Kibana.

Phase 2: validation of SalesForce data fields, ensuring data entities are correct, accurate and complete. Data will need to be pulled from SalesForce to Hadoop, and processed using Map Reduce and/or Spark. Error handling will need to be considered using Elasticsearch / Kibana.

Required experience:

Defining test cases / test plans
Design, develop, document, execute data checks, test cases, test plans
Reporting and dashboarding (preferably PowerBI)
DevOps (CI / CD)

Preferred experience:

Autonomous testing
SalesForce
Data lifecycle management
Metadata management (including lineage, provenance)
Atlassian tools (Bamboo, BitBucket, Sonar)

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Quality Analyst
Location: Johannesburg
Salary:
76 days ago

Data & Analytics Engineer
Location: Johannesburg
Salary: R800000 Annually
Senior data & Analytics engineer – Microsoft Fabric / Azure data Factory Expertð Johannesburg (Office Based)ð Permanent Positionð¡ Ideal Candidate ProfileAre you a data engineering specialist with a strong cloud-first mindset?You understand end-to-end data flow — from extraction to analytics — and know how to make it scalable, reliable, and intelligent?Are you passion...
1 day ago

Systems Engineer (Unix/Solaris) - Hybrid
Location: Pretoria
Salary:
1 day ago

Data Engineer (Integration for Data Science Team)
Location: Johannesburg
Salary:
1 day ago

SM 17192 - DESIGN SPECIALIST PAVEMENT AND MATERIALS
Location: Johannesburg
Salary: R1, 2m P/A
DESIGN SPECIALIST PAVEMENT AND MATERIALS
1 day ago

Application Engineer – Mechanical Engineering – AA/EE - East Rand
Location: East Rand
Salary: Salary offer: R850K – R950K TCTC
Application engineer – Mechanical engineering – AA/EE - East Rand
2 days ago

Quality Engineer
Location: Johannesburg
Salary: 762000 Annually
quality engineer required to lead, develop, and enforce quality activities at the suppliers to obtain reliable products, on time, to the required quality standards, and manufactured with capable processes. Manage any non-conformance and non-compliance of supplied products to prevent further recurrence.
2 days ago

Front Arena Software Engineer / System Analyst
Location: Johannesburg
Salary:
2 days ago

Intermediate Software Developer
Location: Johannesburg
Salary: Annually
The Intermediate C# Developer will be responsible for designing, developing and maintaining bespoke solutions.
3 days ago

Data and Analytics Engineer
Location: Johannesburg
Salary:
Are you an experienced data and Analytics engineer passionate about transforming data into actionable insights? Our client is looking for a skilled professional to join their team.
3 days ago

Data Quality Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Quality Engineer in Johannesburg