Data Engineer x 2

Recruiter:

Praesignis (Pty) Ltd

Job Ref:

JHB000362/JD

Date posted:

Tuesday, January 5, 2021

Location:

Johannesburg, South Africa

Salary:

Hourly

SUMMARY:
We are looking for a savvy Data Engineer to join our growing team of analytics experts.

POSITION INFO:

Phase 1: data validation between MSSQL and SalesForce, ensuring the volumes are aligned after several rules and transformations have been implemented. Rules in SalesForce have been applied. Rules in MSSQL will need to built using Stored Procs. Error handling will need to be considered using Elasticsearch / Kibana.

Phase 2: validation of SalesForce data fields, ensuring data entities are correct, accurate and complete. Data will need to be pulled from SalesForce to Hadoop, and processed using Map Reduce and/or Spark. Error handling will need to be considered using Elasticsearch / Kibana.

Required experience:

Spark / Map Reduce
Elasticsearch / Kibana
Java
API engineering (REST)
SQL
DevOps (CI / CD)
Data modelling

Preferred experience:

SalesForce
Data lifecycle management
Metadata management (including lineage, provenance)
Atlassian tools (Bamboo, BitBucket, Sonar)

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Data Engineer
Location: Johannesburg
Salary: Annually
The Senior data engineer will be responsible for leading the design, development and governance of the company's enterprise data infrastructure, transitioning from the current SSIS based ETL environment to a modern, scalable, azure-based cloud data warehouse.
3 days ago

Client Support Data Engineer
Location: Johannesburg
Salary: Market-related
Play a key role in supporting clients with data-driven solutions in a growing international software company.
3 days ago

Data Engineer (Contractor)
Location: Johannesburg
Salary: Market-related
Work on impactful data projects with a leading insurance client Johannesburg | R550 per hour | 08:0017:00 | 12-month contract with extension potential
7 days ago

AWS Data Engineer
Location: Johannesburg
Salary:
14 days ago

Azure Data Engineer
Location: Kempton Park
Salary:
14 days ago

Senior Data Engineer - Onsite - JHB or CPT - Contract
Location: South Africa
Salary: R600 - 690 per hour
Senior data engineer - Onsite - JHB or CPT - Contract
15 days ago

Big Data Data Engineer
Location: Johannesburg
Salary:
15 days ago

Data Engineer
Location: Johannesburg
Salary:
15 days ago

Senior Data Engineer
Location: Johannesburg
Salary: market related Monthly
Job Summary:Our client is seeking a highly skilled Senior data engineer with deep expertise in Snowflake and Matillion to design, build, and optimize scalable data pipelines and integration solutions. The ideal candidate will have a strong background in cloud data warehousing, ETL/ELT processes, and modern data architecture. Responsibilities:data Management and API integration.Design, develop...
16 days ago

Data Engineer
Location: Pretoria
Salary: R60 000 per month neg
data engineer - Centurion
17 days ago

Data Engineer x 2

Similar jobs you might be interested in:

Create a free job alert for Data Engineer x 2 in Johannesburg