Data Engineer x 2

Recruiter:

Praesignis (Pty) Ltd

Job Ref:

JHB000362/JD

Date posted:

Tuesday, January 5, 2021

Location:

Johannesburg, South Africa

Salary:

Hourly

SUMMARY:
We are looking for a savvy Data Engineer to join our growing team of analytics experts.

POSITION INFO:

Phase 1: data validation between MSSQL and SalesForce, ensuring the volumes are aligned after several rules and transformations have been implemented. Rules in SalesForce have been applied. Rules in MSSQL will need to built using Stored Procs. Error handling will need to be considered using Elasticsearch / Kibana.

Phase 2: validation of SalesForce data fields, ensuring data entities are correct, accurate and complete. Data will need to be pulled from SalesForce to Hadoop, and processed using Map Reduce and/or Spark. Error handling will need to be considered using Elasticsearch / Kibana.

Required experience:

Spark / Map Reduce
Elasticsearch / Kibana
Java
API engineering (REST)
SQL
DevOps (CI / CD)
Data modelling

Preferred experience:

SalesForce
Data lifecycle management
Metadata management (including lineage, provenance)
Atlassian tools (Bamboo, BitBucket, Sonar)

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary: 840000 Annually
Apply here to showcase your data engineer skills! Work with modern tech, big data, and a team that loves clean, scalable solutions.
7 days ago

Data Engineer
Location: Centurion
Salary:
We are recruting for a data engineer, on a 12-month contract.
7 days ago

SQL Data Engineer
Location: Centurion
Salary: market related Monthly
Role PurposeOur client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service. RequirementsTechnical Skills:Advanced proficiency in SQL Transact, SQL Server, SSIS, and SSRS, including performance tuning and query...
8 days ago

SQL Data Engineer (12 month contract)
Location: Centurion
Salary: 1000 Monthly
Our client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service.
9 days ago

AWS Data Engineer
Location: Pretoria North
Salary:
10 days ago

Data Engineer
Location: Centurion
Salary: 550 000 Annually
Are you a data enthusiast who thrives on building smart, scalable data solutions? If you're looking to be part of a tech-forward environment that doesn’t compromise on culture, then this opportunity is calling your name. We’re looking for a solutions-driven data engineer to join a vibrant and growing team.You’ll work closely with Analysts, Actuaries, finance, and software teams t...
11 days ago

Data Engineer
Location: Centurion
Salary:
Our client is seeking a skilled data engineer to join their growing team. If you are passionate about the technical aspects of the data landscape and thrive on building optimized processes that deliver high-quality, reusable datasets, then this could be the perfect opportunity for you.
11 days ago

Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH
Location: Pretoria
Salary: 1152000
data engineer / data Scientist – Midrand / Semi-Remote – R600 PH
11 days ago

Data Engineer
Location: Centurion
Salary: Annually
The data engineer will be responsible for developing best practices and patterns, maintaining our current workloads, and optimizing our data warehouse builds, data pipelines, and data products.
15 days ago

Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum
Location: Johannesburg
Salary: 900000
Intermediate or Senior AWS data engineer – Johannesburg – up to R900k per annum
15 days ago

Data Engineer x 2

Similar jobs you might be interested in:

Create a free job alert for Data Engineer x 2 in Johannesburg