Data Engineer

Recruiter:

Network Recruitment International

Job Ref:

NCS000170/NM

Date posted:

Thursday, June 30, 2022

Location:

Johannesburg, South Africa

Salary:

R620 Hourly

JOB SUMMARY:
A technology focussed individual, data engineers will need to design, configure, develop and deploy data transformations.

The purpose of Global Information Management (IM) is to enable the delivery of business processes, communication, collaboration and knowledge management through the deployment, support and maintenance of enterprise IT/OT technology, infrastructure, applications and Mine Technical systems.

JOB DESCRIPTION:

Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates
Combine and curate data in a central data lake
Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

This work involves analysis, reflection and the use of data over a more extended period, to anticipate problems. It requires knowledge of the overall system and focuses on the direct application and improvement of systems

Key Skills:
· Phyton – Proficient
· PySpark - Proficient
· SQL – Competent
· Solution Architecture – Competent
· API Design - Competent
· Containers – Competent
· CI/CD – Competent
· Azure Cloud - Competent
· Data Stream patterns and technology – Proficient
· Data stream patterns and technology – Proficient
· Data engineering design patterns – Competent
· Mining data – Beneficial

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

2050 - AWS Data Engineer
Location: Pretoria
Salary: Neg Monthly
Large company in Pretoria looking to fill this urgent role. Contracthybrid (2/3 times at the office)
Today

AWS Data Engineer (Expert)
Location: Midrand
Salary:
Join our team as an AWS data engineer (Expert) and leverage your skills in building and maintaining Big data Pipelines using advanced cloud platforms. We seek innovative problem-solvers with expertise in Python, SQL, and AWS services to drive our data initiatives forward. Be part of a collaborative environment where your contributions ensure accurate and secure data management.
Today

SAP Data Engineer BW Focus ADV 2448
Location: Midrand
Salary:
SAP data engineer (SAP BW)long-term contract
4 days ago

Intermediate Data Engineer - Johannesburg – up to R700k per annum
Location: Johannesburg
Salary: 700000
Intermediate data engineer - Johannesburg – up to R700k per annum
4 days ago

Azure Data Engineer – Johannesburg – R800k up to R1mil per annum
Location: Johannesburg
Salary: 1000000
Azure data engineer – Johannesburg – R800k up to R1mil per annum
4 days ago

Data engineer – Johannesburg – up to R900k
Location: Johannesburg
Salary: 900000
data engineer – Johannesburg – up to R900k
7 days ago

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
10 days ago

AWS Data Engineer (Senior) 2517
Location: Pretoria
Salary: Monthly
AWS data engineer
11 days ago

AWS Data Engineer (Expert)
Location: Centurion
Salary:
Join our client as an Expert AWS data engineer in South Africa. Design, implement, and optimize Big data Pipelines using AWS services. Ensure data integrity, security, and compliance while collaborating with teams to integrate solutions. Bring your expertise in AWS technologies and data engineering to drive impactful data solutions.
13 days ago

Data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
Location: Johannesburg
Salary: 1000000
data engineer (AWS and Redshift) - Johannesburg – up to R1mil
25 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Johannesburg