Data Engineer

Recruiter:

Network Recruitment International

Job Ref:

NCS000170/NM

Date posted:

Thursday, June 30, 2022

Location:

Johannesburg, South Africa

Salary:

R620 Hourly

JOB SUMMARY:
A technology focussed individual, data engineers will need to design, configure, develop and deploy data transformations.

The purpose of Global Information Management (IM) is to enable the delivery of business processes, communication, collaboration and knowledge management through the deployment, support and maintenance of enterprise IT/OT technology, infrastructure, applications and Mine Technical systems.

JOB DESCRIPTION:

Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates
Combine and curate data in a central data lake
Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

This work involves analysis, reflection and the use of data over a more extended period, to anticipate problems. It requires knowledge of the overall system and focuses on the direct application and improvement of systems

Key Skills:
· Phyton – Proficient
· PySpark - Proficient
· SQL – Competent
· Solution Architecture – Competent
· API Design - Competent
· Containers – Competent
· CI/CD – Competent
· Azure Cloud - Competent
· Data Stream patterns and technology – Proficient
· Data stream patterns and technology – Proficient
· Data engineering design patterns – Competent
· Mining data – Beneficial

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary: Hourly
Our client, a well-established global financial services group with a long-standing presence in South Africa, operating within a highly regulated, data-driven environment, is seeking an Intermediate data engineer to join their team on a 12-month contract. This role offers the opportunity to work in a collaborative environment, combining technical SQL expertise with data-driven insights to sup...
Today

Data Engineer/API Developer
Location: Sandton
Salary:
Today

Junior AWS Data Engineer
Location: Randburg
Salary: R150 Hourly
Our esteemed client is looking for a Junior AWS data engineer for their Hadoop team!
3 days ago

Data Engineer/Scientist - 3407
Location: Pretoria
Salary: Neg Monthly
ð AWS data engineer | Cloud & AnalyticsWe’re looking for an AWS data engineer to build scalable data pipelines, cloud solutions, and dashboards that drive real business decisions.
4 days ago

Lead Data Engineer
Location: Johannesburg
Salary: R90 000 - R115 000
data engineer - Lead
3 days ago

Senior SharePoint Data Engineer
Location: Johannesburg
Salary:
6 days ago

Data Engineer (Microsoft Fabric)
Location: Johannesburg
Salary: Annually
The data engineer will be responsible for enhancing business intelligence, optimising operations and driving data driven decision making. Your Microsoft Fabric experience will help lead the initial phases of a warehouse rework project and support ongoing expansion of our newly created data warehouse within the Microsoft Fabric platform.
7 days ago

Data Engineer
Location: Johannesburg
Salary: Annually
The data engineer will be responsible for developing data architecture and integration pipelines to ensure information accuracy, quality and accessibility.
8 days ago

Data Engineer
Location: Johannesburg
Salary: R 1 000 000 Annually
Are you an experienced data engineer ready to take on a high-impact role? Join a forward-thinking organisation in Sandton and help design scalable data solutions that drive business intelligence. If you have GCP and Big data expertise, this is your chance to make a difference!
9 days ago

Data Engineer
Location: Cote Dâivoire
Salary:
Our client in the Digital Communications sector is looking for a data engineer. Contract for 6 to 12 months.Capabilities to fluently speak and understand French; good English command would be a plusLocation - Côte d’Ivoire
10 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Johannesburg