Data Engineer

Recruiter:

HR Genie

Job Ref:

RM Sept 01

Date posted:

Tuesday, September 7, 2021

Location:

Johannesburg Metro, South Africa

Salary:

R700 - 1,000 per hour

SUMMARY:
Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python a

POSITION INFO:

Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates
Combine and curate data in a central data lake
Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

Specialist Areas:

Strong experience of building large scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake. Experience of managing unstructured file meta-data, conversions, standardisation and related workflows. Experience of building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:

Provides a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Technical Skills

Phyton – Proficient
PySpark - Proficient
SQL – Competent
Solution Architecture – Competent
API Design - Competent
Containers – Competent
CI/CD – Competent
Azure Cloud - Competent
Data Stream patterns and technology – Proficient
Data stream patterns and technology – Proficient
Data engineering design patterns – Competent
Mining data – Beneficialy

Mining experience required.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer
Location: Pretoria
Salary:
Recruit Pro Solutions is partnering with a well-established organisation to identify skilled and motivated data engineers who are passionate about building scalable data solutions and working with modern data platforms. This opportunity is ideal for data professionals who enjoy working across the full data lifecycle and want exposure to exciting, data-driven environments.
Today

MS Fabric Data Engineer (JHB/CPT)
Location: Johannesburg
Salary:
1 day ago

Data Engineer
Location: Johannesburg
Salary:
We are looking for a skilled data engineer,to design, build, and maintain scalable data pipelines and platforms that turn raw data into actionable insights. This permanent role is based in Bryanston, Johannesburg, and offers the opportunity to work with modern data technologies in a collaborative, high-impact environment.
2 days ago

Cloud Data Engineer
Location: Midrand
Salary: Hourly
Brief Description:Are you an experienced Cloud data engineer with a strong background in building scalable, cloud-based data solutions? I’m currently inviting skilled Cloud data engineers to apply for upcoming contract and long-term assignments with various clients across South Africa.
3 days ago

Data Engineer (Senior) 3245
Location: Menlyn
Salary:
data engineer (Senior)long-term contract
4 days ago

Senior Data Engineer
Location: South Africa
Salary: Annually
Start 2026 like the Cape Town Cycle Tour—fast, focused, and leading the pack! We need a senior data engineer who can architect pipelines that power AI-driven insights. This is your chance to ride the wave of innovation where AI writes 40% of the code, and you steer the strategy.
11 days ago

Intermediate Data Engineer
Location: South Africa
Salary: Annually
Kick off 2026 like the Proteas chasing a record score—strategic, powerful, and unstoppable! We’re looking for a data engineer who can turn chaos into clarity and pipelines into performance. AI is your wingman, generating up to 40% of code, so you can focus on the big plays.
12 days ago

Junior Data Engineer
Location: South Africa
Salary: Annually
Start 2026 with a career that’s as exciting as Cape Town’s summer vibe! Join a team where AI is generating up to 40% of code and learn how to build smarter, faster data solutions.
17 days ago

Azure Data Engineer
Location: Johannesburg
Salary: Market-related
Build enterprise-scale data pipelines and modern cloud data solutions in a high-growth environment.
29 days ago

Senior Data Engineer
Location: Johannesburg
Salary:
44 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Johannesburg Metro