Data Engineer

Recruiter:

Network Recruitment International

Job Ref:

NCM000166/MM

Date posted:

Thursday, June 30, 2022

Location:

Johannesburg, South Africa

Salary:

500 Hourly

JOB SUMMARY:
One of my clients in the consulting space is looking for a Data Engineer to design, configure, develop and deploy data transformations. 12 months contract position
This person will develop ETL pipelines in Azure Databricks using Python and on Azure SQL using T-SQL and deploy using ARM templates, combine and curate data in a central data lake, with strong knowledge of standard BI concepts as mandatory, build pipelines using other Azure stream technologies and with strong attention to detail.

JOB DESCRIPTION:

Formal qualifications:
An undergraduate qualification (Bachelor's degree or equivalent) in the relevant IM discipline and/or Technical competencies and certification with relevant years of experience in a similar role.

Role-specific knowledge:

Data Lake
Data Modeling
Data Architecture
Azure Data Environment

Specialist Areas:

Unstructured Data - Applies to any products that handle large-scale data such as images.
Strong experience in building large-scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake.
Experience managing unstructured file meta-data, conversions, standardization, and related workflows.
Experience in building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:
Provide a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Skills:

Python
PySpark
SQL
Solution Architecture
API Design
Containers
CI/CD
Azure Cloud
Data Stream patterns and technology
Data stream patterns and technology
Data engineering design patterns
Mining data

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

SAP Data Engineer BW Focus ADV 2448
Location: Midrand
Salary:
SAP data engineer (SAP BW)long-term contract
1 day ago

Intermediate Data Engineer - Johannesburg – up to R700k per annum
Location: Johannesburg
Salary: 700000
Intermediate data engineer - Johannesburg – up to R700k per annum
1 day ago

Azure Data Engineer – Johannesburg – R800k up to R1mil per annum
Location: Johannesburg
Salary: 1000000
Azure data engineer – Johannesburg – R800k up to R1mil per annum
1 day ago

Cloud Data Engineer
Location: Johannesburg
Salary:
Cloud data engineer (Azure, Contract)We have a requirement, at our financial services client, for a senior data engineer with extensive technical delivery and experience in the Azure Cloud platform. The purpose of this role includes - Owning and accountability for a large application platform or a collection of application platforms that deliver a capability/ service. Deliver deep speci...
2 days ago

Data engineer – Johannesburg – up to R900k
Location: Johannesburg
Salary: 900000
data engineer – Johannesburg – up to R900k
4 days ago

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
7 days ago

AWS Data Engineer (Senior) 2517
Location: Pretoria
Salary: Monthly
AWS data engineer
8 days ago

AWS Data Engineer (Expert)
Location: Centurion
Salary:
Join our client as an Expert AWS data engineer in South Africa. Design, implement, and optimize Big data Pipelines using AWS services. Ensure data integrity, security, and compliance while collaborating with teams to integrate solutions. Bring your expertise in AWS technologies and data engineering to drive impactful data solutions.
10 days ago

Data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
Location: Johannesburg
Salary: 1000000
data engineer (AWS and Redshift) - Johannesburg – up to R1mil
22 days ago

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
22 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Johannesburg