Data Architect

Recruiter:

HR Genie

Job Ref:

RM Sept 01

Date posted:

Tuesday, September 7, 2021

Location:

Johannesburg Metro, South Africa

Salary:

R700 - 1,000 per hour

SUMMARY:
Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python a

POSITION INFO:

Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates
Combine and curate data in a central data lake
Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

Specialist Areas:

Strong experience of building large scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake. Experience of managing unstructured file meta-data, conversions, standardisation and related workflows. Experience of building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:

Provides a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Technical Skills

Phyton – Proficient
PySpark - Proficient
SQL – Competent
Solution Architecture – Competent
API Design - Competent
Containers – Competent
CI/CD – Competent
Azure Cloud - Competent
Data Stream patterns and technology – Proficient
Data stream patterns and technology – Proficient
Data engineering design patterns – Competent
Mining data – Beneficialy

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Architect
Location: Johannesburg
Salary: 700000
In search of a skilled data architect in JHB!
3 days ago

Data Architect
Location: Johannesburg
Salary: 700000
In search of a skilled data architect in JHB!
12 days ago

Senior Data Architect
Location: Pretoria
Salary: R1. 27m-R1.53 depending on Qual.and Exp.
Pretoria
50 days ago

Cloud Solution Architect
Location: Sandown
Salary:
1 day ago

Storage Engineer
Location: Johannesburg
Salary: 1000 Monthly
The HCI and Storage Engineer will be primarily responsible for installing, monitoring, testing andmaintaining both cloud and on-premises infrastructure solutions, with a specific emphasis on Hyper-Converged Infrastructure (HCI), VxRail, UNITY Storage and VNX(e) Hardware and software This role will involve providing specialised technical support and guidance through high-level analysis,diagnos...
2 days ago

Storage Engineer
Location: Johannesburg
Salary: Market Related Monthly
Main Job Purpose:The HCI and Storage Engineer will be primarily responsible for installing, monitoring, testing andmaintaining both cloud and on-premises infrastructure solutions, with a specific emphasis on Hyper-Converged Infrastructure (HCI), VxRail, UNITY Storage and VNX(e) Hardware and software This role will involve providing specialised technical support and guidance through high-level...
7 days ago

Transformation Verifications to work as Head of Advisory (SaaS BBBEE)
Location: Johannesburg
Salary:
8 days ago

Senior Back-End Developer
Location: Johannesburg
Salary:
Our client, a leading provider of innovative digital banking solutions, is looking for a Senior Back-End Software Engineer to join their team. In this role, you will be a technical leader—designing, optimizing, and owning mission-critical back-end services that power cutting-edge financial applications. As part of a collaborative, remote-first team, you will help shape the technical strategy...
9 days ago

Team Lead MS SQL Engineer - ITIL / COBIT / Azure - Randburg
Location: Randburg
Salary: Market related
Team Lead MS SQL Engineer - ITIL / COBIT / Azure - Randburg Introduction
9 days ago

Team Lead MS SQL Engineer - ITIL / COBIT / Azure - Randburg
Location: Randburg
Salary: Market related
Team Lead MS SQL Engineer - ITIL / COBIT / Azure - Randburg Introduction
9 days ago

Data Architect

Similar jobs you might be interested in:

Create a free job alert for Data Architect in Johannesburg Metro