Data Architect

Recruiter:

HR Genie

Job Ref:

RM Sept 01

Date posted:

Tuesday, September 7, 2021

Location:

Johannesburg Metro, South Africa

Salary:

R700 - 1,000 per hour

SUMMARY:
Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python a

POSITION INFO:

Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates
Combine and curate data in a central data lake
Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

Specialist Areas:

Strong experience of building large scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake. Experience of managing unstructured file meta-data, conversions, standardisation and related workflows. Experience of building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:

Provides a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Technical Skills

Phyton – Proficient
PySpark - Proficient
SQL – Competent
Solution Architecture – Competent
API Design - Competent
Containers – Competent
CI/CD – Competent
Azure Cloud - Competent
Data Stream patterns and technology – Proficient
Data stream patterns and technology – Proficient
Data engineering design patterns – Competent
Mining data – Beneficialy

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Java Developer (IDIT) Team Lead
Location: Johannesburg
Salary:
Our client in Insurance industry is looking for Java Developer (IDIT) Team Lead Java Team Lead will be responsible for overseeing the development of complex IT platform using Java Enterprise Edition, specifically the IDIT platform. This role includes leading a development team, driving end-to-end project delivery, ensuring technical excellence, and fostering collaboration across business and IT st...
Today

Java Developer (IDIT) Team Lead
Location: Johannesburg
Salary:
Job Purpose:Java Team Lead will be responsible for overseeing the development of a complex IT platform using Java Enterprise Edition, specifically the IDIT platform. This role includes leading a development team, driving end-to-end project delivery, ensuring technical excellence, and fostering collaboration across business and IT stakeholders. The successful candidate will provide both hands-on co...
Today

AWS Cloud Engineer
Location: Pretoria
Salary:
Our client in Pretoria is Hiring an AWS Cloud Engineer.
1 day ago

L2 System Engineer
Location: Sunninghill
Salary:
Our client is seeking a highly skilled L2 Systems Engineer to join their company in Gauteng. This role requires an experienced professional who can lead technical initiatives, drive the transition toward proactive, data-driven and intelligence-led IT services, and ensure strict regulatory and cybersecurity compliance within a Managed Intelligence Platform (MIP) environment.
1 day ago

MS Fabric Data Engineer (JHB/CPT)
Location: Johannesburg
Salary:
1 day ago

Cloud Infrastructure Engineer
Location: Johannesburg
Salary: R250 Per Hour Hourly
Brief Description:Are you an experienced Cloud Infrastructure Engineer ready to take the next step into senior-level responsibility? I’m currently inviting Intermediate to Senior Cloud Engineers to apply for upcoming contract and long-term assignments with various clients across South Africa.
3 days ago

Senior Cloud Architect
Location: Johannesburg
Salary: 1500000 Monthly
Are you an experienced cloud architect with a passion for designing secure, scalable solutions? This is your opportunity to lead enterprise-level cloud projects and shape the future of digital infrastructure.
3 days ago

Intermediate C# Developer with Apache Kafka
Location: Pretoria
Salary:
We are seeking a medium-level C# Developer with strong experience in modern cloud-native application development.The ideal candidate will have proven skills in microservices architecture, containerised deployments, and Azure/Kubernetes orchestration, as well as hands-on production experience with Apache Kafka. The role involves building and maintaining scalable, resilient services that integr...
3 days ago

Senior Actuarial Analyst
Location: Johannesburg
Salary:
Own the analytics engine behind South Africa’s debt review (DR) performance. If you love turning complex lifecycle data into predictive models, sharper workflows, and higher collections, this role lets you build the single source of truth for active DR, pre-Term, and TDR—translating insight into operational and financial impact.
4 days ago

Senior Data Engineer
Location: South Africa
Salary: Annually
Start 2026 like the Cape Town Cycle Tour—fast, focused, and leading the pack! We need a senior data engineer who can architect pipelines that power AI-driven insights. This is your chance to ride the wave of innovation where AI writes 40% of the code, and you steer the strategy.
11 days ago

Data Architect

Similar jobs you might be interested in:

Create a free job alert for Data Architect in Johannesburg Metro