Data Engineer

Recruiter:

Network Recruitment International

Job Ref:

NCM000166/MM

Date posted:

Thursday, June 30, 2022

Location:

Johannesburg, South Africa

Salary:

500 Hourly

JOB SUMMARY:
One of my clients in the consulting space is looking for a Data Engineer to design, configure, develop and deploy data transformations. 12 months contract position
This person will develop ETL pipelines in Azure Databricks using Python and on Azure SQL using T-SQL and deploy using ARM templates, combine and curate data in a central data lake, with strong knowledge of standard BI concepts as mandatory, build pipelines using other Azure stream technologies and with strong attention to detail.

JOB DESCRIPTION:

Formal qualifications:
An undergraduate qualification (Bachelor's degree or equivalent) in the relevant IM discipline and/or Technical competencies and certification with relevant years of experience in a similar role.

Role-specific knowledge:

Data Lake
Data Modeling
Data Architecture
Azure Data Environment

Specialist Areas:

Unstructured Data - Applies to any products that handle large-scale data such as images.
Strong experience in building large-scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake.
Experience managing unstructured file meta-data, conversions, standardization, and related workflows.
Experience in building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:
Provide a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Skills:

Python
PySpark
SQL
Solution Architecture
API Design
Containers
CI/CD
Azure Cloud
Data Stream patterns and technology
Data stream patterns and technology
Data engineering design patterns
Mining data

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary: 840000 Annually
data doesn’t engineer itself — that’s why we want you. If you are on the lookout for your next data engineer role that will be ground-breaking, then apply here...
4 days ago

Senior Azure Data Engineer
Location: Johannesburg
Salary:
4 days ago

Senior Data Engineer
Location: Johannesburg
Salary: Annual Salary
Are you the BEST Senior data engineer??
5 days ago

Data Engineer
Location: Pretoria
Salary: 850 000 Annually
Are you a skilled data engineer ready to build scalable, high-performance data solutions? Join a dynamic team where your expertise in modern data platforms, cloud technologies, and big data processing will directly support business intelligence, analytics, and client reporting. This is your opportunity to work on impactful projects and grow your career in a forward-thinking environment.
6 days ago

Data Engineer
Location: Johannesburg
Salary: Negotiable
The QA Analyst/engineer will play a vital role in delivering trusted solutions that support business decision-making.
12 days ago

Kafka & Flink Data Engineer
Location: Johannesburg
Salary:
12 days ago

Senior Data Engineer
Location: Centurion
Salary: 700 000 Annually
Are you a seasoned data engineering professional ready to lead high-impact projects in a cutting-edge telemetry and fleet management environment? This is your opportunity to take ownership of technical delivery, drive innovation, and mentor top talent in a role that blends leadership with hands-on engineering excellence.
15 days ago

Data Engineer
Location: Sandton
Salary: Market Related
data engineer
18 days ago

Data Engineer
Location: Pretoria
Salary:
Introduction:Our client, a fast-growing data solutions start-up based in Pretoria East, is looking for a motivated and detail-oriented data engineer to join their dynamic team. This is an exciting opportunity for someone passionate about data, technology, and innovation to contribute to building scalable data systems and play a key role in shaping the company’s data engineering capability.&n...
21 days ago

Data Engineer/Analyst
Location: Pretoria
Salary:
We’re recruiting for a prominent and highly respected bank, offering a 24-month contract opportunity for an experienced data engineer/Analyst. This role is part of the bank’s transformational programme to enhance process efficiency, effectiveness, and quality through business process modelling and engineering.We're looking for a sharp analytical thinker with strong interpersonal skills...
22 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Johannesburg