Data Engineer

Recruiter:

Network Recruitment International

Job Ref:

NCM000166/MM

Date posted:

Thursday, June 30, 2022

Location:

Johannesburg, South Africa

Salary:

500 Hourly

JOB SUMMARY:
One of my clients in the consulting space is looking for a Data Engineer to design, configure, develop and deploy data transformations. 12 months contract position
This person will develop ETL pipelines in Azure Databricks using Python and on Azure SQL using T-SQL and deploy using ARM templates, combine and curate data in a central data lake, with strong knowledge of standard BI concepts as mandatory, build pipelines using other Azure stream technologies and with strong attention to detail.

JOB DESCRIPTION:

Formal qualifications:
An undergraduate qualification (Bachelor's degree or equivalent) in the relevant IM discipline and/or Technical competencies and certification with relevant years of experience in a similar role.

Role-specific knowledge:

Data Lake
Data Modeling
Data Architecture
Azure Data Environment

Specialist Areas:

Unstructured Data - Applies to any products that handle large-scale data such as images.
Strong experience in building large-scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake.
Experience managing unstructured file meta-data, conversions, standardization, and related workflows.
Experience in building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:
Provide a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Skills:

Python
PySpark
SQL
Solution Architecture
API Design
Containers
CI/CD
Azure Cloud
Data Stream patterns and technology
Data stream patterns and technology
Data engineering design patterns
Mining data

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary: 840000 Annually
Apply here to showcase your data engineer skills! Work with modern tech, big data, and a team that loves clean, scalable solutions.
7 days ago

Data Engineer
Location: Centurion
Salary:
We are recruting for a data engineer, on a 12-month contract.
7 days ago

SQL Data Engineer
Location: Centurion
Salary: market related Monthly
Role PurposeOur client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service. RequirementsTechnical Skills:Advanced proficiency in SQL Transact, SQL Server, SSIS, and SSRS, including performance tuning and query...
8 days ago

SQL Data Engineer (12 month contract)
Location: Centurion
Salary: 1000 Monthly
Our client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service.
9 days ago

AWS Data Engineer
Location: Pretoria North
Salary:
10 days ago

Data Engineer
Location: Centurion
Salary: 550 000 Annually
Are you a data enthusiast who thrives on building smart, scalable data solutions? If you're looking to be part of a tech-forward environment that doesn’t compromise on culture, then this opportunity is calling your name. We’re looking for a solutions-driven data engineer to join a vibrant and growing team.You’ll work closely with Analysts, Actuaries, finance, and software teams t...
11 days ago

Data Engineer
Location: Centurion
Salary:
Our client is seeking a skilled data engineer to join their growing team. If you are passionate about the technical aspects of the data landscape and thrive on building optimized processes that deliver high-quality, reusable datasets, then this could be the perfect opportunity for you.
11 days ago

Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH
Location: Pretoria
Salary: 1152000
data engineer / data Scientist – Midrand / Semi-Remote – R600 PH
11 days ago

Data Engineer
Location: Centurion
Salary: Annually
The data engineer will be responsible for developing best practices and patterns, maintaining our current workloads, and optimizing our data warehouse builds, data pipelines, and data products.
15 days ago

Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum
Location: Johannesburg
Salary: 900000
Intermediate or Senior AWS data engineer – Johannesburg – up to R900k per annum
15 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Johannesburg