Lead / Senior Azure Data Engineer

 

Recruiter:

Pro Worx

Job Ref:

1010819

Date posted:

Thursday, August 19, 2021

Location:

Johannesburg, South Africa

Salary:

Monthly salary


SUMMARY:
Lead / Senior Azure Data Engineer required for remote work opportunity.

POSITION INFO:

Purpose:

Perform a leadership role across various projects. Technology focussed individual able to design, configure, develop, deploy and support data and analytics application. Must be able to work in a fluid environment with changing requirements whilst maintaining absolute attention to detail. The data and analytics solution will be developed using wide range of azure technology services serving to varied architecture pattern needs.

Key Responsibilities:

  • Develop, test, operate and support the end-to-end batch, near real time data and analytics solution.
  • Build stream pipelines and leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
  • Be able to develop quality Python/PySpark and adopt/implement software development best practices to ensure high quality standards are met.
  • Performs thorough code reviews of fellow developers and ensure quality code.
  • Use DevOps knowledge, cloud and data engineering expertise to operate, monitor and troubleshoot the pipelines / code bases.
  • Effectively test and adopt testing frameworks to embed and codify tests.
  • Take technical ownership for the implementation of the solution at an allocated mining site.
  • Clearly communicate and explain concepts to senior stakeholders and key teams during sprint reviews and other programme meetings.
  • Have a clear understanding of agile best practices and proactively collaborate and support the team if needed during the whole sprint cycle.
  • Document technical implementation details and artefacts created as part of the process.
  • Serve data for application and analytics through a variety of technologies such as Delta Lake, SQL DB, CosmosDB and TSI.
  • Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory.
Requirements:
  • Be willing to work with global teams in different time zones. 
  • Relevant degree and certifications
  • Must have Advanced experience in Object oriented programming, data structures, etc. 
  • Creating high-level, low-level design documentation. 
  • Solution architect skills.
  • Experience in Agile Software Development.
  • Experience with Microsoft Azure. 
  • Experience in IoT solution is a big plus. 
Please note: The position may change to onsite depending on the organization. 
 


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Financial Accountant / Team Lead
Location: Centurion
Salary: 480,000 Annually
A leading organisation based in Centurion is seeking an immediately available senior Financial Accountant / Team lead to join their high-performing finance team. The successful candidate will take ownership of key financial processes, oversee junior staff, and ensure accuracy and compliance across reporting and reconciliations.This role is ideal for a technically strong accountant with solid post-...
Today


Senior Backend Software Engineer / Technical Lead
Location: Johannesburg
Salary: 80 000 Monthly
Platform Technical lead / senior Backend Software engineer – Remote (South Africa Only)My client is looking for a senior Backend Software engineer / Platform Technical lead who thrives in fast-paced, collaborative environments and enjoys tackling complex, high-impact challenges that power products used by thousands globally.About My Client:A Digital Communications SaaS company with 20+ years...
3 days ago


Senior Data Science Consultant
Location: South Africa
Salary: market related Monthly
Our client is seeking a full-time senior data Science Consultant with strong data science and consulting expertise to join their dynamic and growing data Science team. Role and Responsibilities:As part of the company data Science team, you will report directly to the Head: data Science.As a senior data Science Consultant, you will be responsible for designing and leading data science projects...
3 days ago


Senior Full Stack .NET Developer - (PERMANENT)
Location: Sandton
Salary:
6 days ago


Senior Data Science Consultant - Remote
Location: South Africa
Salary: 1000 Annually
Our client is seeking a full-time senior data Science Consultant with strong data science and consulting expertise to join their dynamic and growing data Science team.
9 days ago


Senior Data Science Consultant
Location: South Africa
Salary: 1 Monthly
senior data Science Consultant
10 days ago


SharePoint Architect/ Technical Lead - Contract
Location: Sandton
Salary: R650 - 730 per hour
SharePoint Architect/ Technical lead - Contract
10 days ago


SharePoint Developer - Contract
Location: Sandton
Salary: R550 - 600 per hour
SharePoint Developer - Contract
10 days ago


Head of Platform Operations
Location: Pretoria
Salary:
10 days ago


Senior Manager Software Engineering
Location: Johannesburg
Salary: Negotiable
senior Manager Software engineering
13 days ago


Create a free job alert for Lead / Senior Azure Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions