Lead / Senior Azure Data Engineer

Recruiter:

Pro Worx

Job Ref:

1010819

Date posted:

Thursday, August 19, 2021

Location:

Johannesburg, South Africa

Salary:

Monthly salary

SUMMARY:
Lead / Senior Azure Data Engineer required for remote work opportunity.

POSITION INFO:

Purpose:

Perform a leadership role across various projects. Technology focussed individual able to design, configure, develop, deploy and support data and analytics application. Must be able to work in a fluid environment with changing requirements whilst maintaining absolute attention to detail. The data and analytics solution will be developed using wide range of azure technology services serving to varied architecture pattern needs.

Key Responsibilities:

Develop, test, operate and support the end-to-end batch, near real time data and analytics solution.
Build stream pipelines and leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
Be able to develop quality Python/PySpark and adopt/implement software development best practices to ensure high quality standards are met.
Performs thorough code reviews of fellow developers and ensure quality code.
Use DevOps knowledge, cloud and data engineering expertise to operate, monitor and troubleshoot the pipelines / code bases.
Effectively test and adopt testing frameworks to embed and codify tests.
Take technical ownership for the implementation of the solution at an allocated mining site.
Clearly communicate and explain concepts to senior stakeholders and key teams during sprint reviews and other programme meetings.
Have a clear understanding of agile best practices and proactively collaborate and support the team if needed during the whole sprint cycle.
Document technical implementation details and artefacts created as part of the process.
Serve data for application and analytics through a variety of technologies such as Delta Lake, SQL DB, CosmosDB and TSI.
Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory.

Requirements:

Be willing to work with global teams in different time zones.
Relevant degree and certifications
Must have Advanced experience in Object oriented programming, data structures, etc.
Creating high-level, low-level design documentation.
Solution architect skills.
Experience in Agile Software Development.
Experience with Microsoft Azure.
Experience in IoT solution is a big plus.

Please note: The position may change to onsite depending on the organization.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Engineer Team Lead
Location: Johannesburg
Salary:
60 days ago

Senior Full Stack Engineer
Location: South Africa
Salary: Market Related Monthly
Role:Our client is looking for a highly experienced and driven senior Full Stack engineer with a strong background in enterprise application development using .NET and Angular. This role is perfect for someone who thrives in fast-paced environments and is eager to contribute to scalable, high-performance systems that handle large volumes of data. You will play a pivotal role in designing...
2 days ago

IT Manager
Location: Johannesburg
Salary: Annually
The IT Manager will be responsible for planning, delivery, security and ongoing management of IT systems and services across the SA operations. Ensuring stable, secure and cost-effective IT services IT services that enable business objectives, while leading a local IT Team and managing Vendors, projects and compliance
2 days ago

Lead Data Governance
Location: Johannesburg
Salary: Annually
Are you ready to lead a data transformation at scale? This is a rare opportunity to join South Africa’s market leader in alternative risk transfer solutions and take ownership of building a best-in-class data Management and Analytics Centre of Excellence. In this role, you will shape enterprise-wide data governance and analytics strategies that deliver measurable business value.
2 days ago

Senior Infrastructure Enigneer - Contract
Location: Pretoria
Salary: R400 - 450 per hour
senior Infrastructure Enigneer - Contract
2 days ago

L2 System Engineer
Location: Sunninghill
Salary:
Our client is seeking a highly skilled L2 Systems engineer to join their company in Gauteng. This role requires an experienced professional who can lead technical initiatives, drive the transition toward proactive, data-driven and intelligence-led IT services, and ensure strict regulatory and cybersecurity compliance within a Managed Intelligence Platform (MIP) environment.
3 days ago

Senior Infrastructure Enigneer - Contract
Location: Pretoria
Salary: R400 - 450 per hour
senior Infrastructure Enigneer - Contract
4 days ago

Senior Infrastructure Enigneer - Contract
Location: Pretoria
Salary: R400 - 450 per hour
senior Infrastructure Enigneer - Contract
4 days ago

Senior Infrastructure Engineer
Location: Pretoria
Salary: Market Related Monthly
Job SummaryThe senior Infrastructure engineer is responsible for designing, implementing and maintaining robust ITinfrastructure solutions. This role ensures high availability, security and scalability of systems whileleading infrastructure projects and mentoring junior team members. ResponsibilitiesDesign, implement and manage enterprise-level infrastructure including servers, storage, virtu...
4 days ago

Senior Cloud Architect
Location: Johannesburg
Salary: 1500000 Monthly
Are you an experienced cloud architect with a passion for designing secure, scalable solutions? This is your opportunity to lead enterprise-level cloud projects and shape the future of digital infrastructure.
5 days ago

Lead / Senior Azure Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Lead / Senior Azure Data Engineer in Johannesburg