Lead Data Engineer

 

Recruiter:

Belmar Personnel

Job Ref:

Lead Data Engineer

Date posted:

Wednesday, July 14, 2021

Location:

CapeTown, South Africa

Salary:

R60 000 - R70 000 per month


SUMMARY:
Lead Data Engineer

POSITION INFO:

Qualification

  • Degree in information technology / mathematics / engineering / actuarial science or related discipline. 

Experience

  • 8+ Years’ in a technical data role, preferably in a formal data, data warehouse or business intelligence environment. 

The Lead Data Engineer is responsible for creating business value by leading a team that apply data engineering and data management disciplines to design and build data solutions that enable data driven decision support, in order to optimize business decisions and processes.

Data Solutions

Sourcing data

  • Identify data sources that can add value to decision making.
  • Work with source system owners and analysts to understand source data, e.g. data profiling, definition and mapping.

Loading data

  • Design and implement efficient data loads, using traditional structured data ETL techniques.
  • Design and implement real time and near real time data load solutions, using technologies like data streaming.
  • Design and implement unstructured data loads, e.g. text speech, images and video.
  • Design and implement load monitoring tools and procedures and perform continuous monitoring and optimising of loads.

Storing data

  • Work with analysts and architect to design and implement effective and efficient data warehouse data models using appropriate modelling techniques.
  • Design and implement data pipelines for ad hoc, unstructured and other data models. 

Enhancing data

  • Design and implement appropriate aggregation data structures that enhance usability of data, e.g. multi- dimensional OLAP structures, summary tables etc.
  • Design, implement and maintain appropriate indexing on tables to enhance speed of access.
  • Design and implement data models that support automated decision making and/or further analytics.
  • Continuously search for data elements from other sources to enhance existing data objects to supplement/ enhance context.

Managing data

  • Design and implement data monitoring solutions and procedures and continuously monitor and maintain integrity of existing environment, troubleshoot technical and data issues and make appropriate changes where required.
  • Design and implement meta-data solutions that assist with understanding and managing data.
  • Work together with business owners, analysts and IT to manage changes to data in the organization and maintain good data governance.
    • Provide technical and data related support to source system teams and external parties with whom we exchange data.
    • Manage data growth and usage by implementing effective strategies, e.g. archiving and indexing.
    • Manage systems, technology and tools that enable data management and analytics and liaise with IT infrastructure and IT Operations regarding system and infrastructure management.

 Personal, People and Functional leadership

  • Take ownership of own work by delivering high quality work on time.
  • Show initiative and be pre-active in finding opportunities to improve data and/or processes.
  • Take ownership of own career development by continuously improving skills, knowledge and the application thereof in designing and implementing solutions.
    • Positive engagement in team activities and actively contribute ideas to improve team dynamics and performance.
    • Cross functional data and team knowledge gathering and sharing.
    • Responsible for team activities, team dynamics and performance.
    • Manage project and task delivery of team as well as quality control there off.
    • Functional Competencies
      • SQL
      • Data analysis
      • Data visualisation
      • Data modelling
      • Microsoft business intelligence data technologies (SSIS, SSAS, SQL Server)
      • Data warehouse concepts and best practices


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Data Lead / Senior Data Scientist - Klapmuts
Location: Klapmuts
Salary:
Our client in the Boland is in need of a data lead.
14 days ago


Senior Data Engineering Technical Lead
Location: Cape Town
Salary: Monthly
We’re looking for a Senior data engineering Technical lead who thrives on solving complex problems at scale. This role offers the opportunity to lead enterprise-grade data initiatives, design and build high-performance data platforms, and work hands-on with petabyte-scale systems in modern cloud environments.
16 days ago


Senior Data Engineer
Location: Cape Town
Salary:
8 days ago


Junior to Intermediate Helpdesk Engineer
Location: Cape Town
Salary: Annually
The Helpdesk L3 engineer will be responsible for tickets and solving issues.
8 days ago


Document Controller - Construction
Location: Cape Town
Salary:
Are you currently working in a Construction/New Energy company managing the document and administration flow for successful follow through of all projects?Our “New Energy” client, based in the Cape Town Waterfront, requires a high-energy meticulous document multitasker to coordinate and manage all documentation and compliance between contractors & document submissions.Travel at tim...
12 days ago


Senior Backend Engineer
Location: Capetown
Salary: Market Related
Senior Backend engineer
6 days ago


Construction Admin Support Specialist to Project Managers
Location: Cape Town
Salary:
Are you currently working in construction or in the "new energy" sector supporting the project managers in the engineering team managing the full life cycle of all documents for projects from START to FINISH?Our “New Energy” client, based in the Cape Town CBD, is seeking a versatile, high-energy multitasker to coordinate all administration aspects of this exciting role.Travel required ...
14 days ago


Support Document Coordinator - Project Engineers & Construction Management
Location: Cape Town
Salary:
Is your experience managing all controlled documents during the project structuring and execution phases in a construction environment?Our “New Energy” client, based in the Cape Town CBD, is seeking a versatile, high-energy multitasker to coordinate and enhance the integration of the Document Management System, manage due diligence reviews, ensure compliance, and facilitate seamless co...
18 days ago


C++ Software Engineer (Somerset West)
Location: Capetown
Salary: up to R1.3 million pa depending on exp
A well-established engineering organisation based in Somerset West is seeking an exceptional and passionate Principal / Specialist Software engineer in C++ to join its Application Software Team.
20 days ago


Senior Data Engineer (Spark & Python Specialist)
Location: Cape Town
Salary:
22 days ago


Create a free job alert for Lead Data Engineer in CapeTown

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions