Lead Data Engineer

 

Recruiter:

Communicate Recruitment: IT 2

Job Ref:

CER010759/LM

Date posted:

Monday, August 23, 2021

Location:

Johannesburg, South Africa

Salary:

R700 000 Annually


SUMMARY:
One of our business associates that is popular in the software industry is currently looking for a Lead Data Engineer for their ever-rising organization. Successful applicant must be influential and multi-disciplined. This opportunity will come great rewards and fringe benefits

POSITION INFO:

Description:

 

Leveraging a thorough understanding of the business data requirements & own data subject matter expertise (ahead of trend), set data architecture direction & lead the agile solution design, deployment, implementation & ongoing optimization of enterprise wide data retrieval, storage and distribution across an estate.

 

Education:

 

B-Degree in Computer Science OR; equivalent level of industry certification in Technical field &

essential if minimum requirements of experience & practical application in the following is evident.

 

 

Skills:

 

  • 5- 8 years’ experience with designing and building, BI systems and complex data eco systems
  • 5 + years’ experience working in Big data environment (advantageous for all, a must for high volume
  • environments) – optimising and building big data pipelines, architectures and data sets with e.g. Java,
  • Scala, Python, Hadoop, Apache Spark and Kafka
  • Cross domain knowledge
  • Architecture
  • Infrastructure
  • Logical & physical design of data structures
  • Testing
  • Web Applications & specifically knowledge of data design patterns used within web applications
  • Service Side
  • Influencing
  • Automation
  • Messaging
  • Solutioning
  • SSL Security including expertise in encryption methods & data transfer across systems
  • CI/CD etc.

·         Experience as an agile practitioner and knowledge or experience of other delivery methodologies e.g.

·         Kanban, RUP etc.

·         Excellent communication, analytical skills and decision-making ability in collaborative environments

·         Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript

·         Solid understanding of Object-Oriented Design and ability to properly apply general design patterns and paradigms

·         Experience with test-driven development and domain driven design

·         Solid understanding of messaging protocols and web services like and REST

·         Experience with open-source relational and NoSQL databases

·         Advanced knowledge of SQL e.g. query authoring

·         Knowledge of systems such as Windows, Linux etc

·         Knowledge of application server containers: Tomcat, Jetty, JBoss, NodeJS, IIS, .Net Core etc.

·         Good understanding of frameworks and libraries like, jQuery, TypeScript, HTML, CSS

·         Experience with CI / CD tools (like Jenkins, Bamboo, TFS,) and Artefact Management (preferably Nexus),

·         Experience with Cloud platforms e.g. AWS & Google Cloud Platform

·         Ability to create and maintain sophisticated CI / CD pipelines

·         Strong understanding of version control and related concepts and techniques, particularly Git

·         Experience with appropriate unit testing framework(s)

·         Excellent debugging and problem-solving skills.

·         Comfortable with stubbing tools like wire mock and/or hoverfly

·         Experience with scripting languages like Bash and/or Python

·         Familiar with OAuth, Open Connect ID and SAML, preferably with an understanding of AD / LDAP /

·         Kerberos

 

·         Familiar with Containerisation technologies like Docker & or orchestrators like Kubernetes

 

Please visit our website www.communicate.co.za to submit your CV directly or to view other I.T related jobs.   If you have not had any response in two weeks, please consider your application unsuccessful. Your profile will be kept on our database for any other suitable positions.

 

We also invite you to contact us to discuss other exciting career opportunities in our niche area! For more information, please call Lufuno Mokwebo on 087 ----- or email on lmokwebo@communicate.co.za  

 

·         Experience as an agile practitioner and knowledge or experience of other delivery methodologies e.g.

·         Kanban, RUP etc.

·         Excellent communication, analytical skills and decision-making ability in collaborative environments

·         Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript

·         Solid understanding of Object-Oriented Design and ability to properly apply general design patterns and paradigms

·         Experience with test-driven development and domain driven design

·         Solid understanding of messaging protocols and web services like and REST

·         Experience with open-source relational and NoSQL databases

·         Advanced knowledge of SQL e.g. query authoring

·         Knowledge of systems such as Windows, Linux etc

·         Knowledge of application server containers: Tomcat, Jetty, JBoss, NodeJS, IIS, .Net Core etc.

·         Good understanding of frameworks and libraries like, jQuery, TypeScript, HTML, CSS

·         Experience with CI / CD tools (like Jenkins, Bamboo, TFS,) and Artefact Management (preferably Nexus),

·         Experience with Cloud platforms e.g. AWS & Google Cloud Platform

·         Ability to create and maintain sophisticated CI / CD pipelines

·         Strong understanding of version control and related concepts and techniques, particularly Git

·         Experience with appropriate unit testing framework(s)

·         Excellent debugging and problem-solving skills.

·         Comfortable with stubbing tools like wire mock and/or hoverfly

·         Experience with scripting languages like Bash and/or Python

·         Familiar with OAuth, Open Connect ID and SAML, preferably with an understanding of AD / LDAP /

·         Kerberos

·         Familiar with Containerisation technologies like Docker & or orchestrators like Kubernetes

 

 

 

 

 

 

Please visit our website www.communicate.co.za to submit your CV directly or to view other I.T related jobs.   If you have not had any response in two weeks, please consider your application unsuccessful. Your profile will be kept on our database for any other suitable positions.

We also invite you to contact us to discuss other exciting career opportunities in our niche area! For more information, please call Lufuno Mokwebo on 087 ----- or email on --------Please upload your CV here-------->  

 



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Technical Consultant
Location: Johannesburg
Salary: Monthly
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.We are looking for a Senior Technical Consultant (Storage, Backup & Infrastructure) to join our financial services client based in Sandton on a 12-month contract.
7 days ago


Systems Engineer: Genetec
Location: Pretoria
Salary: R1.5 million per annum (cost to company)
Our client, a longstanding proudly South African manufacturing concern, currently seeks your systems engineering experience to provide team leadership for the support, maintenance and enhancement of electronic security functional software and infrastructure with a focus on configuration, analysis, testing and general application and hardware support.
11 days ago


Quality Manager
Location: Johannesburg
Salary: 550000 Annually
Our client is seeking an experienced Quality Manager to lead the company’s Quality Management function and ensure that all products, services, and processes meet the highest standards of performance and compliance. The successful candidate will be responsible for maintaining and improving the Quality Management System (QMS), driving continuous improvement initiatives, and ensuring adherence ...
18 days ago


Senior Project Engineer Mechanical/Mining
Location: Johannesburg
Salary: Market-related
This role is for a seasoned professional with strong EPCM experience to lead complex projects from design through to execution. Joburg, Mining and minerals processing sector, 8:00 am - 17:00 pm, R150,000 – R220,000 CTC per month
18 days ago


Senior Project Engineer Mechanical/Mining
Location: Johannesburg
Salary: market related
The purpose of this role is to deliver engineering solutions across major projects while ensuring technical excellence and compliance.
20 days ago


Specialist Support Engineer (Virtualisation & Storage Infrastructure)
Location: Johannesburg
Salary: Annually
This position is based in the MIS department, reporting to the MIS Operations Manager.
22 days ago


Senior Data Engineer (Spark & Python Specialist)
Location: South Africa
Salary: Market Related Monthly
Role:Our client is seeking a Senior Cloud data engineer to join their engineering team at the company. In this role, you will be a key technical contributor responsible for building, optimizing, and maintaining high-performance data processing engines. You will apply your deep expertise in Spark Best Practices to develop modular, portable PySpark applications, ensuring the companies platform ...
22 days ago


Senior Design Engineer (Land Systems) Pretoria | Defence & Armoured Vehicle Engineering
Location: Pretoria
Salary: Competitive
Design vehicles built for the toughest environments. lead the development of advanced land systems that must perform when it matters most.
32 days ago


Electrical Engineer
Location: Johannesburg
Salary:
Job Title: Electrical engineer  Location: Gauteng (Randfontein) Industry: Water Treatment & OEM Type:   Full-Time     / Environment: Technical, project-driven, solutions-focused About the Role Our client, a well-established player in the water treatment and OEM sector, is seeking a skilled Electrical engineer to take responsibility for the design, execution, and manag...
34 days ago


Technical Marketing Engineer
Location: Johannesburg
Salary: R550 000.00
Drives data‑driven sales and product readiness by bridging engineering, supply chain, and commercial strategy.
41 days ago


Create a free job alert for Lead Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions