Lead Data Engineer

SUMMARY:
One of our business associates that is popular in the software industry is currently looking for a Lead Data Engineer for their ever-rising organization. Successful applicant must be influential and multi-disciplined. This opportunity will come great rewards and fringe benefits

POSITION INFO:

Description:

Leveraging a thorough understanding of the business data requirements & own data subject matter expertise (ahead of trend), set data architecture direction & lead the agile solution design, deployment, implementation & ongoing optimization of enterprise wide data retrieval, storage and distribution across an estate.

Education:

Skills:

• 5- 8 years’ experience with designing and building, BI systems and complex data eco systems
• 5 + years’ experience working in Big data environment (advantageous for all, a must for high volume
• environments) – optimising and building big data pipelines, architectures and data sets with e.g. Java,
• Scala, Python, Hadoop, Apache Spark and Kafka
• Cross domain knowledge
• Architecture
• Infrastructure
• Logical & physical design of data structures
• Testing
• Web Applications & specifically knowledge of data design patterns used within web applications
• Service Side
• Influencing
• Automation
• Messaging
• Solutioning
• SSL Security including expertise in encryption methods & data transfer across systems
• CI/CD etc.

·         Experience as an agile practitioner and knowledge or experience of other delivery methodologies e.g.

·         Kanban, RUP etc.

·         Excellent communication, analytical skills and decision-making ability in collaborative environments

·         Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript

·         Solid understanding of Object-Oriented Design and ability to properly apply general design patterns and paradigms

·         Experience with test-driven development and domain driven design

·         Solid understanding of messaging protocols and web services like and REST

·         Experience with open-source relational and NoSQL databases

·         Advanced knowledge of SQL e.g. query authoring

·         Knowledge of systems such as Windows, Linux etc

·         Knowledge of application server containers: Tomcat, Jetty, JBoss, NodeJS, IIS, .Net Core etc.

·         Good understanding of frameworks and libraries like, jQuery, TypeScript, HTML, CSS

·         Experience with CI / CD tools (like Jenkins, Bamboo, TFS,) and Artefact Management (preferably Nexus),

·         Experience with Cloud platforms e.g. AWS & Google Cloud Platform

·         Ability to create and maintain sophisticated CI / CD pipelines

·         Strong understanding of version control and related concepts and techniques, particularly Git

·         Experience with appropriate unit testing framework(s)

·         Excellent debugging and problem-solving skills.

·         Comfortable with stubbing tools like wire mock and/or hoverfly

·         Experience with scripting languages like Bash and/or Python

·         Familiar with OAuth, Open Connect ID and SAML, preferably with an understanding of AD / LDAP /

·         Kerberos

·         Familiar with Containerisation technologies like Docker & or orchestrators like Kubernetes

Please visit our website www.communicate.co.za to submit your CV directly or to view other I.T related jobs.   If you have not had any response in two weeks, please consider your application unsuccessful. Your profile will be kept on our database for any other suitable positions.

We also invite you to contact us to discuss other exciting career opportunities in our niche area! For more information, please call Lufuno Mokwebo on 087 ----- or email on lmokwebo@communicate.co.za  

·         Experience as an agile practitioner and knowledge or experience of other delivery methodologies e.g.

·         Kanban, RUP etc.

·         Excellent communication, analytical skills and decision-making ability in collaborative environments

·         Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript

·         Solid understanding of Object-Oriented Design and ability to properly apply general design patterns and paradigms

·         Experience with test-driven development and domain driven design

·         Solid understanding of messaging protocols and web services like and REST

·         Experience with open-source relational and NoSQL databases

·         Advanced knowledge of SQL e.g. query authoring

·         Knowledge of systems such as Windows, Linux etc

·         Knowledge of application server containers: Tomcat, Jetty, JBoss, NodeJS, IIS, .Net Core etc.

·         Good understanding of frameworks and libraries like, jQuery, TypeScript, HTML, CSS

·         Experience with CI / CD tools (like Jenkins, Bamboo, TFS,) and Artefact Management (preferably Nexus),

·         Experience with Cloud platforms e.g. AWS & Google Cloud Platform

·         Ability to create and maintain sophisticated CI / CD pipelines

·         Strong understanding of version control and related concepts and techniques, particularly Git

·         Experience with appropriate unit testing framework(s)

·         Excellent debugging and problem-solving skills.

·         Comfortable with stubbing tools like wire mock and/or hoverfly

·         Experience with scripting languages like Bash and/or Python

·         Familiar with OAuth, Open Connect ID and SAML, preferably with an understanding of AD / LDAP /

·         Kerberos

·         Familiar with Containerisation technologies like Docker & or orchestrators like Kubernetes

Please visit our website www.communicate.co.za to submit your CV directly or to view other I.T related jobs.   If you have not had any response in two weeks, please consider your application unsuccessful. Your profile will be kept on our database for any other suitable positions.

We also invite you to contact us to discuss other exciting career opportunities in our niche area! For more information, please call Lufuno Mokwebo on 087 ----- or email on --------Please upload your CV here-------->  

NB! This job is now closed. You can apply for other jobs by uploading your CV.