Lead Big Data Lab Engineer

SUMMARY:
Permanent. Cape Town

POSITION INFO:

We require a Lead Engineer for our Big Data Lab team to provide input into the strategic direction of the team and its activities, whilst ensuring sound integration and implementation, throughout the organisation, partnering with a number of stakeholders and cross-functional teams. You will lead and participate in a variety of projects and provide guidelines on development patterns standards and best practices. You will lead a team and act as a subject matter expert on all things data engineering, whilst staying up to date with the latest technology stacks, patterns and trends.

As a generalist in a Big Data role you will help the company to establish a variety of innovative projects through the integration of data engineering, software engineering and machine learning skills of resources in the team.

Job Objectives:
• Maintain a clear and aligned vision and mission statement for the data and acting as key input to the strategic direction of the division.
• Analyse and understand the functional business requirements as defined by the Business Analysts, owners and other stakeholders as input to understanding various stakeholders impacted by activities related to the Data Lab.
• Maintain technical architecture and technical documentation not residing with the architecture team.
• Ensure team members follow best practices and establish procedures for DevSecOps.
• Provide strategic facilitation that leads to a short and long-term roadmap with clear deliverable description, expectations, timings.
• Present the latest projects, development patterns and techniques in knowledge sharing and community of practice sessions.
• Facilitate daily team standup sessions and ensure Sprint tasks are updated daily.
• Facilitate Sprint backlog grooming, planning and reviews.
• Initiate meetings and/or attend meetings with key stakeholders to establish requirements and provide feedback.
• Provide consolidated weekly feedback on project statuses, incidents and delivery estimates.
• Ensure all team members and stakeholders commit their work to source control.
• Ensure alignment of functional areas, key performance areas and establishing aligned, measurable and clear key performance indicators and development plans for all team members.
• Identify skill gaps and training needs of team members.
• Facilitate hackathons, competitions and projects with students and other groups as identified.
• Stay up to date with the latest technology stacks, patterns and trends.
• Take ownership to gain knowledge of the retail environment and share that knowledge across the team.

Required Qualifications & Experience:
• Completed Degree+ in Information Systems, or B.Sc Comp Sci or similar.
• 5 years or more experience in a Senior Data Engineering or similar role, managing or providing guidance to technology architecture frameworks, policies, procedures and guidelines.
• Experience specific requirements:
- Proven track record managing a Data Lab/ Data Engineering team, delivering within the functional domains:
- Business Intelligence (BI Developer with knowledge of traditional Data Warehouse concepts).
- Data Engineering skills (Big Data, Hadoop, Spark). AWS (EMR, S3, Athena, RDS, Lambda, API Gateway).
- Solid understanding of the Software Development Life Cycle (SDLC). User requirements analysis.
- Solution architecture design.
- Strong SQL skills, particularly on Big Data.
• Experience within the FMCG, retail sector or similar where you have demonstrable knowledge of technological and data practices and an understanding of the data and development execution in this space.
• Exposure to statutory requirements, applying and monitoring relevant laws, regulations and best practices as they relate to Big Data, technology architecture and development.

NB! This job is now closed. You can apply for other jobs by uploading your CV.