Lead Big Data Lab Engineer

 

Recruiter:

Progressive Edge

Job Ref:

PEJR013

Date posted:

Wednesday, July 14, 2021

Location:

CapeTown, South Africa

Salary:

Market related


SUMMARY:
Permanent. Cape Town

POSITION INFO:

We require a Lead Engineer for our Big Data Lab team to provide input into the strategic direction of the team and its activities, whilst ensuring sound integration and implementation, throughout the organisation, partnering with a number of stakeholders and cross-functional teams. You will lead and participate in a variety of projects and provide guidelines on development patterns standards and best practices. You will lead a team and act as a subject matter expert on all things data engineering, whilst staying up to date with the latest technology stacks, patterns and trends.

As a generalist in a Big Data role you will help the company to establish a variety of innovative projects through the integration of data engineering, software engineering and machine learning skills of resources in the team.

Job Objectives:
• Maintain a clear and aligned vision and mission statement for the data and acting as key input to the strategic direction of the division.
• Analyse and understand the functional business requirements as defined by the Business Analysts, owners and other stakeholders as input to understanding various stakeholders impacted by activities related to the Data Lab.
• Maintain technical architecture and technical documentation not residing with the architecture team.
• Ensure team members follow best practices and establish procedures for DevSecOps.
• Provide strategic facilitation that leads to a short and long-term roadmap with clear deliverable description, expectations, timings.
• Present the latest projects, development patterns and techniques in knowledge sharing and community of practice sessions.
• Facilitate daily team standup sessions and ensure Sprint tasks are updated daily.
• Facilitate Sprint backlog grooming, planning and reviews.
• Initiate meetings and/or attend meetings with key stakeholders to establish requirements and provide feedback.
• Provide consolidated weekly feedback on project statuses, incidents and delivery estimates.
• Ensure all team members and stakeholders commit their work to source control.
• Ensure alignment of functional areas, key performance areas and establishing aligned, measurable and clear key performance indicators and development plans for all team members.
• Identify skill gaps and training needs of team members.
• Facilitate hackathons, competitions and projects with students and other groups as identified.
• Stay up to date with the latest technology stacks, patterns and trends.
• Take ownership to gain knowledge of the retail environment and share that knowledge across the team.

Required Qualifications & Experience:
• Completed Degree+ in Information Systems, or B.Sc Comp Sci or similar.
• 5 years or more experience in a Senior Data Engineering or similar role, managing or providing guidance to technology architecture frameworks, policies, procedures and guidelines.
• Experience specific requirements:
- Proven track record managing a Data Lab/ Data Engineering team, delivering within the functional domains:
- Business Intelligence (BI Developer with knowledge of traditional Data Warehouse concepts).
- Data Engineering skills (Big Data, Hadoop, Spark). AWS (EMR, S3, Athena, RDS, Lambda, API Gateway).
- Solid understanding of the Software Development Life Cycle (SDLC). User requirements analysis.
- Solution architecture design.
- Strong SQL skills, particularly on Big Data.
• Experience within the FMCG, retail sector or similar where you have demonstrable knowledge of technological and data practices and an understanding of the data and development execution in this space.
• Exposure to statutory requirements, applying and monitoring relevant laws, regulations and best practices as they relate to Big Data, technology architecture and development.



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Head of Sales
Location: Cape Town
Salary:
87 days ago


Business Development Manager
Location: Cape Town
Salary: R28 000 Monthly
Ready to lead, close big deals, and drive growth?A top courier company in Cape Town is looking for a powerhouse Business Development Manager to take corporate sales to the next level!
1 day ago


Operations Financial Manager
Location: Cape Town
Salary: R1 100 000
If you’re a Finance Operations Manager who thrives in high-volume, high-impact environments where budgets are massive, operations move fast, and financial insight shapes the entire retail strategy, then this opportunity within a JSE listed Retail group is your next power move. And if you're someone who can turn numbers into strategy, trends into action, and store performance into profitabili...
4 days ago


General Manager
Location: Cape Town
Salary:
A stylish 5-star urban hotel is looking for a strong GENERAL MANAGER
38 days ago


Lead Structural Engineer
Location: Cape Town
Salary: 1 200 000 Annually
Design. lead. Build the Future. We’re looking for a Senior Structural engineer who thrives on big ideas, bold designs, and seeing their work come to life. This is your chance to take the lead on major projects — from concept to construction — and leave your mark on skylines that matter.
18 days ago


Senior Retail Financial Manager
Location: Cape Town
Salary:
If you’re a CA(SA) who lives for problem-solving, spotting risks before they bite, and steering big retail operations with calm confidence, this one’s worth your attention. This role puts you right at the centre of decision-making, supporting teams across operations, property, and HR - and your voice actually matters here.You’ll join a well-known national retailer with massive sc...
29 days ago


Finance Operations Manager
Location: Cape Town
Salary: R1 200 000
If you’re a Finance Operations Manager who thrives in high-volume, high-impact environments where budgets are massive, operations move fast, and financial insight shapes the entire retail strategy  then this opportunity within a JSE-listed Retail Group is your next power move.And if you're someone who can turn numbers into strategy, trends into action, and store performance into profita...
29 days ago


Marketing Coordinator
Location: Stellenbosch
Salary: Monthly
Ready to spice up your marketing career?  Our awesome client – a big name in the food manufacturing scene in Kraaifontein – is on the hunt for a dynamic Marketing Coordinator to join their vibrant team! If you’re a marketing enthusiast who thrives on creativity, loves learning new tricks, thinks outside the (lunch)box, and can juggle multiple tasks in a fast-paced environment, this could be...
29 days ago


Talent Delivery Lead (SaaS)
Location: Capetown
Salary: Market Related Base dependent on level & Incentives/Commission
lead delivery in a boutique search firm!
70 days ago


Researcher - Corporate Meeting Development
Location: Table View
Salary: R12k - 20k per month + Commission
Researcher - Corporate Meeting Development Table View R12000 - R20000 + Commission
1 day ago


Create a free job alert for Lead Big Data Lab Engineer in CapeTown

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions