Senior Data Engineer/ Technical Lead

 

Recruiter:

PBT Group

Job Ref:

133437317

Date posted:

Thursday, June 30, 2022

Location:

Cape Town, South Africa


JOB SUMMARY:
-

JOB DESCRIPTION:

PBT Group has an opportunity for a Senior Data Engineer / Technical Lead. The Senior Data Engineer should be comfortable with solution design & data architecture. Must have experience in migrating legacy to AWS Lambda.

 

Duties:

  • Assist in designing and implementing scalable and robust processes for ingesting and transforming datasets.
  • Design, implement and support the creation and maintenance of data pipelines from a multitude of sources.
  • Ingest large, complex data sets that meet functional and non-functional requirements.
  • Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
  • Design and build bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
  • Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
  • Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
  • Development of API’s for returning data to Enterprise Applications.
  • Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
  • Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.
  • Provide support in the operational environment with all relevant support teams for data services.
  • Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.
  • Support, test and deployment of new services and features.
  • Design and Implement actionable Alerts, Monitoring and Observability using various toolsets that support our resilience including DR activities
  • Design and build Data validation and reconciliation alerts from source

 

Required Skills:

  • Strong modular system design skills.
  • Conventional and data warehouse modeling skills are required, in order to understand the various data models and to define the mappings between them.
  • System analysis and design skills are necessary to design and document the data extractions and transformations.
  • Expert knowledge of the capabilities of the ETL tools being used, to know what their capabilities and shortcomings are – in order to exploit or avoid those aspects in the ETL program designs.
  • Good organisation, planning and basic management skills.
  • Good interpersonal and communication skills.
  • Decision making and problem solving skills.

 

Required Qualifications / Training:

  • Relevant data warehouse and BI solution training is essential.
  • B.Sc. or related degree is advantageous.

 

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Data Engineer (Kafka Streaming, Spark, Iceberg on Kubernetes)
Location: Capetown
Salary: Market-Related
As a senior data engineer, you''ll architect and develop real-time data processing systems that push the boundaries of performance and scalability.
1 day ago


Senior Data Engineer (Snowflake, DBT)
Location: Cape Town
Salary:
19 days ago


Senior Data Engineer (Snowflake, DBT)
Location: Cape Town
Salary:
19 days ago


Data Solutions Architect / Senior Data Engineer
Location: Cape Town
Salary:
19 days ago


Senior Data Engineer
Location: Cape Town
Salary:
What will you do?You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers, from BigQuery and dataproc to Kubernetes and AI Hub. You should idea dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it. We are in the game of taking data and turning it into amazing stories and pretty pi...
22 days ago


Senior Data Engineer – Cape Town – HYBRID – R900 PH
Location: Capetown
Salary: 1728000
senior data engineer – Cape Town – HYBRID – R900 PH
84 days ago


Data Scientist / Senior Software Engineer
Location: Stellenbosch
Salary:
Dare to dive into the dark arts of data? My client seeks a tech conjurer to summon AI and ML magic from massive datasets. If you thrive on real-time systems and scalable spells, this is your haunted calling.
5 days ago


Data Engineer (Senior-Level)
Location: Cape Town
Salary:
7 days ago


Senior Data Science Consultant
Location: Cape Town
Salary:
Today


Data Scientist (Senior-Level)
Location: Cape Town
Salary:
7 days ago


Create a free job alert for Senior Data Engineer/ Technical Lead in Cape Town

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions