AWS Data Engineer

 

Recruiter:

PBT Group

Job Ref:

1160435330

Date posted:

Thursday, June 30, 2022

Location:

Cape Town, South Africa


JOB SUMMARY:
-

JOB DESCRIPTION:

PBT Group has an opportunity for an Intermediate Data Engineer. The Data Engineer must have experience in migrating legacy to AWS Lambda.

 

Duties:

  • Assist in designing and implementing scalable and robust processes for ingesting and transforming datasets.
  • Design, implement and support the creation and maintenance of data pipelines from a multitude of sources.
  • Ingest large, complex data sets that meet functional and non-functional requirements.
  • Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
  • Design and build bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
  • Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
  • Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
  • Development of API’s for returning data to Enterprise Applications.
  • Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
  • Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.
  • Provide support in the operational environment with all relevant support teams for data services.
  • Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.
  • Support, test and deployment of new services and features.
  • Design and Implement actionable Alerts, Monitoring and Observability using various toolsets that support our resilience including DR activities
  • Design and build Data validation and reconciliation alerts from source

 

Required Skills:

  • Strong modular system design skills.
  • Conventional and data warehouse modeling skills are required, in order to understand the various data models and to define the mappings between them.
  • System analysis and design skills are necessary to design and document the data extractions and transformations.
  • Expert knowledge of the capabilities of the ETL tools being used, to know what their capabilities and shortcomings are – in order to exploit or avoid those aspects in the ETL program designs.
  • Good organisation, planning and basic management skills.
  • Good interpersonal and communication skills.
  • Decision making and problem solving skills.

 

Required Qualifications / Training:

  • Relevant data warehouse and BI solution training is essential.
  • B.Sc. or related degree is advantageous.

 

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Python Developer (AWS | Data Platforms)
Location: Cape Town
Salary:
7 days ago


BI Developer
Location: Cape Town
Salary:
3 days ago


Data Engineer
Location: Cape Town
Salary:
3 days ago


Data Engineer
Location: Stellenbosch
Salary:
Before action, there must be a fundamental law. A distinguished institution seeks a Natural Philosopher of Systems to uncover and codify the principles governing the chaotic universe of raw information. Your quest is not merely to process data, but to establish its immutable laws of motion—designing the very gravity wells and frictionless planes that compel data to flow with purpose, precisi...
11 days ago


DevOps Engineer (AI/ML)
Location: Bellville
Salary: R75k - 100k per month
DevOps engineer with strong MLOps experience to help operationalize AI and Machine Learning models
18 days ago


Full Stack Engineer (TypeScript, React.js, Node.js & AWS) (CPT - UK Work Hours)
Location: Cape Town
Salary:
35 days ago


AI/ML Engineer (CPT) (26485)
Location: Cape Town
Salary:
42 days ago


Machine Learning Engineer (Model Deployment or MLOps) (CPT Hybrid or Remote)
Location: Cape Town
Salary:
42 days ago


Tech Lead (Systems Engineer) - (CONTRACT)
Location: Cape Town
Salary:
56 days ago


Platform Engineer
Location: Somerset West
Salary:
57 days ago


Create a free job alert for AWS Data Engineer in Cape Town

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions