Intermediate and Senior Big Data / AWS Data Engineers

Recruiter:

PBT Group

Job Ref:

2445722834

Date posted:

Thursday, May 12, 2022

Location:

Johannesburg, South Africa

JOB SUMMARY:
-

JOB DESCRIPTION:

PBT Group has a requirement for a Big Data / AWS Data Engineer Developer to interpret requirements provided by business and produce effective Big Data solutions and to design and build AWS Cloud ETL pipelines for ingesting and processing of Big Data.

Programming exposure for code transformations and integrating the big data solution with existing systems. Develop information solutions from a variety of sources for both structured and unstructured data. Technical ownership of Big Data solutions for structured and unstructured data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop and implement big data models and solutions

- Design and implement ETL methodologies and technologies and the integration with big data

- Conduct root cause analysis on production issues

- Technical leadership of entire information management process of both structured and unstructured data

- Provide ongoing support and enhancement to ETL system

- Optimization and the information solutions

- Implementing machine learning algorithms

- Configuration of the Hadoop infrastructure and environment for optimal performance

- Integrate with statistical and actuarial analysts to build models

- Producing relevant technical documentation and specifications

- Estimate time and resource requirements for business requirement

- Integration of big data solutions with existing reporting and analytical solutions

- Develop data processing functions (DPF’s) using Java and Python

Experience:

- Data Warehouse principles and practises

- Big Data using Hadoop

- Kimball Methodology

- ETL development

- Data Security and Protection Policies

- AWS cloud

- SQL

- Python

- Scala

- HIVE SQL

Qualifications:

- Matric Essential

- National Diploma in IT (BTech)

- Bachelor of Science (Information Systems, Computer Science, Mathematics) Advantageous

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Intermediate to Senior PHP Developer
Location: Johannesburg
Salary: Monthly
A client in the SaaS industry is looking for a strong PHP Developer to join their corporate client, that is working on a large scale project.
1 day ago

Intermediate to Senior PHP Developer
Location: Johannesburg
Salary: Monthly
A client in the SaaS industry is looking for a strong PHP Developer to join their corporate client, that is working on a large scale project.
11 days ago

Intermediate to Senior Business Analyst
Location: Johannesburg
Salary:
Our client is seeking an intermediate to senior Business Analyst to join their growing development team. This is an excellent opportunity to become part of a dynamic, innovative, and results-driven team that is passionate about delivering cutting-edge solutions. With ample scope to learn new technologies and contribute to exciting projects, this is the perfect time to brin...
11 days ago

Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum
Location: Johannesburg
Salary: 900000
intermediate or senior aws data Engineer – Johannesburg – up to R900k per annum
15 days ago

Senior/Intermediate Software & Firmware Engineer
Location: Centurion
Salary:
We are seeking a senior/intermediate Software & Firmware Engineer to lead the development of embedded systems and device software for our next-generation medical devices. In this role, you’ll be a key contributor to product architecture, design, and development from concept through FDA clearance and beyond. You’ll collaborate cross-functionally with systems engineers, hardware team...
21 days ago

Intermediate & Senior Travel Consultants
Location: Rosebank
Salary: Monthly
Well-known Outbound Travel Company based in Rosebank is looking for energetic, well-travelled and passionate intermediate & senior Travel Consultants. You will provide world-class service by effectively managing and coordinating the selling and booking of holiday packages to an expanding and dedicated clientele to achieve personal and company sales targets in line with the company strateg...
52 days ago

INTERMEDIATE TO SENIOR C# DEVELOPER (BLAZOR & .NET MAUI) - SANDTON UP TO @ R1.08M PA
Location: Johannesburg
Salary: 1080000
intermediate TO senior C# DEVELOPER (BLAZOR & .NET MAUI) - SANDTON UP TO @ R1.08M PA
58 days ago

INTERMEDIATE TO SENIOR C# DEVELOPER (BLAZOR & .NET MAUI) - SANDTON UP TO @ R1.08M PA
Location: Johannesburg
Salary: 1080000
intermediate TO senior C# DEVELOPER (BLAZOR & .NET MAUI) - SANDTON UP TO @ R1.08M PA
59 days ago

Senior Full Stack Angular Developer
Location: Pretoria
Salary:
Are you a passionate and skilled Full Stack Angular Programmer with a strong background in both front-end and back-end development? We are looking for an experienced professional to join our dynamic team, contributing to the design, development, and deployment of cutting-edge web applications.
2 days ago

Senior Data Analyst
Location: Parktown
Salary:
A well established Law Firm in Parktown is seeking a senior data Analyst to join their teamSalary : R30,000 CTC
3 days ago

Intermediate and Senior Big Data / AWS Data Engineers

Similar jobs you might be interested in:

Create a free job alert for Intermediate and Senior Big Data / AWS Data Engineers in Johannesburg