Intermediate and Senior Big Data / AWS Data Engineers

 

Recruiter:

PBT Group

Job Ref:

2445722834

Date posted:

Thursday, May 12, 2022

Location:

Johannesburg, South Africa


JOB SUMMARY:
-

JOB DESCRIPTION:

PBT Group has a requirement for a Big Data / AWS Data Engineer Developer to interpret requirements provided by business and produce effective Big Data solutions and to design and build AWS Cloud ETL pipelines for ingesting and processing of Big Data.

 

Programming exposure for code transformations and integrating the big data solution with existing systems. Develop information solutions from a variety of sources for both structured and unstructured data. Technical ownership of Big Data solutions for structured and unstructured data.

 

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

 

 

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop and implement big data models and solutions

- Design and implement ETL methodologies and technologies and the integration with big data

- Conduct root cause analysis on production issues

- Technical leadership of entire information management process of both structured and unstructured data

- Provide ongoing support and enhancement to ETL system

- Optimization and the information solutions

- Implementing machine learning algorithms

- Configuration of the Hadoop infrastructure and environment for optimal performance

- Integrate with statistical and actuarial analysts to build models

- Producing relevant technical documentation and specifications

- Estimate time and resource requirements for business requirement

- Integration of big data solutions with existing reporting and analytical solutions

- Develop data processing functions (DPF’s) using Java and Python

 

Experience:

- Data Warehouse principles and practises

- Big Data using Hadoop

- Kimball Methodology

- ETL development

- Data Security and Protection Policies

- AWS cloud

- SQL

- Python

- Scala

- HIVE SQL

 

Qualifications:

- Matric Essential

- National Diploma in IT (BTech)

- Bachelor of Science (Information Systems, Computer Science, Mathematics) Advantageous

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

IT Audit Manager
Location: Johannesburg
Salary: 1100000 Annually
A leading insurance provider known for its commitment to innovation and excellence, is currently seeking a highly skilled and experienced Audit Manager specialising in data Analytics to join their dynamic team.
9 days ago


Senior Data Warehouse Developer
Location: Centurion
Salary:
19 days ago


Project Architect
Location: Johannesburg
Salary: CTC
Project Architect
Today


SharePoint Architect/ Technical Lead - Contract
Location: Sandton
Salary: R650 - 730 per hour
SharePoint Architect/ Technical Lead - Contract
1 day ago


SharePoint Developer - Contract
Location: Sandton
Salary: R550 - 600 per hour
SharePoint Developer - Contract
1 day ago


Senior Credit Controller
Location: Johannesburg
Salary: 430000 Annually
 Are you passionate about credit control and financial excellence?If managing complex accounts, reducing risk, and keeping cash flow healthy is what drives you, then this senior Credit Controller opportunity in the FMCG industry could be your next big career move.
1 day ago


Bookkeeper
Location: Centurion
Salary: R18000 to R22500 p/m
The successful candidate will be responsible for capturing transactions, performing reconciliations, and maintaining accurate financial records, while assisting with various ad-hoc finance tasks as required.
1 day ago


Bookkeeper
Location: Centurion
Salary: R18000 to R22500 p/m
The successful candidate will be responsible for capturing transactions, performing reconciliations, and maintaining accurate financial records, while assisting with various ad-hoc finance tasks as required.
1 day ago


Bookkeeper
Location: Centurion
Salary: R18000 to R22500 p/m
The successful candidate will be responsible for capturing transactions, performing reconciliations, and maintaining accurate financial records, while assisting with various ad-hoc finance tasks as required.
1 day ago


Senior Credit Controller
Location: Johannesburg
Salary: 400000 Annually
Are you the Sherlock Holmes of numbers, spotting risks before they appear and turning overdue balances into business wins? A FMCG powerhouse is looking for a senior Credit Controller who’s not just about chasing payments, but about driving smart, strategic credit decisions that keep the cash flowing and customers happy.
2 days ago


Create a free job alert for Intermediate and Senior Big Data / AWS Data Engineers in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions