Intermediate and Senior Big Data / AWS Data Engineers

Recruiter:

PBT Group

Job Ref:

2445722834

Date posted:

Thursday, May 12, 2022

Location:

Johannesburg, South Africa

JOB SUMMARY:
-

JOB DESCRIPTION:

PBT Group has a requirement for a Big Data / AWS Data Engineer Developer to interpret requirements provided by business and produce effective Big Data solutions and to design and build AWS Cloud ETL pipelines for ingesting and processing of Big Data.

Programming exposure for code transformations and integrating the big data solution with existing systems. Develop information solutions from a variety of sources for both structured and unstructured data. Technical ownership of Big Data solutions for structured and unstructured data.

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop and implement big data models and solutions

- Design and implement ETL methodologies and technologies and the integration with big data

- Conduct root cause analysis on production issues

- Technical leadership of entire information management process of both structured and unstructured data

- Provide ongoing support and enhancement to ETL system

- Optimization and the information solutions

- Implementing machine learning algorithms

- Configuration of the Hadoop infrastructure and environment for optimal performance

- Integrate with statistical and actuarial analysts to build models

- Producing relevant technical documentation and specifications

- Estimate time and resource requirements for business requirement

- Integration of big data solutions with existing reporting and analytical solutions

- Develop data processing functions (DPF’s) using Java and Python

Experience:

- Data Warehouse principles and practises

- Big Data using Hadoop

- Kimball Methodology

- ETL development

- Data Security and Protection Policies

- AWS cloud

- SQL

- Python

- Scala

- HIVE SQL

Qualifications:

- Matric Essential

- National Diploma in IT (BTech)

- Bachelor of Science (Information Systems, Computer Science, Mathematics) Advantageous

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Graphic Designer and Web Developer (Intermediate - Senior)
Location: Johannesburg
Salary: Market-related
Join a team in Houghton for a role that demands a unique blend of creative flair, technical expertise, and precision. Sandton, Johannesburg
8 days ago

Junior BI Developer
Location: Johannesburg
Salary:
An excellent entry level opportunity for an aspiring business intelligence professional eager to build strong technical foundations while working with data reporting and modern Microsoft technologies.
13 days ago

Intermediate Full Stack Software Developer
Location: Johannesburg
Salary: 30000.00 Monthly
Our client is looking for an intermediate Full Stack Developer to join their innovative and collaborative development team.
16 days ago

System Analyst
Location: Rivonia
Salary:
3 days ago

Junior BI Developer
Location: Johannesburg
Salary:
Are you detail-driven, curious, and eager to grow your career in Business Intelligence?Our client, a leading direct selling company, is seeking a Junior BI Developer to join their development team and help design, deliver, and maintain BI solutions that power smarter decision-making across the organisation.This is the perfect role for someone with foundational Microsoft data skills who is ready to...
4 days ago

ShortâTerm (NonâLife) Pricing Actuary
Location: Johannesburg
Salary:
ShortâTerm (NonâLife) Pricing ActuaryA fantastic opportunity for an intermediate Actuary to specialise in ShortâTerm (NonâLife) Pricing, gaining handsâon exposure to live portfolios while progressing steadily toward FASSA qualification in a supportive, dataâdriven environment.This role is within a wellâestablished ShortâTerm Insurance business that places strong emphasis on pricing...
6 days ago

Junior Database Administrator (SQL & Open Source)
Location: Midrand
Salary: 25000 Monthly
Job Title:Junior database Administrator (SQL & Open Source databases)Work Model:Hybrid Contract Term:3 Years Main Purpose of the Job:The Junior database Administrator is responsible for supporting and maintaining Massmart’s enterprise database environment across retail and data centre platforms. The role ensures the availability, performance, and stability of critical database ...
6 days ago

Sales Administrator
Location: Sandton
Salary: Market related
The Sales Administrator shall ensure all compliance Policies and Procedures are adhered to, that all
9 days ago

Senior Internal Auditor
Location: Johannesburg
Salary: Market Related
An experienced senior Internal Auditor to be responsible for planning, leading, executing and reviewing financial, operational, compliance and IT audits to evaluate the effectiveness of risk management, internal controls and governance processes.
9 days ago

Senior Credit Controller
Location: Johannesburg
Salary:
Are you a results-driven credit professional who thrives on balancing firm credit control with strong customer relationships?
14 days ago

Intermediate and Senior Big Data / AWS Data Engineers

Similar jobs you might be interested in:

Create a free job alert for Intermediate and Senior Big Data / AWS Data Engineers in Johannesburg