AWS Data Engineer and Information Team Lead

Recruiter:

PBT Group

Job Ref:

1079874713

Date posted:

Thursday, June 2, 2022

Location:

Johannesburg, South Africa

JOB SUMMARY:
-

JOB DESCRIPTION:

PBT Group has a requirement for a Hadoop Developer to interpret requirements provided by business and produce effective Big Data solutions.

The Hadoop Data and Information specialist will be responsible to design, develop and support application solutions with focus primarily on Hadoop for a Financial Services Environment. This role will play a vital role in building new data pipelines from various structured and unstructured sources into Hadoop. Must be eager to wear multiple hats and be capable of picking up new technologies at a fast pace.

Programming exposure for code transformations and integrating the big data solution with existing systems. Develop information solutions from a variety of sources for both structured and unstructured data. Technical ownership of Big Data solutions for structured and unstructured data.

DUTIES:

Develop and implement big data models and solutions
Design and implement ETL methodologies and technologies and the integration with big data
Conduct root cause analysis on production issues
Technical leadership of entire information management process of both structured and unstructured data
Provide ongoing support and enhancement to ETL system
Optimization and the information solutions
Implementing machine learning algorithms
Configuration of the Hadoop infrastructure and environment for optimal performance
Integrate with statistical and actuarial analysts to build models
Producing relevant technical documentation and specifications
Estimate time and resource requirements for business requirement
Integration of big data solutions with existing reporting and analytical solutions
Develop data processing functions (DPF’s) using Java and Python

SKILLS REQUIRED:

Big Data Developer
Hadoop based architecture with Hortonworks Data Flow & Data Platform clusters
HDF, HBase, Hive, Spark, Storm
AWS experience would be a major advantage.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Specialist Data Scientist
Location: Johannesburg
Salary: 1 200 000
Mission/ Core purpose of the Job:To determine insights and develop statistical models from large quantities of structured and unstructured data to shape or meet specific business needs and goals.Trainingdata science and advanced analytics.data base modelling and data warehousing principles (SQL)big data tools (Spark, Hive, etc)Strong Programming skills (R, SAS, Python, C++, Java, etc…)Compu...
Today

Business Development Manager
Location: Midrand
Salary:
Are you an accomplished and results-driven sales professional with a strong track record of driving revenue growth? Our client is looking for a Business Development Manager to join a fast-growing software services company in Midrand, Gauteng. This is a key role for a strategic thinker who can identify market opportunities and turn them into tangible business success.
1 day ago

Senior Internal Auditor (Operational Audits)
Location: Johannesburg
Salary: 580000 Annually
Ready to take the lead on impactful audits? Apply now and bring your insights to the forefront of operational excellence!
1 day ago

Specialist: Developer (C#)
Location: Johannesburg
Salary: 60000.00 Monthly
Our client is looking for a highly skilled Specialist: C# Developer to join a dynamic development team. The successful candidate will design, develop, and maintain scalable web applications, lead technical projects, and mentor junior developers. This role requires proficiency in both front-end and back-end technologies, strong software architecture knowledge, and experience working within agile me...
3 days ago

DevOps & Infrastructure Lead
Location: Johannesburg
Salary: 70000.00 Monthly
Our client is seeking a strategic DevOps & Infrastructure lead to guide their infrastructure and Tier 2 Support function through a structured transformation into a fully DevOps-driven capability. This senior leadership role combines operational accountability with strategic oversight to ensure the stability, scalability, and modernisation of all critical systems.
3 days ago

Senior Application Developer (.NET)
Location: Johannesburg
Salary:
Ready to take your .NET expertise to the next level? Join a dynamic team in Sandton and work on impactful projects that make a real difference in healthcare and pharmaceutical sectors. This is your chance to thrive in a hybrid environment with flexibility and top-tier benefits!
4 days ago

Team Lead (Mobile Development)
Location: Centurion
Salary: 100000.00 Monthly
Our client is seeking an experienced Mobile Development team lead to oversee native Android and iOS development, mentor a high-performing team, and deliver high-quality mobile solutions in a collaborative hybrid environment.
4 days ago

Lead Developer â Android
Location: Centurion
Salary:
Our client is seeking a skilled Android lead Developer to lead mobile development projects, mentor the team, and deliver innovative Android solutions in a collaborative hybrid environment.
4 days ago

Lead Developer
Location: Centurion
Salary: 90000.00 Monthly
Our client is seeking a technically strong lead Developer to guide complex projects, mentor a development team, and implement innovative solutions in a collaborative, hybrid environment.
4 days ago

Senior Angular Developer
Location: Centurion
Salary: 70000.00 Monthly
Our client is seeking a highly skilled senior Angular Developer with strong experience in Angular 16+ and NgRx. The ideal candidate is technically sharp, a confident communicator, and ready to contribute to complex, high-impact projects in a collaborative environment.
4 days ago

Senior Big Data / Hadoop / AWS Data Engineer and Information Team Lead

Similar jobs you might be interested in:

Create a free job alert for Senior Big Data / Hadoop / AWS Data Engineer and Information Team Lead in Johannesburg