AWS / Cloud Data Engineer

 

Recruiter:

PBT Group

Job Ref:

PBTGR00009

Date posted:

Friday, September 17, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

POSITION INFO:

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

 

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

 

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

 

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

 

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

 

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

AWS Cloud Data Engineer
Location: Pretoria
Salary:
31 days ago


Senior Java Back-End Engineer (Remote)
Location: Johannesburg
Salary: 70000.00 Monthly
Our client, a boutique software engineering firm supporting fintech projects globally, is seeking a Senior Backend Software engineer to architect, develop, and optimize high-performance backend systems. This is a fully remote, work-from-home position.
Today


Cyber Security Engineer
Location: Johannesburg
Salary:
Brief Description:Are you an Cyber Security engineer with a passion for protecting digital assets and securing enterprise environments? Our clients are looking for skilled professionals to join dynamic teams and contribute to robust security initiatives.
Today


Data Engineer - 6 month contract (CPT/JHB)
Location: Johannesburg
Salary: 1000 Monthly
We are seeking a data engineer with strong experience in Snowflake and Matillion to join our data team. The ideal candidate will be responsible for designing, building, and optimising scalable data pipelines and architectures to support business intelligence, analytics, and data science initiatives.Candidate must have ETL, Snowflake and Matillion experience
Today


AI Engineer
Location: Centurion
Salary: Monthly
We are seeking an experienced Head of IT to lead and manage an organisation’s IT infrastructure environments. This role is responsible for ensuring the stability, scalability, and security of all IT systems and supporting power infrastructure, while overseeing vendors, internal governance, and incident response.
1 day ago


Data Engineer (Integration for Data Science Team)
Location: Johannesburg
Salary:
1 day ago


Data Scientist (Integration for Data Science Team)
Location: Johannesburg
Salary:
1 day ago


Full Stack Developer - 2515
Location: Pretoria
Salary: Hourly
Full Stack Developer with ITIL Certification and sound knowledge in Java / JavaScript / Python / C# / Kotlin and Microservices Architectures required for a reputable global company based in Gauteng
3 days ago


Senior Full Stack .NET Developer - (PERMANENT)
Location: Sandton
Salary:
6 days ago


Head of Software Engineering - Hybrid
Location: Sandton
Salary:
7 days ago


Create a free job alert for AWS / Cloud Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions