AWS / Cloud Data Engineer

Location: CapeTown, South Africa
Salary: Market Related
Recruiter: PBT Group
Job Ref: BCP0008
Summary: We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

 

 

Job Description

We are looking to hire a skilled AWS Cloud ETL Developer to design and build AWS Cloud ETL pipelines for ingesting and processing of Big data.

 

Your duties will include working with the AWS data lake development team, developing and implementing solutions to facilitate movement of data, testing the solutions and performing third line support for developed solutions.

 

DUTIES:

- Consult with business teams to understand data ingestion and processing requirements

- Develop effective, secure, and fit-for-purpose ETL capabilities to ingest and process data to, from and on the cloud

- Identify suitable cloud components on the basis of performance, cost-effectiveness, security, and other relevant metrics

- Develop patterns which meet the business objectives, follow best practices, and are extendable or re-usable

- Follow the software development lifecycle

- Test and troubleshoot solution characteristics

- Provide documentation on how your solution should be used, and train business teams how to use them

- Provide third line support for developed solutions, including troubleshooting and implementing corrective measures, tuning and optimisation, and monitoring.

- Identify and assist with improvements to developed solutions, on the basis of operational excellence, security, reliability, performance efficiency and cost optimisation.

- Manage time effectively through planning and prioritisation of activities

- Discuss and communicate progress with the development team and stakeholders

 

EXPERIENCE:

- Be familiar with modern cloud concepts and best practices.

- Must have development experience on traditional relational databases and with big data technologies.

- Extensive knowledge of coding languages especially Python, PySpark and SQL.

- Experience working with AWS cloud technologies for processing business data

- Solid knowledge / experience with Business Intelligence architectures, best practices & principles and techniques.

- Proven work experience as a Data Engineer developing ETL code, pipelines and data engineering

- Understand and integrate with common Enterprise IT components such as Active Directory, virtual machines, shares, etc

- Ability to troubleshoot and solve complex technical problems

- Experience managing the software development lifecycle

- Creative problem-solving skills around data engineering and data integration.

- The ability to prioritise activities and deliver on time

- Be willing and able to learn and adapt to the changing tech landscape

- Have a positive attitude and strong written and verbal communication and interpersonal skills

 

ADVANTAGEOUS SKILLS:

- Data warehousing experience

- Big data experience

- Relevant AWS cloud certification/s

- Experience with Terraform

 

QUALIFICATIONS/ CERTIFICATION:

- Bachelor’s degree in Computer Science, Information Technology, Data Engineering or related field

- Ideally have at least one relevant AWS cloud certification

 

New users - Upload your CV                      Existing users - Login here

 

Similar jobs your might be interested in:

AWS / Cloud Data Engineer
CapeTown
We are looking to hire a skilled aws cloud ETL Developer to design and build aws cloud ETL pipelines for ingesting and processing of Big data.
25 days ago


Python Software Engineer
CapeTown
Python Software engineer
1 day ago


QUALITY ENGINEER (PAROW INDUSTRIA)
Capetown
Automotive Manufacturing concern Is currently seeking a Quality engineer for their operations in the Parow Industria area
1 day ago


PROCESS ENGINEER (PAROW INDUSTRIA)
Capetown
Automotive Manufacturing concern Is currently seeking a Process engineer for their operations in the Parow Industria area
1 day ago


Preventative Maintenance Engineer
Capetown
Our client based in the Northern Suburbs is seeking to appoint a Preventative Maintenance engineer with applicable experience in the manufacturing industry. The ideal candidate will have experience and a passion for management, planning and organizin...
2 days ago


Business Intelligence Engineer
Capetown
A next-generation online digital giant is seeking a QlikView/ Qlik Sense expert to join their high performing team. Work in a fast-paced environment offering exposure to the bleeding-edge of technology, highly competitive salaries, international expo...
2 days ago


Unix Systems Engineer
Capetown
CAREER OPPORTUNITY | This is a very technical, hands-on opportunity for a Senior Unix Systems engineer to be part of the Core Unix Operations Support team responsible for maintaining the customer service level agreements with respect to the companyâ...
2 days ago


Process Engineer / Projects (ref:1957)
Capetown
Position available for a Process engineer / Projects at Manufacturing company in the Northern Suburbs of Cape Town.
3 days ago


Platform Engineer / Devops
Capetown
STOP! You have to read about this EXCITING opportunity ! It’s a CAREER CHANGING ONE !! LOOKING FOR A PLATFORM engineer WITH GKE
3 days ago


Preventative Maintenance Engineer
Capetown
PREVENTATIVE MAINTENANCE engineer Our client based in the Northern Suburbs is seeking to appoint a Maintenance engineer with applicable experience in the manufacturing industry.
3 days ago


Active Service Support Engineer
Capetown
To provide immediate first line support and daily assistance of all service support related issues.
4 days ago


 

Create a free job alert for                                

AWS / Cloud Data Engineer in CapeTown

Enter your email address below
and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you. By giving us your email address your agree to our Terms and Conditions