Senior Data Engineer with AWS G1775

Recruiter:

Open Source (Pty) Ltd

Job Ref:

CPT001124/PV

Date posted:

Tuesday, December 21, 2021

Location:

Midrand, South Africa

SUMMARY:
We are currently recruiting for a Senior Data Engineer with extensive experience in AWS. The ideal candidate will have a minimum of 8 years experience in an expert level role.

Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark.
Experience with building data pipelines and applications to stream and process datasets at low latencies.
Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning of high-level data structures.
Experience designing and supporting large-scale distributed systems in a production environment

AWS Solid understanding of Components - VPC | IAM. Above average experience/understanding of AWS Components:

Lambda
DynamoDB
Param Store
Secrets Manager
Athena
Glue
CloudWatch
Step Function
SNS
Code Build/Pipeline
CloudFormation
S3

Strong experience/understanding of:

Python 3x
SQL
Py Spark
Boto3
Terraform
ETL
Docker
Linux / Unix
Big Data
Oracle/PostgreSQL
Powershell / Bash

POSITION INFO:
Role Tasks:

Coordination between development and support environments
Assisting with the business case
Planning and monitoring
Eliciting requirements
Requirements organisation
Translating and simplifying requirements
Requirements management and communication
Requirements analysis
Document requirements in appropriate format depending on methodology followed
Assist with identification and management of risks

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum
Location: Johannesburg
Salary: 900000
Intermediate or senior aws data engineer – Johannesburg – up to R900k per annum
15 days ago

Senior AWS Data Engineer
Location: Centurion
Salary:
Are you passionate about building scalable data solutions in the cloud? We’re looking for a senior aws data engineer to play a key role in designing and maintaining robust data platforms that power real business outcomes.
17 days ago

Senior Data Operations Engineer
Location: Johannesburg
Salary:
22 days ago

Senior Data Analyst
Location: Parktown
Salary:
A well established Law Firm in Parktown is seeking a senior data Analyst to join their teamSalary : R30,000 CTC
3 days ago

Senior Forensic Data Administrator
Location: Centurion
Salary:
An Internal Vacancy exists for a senior Forensic data Administrator in the Specialised Services Division based in Centurion – Head OfficeThe suitable candidate’s main responsibilities and duties include, but are not limited to, the following:
3 days ago

Senior Data Devolper
Location: Johannesburg
Salary: R70k - 80k per month
Developer with relevant Experience
7 days ago

Senior Data Scientist â Machine Learning AI
Location: Johannesburg
Salary:
Build the Future of AI-Driven Customer Engagement. Are you fluent in Python and passionate about shaping the future of intelligent conversations? We’re searching for an AI engineer who’s ready to design, build, and scale voice bots, chatbots, and next-gen NLP solutions, including for under-served African languages. If you thrive at the intersection of language, data, and innovation, th...
7 days ago

Senior Data Analyst
Location: Johannesburg
Salary: Annually
The senior data Analyst will be responsible for interpreting business requirements, maintaining and enhancing existing reports, ensuring data quality and delivering actionable insights through data models and dashboards.
15 days ago

Senior Data Analyst
Location: Johannesburg
Salary: 600 000 Annually
Do you thrive in environments where your analytical skills and data storytelling drive real impact? A well-established South African insurance company is on the hunt for a senior data Analyst to join their IT team. This is your opportunity to step into a leadership role where you’ll guide a team of Analysts and work closely with engineers and stakeholders to bring data to life through dashbo...
17 days ago

Senior Data Analyst
Location: Johannesburg
Salary:
21 days ago

Senior Data Engineer with AWS G1775

Similar jobs you might be interested in:

Create a free job alert for Senior Data Engineer with AWS G1775 in Midrand