Data Engineer (Senior) 1053

Recruiter:

Open Source (Pty) Ltd

Job Ref:

JHB001965/KMM

Date posted:

Friday, June 5, 2026

Location:

Menlyn, South Africa

SUMMARY:
Data Engineer

We are seeking a highly skilled Data Engineer to join our growing data team, with a core focus on designing and delivering scalable, cloud-based data platforms. This role centres on building robust data pipelines, enabling high-quality data for analytics and reporting, and driving modern data engineering practices across the organisation. You will work closely with stakeholders, BI teams, and fellow engineers to transform complex data into valuable business insights.

POSITION INFO:

Essential Skills

Strong hands-on experience with Python (3.x) and PySpark for large-scale data processing
Minimum 3+ years working with AWS services such as Athena, Glue, Lambda, S3, and ECS
Experience with NoSQL (DynamoDB) and relational databases (Oracle/PostgreSQL), including advanced Oracle SQL
Proven experience with Oracle Cloud Infrastructure (OCI) services
Expertise in data formats and schema design including Parquet, AVRO, JSON, XML and CSV
Solid experience building ETL pipelines using AWS Glue or similar tools
Experience with Docker and containerisation (Kubernetes/OpenShift advantageous)
Strong scripting skills (Bash, PowerShell) and familiarity with Linux/Unix environments
Hands-on experience with data quality frameworks and validation techniques
Familiarity with DevOps practices, including Terraform/CloudFormation, CI/CD pipelines, Git, and Jenkins

Role & Responsibilities

Design, build, and maintain scalable data pipelines and ETL workflows
Develop Python and PySpark applications for data transformation at scale
Implement and optimise data lakes and data warehouses on cloud platforms
Ensure data quality, integrity, and consistency through testing and validation
Translate business requirements into technical data models and specifications
Review and propose solution architectures and design alternatives
Manage and support cloud infrastructure and CI/CD pipelines
Produce and maintain technical documentation, runbooks, and artefacts
Support production environments, including monitoring, troubleshooting, and incident management
Collaborate with BI teams to optimise data for tools such as Tableau and Business Objects
Mentor and support team members, contributing to knowledge sharing and capability building
Actively participate in Agile ceremonies and continuous improvement initiatives

Must Haves (Non-Negotiable)

Minimum 3–5 years’ experience as a Data Engineer
Proven expertise in Python, PySpark, and cloud-based data engineering (AWS and/or OCI)
Strong experience in ETL development and data pipeline design
Solid understanding of data modelling and schema design (non low-code approaches)
Hands-on experience with both relational and NoSQL databases
Experience with cloud infrastructure, CI/CD pipelines, and DevOps practices
Ability to work in cross-functional teams and deliver in Agile environments

Advantageous Skills

Experience with Kafka, AWS Kinesis, or streaming data platforms
Knowledge of AWS Redshift, EMR, and other analytical/warehouse solutions
Familiarity with enterprise cloud data frameworks (e.g., BMW Cloud Data Hub or similar)
Experience with Java/JEE and application servers
Exposure to monitoring tools such as CloudWatch and Grafana
AWS certifications (e.g., AWS Certified Cloud Practitioner)
Experience building and integrating REST APIs
Experience with MongoDB or other NoSQL technologies
Understanding of BI schema design and reporting optimisation

Qualifications

Relevant degree in IT, Computer Science, Engineering, or equivalent practical experience
3–5 years of hands-on experience in data engineering roles
Cloud certifications such as AWS or Oracle Cloud certifications are highly desirable
Advanced degrees or specialised data engineering certifications are advantageous

Similar jobs you might be interested in:

Data Engineer (Senior) 1053
Location: Menlyn
Salary:
data engineer We are seeking a highly skilled data engineer to join our growing data team, with a core focus on designing and delivering scalable, cloud-based data platforms. This role centres on building robust data pipelines, enabling high-quality data for analytics and reporting, and driving modern data engineering practices across the organisation. You will work closely with stakeholders,...
Today

Data Engineer (Senior) 0641
Location: Menlyn
Salary:
senior data engineer (Cloud & Big data)We are seeking a senior data engineer to design, build, and optimize scalable data solutions in a cloud-first, enterprise environment. This role is suited to someone who can take ownership of complex data pipelines, collaborate across teams, and drive best practices in data engineering and DevOps.
15 days ago

Senior Data Engineer
Location: Johannesburg
Salary:
10 days ago

Senior Data Engineer
Location: Pretoria
Salary: R70 000
Lexdan Select is assisting a Financial Services company with their search for a senior data engineer. Based in Pretoria.
18 days ago

Senior Informatica Data Engineer
Location: Johannesburg
Salary:
21 days ago

Senior Data Engineer
Location: Johannesburg
Salary: Monthly
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.We are looking for a senior data engineer to join our financial services client on a contract basis (hybrid).
22 days ago

Senior Data Engineer (Lead)
Location: Pretoria
Salary:
An exciting opportunity exists for a highly skilled senior data engineer / data Lead to join a leading client in the financial services sector on an 18-month fixed-term contract. This role is ideal for a data professional who can combine strong technical engineering capability with leadership, stakeholder engagement, and data management expertise.The successful candidate will play a critical role ...
29 days ago

Senior Infrastructure & Data Protection Engineer | Johannesburg | Permanent
Location: Johannesburg
Salary:
74 days ago

Data Engineer – Banking / Financial Services
Location: Johannesburg
Salary:
Today

Data Engineer
Location: Johannesburg
Salary:
We’re looking for a data-driven professional with a strong analytics mindset to join a growing team. This role is ideal for someone who enjoys working hands-on with data, uncovering insights, and supporting business decisions.
3 days ago