Big Data Engineer

Recruiter:

A 1L Realization (Pty) Ltd

Job Ref:

JHB000991/Tshid

Date posted:

Thursday, July 2, 2026

Location:

Johannesburg, South Africa

SUMMARY:
Our client in the Connectivity Services sector is looking for a Big Data Engineer on a contract duration of 6 months.

Role Purpose

The Big Data Engineer is responsible for designing, developing and maintaining scalable big data pipelines that ingest, transform and process large volumes of structured and unstructured data. The role supports the delivery of advanced analytics, machine learning and customer insight solutions by building reliable, high-performance data platforms and datasets that enable DataCo's commercial and monetisation objectives.

POSITION INFO:
Key Responsibilities Design, develop and maintain high-volume data ingestion, transformation and processing pipelines using big data technologies. Build scalable audience builder pipelines, customer segmentation layers and ADR-ready datasets to support analytics and monetisation use cases. Develop batch and streaming data pipelines for processing data from telecommunications networks, CRM systems, digital platforms and external data sources. Apply data quality controls, validation, cleansing and enrichment logic to ensure trusted, production-ready datasets. Optimise pipeline performance, scalability and reliability to support high-volume data processing. Collaborate with Solution Architects, Data Scientists, Product Owners and Data Analysts to deliver data products and machine learning solutions. Integrate data from multiple enterprise systems using ETL\/ELT frameworks, APIs and event-driven technologies. Support deployment, monitoring, troubleshooting and continuous improvement of data pipelines. Ensure compliance with data governance, security, privacy and enterprise architecture standards. Produce technical documentation and participate in Agile delivery ceremonies. Qualifications & Experience Bachelor's degree in Computer Science, Information Technology, Data Engineering or a related field. 5-8 years' experience in Big Data Engineering or Data Engineering. Hands-on experience with Apache Spark, Hadoop and distributed data processing frameworks. Strong SQL and programming skills in Python, Scala or Java. Experience with ETL\/ELT development, data lakes, data warehouses and cloud data platforms (AWS, Azure or Google Cloud Platform). Experience with streaming technologies such as Apache Kafka is advantageous. Experience working with telecommunications, customer analytics or digital platforms is preferred. Key Competencies Big Data engineering Apache Spark and Hadoop ETL\/ELT development Data pipeline development and optimisation SQL, Python, Scala or Java Data modelling and transformation Cloud data platforms Performance tuning and troubleshooting Data quality and governance Agile delivery and collaboration

Similar jobs you might be interested in:

Big Data Engineer
Location: Johannesburg
Salary:
Our client in the Connectivity Services sector is looking for a big data engineer on a contract duration of 6 months.Role PurposeThe big data engineer is responsible for designing, developing and maintaining scalable big data pipelines that ingest, transform and process large volumes of structured and unstructured data. The role supports the delivery of advanced analytics, machine learning and cus...
Today

Manager: AI Data Governance and Data Management
Location: Johannesburg
Salary:
Our client in the Communications Technology sector is seeking a Manager: AI data Governance and data Management on a contract duration of 6 months. As the Manager: AI data Governance and data Management, you will be responsible for leading and operationalising a robust AI data governance and data management framework across 16 operating markets ensuring that 65M+ monthly active customers and ...
3 days ago

Full Stack Microsoft Developer Engineer
Location: Pretoria
Salary: 60000 Monthly
Leverage your experience at an established SA technology company.Job Title: Full Stack Microsoft Developer engineerLocation: Waterkloof Ridge, Pretoria Basic Salary: R60K – R85KAbout the CompanyOur client is an established South African technology company that started in 2009. They build top-quality web, mobile, and cloud software for insurance companies and financial businesses across Afric...
26 days ago

Senior Data Engineer
Location: Johannesburg
Salary:
37 days ago

Software Engineer, Machine Learning
Location: Johannesburg
Salary:
69 days ago

Senior Support Engineer (L2/L3 Operations)
Location: Johannesburg
Salary:
Our client in the Telco sector is seeking a Senior Support engineer (L2/L3 Operations) on a contract duration of 6 months.Role PurposeThe Senior Support engineer is responsible for providing advanced (L2/L3) operational support across enterprise data platforms, APIs, analytics systems and digital services. The role ensures rapid incident resolution, deep technical troubleshooting and root-cause an...
Today

Senior Privacy Engineer (Privacy-Enhancing Technologies)
Location: Johannesburg
Salary:
Our client in the Telecommunications & Networking sector is seeking a Senior Privacy engineer (Privacy-Enhancing Technologies) on a contract duration of 6 months.Role PurposeThe Senior Privacy engineer is responsible for designing and implementing privacy-enhancing technologies (PETs) across enterprise data platforms, pipelines and analytics systems. The role ensures that sensitive subscriber,...
Today

MLOps Engineer
Location: Johannesburg
Salary:
Our client in the Network Communications sector is looking for an MLOps engineer on a contract duration of 6 months.Role PurposeThe MLOps engineer is responsible for operationalising machine learning models into scalable, reliable and production-ready services. The role focuses on deploying, monitoring, maintaining and continuously improving ML models in production environments. Model development ...
Today

Platform Engineer
Location: Johannesburg
Salary:
Our client in the Communications Technology sector is seeking a Platform engineer on a contract duration of 6 months.Role PurposeThe Platform engineer is responsible for designing, implementing and maintaining the engineering platform that enables the rapid, secure and reliable delivery of data products, analytics solutions and digital services. The role focuses on building self-service capabiliti...
Today

Procurement Project Manager
Location: Johannesburg
Salary: R39,000.00-R50,000.00
HUAWEI : Procurement Project Manager
1 day ago