Senior Data Engineer

SUMMARY:
A global tech-driven powerhouse behind some of the world’s leading digital gaming and betting platforms is looking for a Senior Data Engineer to help drive a large-scale transformation to a modern, cloud-native data infrastructure.

POSITION INFO:
You won’t just support data systems - you’ll reshape them.

This role is central to migrating from legacy on-prem environments to a cutting-edge lake house architecture. You’ll lead the charge in designing scalable pipelines, building real-time data flows, and mentoring future data leaders - all while leveraging the latest in cloud technologies.

Duties:

• Design, build, and maintain robust pipelines in hybrid environments (on-prem & cloud).
• Lead the migration of systems to cloud lake house platforms like Delta Lake or Apache Hudi.
• Implement real-time streaming solutions using Kafka or RabbitMQ.
• Optimize SQL queries and database structures for performance and scale.
• Develop scalable data models for cloud-native analytics.
• Collaborate across teams to integrate data sources into a single platform.
• Mentor junior engineers and foster a culture of technical excellence.
• Stay ahead of industry trends and guide architectural evolution.

• Matric (Grade 12)
• Qualification in Computer Science or Software Engineering.

• 5+ years in data engineering or related roles.
• Strong SQL skills (queries, optimization, stored procedures).
• Proficient in Python, Java, or Scala.
• Experience with cloud platforms like AWS Redshift, Azure Synapse, or Google BigQuery.
• Hands-on knowledge of lake house technologies (Delta Lake, Apache Iceberg, etc.).
• Expertise in streaming platforms (Kafka, RabbitMQ).
• Skilled in both on-prem and cloud data modelling.
• Confident mentoring and guiding junior team members.
• Experience with big data frameworks (Spark, Flink, Hadoop).
• Knowledge of Docker, Kubernetes, and CI/CD for data workflows.
• Real-time analytics and event-driven architectures in cloud settings.
• Experience with cloud cost optimization and hybrid data environments.
• Proficiency in C#, Bash, or PowerShell scripting
• Terraform or other IaC tooling.

• Strong experience with cloud data services such as AWS Redshift, Azure Synapse, or Google BigQuery, along with the ability to design, build, and optimize scalable cloud-based data pipelines.
• Expertise in SQL for querying, optimization, and stored procedures, as well as designing data models that support both on-premises and cloud-based systems.
• Proficiency in real-time data streaming using platforms like Kafka or RabbitMQ, ensuring efficient and scalable data flows for high-performance systems.
• Strong ability to mentor junior engineers, fostering a collaborative team environment and helping others build their skills and expertise in cloud data engineering.
• Continuous learning and staying updated on the latest cloud technologies and lake house architectures (e.g., Delta Lake, Apache Iceberg) to ensure the team is at the forefront of industry standards.