Senior Data Engineer Support Resources

SUMMARY:
-

POSITION INFO:

Two senior data engineer support contractors are required for a high-performance data engineering environment. These professionals will operate in a hybrid capacity—combining data engineering and software engineering expertise—to support mission-critical data products and platforms. Candidates must possess deep troubleshooting capabilities and a versatile skill set, especially in on-premise technologies.

The support team operates on a 24x7 schedule, with these roles forming part of the second-line support layer. When not engaged in support tasks, the individuals will contribute directly to delivery activities across various squads.

Tech Stack

• Cloud: AWS Services
• Data Platforms: SAP HANA, Cloudera (including NiFi)
• Languages & Tools: Python
• Infrastructure: Predominantly on-prem with some cloud integration

Role Responsibilities

• Provide 24x7 second-line operational support for data platforms and products.
• Troubleshoot complex issues across a wide range of technologies.
• Collaborate with engineering squads to assist with development and delivery tasks during non-support windows.
• Build and maintain ingestion pipelines that collect and protect data from diverse sources.
• Simplify data transformation processes for SQL users, enabling orchestration through DAGs and other automation.
• Accelerate insights and ML model development by enabling frictionless interaction with platform tools.
• Ensure platform performance through logging, metrics, tracing, SLIs/SLOs, and real-time observability.
• Build platforms that prioritise security and compliance, implementing best practices around encryption, RBAC, VPCs, and IAM integration.
• Employ containerisation and Infrastructure-as-Code (IaC) using Docker and Terraform.
• Participate in architectural discussions and technology spikes, providing recommendations based on hands-on evaluation.
• Mentor junior team members and promote a culture of continuous learning and excellence.

Ideal Candidate Profile

Experience:

• 5+ years in data engineering within a platform or services team
• At least 2 years of recent experience with modern cloud-based technologies

Skills & Mindset:

• Strong independent problem-solver, comfortable with ambiguity
• Demonstrated ownership, initiative, and high agency
• Innovative thinker with a bias toward action
• Comfortable working in fast-paced environments and delivering iteratively
• Cost-conscious and efficiency-driven
• Values diverse perspectives and continuous improvement

Examples of Platform Responsibilities

• Ingestion of data from APIs, enterprise systems, or streaming sources into data lakes/lakehouses
• Use of orchestration platforms like Airflow and analytics tools such as dbt
• Management of data processing and storage platforms (e.g. Snowflake, Databricks)
• Implementing privacy and security measures like data masking and access control
• Enable self-service analytics using tools like PowerBI or Tableau
• Building configurable data services for real-time and batch data processing using Python, SQL, or Spark

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

* If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.

NB! This job is now closed. You can apply for other jobs by uploading your CV.