Data Integration Engineer

SUMMARY:
-

POSITION INFO:

PBT Group is a leading data and analytics consultancy, helping organisations unlock value through data-driven transformation. As part of our continued growth, we are expanding our Digital and Data capability to support modern, scalable, and real-time integration across enterprise ecosystems.

Role Overview

We are looking for a highly skilled Data Integration Engineer to design, build, and support modern integration solutions across enterprise systems, applications, APIs, and data platforms.

This role sits at the centre of our transformation journey towards an event-driven, API-enabled architecture, enabling real-time and scalable data exchange. You will play a key role in building backend services, APIs, middleware, and event-based integration solutions that support both operational systems and downstream analytics platforms.

This is a hands-on engineering role suited to someone passionate about distributed systems, cloud-native development, and modern integration patterns.

Key Responsibilities

1. Integration & Backend Engineering

• Design, develop, and maintain backend integration services and middleware.
• Build scalable APIs enabling connectivity across enterprise systems.
• Develop RESTful APIs and asynchronous integration patterns.
• Integrate internal systems, third-party services, and cloud platforms.

2. Event-Driven & Real-Time Architecture

• Design and implement event-driven solutions using Kafka and/or Azure Event Hubs.
• Build real-time and near real-time data pipelines.
• Develop resilient producer and consumer services.
• Implement advanced messaging patterns, including:
  • Routing
  • Retry strategies
  • Dead-letter queues
  • Replay processing

3. Cloud & Platform Engineering

• Develop cloud-native integration services using:
  • Azure Functions
  • Azure API Management (APIM)
  • Azure Event Hubs
  • Azure Databricks
  • Confluent Kafka
• Enable integration into enterprise data and analytics platforms.
• Collaborate with data and platform teams on scalable data exchange solutions.

4. Architecture & Technical Delivery

• Contribute to architecture and solution design for integration platforms.
• Ensure scalability, performance, security, and reliability of integration services.
• Define and promote integration standards and reusable frameworks.
• Support CI/CD pipelines and automated deployments.

5. Monitoring, Support & Governance

• Implement observability (monitoring, logging, alerting) for services.
• Troubleshoot and resolve integration and production issues.
• Ensure adherence to security and governance standards.
• Maintain technical documentation, including:
  • API specifications
  • Architecture diagrams

6. Cross-Functional Collaboration

• Partner with Product, Engineering, Data, and Operations teams.
• Translate business requirements into scalable technical solutions.
• Clearly communicate technical risks, trade-offs, and recommendations.

Minimum Requirements

Essential Experience

• 6–8 years in:
  • Backend engineering
  • Integration engineering
  • Middleware development

Technical Skills

• Strong hands-on experience with:
  • REST APIs
  • Backend services development
  • SQL and relational databases
  • System integration patterns
• Experience with event-driven architectures and distributed systems
• Exposure to:
  • Kafka and/or Azure Event Hubs
  • Azure Functions
  • Azure API Management (APIM)
  • Azure Databricks

Core Competencies

• Strong understanding of:
  • Synchronous vs asynchronous integration patterns
• Proven ability to design scalable, secure, and resilient services
• Strong troubleshooting and analytical problem-solving skills
• Experience working in Agile environments

Preferred / Nice to Have

• CI/CD pipelines and Infrastructure as Code
• Microservices architecture experience
• Cloud-native application design patterns
• Monitoring and observability platforms (e.g., Application Insights, Prometheus, Grafana)
• Data platform integration and streaming analytics

Behavioural Competencies

• Strong communication and stakeholder engagement skills
• Ability to simplify complex technical concepts
• Collaborative team player across cross-functional teams
• Adaptable and comfortable in fast-paced environments
• Curious and passionate about modern engineering and integration practices

Key Performance Indicators (KPIs)

• Delivery of robust, scalable integration solutions
• High reliability and performance of APIs and event-driven services
• Reduction in integration failures and production incidents
• Quality, maintainability, and reusability of code
• Effective monitoring and observability implementation
• Strong collaboration across teams
• Continuous improvement of integration standards
• Contribution to modernising enterprise integration architecture

* In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent

* If you have not received any feedback after 2 weeks, please consider you application as unsuccessful.