Cloud Data Engineer

 

Recruiter:

PBT Group

Job Ref:

PBT2527161352

Date posted:

Wednesday, September 15, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
PBT Group has an opportunity for a Cloud Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making.

POSITION INFO:

PBT Group has an opportunity for a Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making. Responsible for the Data Ingestion, Transformation, ETL, Data Modelling, Data Architecture and Storage management.

 

One of the key responsibilities will be the translation of business requirements into usable cloud hosted data architecture, which will include an enterprise data model, associated metadata and common business glossary that are used to guide enterprise solution development and achieve consistency of data assets.

 

The Data Engineer will be responsible to take business requirements, knowledge of current and future state     architecture on data platform design and business capabilities, knowledge of enterprise data standards and   deep data expertise into account, to design data architecture solutions that can be implemented in a cost- effective manner. The specific tasks performed will include analyzing business requirements and translate them into data solutions to address complex business needs. The Lead is required to be innovate and creative in their solutioning and frequently involve multiple platforms, software, hardware, technologies, and tools.

 

Duties:

  • Provide month-end production rotational support to ensure data is consumed and ingested to ensure reports are generated within agreed SLAs with business. Resolve production incidents and conduct root cause analysis for improvement.
  • ETL development into staging and data warehouse environments. Develop new data extracts and modify ETL processes as required to improve reporting datasets.
  • Develop and maintain data sets, ETL processes and reports related in order to support operations and decision making related to commercial and personal insurance, provide direct support to end-users.
  • Collaborate with business users and application developers to provide required data. Estimate the time and resource requirements of ETL development work. Validate data and test routines developed & provision of ongoing maintenance and support of assigned ETL applications
  • Analyse the systems environment to understand how the business systems enable these business processes and how the related data is captured and stored. Analyse the structures in which the data is stored to understand what data can be extracted and how it would be done in an efficient manner.
  • Analyse the existing reporting environment to understand what reporting is available and how this can be utilized or amended to inform the specific Business decisions involved.
  • Test all developments for data accuracy, performance and system impact & engage relevant Business users, train them on report usage and guide them in doing user testing.
  • Schedule data extracts and report runs as required to deliver the required information to users at the necessary frequency. Ensure that scheduled procedures are handed over for monitoring and support by the appropriate resources. Update report specifications to reflect the as-built situation.
  • Update technical documentation on data extracts and report functionality to facilitate future understanding to the extent required for ongoing support. Respond to user queries, error logging and further enhancement requests to ensure reports are used and serve their intended purpose.
  • Provide OLAP support and end-user training on the various cubes used for reporting downstream
  • Data Modelling - emphasizes on what data is needed and how it should be organized instead of what operations need to be performed on the data. Data Model is like architect''s building plan which helps to build a conceptual model and set the relationship between data items. This data capability is required in preparation of the Data Platform implementation, and will also align with the approach taken by Group Data to implement ERWIN as a tool of choice for Data Modelling
  • Data Architecture – ensures that we have composed of models, policies, rules or standards that govern which data is collected, and how it is stored, arranged, integrated, and put to use in data systems and in organizations. This data capability is also aligned with the direction that Group Data is taking

 

Project Related Deliverables and Tasks

Assist the Data Engineering Lead on the below-listed tasks:

 

  • Select and implement the appropriate tools, software, applications, and systems to support cloud data technology goals from the chosen MS Azure stack.
  • Oversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring good data quality.
  • Collaborate with Project & Data Stream Leads, Consultants and business unit leaders for all exercises pertaining to the Data Platform Program.
  • Create and maintain data model and metadata policies and procedures for functional design.
  • Provide technical recommendations and engage with ETL/BI Architects, Business SMEs and other stakeholders throughout the Solution/Data Architecture and implementation lifecycle and recommend effective solutions to develop high performance and highly scalable data solutions (data marts/warehouse and data mining and advanced analytics)
  • Raise and ensure data-related problems in regard to systems integration, compatibility, and multiple-platform integration are addressed.
  • Develop and implement key components as needed to create testing criteria in order to guarantee the reliability and performance of data architecture. Ensure the testing process incorporates Test Automation.
  • Drive a Data Platform environment that enables maintenance of the current and accurate view of the larger data picture, an environment that supports a single version of the truth and is scalable to support future analytical needs.
  • Identify and develop opportunities for data reuse, migration, or retirement and platform upgrades.
  • Communicate with customer, project team in a timely manner and escalates issues & risks appropriately.

 

Experience:

  • 5+ years’ experience of delivering Business Intelligence projects using Microsoft & Informatica tools, Visualization Tools (QlikView, SSRS, Power BI). Insurance background and knowledge preferred.
  • 5 years+ Experience in cloud computing infrastructure (e.g., MS Azure, Amazon Web Services etc.) and considerations for scalable, distributed systems
  • 5 – 7 years’ experience delivering business capabilities in the short-term insurance business, including hands on experience in the development and design of functional and non-functional technical specifications for complex systems
  • Short-term insurance business is a key requirement and not negotiable.
    • Deep knowledge of contemporary architectural principles across the data architectural domain
    • Understanding of the enterprise architecture to ensure on-going alignment, driving the technical roadmap for key applications and platforms.
    • Knowledge of different SDLC Methodologies, preferably Agile
    • Ability to produce solutions using:
      • Microsoft SQL Integration Services, MS SQL Analysis Services, MS SQL Reporting Services, MS PowerBI, QlikView, Informatica (PowerCenter & PWX CDC)
      • Knowledge of & Scaled Agile Framework (SAFe) practices will be advantageous
      • Knowledge of Cloud Services (Azure & AWS) is critical

 

Qualifications/ Certification:

  • Matric,
  • BSc Computer Science, Data Informatics, Information Technology, or any other related degree
  • Cloud Certification is a key requirement


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

AWS Cloud Data Engineer
Location: Pretoria
Salary:
31 days ago


Marketing & Data Cloud Consultant
Location: Johannesburg
Salary: Market related and negotiable
🌍 Calling All Certified Marketing cloud & data cloud Professionals in South Africa!
3 days ago


Senior Java Back-End Engineer (Remote)
Location: Johannesburg
Salary: 70000.00 Monthly
Our client, a boutique software engineering firm supporting fintech projects globally, is seeking a Senior Backend Software engineer to architect, develop, and optimize high-performance backend systems. This is a fully remote, work-from-home position.
Today


Cyber Security Engineer
Location: Johannesburg
Salary:
Brief Description:Are you an Cyber Security engineer with a passion for protecting digital assets and securing enterprise environments? Our clients are looking for skilled professionals to join dynamic teams and contribute to robust security initiatives.
Today


Data & Analytics Engineer
Location: Johannesburg
Salary: R800000 Annually
Senior data & Analytics engineer – Microsoft Fabric / Azure data Factory Expert📍 Johannesburg (Office Based)🕓 Permanent Position💡 Ideal Candidate ProfileAre you a data engineering specialist with a strong cloud-first mindset?You understand end-to-end data flow — from extraction to analytics — and know how to make it scalable, reliable, and intelligent?Are you passion...
1 day ago


Data Engineer (Integration for Data Science Team)
Location: Johannesburg
Salary:
1 day ago


IT Infrastructure Engineer
Location: Pretoria
Salary:
We are partnering with a leading organisation in the Financial Services sector to recruit an experienced Infrastructure engineer. The ideal candidate will have 6+ years’ experience in maintaining and supporting infrastructure systems and data centre environments. The role requires proven expertise in managing and supporting Microsoft Server-based operating systems, including Active Directory...
6 days ago


AI Engineer
Location: Johannesburg
Salary:
Kickstart your career as an AI engineer and help build cutting-edge AI capabilities from the ground up. This is an early-career opportunity to work across the full AI stack—data engineering, ML/AI model development, cloud infrastructure, and AI application deployment—while learning alongside a small, highly skilled team of peers.
13 days ago


QA Engineer
Location: Johannesburg
Salary: Monthly
We are looking for a skilled QA engineer to join an in-house software department supporting a dynamic group of companies, based in Germiston. This is an exciting opportunity to gain exposure to a wide range of software development projects and contribute to delivering high-quality solutions.
Today


DevOps Engineer
Location: Centurion
Salary: 700 000 Annually
Are you a Kubernetes and Rancher expert with a passion for automation, resilience, and high availability? This is your opportunity to join a forward-thinking tech team where innovation meets impact. If you're driven by the challenge of building robust CI/CD pipelines and maintaining mission-critical infrastructure, this role is for you.
14 days ago


Create a free job alert for Cloud Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions