Cloud Data Engineer

 

Recruiter:

PBT Group

Job Ref:

PBT2527161352

Date posted:

Wednesday, September 15, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
PBT Group has an opportunity for a Cloud Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making.

POSITION INFO:

PBT Group has an opportunity for a Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making. Responsible for the Data Ingestion, Transformation, ETL, Data Modelling, Data Architecture and Storage management.

 

One of the key responsibilities will be the translation of business requirements into usable cloud hosted data architecture, which will include an enterprise data model, associated metadata and common business glossary that are used to guide enterprise solution development and achieve consistency of data assets.

 

The Data Engineer will be responsible to take business requirements, knowledge of current and future state     architecture on data platform design and business capabilities, knowledge of enterprise data standards and   deep data expertise into account, to design data architecture solutions that can be implemented in a cost- effective manner. The specific tasks performed will include analyzing business requirements and translate them into data solutions to address complex business needs. The Lead is required to be innovate and creative in their solutioning and frequently involve multiple platforms, software, hardware, technologies, and tools.

 

Duties:

  • Provide month-end production rotational support to ensure data is consumed and ingested to ensure reports are generated within agreed SLAs with business. Resolve production incidents and conduct root cause analysis for improvement.
  • ETL development into staging and data warehouse environments. Develop new data extracts and modify ETL processes as required to improve reporting datasets.
  • Develop and maintain data sets, ETL processes and reports related in order to support operations and decision making related to commercial and personal insurance, provide direct support to end-users.
  • Collaborate with business users and application developers to provide required data. Estimate the time and resource requirements of ETL development work. Validate data and test routines developed & provision of ongoing maintenance and support of assigned ETL applications
  • Analyse the systems environment to understand how the business systems enable these business processes and how the related data is captured and stored. Analyse the structures in which the data is stored to understand what data can be extracted and how it would be done in an efficient manner.
  • Analyse the existing reporting environment to understand what reporting is available and how this can be utilized or amended to inform the specific Business decisions involved.
  • Test all developments for data accuracy, performance and system impact & engage relevant Business users, train them on report usage and guide them in doing user testing.
  • Schedule data extracts and report runs as required to deliver the required information to users at the necessary frequency. Ensure that scheduled procedures are handed over for monitoring and support by the appropriate resources. Update report specifications to reflect the as-built situation.
  • Update technical documentation on data extracts and report functionality to facilitate future understanding to the extent required for ongoing support. Respond to user queries, error logging and further enhancement requests to ensure reports are used and serve their intended purpose.
  • Provide OLAP support and end-user training on the various cubes used for reporting downstream
  • Data Modelling - emphasizes on what data is needed and how it should be organized instead of what operations need to be performed on the data. Data Model is like architect''s building plan which helps to build a conceptual model and set the relationship between data items. This data capability is required in preparation of the Data Platform implementation, and will also align with the approach taken by Group Data to implement ERWIN as a tool of choice for Data Modelling
  • Data Architecture – ensures that we have composed of models, policies, rules or standards that govern which data is collected, and how it is stored, arranged, integrated, and put to use in data systems and in organizations. This data capability is also aligned with the direction that Group Data is taking

 

Project Related Deliverables and Tasks

Assist the Data Engineering Lead on the below-listed tasks:

 

  • Select and implement the appropriate tools, software, applications, and systems to support cloud data technology goals from the chosen MS Azure stack.
  • Oversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring good data quality.
  • Collaborate with Project & Data Stream Leads, Consultants and business unit leaders for all exercises pertaining to the Data Platform Program.
  • Create and maintain data model and metadata policies and procedures for functional design.
  • Provide technical recommendations and engage with ETL/BI Architects, Business SMEs and other stakeholders throughout the Solution/Data Architecture and implementation lifecycle and recommend effective solutions to develop high performance and highly scalable data solutions (data marts/warehouse and data mining and advanced analytics)
  • Raise and ensure data-related problems in regard to systems integration, compatibility, and multiple-platform integration are addressed.
  • Develop and implement key components as needed to create testing criteria in order to guarantee the reliability and performance of data architecture. Ensure the testing process incorporates Test Automation.
  • Drive a Data Platform environment that enables maintenance of the current and accurate view of the larger data picture, an environment that supports a single version of the truth and is scalable to support future analytical needs.
  • Identify and develop opportunities for data reuse, migration, or retirement and platform upgrades.
  • Communicate with customer, project team in a timely manner and escalates issues & risks appropriately.

 

Experience:

  • 5+ years’ experience of delivering Business Intelligence projects using Microsoft & Informatica tools, Visualization Tools (QlikView, SSRS, Power BI). Insurance background and knowledge preferred.
  • 5 years+ Experience in cloud computing infrastructure (e.g., MS Azure, Amazon Web Services etc.) and considerations for scalable, distributed systems
  • 5 – 7 years’ experience delivering business capabilities in the short-term insurance business, including hands on experience in the development and design of functional and non-functional technical specifications for complex systems
  • Short-term insurance business is a key requirement and not negotiable.
    • Deep knowledge of contemporary architectural principles across the data architectural domain
    • Understanding of the enterprise architecture to ensure on-going alignment, driving the technical roadmap for key applications and platforms.
    • Knowledge of different SDLC Methodologies, preferably Agile
    • Ability to produce solutions using:
      • Microsoft SQL Integration Services, MS SQL Analysis Services, MS SQL Reporting Services, MS PowerBI, QlikView, Informatica (PowerCenter & PWX CDC)
      • Knowledge of & Scaled Agile Framework (SAFe) practices will be advantageous
      • Knowledge of Cloud Services (Azure & AWS) is critical

 

Qualifications/ Certification:

  • Matric,
  • BSc Computer Science, Data Informatics, Information Technology, or any other related degree
  • Cloud Certification is a key requirement


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Intermediate Cloud Data Platform Support Engineer (Remote)
Location: South Africa
Salary: 1000 Annually
The Intermediate cloud data Platform Support engineer will play a critical role in ensuring the stability, reliability, and efficiency of the company data platform hosted in Microsoft Azure, with a future vision to extend into other cloud environments. This role is primarily focused on incident response, technical support, and platform reliability, while also contributing to proactive improve...
6 days ago


BI Database Administrator: DataLakes + Data Migration + Data Cloud: Centurion: Permanent
Location: Centurion
Salary:
8 days ago


Data Architect
Location: Johannesburg
Salary: 700000
In search of a skilled data Architect in JHB!
2 days ago


Senior Data Engineer
Location: Johannesburg
Salary: Annually
The Senior data engineer will be responsible for leading the design, development and governance of the company's enterprise data infrastructure, transitioning from the current SSIS based ETL environment to a modern, scalable, azure-based cloud data warehouse.
2 days ago


Systems Administrator
Location: Johannesburg
Salary: Annually
The Systems Administrator is responsible for installing, configuring, and updating systems; proactively monitoring to identify potential issues; implementing preventative measures; ensuring regular system backups; and managing downtime effectively.
3 days ago


Senior Systems Administrator
Location: Johannesburg
Salary: Annually
The Senior Systems Administrator will be responsible for administration and maintenance of all company networks, servers and hardware and ensuring that there is robust cybersecurity and data security protocols in place.
3 days ago


Full Stack Developer
Location: Pretoria
Salary: Annually
Seeking a Full Stack Developer with 4+ years' experience who will be responsible for front-end and back-end development.
3 days ago


Storage Engineer
Location: Johannesburg
Salary: Market Related Monthly
Main Job Purpose:The HCI and Storage engineer will be primarily responsible for installing, monitoring, testing andmaintaining both cloud and on-premises infrastructure solutions, with a specific emphasis on Hyper-Converged Infrastructure (HCI), VxRail, UNITY Storage and VNX(e) Hardware and software This role will involve providing specialised technical support and guidance through high-level...
6 days ago


Senior Machine Learning Engineer (6-Month Contract)
Location: Johannesburg
Salary: Market-related
Join a bespoke AI consultancy delivering greenfield AI solutions for leading banks, Johannesburg | R600 per hour | 08:00 am to 5:00 pm
6 days ago


Machine Learning Engineer (12-Month Contract)
Location: Johannesburg
Salary: Market-Related
We are seeking a Machine Learning engineer to support a 12-month project within the banking sector.
6 days ago


Create a free job alert for Cloud Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions