Cloud Data Engineer

SUMMARY:
-

POSITION INFO:

PBT Group has an opportunity for a Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making. Responsible for the Data Ingestion, Transformation, ETL, Data Modelling, Data Architecture and Storage management.

Â

One of the key responsibilities will be the translation of business requirements into usable cloud hosted data architecture, which will include an enterprise data model, associated metadata and common business glossary that are used to guide enterprise solution development and achieve consistency of data assets.

Â

The Data Engineer will be responsible to take business requirements, knowledge of current and future state architecture on data platform design and business capabilities, knowledge of enterprise data standards and deep data expertise into account, to design data architecture solutions that can be implemented in a cost- effective manner. The specific tasks performed will include analyzing business requirements and translate them into data solutions to address complex business needs. The Lead is required to be innovate and creative in their solutioning and frequently involve multiple platforms, software, hardware, technologies, and tools.

Â

Duties:

• Provide month-end production rotational support to ensure data is consumed and ingested to ensure reports are generated within agreed SLAs with Resolve production incidents and conduct root cause analysis for improvement.
• ETL development into staging and data warehouse Develop new data extracts and modify ETL processes as required to improve reporting datasets.
• Develop and maintain data sets, ETL processes and reports related in order to support operations and decision making related to commercial and personal insurance, provide direct support to end-users.
• Collaborate with business users and application developers to provide required data. Estimate the time and resource requirements of ETL development work. Validate data and test routines developed & provision of ongoing maintenance and support of assigned ETL applications
• Analyse the systems environment to understand how the business systems enable these business processes and how the related data is captured and stored. Analyse the structures in which the data is stored to understand what data can be extracted and how it would be done in an efficient
• Analyse the existing reporting environment to understand what reporting is available and how this can be utilized or amended to inform the specific Business decisions
• Test all developments for data accuracy, performance and system impact & engage relevant Business users, train them on report usage and guide them in doing user
• Schedule data extracts and report runs as required to deliver the required information to users at the necessary frequency. Ensure that scheduled procedures are handed over for monitoring and support by the appropriate resources. Update report specifications to reflect the as-built
• Update technical documentation on data extracts and report functionality to facilitate future understanding to the extent required for ongoing support. Respond to user queries, error logging and further enhancement requests to ensure reports are used and serve their intended purpose.
• Provide OLAP support and end-user training on the various cubes used for reporting downstream
• Data Modelling - emphasizes on what data is needed and how it should be organized instead of what operations need to be performed on the Data Model is like architect''s building plan which helps to build a conceptual model and set the relationship between data items. This data capability is required in preparation of the Data Platform implementation, and will also align with the approach taken by Group Data to implement ERWIN as a tool of choice for Data Modelling
• Data Architecture – ensures that we have composed of models, policies, rules or standards that govern which data is collected, and how it is stored, arranged, integrated, and put to use in data systems and in This data capability is also aligned with the direction that Group Data is taking

Â

Project Related Deliverables and Tasks

Assist the Data Engineering Lead on the below-listed tasks:

• Select and implement the appropriate tools, software, applications, and systems to support cloud data technology goals from the chosen MS Azure
• Oversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring good data quality.
• Collaborate with Project & Data Stream Leads, Consultants and business unit leaders for all exercises pertaining to the Data Platform
• Create and maintain data model and metadata policies and procedures for functional design.
• Provide technical recommendations and engage with ETL/BI Architects, Business SMEs and other stakeholders throughout the Solution/Data Architecture and implementation lifecycle and recommend effective solutions to develop high performance and highly scalable data solutions (data marts/warehouse and data mining and advanced analytics)
• Raise and ensure data-related problems in regard to systems integration, compatibility, and multiple-platform integration are
• Develop and implement key components as needed to create testing criteria in order to guarantee the reliability and performance of data architecture. Ensure the testing process incorporates Test
• Drive a Data Platform environment that enables maintenance of the current and accurate view of the larger data picture, an environment that supports a single version of the truth and is scalable to support future analytical needs.
• Identify and develop opportunities for data reuse, migration, or retirement and platform upgrades.
• Communicate with customer, project team in a timely manner and escalates issues & risks

Â

Experience:

• 5+ years’ experience of delivering Business Intelligence projects using Microsoft & Informatica tools, Visualization Tools (QlikView, SSRS, Power BI). Insurance background and knowledge preferred.
• 5 years+ Experience in cloud computing infrastructure (e.g., MS Azure, Amazon Web Services etc.) and considerations for scalable, distributed systems
• 5 – 7 years’ experience delivering business capabilities in the short-term insurance business, including hands on experience in the development and design of functional and non-functional technical specifications for complex systems
• Short-term insurance business is a key requirement and not
• Deep knowledge of contemporary architectural principles across the data architectural domain
• Understanding of the enterprise architecture to ensure on-going alignment, driving the technical roadmap for key applications and
• Knowledge of different SDLC Methodologies, preferably Agile
• Ability to produce solutions using:
  • Microsoft SQL Integration Services, MS SQL Analysis Services, MS SQL Reporting Services, MS PowerBI, QlikView, Informatica (PowerCenter & PWX CDC)
  • Knowledge of & Scaled Agile Framework (SAFe) practices will be advantageous
  • Knowledge of Cloud Services (Azure & AWS) is critical

Â

Qualifications/ Certification:

• Matric,
• BSc Computer Science, Data Informatics, Information Technology, or any other related degree
• Cloud Certification is a key requirement

NB! This job is now closed. You can apply for other jobs by uploading your CV.