Cloud Data Engineer

 

Recruiter:

PBT Group

Job Ref:

PBT2527161352

Date posted:

Wednesday, September 15, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
PBT Group has an opportunity for a Cloud Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making.

POSITION INFO:

PBT Group has an opportunity for a Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making. Responsible for the Data Ingestion, Transformation, ETL, Data Modelling, Data Architecture and Storage management.

 

One of the key responsibilities will be the translation of business requirements into usable cloud hosted data architecture, which will include an enterprise data model, associated metadata and common business glossary that are used to guide enterprise solution development and achieve consistency of data assets.

 

The Data Engineer will be responsible to take business requirements, knowledge of current and future state     architecture on data platform design and business capabilities, knowledge of enterprise data standards and   deep data expertise into account, to design data architecture solutions that can be implemented in a cost- effective manner. The specific tasks performed will include analyzing business requirements and translate them into data solutions to address complex business needs. The Lead is required to be innovate and creative in their solutioning and frequently involve multiple platforms, software, hardware, technologies, and tools.

 

Duties:

  • Provide month-end production rotational support to ensure data is consumed and ingested to ensure reports are generated within agreed SLAs with business. Resolve production incidents and conduct root cause analysis for improvement.
  • ETL development into staging and data warehouse environments. Develop new data extracts and modify ETL processes as required to improve reporting datasets.
  • Develop and maintain data sets, ETL processes and reports related in order to support operations and decision making related to commercial and personal insurance, provide direct support to end-users.
  • Collaborate with business users and application developers to provide required data. Estimate the time and resource requirements of ETL development work. Validate data and test routines developed & provision of ongoing maintenance and support of assigned ETL applications
  • Analyse the systems environment to understand how the business systems enable these business processes and how the related data is captured and stored. Analyse the structures in which the data is stored to understand what data can be extracted and how it would be done in an efficient manner.
  • Analyse the existing reporting environment to understand what reporting is available and how this can be utilized or amended to inform the specific Business decisions involved.
  • Test all developments for data accuracy, performance and system impact & engage relevant Business users, train them on report usage and guide them in doing user testing.
  • Schedule data extracts and report runs as required to deliver the required information to users at the necessary frequency. Ensure that scheduled procedures are handed over for monitoring and support by the appropriate resources. Update report specifications to reflect the as-built situation.
  • Update technical documentation on data extracts and report functionality to facilitate future understanding to the extent required for ongoing support. Respond to user queries, error logging and further enhancement requests to ensure reports are used and serve their intended purpose.
  • Provide OLAP support and end-user training on the various cubes used for reporting downstream
  • Data Modelling - emphasizes on what data is needed and how it should be organized instead of what operations need to be performed on the data. Data Model is like architect''s building plan which helps to build a conceptual model and set the relationship between data items. This data capability is required in preparation of the Data Platform implementation, and will also align with the approach taken by Group Data to implement ERWIN as a tool of choice for Data Modelling
  • Data Architecture – ensures that we have composed of models, policies, rules or standards that govern which data is collected, and how it is stored, arranged, integrated, and put to use in data systems and in organizations. This data capability is also aligned with the direction that Group Data is taking

 

Project Related Deliverables and Tasks

Assist the Data Engineering Lead on the below-listed tasks:

 

  • Select and implement the appropriate tools, software, applications, and systems to support cloud data technology goals from the chosen MS Azure stack.
  • Oversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring good data quality.
  • Collaborate with Project & Data Stream Leads, Consultants and business unit leaders for all exercises pertaining to the Data Platform Program.
  • Create and maintain data model and metadata policies and procedures for functional design.
  • Provide technical recommendations and engage with ETL/BI Architects, Business SMEs and other stakeholders throughout the Solution/Data Architecture and implementation lifecycle and recommend effective solutions to develop high performance and highly scalable data solutions (data marts/warehouse and data mining and advanced analytics)
  • Raise and ensure data-related problems in regard to systems integration, compatibility, and multiple-platform integration are addressed.
  • Develop and implement key components as needed to create testing criteria in order to guarantee the reliability and performance of data architecture. Ensure the testing process incorporates Test Automation.
  • Drive a Data Platform environment that enables maintenance of the current and accurate view of the larger data picture, an environment that supports a single version of the truth and is scalable to support future analytical needs.
  • Identify and develop opportunities for data reuse, migration, or retirement and platform upgrades.
  • Communicate with customer, project team in a timely manner and escalates issues & risks appropriately.

 

Experience:

  • 5+ years’ experience of delivering Business Intelligence projects using Microsoft & Informatica tools, Visualization Tools (QlikView, SSRS, Power BI). Insurance background and knowledge preferred.
  • 5 years+ Experience in cloud computing infrastructure (e.g., MS Azure, Amazon Web Services etc.) and considerations for scalable, distributed systems
  • 5 – 7 years’ experience delivering business capabilities in the short-term insurance business, including hands on experience in the development and design of functional and non-functional technical specifications for complex systems
  • Short-term insurance business is a key requirement and not negotiable.
    • Deep knowledge of contemporary architectural principles across the data architectural domain
    • Understanding of the enterprise architecture to ensure on-going alignment, driving the technical roadmap for key applications and platforms.
    • Knowledge of different SDLC Methodologies, preferably Agile
    • Ability to produce solutions using:
      • Microsoft SQL Integration Services, MS SQL Analysis Services, MS SQL Reporting Services, MS PowerBI, QlikView, Informatica (PowerCenter & PWX CDC)
      • Knowledge of & Scaled Agile Framework (SAFe) practices will be advantageous
      • Knowledge of Cloud Services (Azure & AWS) is critical

 

Qualifications/ Certification:

  • Matric,
  • BSc Computer Science, Data Informatics, Information Technology, or any other related degree
  • Cloud Certification is a key requirement


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Python & AWS Software Engineer (Senior)
Location: Centurion
Salary:
SummaryJoin our dynamic client as a Senior Python & AWS Software engineer, where you'll play a pivotal role in crafting innovative IT solutions for global clients. You'll leverage your expertise in API and ETL development, alongside proficiency in Git, CI/CD pipelines, and PySpark, to drive impactful projects within the Impact Foundry Platform. Collaborate closely with cross-functional teams, ...
1 day ago


Network engineer L3 X2 - Contract
Location: Dunkeld West
Salary: R400 - 435 per hour
Network engineer L3 X2 - Contract
3 days ago


Machine Learning Engineer
Location: Johannesburg
Salary: Market related
Machine Learning engineer | Johannesburg
10 days ago


Data Streaming Platform Engineer (Advanced)
Location: Midrand
Salary:
Company PurposeOur client in the motor industry is seeking an experienced data Streaming Platform engineer to delve into the core of data streaming processes, ensuring robustness, scalability, and efficiency at every stage. From designing and implementing streaming architectures to optimizing data pipelines, you'll play a crucial role in shaping our data infrastructure and driving insights to fuel...
11 days ago


System Administrator / DevOps Engineer
Location: Johannesburg
Salary: 50 000 Monthly
Role: DevOps engineerLocation: Illovo, Johannesburg Our client is a leading ISP who are looking for a dynamic and driven DevOps engineer to join their team. Your team will maintain, upgrade and manage their diverse and growing infrastructure environment. You will be asked to explore, evaluate and implement new software tools and technologies to help automate and simplify processes in order to...
11 days ago


Solutions Architect
Location: Johannesburg
Salary: 1000000
Are you a seasoned Solutions Architect looking to join a dynamic, reputable organization in the financial technology sector? Here's a Hybrid Role to consider.
16 days ago


Sales Engineer
Location: Centurion
Salary:
Sales engineer: Blend technical prowess with persuasive skills to drive sales and innovation. Be the catalyst between technology and customer success."
16 days ago


Azure/AWS Infrastructure & App Developer (Advanced)
Location: Pretoria
Salary:
**Join Our Team as an Azure/AWS Infra & App Developer (Advanced) in South Africa!**Are you passionate about cloud development, with a focus on networking and security? Do you thrive in collaborative environments and love diving into the latest technologies? If so, we have the perfect opportunity for you!**About Us:**Our organization is a leading provider of IT solutions with a strong focus on ...
19 days ago


AWS Data Engineer with DataBricks
Location: Johannesburg
Salary:
21 days ago


AWS Data Engineer
Location: Midrand
Salary:
**Job Description: **? Join our team as a data engineer! We're on the lookout for someone savvy with Terraform, Python, SQL, and more. Dive into Big data Pipelines, ETL magic, and cloud platforms. Bring your knack for collaboration tools and sprinkle some AWS flair. If you're ready to wrangle data and have a blast doing it, this gig's for you! Apply now and let's build some data dreams together! ?...
24 days ago


Create a free job alert for Cloud Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions