Data Engineer

The incumbent will be responsible for delivering central data management, governance and reporting within the Financial Surveillance Division (FinSurv), without impacting operational procedures or systems. The successful candidate will be supporting projects and other initiatives that span across the organisation.

Designing and implementing data strategies and systems, through collaboration with the IT, EIM (Enterprise Information Management) and Business teams, to create and maintain the data architecture that will drive various initiatives across the organisation

ï‚· Build infrastructure to automate extremely high volumes of data delivery and creatively solve data volume and scaling challenges. Contribute to the design and architecture of innovative solutions to difficult problems.

ï‚· Work with team and stakeholders to continually assess and redefine data technology stack to support changing data patterns and business use cases and to bridge the gaps between Data teams and Business by constantly collaborating with all parties to understand data needs.

ï‚· Build the infrastructure with IT which is required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.

ï‚· Collaborate with IT to source and load a wide range of data across our business into the data lake so that it can be used by analysts and developers to develop data solutions for the business

ï‚· Develop and enhance the data ingestion framework using specified toolsets and will need to understand and continuously seek techniques to ingest data, as well as ensure a high degree of quality and confidence

ï‚· Assemble large, complex data sets that meet functional / non-functional business requirements.

ï‚· Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Liaise between technical teams and specialists and business stakeholders, fostering inter-departmental coordination and cooperation

ï‚· Data Governance (Quality, Accessibility, Ownership and Security). Engage with stakeholders to obtain an understanding of their data practices to contract, manage and meet expectations.

ï‚· Identifies client data quality concerns, conducts root cause analysis and provides feedback to the FinSurv Data Governance Board (DGB) and data management competency centres within the SARB.

ï‚· Become a trusted advisor to stakeholders, and influence decision making by providing an advisory service, guidance and support on data quality practices

ï‚· Maintaining a thorough understanding of the business and data strategy

ï‚· Identify opportunities to influence the improvement or enhancement of business processes and methodologies by researching and recommending improvement initiatives and effective ways to operate and add value to FinSurv.

The following experience is required for this role:

ï‚· 10 - 12 years’ experience in a Data Engineering role building and optimizing data pipelines, architectures and data sets.

ï‚· Constructing data acquisition, warehousing and reporting solutions.

ï‚· Advanced working SQL knowledge and 5 years’ experience working with relational databases, query authoring (SQL)

ï‚· Experience with a variety of databases, technologies, languages and visualisation engines (Power BI, Tableau, SAS)

ï‚· 3-4 years’ experience building analytics tools that utilize the data pipeline to provide actionable insights into customer management, operational efficiency and other key business performance metrics.

Skills:

ï‚· SQL

ï‚· Microsoft Power BI

ï‚· Databases

ï‚· Data Modelling

ï‚· Data Engineering

ï‚· Tableau

ï‚· Relational Databases

ï‚· Data Lakes

ï‚· Performance Metrics

ï‚· Data Pipelines

ï‚· OBIEE

ï‚· Informatica

ï‚· Teradata