Data Engineer

 

Recruiter:

PBT Group

Job Ref:

PBT114142108

Date posted:

Tuesday, October 4, 2022

Location:

Johannesburg, South Africa

Salary:

market related


JOB SUMMARY:
To complement the existing cross-functional team, PBT Group is looking for a Data Engineer who will design and implement scalable and robust processes to support the data engineering capability.

JOB DESCRIPTION:

To complement the existing cross-functional team, PBT Group is looking for a Data Engineer who will design and implement scalable and robust processes to support the data engineering capability. This role will be responsible for implementing and supporting large-scale data ecosystems across the Group. This thought leader will use best practices in cloud engineering, data management and data storage to continue our drive to optimize the way that data is stored, consumed and ultimately democratized. The incumbent will also collaborate with stakeholders across the organisation with use of the Data Engineering practices to facilitate the improvement in the way that data is stored and consumed.

  • Assist in designing and implementing scalable and robust processes for ingesting and transforming complex datasets.
  • Designs, develops, constructs, maintains and supports data pipelines for ETL from a multitude of sources.
  • Creates blueprints for data management systems to centralize, protect, and maintain data
  • sources.
  • Focused on data stewardship and curation, the data engineer enables the data scientist to run their models and analyses to achieve the desired business outcomes
  • Ingest large, complex data sets that meet functional and non-functional requirements.
  • Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
  • Design and build bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
  • Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
  • Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
  • Development of API’s for returning data to Enterprise Applications.
  • Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
  • Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.
  • Provide support in the operational environment with all relevant support teams for data services.
  • Provide input into the management of demand across the various data streams and use cases.
  • Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.
  • Support test and deployment of new services and features.
  • Provides technical leadership to junior data engineers in the team

ROLE & QUALIFICATIONS REQUIREMENTS

  • Matric, with a degree in Computer Science, Business Informatics, Mathematics, Statistics, Physics or Engineering.
  • 3+ years of data engineering experience
  • 3+ years of experience with any data warehouse technical architectures, ETL/ELT, and reporting/analytics tools including , but not limited to , any of the following combinations: (1) SSIS and SSRS, (2) ETL Frameworks, (3) Data conformance, (4) Caching, (5) Spark (6) AWS data builds
  • The candidate having DBA ability and knowledge across at least 2 platforms (example: TSQL, SAS, PSQL, IBM VSAM, DynamoDB and DB2) will also be beneficial.
  • Should be at least at a proficient level in at least one of Python, Java, C/C++ or similar
  • Should be Proficient in bash/ksh, perl, SQL
  • Some experience with R, AWS, XML, json, cron will be beneficial
  • Experience with designing and implementing Cloud (AWS) solutions including use of APIs available.
  • Some experience with Dev/OPS architecture, implementation and operation would be advantageous.
  • Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data.
  • Some experience in applying SAFe/Scrum/Kanban methodologies.
  • Knowledge and understanding of business process management lifecycle which covers the design, modelling, execution, monitoring, and optimization as well as business process reengineering.
  • Good problem solving skills: The ability to exercise judgment in solving technical, operational, and organizational challenges, to identify issues proactively, to present solutions and options leading to resolution
  • Good programming, performance tuning and troubleshooting skills, using the latest popular programming languages such as python, scala, java and suite of Microsoft languages C# and F# preferable.

COMPETENCIES:

  • Collaboration and precise communication
  • Establishing and maintaining strong working relationships with stakeholders across all levels
  • Strategic thinking
  • Leading with Influence
  • Innovating and being curious about technology
  • Quality in execution and outcomes
  • Customer First attitude
  • Personal Mastery (Learning)
  • Problem Solving
  • Data Management
  • Working with ambiguity
  • Working independently and within a team

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary: 840000 Annually
Apply here to showcase your data engineer skills! Work with modern tech, big data, and a team that loves clean, scalable solutions.
7 days ago


Data Engineer
Location: Centurion
Salary:
We are recruting for a data engineer, on a 12-month contract.
7 days ago


SQL Data Engineer
Location: Centurion
Salary: market related Monthly
Role PurposeOur client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service. RequirementsTechnical Skills:Advanced proficiency in SQL Transact, SQL Server, SSIS, and SSRS, including performance tuning and query...
8 days ago


SQL Data Engineer (12 month contract)
Location: Centurion
Salary: 1000 Monthly
Our client offers a collaborative and dynamic work environment. By joining their team, you'll have the opportunity to contribute meaningfully to their data-driven strategies while growing in a culture that values innovation, excellence, and service.
9 days ago


AWS Data Engineer
Location: Pretoria North
Salary:
10 days ago


Data Engineer
Location: Centurion
Salary: 550 000 Annually
Are you a data enthusiast who thrives on building smart, scalable data solutions? If you're looking to be part of a tech-forward environment that doesn’t compromise on culture, then this opportunity is calling your name. We’re looking for a solutions-driven data engineer to join a vibrant and growing team.You’ll work closely with Analysts, Actuaries, finance, and software teams t...
11 days ago


Data Engineer
Location: Centurion
Salary:
Our client is seeking a skilled data engineer to join their growing team. If you are passionate about the technical aspects of the data landscape and thrive on building optimized processes that deliver high-quality, reusable datasets, then this could be the perfect opportunity for you.
11 days ago


Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH
Location: Pretoria
Salary: 1152000
data engineer / data Scientist – Midrand / Semi-Remote – R600 PH
11 days ago


Data Engineer
Location: Centurion
Salary: Annually
The data engineer will be responsible for developing best practices and patterns, maintaining our current workloads, and optimizing our data warehouse builds, data pipelines, and data products.
15 days ago


Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum
Location: Johannesburg
Salary: 900000
Intermediate or Senior AWS data engineer – Johannesburg – up to R900k per annum
15 days ago


Create a free job alert for Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions