Senior Data Engineer

 

Recruiter:

Datonomy Solutions

Job Ref:

208

Date posted:

Friday, February 26, 2021

Location:

Pinelands, South Africa

Salary:

Market related


SUMMARY:
This thought leader will use best practices in cloud engineering, data management and data storage

POSITION INFO:

To complement the existing cross-functional team, we are looking for a Senior Data Engineer who will design and implement scalable and robust processes to support the data engineering capability. This role will be responsible for implementing and supporting large-scale data ecosystems across the Group. This thought leader will use best practices in cloud engineering, data management and data storage to continue our drive to optimize the way that data is stored, consumed and ultimately democratized. The incumbent will also collaborate with stakeholders across the organisation with use of the Data Engineering practices to facilitate the improvement in the way that data is stored and consumed.

KEY AREAS OF RESPONSIBILITIES:

  • Design and implement scalable and robust processes for ingesting and transforming datasets.
  • Design, implement and support the creation and maintenance of data pipelines from a multitude of sources.
  • Ingest large, complex data sets that meet functional and non-functional requirements.
  • Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
  • Design bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
  • Ensure that all data solutions support the organisation’s cloud strategy and aligns to the data achitecture and governance including implementation of these data governance practices.
  • Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
  • Engineer the development of API’s for returning data to Enterprise Applications.
  • Identify, design and implement robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
  • Work with various stakeholders across the organisation to understand data requirements and apply deep technical knowledge of data management to solve key business problems.
  • Provide specialised support in the operational environment with all relevant support teams for data services.
  • Effective mangement of demand across the various data streams and use cases.
  • Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.

ROLE & QUALIFICATIONS REQUIREMENTS

  • Matric, with a degree in Computer Science, Business Informatics, Mathematics, Statistics, Physics or Engineering.
  • 5+ years of data engineering experience  
  • 5+ years of experience with data warehouse technical architectures, ETL/ELT, and reporting/analytics tools including , but not limited to, any of the following combinations (1) SSIS and SSRS,  (2) SAS ETL Framework, (3) SAP ETL Framework, (4) MongoDB ETL deployments, (5) Apache Spark and Apache Hive deployments. The candidate should demonstrate great DBA ability and knowledge across at least 2 platforms (example: TSQL, SAS, PSQL, IBM VSAM and DB2 etc)
  • Experience with designing and implementing Cloud (AWS) solutions including full use of all APIs available
  • Experience with Dev/OPS architecture, implementation and operation
  • Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data.
  • Experience in applying SAFe/Scrum/Kanban methodologies
  • Knowledge and understanding of business process management lifecycle which covers the design, modelling, execution, monitoring, and optimization as well as business process re-engineering.
  • Strong problem solving skills: The ability to exercise judgment in solving technical, operational, and organizational challenges, to identify issues proactively, to present solutions and options leading to resolution
  • Expert programming, performance tuning and troubleshooting skills, using the latest popular programming languages such as python, scala, java and suite of Microsoft languages C# and F# preferable.

COMPETENCIES:

  • Collaboration and communication: working with clients, designers, architects, development team(s)
  • Strategic 
  • Leading with Influence 
  • Innovation
  • Execution 
  • Customer First 
  • Personal Mastery (Learning) 
  • Problem Solving 
  • Data Analysis 
  • Working with ambiguity 
  • Working independently and within a team


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
Location: Durban
Salary: Market related
Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
Today


Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
Location: Durban
Salary: Market related
Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
Today


Analytical Chemistry and Separation Technology Intern
Location: Pietermaritzburg
Salary:
Signa Opportunity is recruiting unemployed youth for quality workplace experience through the Youth Employment Service (YES) initiative.About the YES InitiativeThe initiative was launched by the President in 2018 and is a partnership with the government and labour department to collectively devise a national plan to build economic pathways for South Africa’s youth by creating workplace ...
1 day ago


Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
Location: Durban
Salary: Market related
Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
1 day ago


Senior Cost Accountant / Finance Manager
Location: Pinetown
Salary:
A well-established and growing manufacturing and installation company operating in the branding and marketing sector is seeking a highly experienced Cost Accountant to lead its finance function.The business operates in a high paced jobbing-shop, project-driven manufacturing environment, producing custom-built solutions with varying one-off cost structures, lead times, and installation components. ...
2 days ago


Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
Location: Durban
Salary: Market related
Recruiter/Recruitment Specialist/Labour Broker/Bulk Recruiter
2 days ago


FINANCIAL MANAGER - FOUNDRY
Location: Durban
Salary: Monthly
FINANCIAL MANAGER in the FOUNDRY or HEAVY engineerING Sector -Durban area, KZN
2 days ago


Debtors Manager
Location: Durban
Salary: Annual
Debtors Manager
2 days ago


Accountant
Location: Umhlanga Rocks
Salary:
3 days ago


Customer Service Manager - Durban
Location: Durban
Salary:
4 days ago


Create a free job alert for Senior Data Engineer in Pinelands

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions