Data Engineer - Developer

 

Recruiter:

Sambe Consulting

Job Ref:

Sambe 3

Date posted:

Thursday, October 7, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
The successful applicant will be working within a highly specialized and growing team to enable delivery of data and advanced analytics system capability.

POSITION INFO:

Responsibilities will include:
ï‚· Develop and implement a reusable architecture of data pipelines to make data available for various purposes including Machine Learning (ML), Analytics and Reporting
ï‚· Work collaboratively as part of team engaging with system architects, data scientists and business in a healthcare context
ï‚· Define hardware, tools and software to enable the reusable framework for data sharing and ML model productionization
ï‚· Work comfortably with structured and unstructured data in a variety of different programming languages such as SQL, R, python, Java etc
ï‚· Understanding of distributing programming and advising data scientists on how to optimally structure program code for maximum efficiency
ï‚· Build data solutions that leverage controls to ensure privacy, security, compliance and data quality
ï‚· Understand meta-data management systems and orchestration architecture in the designing of ML/AI pipelines
ï‚· Deep understanding of cutting edge cloud technology and frameworks to enable Data Science

ï‚· System integration skills between Business Intelligence and source transactional
ï‚· Improving overall production landscape as required
ï‚· Define strategies with Data Scientists to monitor models post production
ï‚· Write unit tests and participate in code reviews

 

Technical skills core:
ï‚· Expert in programming languages such as R, Python, Scala and Java
ï‚· Expert database knowledge in SQL and experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Azure stream analytics and PowerBI
ï‚· Modern Azure datawarehouse skills
ï‚· Expert Unix/Linux admin experience including shell script development
ï‚· Exposure to AI or model development
ï‚· Experience working on large and complex datasets
ï‚· Understanding and application of Big Data and distributed computing principles (Hadoop and MapReduce)
ï‚· ML model optimization skills in a production environment
ï‚· Production environment machine learning and AI
ï‚· DevOps/DataOps and CI/CD experience

Technical skills additional:
ï‚· AWS experience

 

Professional Qualifications & Experience
ï‚· Honours or Master’s degree in BSc Computer Science
ï‚· Honours or Master’s degree in Engineering or Software Engineering with solid experience in data mining and machine learning
ï‚· Other qualifications will also be considered if accompanied by the relevant experience



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
Location: Johannesburg
Salary: 1000000
data engineer (AWS and Redshift) - Johannesburg – up to R1mil
11 days ago


Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
11 days ago


AWS Data Engineer - 1432
Location: Pretoria
Salary: Hourly
Contract Starts: 01.06.2024Contract Ends: 31.12.2026Location: Midrand/Menlyn/Rosslyn/Home Office rotation
18 days ago


Data Streaming Platform Engineer (Advanced)
Location: Midrand
Salary:
Company PurposeOur client in the motor industry is seeking an experienced data Streaming Platform engineer to delve into the core of data streaming processes, ensuring robustness, scalability, and efficiency at every stage. From designing and implementing streaming architectures to optimizing data pipelines, you'll play a crucial role in shaping our data infrastructure and driving insights to fuel...
20 days ago


0831_SAP Data Engineer (Focus: SAP BW) (Senior)
Location: Pretoria
Salary:
0831_SAP data engineer (Focus: SAP BW)Location: GautengContract Term: 1 June 2024 - 31 December 2026
20 days ago


Data Engineer
Location: Johannesburg
Salary:
Are you a seasoned data engineer with a strong focus on staging high-quality data? Are you passionate about leveraging your expertise in SQL, ETL toolsets, and database technologies to drive effective data management solutions? If so, we have an exciting opportunity for you!
21 days ago


Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
25 days ago


AWS Data Engineer - Midrand–Semi Remote – R800 PH
Location: Pretoria
Salary: 1440000
AWS data engineer - Midrand–Semi Remote – R800 PH
28 days ago


AWS Data Engineer with DataBricks
Location: Johannesburg
Salary:
30 days ago


Senior Data Engineer
Location: Johannesburg
Salary:
A well-known marketing organization, with branches in multiple overseas countries, is looking for a Senior data engineer to join their organization at their Johannesburg branch. The Senior data engineer will be required to work on a hybrid module. Working within the data Science Team, the data engineer, you will be responsible for the organization's data structure.
11 days ago


Create a free job alert for Data Engineer - Developer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions