Senior Data engineer

Recruiter:

Carlysle Human Capital

Job Ref:

GTG001178/CG

Date posted:

Wednesday, February 8, 2023

Location:

Working from home, South Africa

Salary:

65000 Monthly

SUMMARY:
This is a great opportunity for someone that loves critical thinking, problem solving, and solving challenging problems, and who wants to have an impact in the world. Very flexible environment, output driven, great culture, high tech.

POSITION INFO:
Qualification requirements

Tertiary degree in quantitative field, science, maths, engineering or the like. (Bsc/BEng, pure maths)
Further learning in large data, preferably based on Machine Learning and programming in Python

Experience required

Experience in building and optimizing big data pipelines
Designing and implementing data warehouses, data lakes and data meshes
Advanced knowledge of relational, non-relational databases with strong experience in SQL
Working knowledge of streaming, message queuing and highly scalable data stores
Understanding of DevOps processes, CI/CD, and agile development
Experience in testing and observability in the context of big data
Experience with distributed processing frameworks (Apache Spark, Hive, Kafka, etc.)
Having worked in a cloud environment (Azure, AWS)
Specific technologies: - Python, R, Scala - SQL (MS SQL Server, Postgres) - Apache Spark, Hadoop, Hive - Databricks, EMR

Please aply online and we will be in touch should you meet the minimum requirements.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior AWS Data Engineer - 1154
Location: Pretoria
Salary: Hourly
Our client in the motor industry is looking to employ a Senior AWS data engineer. As a Big data engineer, you will be responsible for building and maintaining robust Big data Pipelines using our client's data Platforms.
Today

AWS Data Engineer - 1432
Location: Pretoria
Salary: Hourly
Contract Starts: 01.06.2024Contract Ends: 31.12.2026Location: Midrand/Menlyn/Rosslyn/Home Office rotation
Today

Data Engineer
Location: Midrand
Salary:
Our client in the banking sector seeks to employ a data engineer yo assemble large, complex data sets to meet functional/non-functional requirements, adhering to best big data practices.
1 day ago

AWS Data Engineer – Semi Remote – R740 Per Hour
Location: Remote
Salary: 1420800
AWS data engineer – Semi Remote – R740 Per Hour
1 day ago

Data Engineer - AZURE
Location: Cape Town
Salary: 60 000 Monthly
the client is seeking an Azure data engineer who will be a cornerstone in constructing the backbone of our cloud-based fitness experiences. Your expertise will not only involve building and maintaining robust data solutions but also ensuring that these systems are insightful and interactive, utilizing Azure data Factory, databricks, and Power BI to transform data into action.
2 days ago

0831_SAP Data Engineer (Focus: SAP BW) (Senior)
Location: Pretoria
Salary:
0831_SAP data engineer (Focus: SAP BW)Location: GautengContract Term: 1 June 2024 - 31 December 2026
2 days ago

Data Engineer
Location: Johannesburg
Salary:
Are you a seasoned data engineer with a strong focus on staging high-quality data? Are you passionate about leveraging your expertise in SQL, ETL toolsets, and database technologies to drive effective data management solutions? If so, we have an exciting opportunity for you!
3 days ago

DevOps Data Engineer
Location: Cape Town
Salary:
3 days ago

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
7 days ago

SQL Data Engineer
Location: Centurion
Salary: 1 Monthly
SQL data engineer
10 days ago