Senior Data Engineer

 

Recruiter:

ClarkHouse

Job Ref:

JHB001114/KJ

Date posted:

Monday, January 4, 2021

Location:

Johannesburg, South Africa


SUMMARY:
Are you an analytical expert utilising your skill set in both technology and social science to find trends and manage data? Use your industry knowledge, contextual understanding, scepticism of existing assumptions – to uncover solutions to business challenges. Your work typically involves making sense of messy, unstructured data, from various sources that don’t neatly fit into a database.

POSITION INFO:

Role and Responsibilities –

·         Responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting.

·         Build data processing frameworks that handles the business’s growing database.

·         Work with senior data science leadership as well as other Data and Analytics teams in leveraging data with reporting and scientific tools.

·         Strive to continuously develop new and improved data engineering capabilities.

·         Provide senior-level contribution to a team that is responsible for the design, deployment, and maintenance of the business’s data platforms.

·         Implement strategies directed at acquiring data and promoting the development of new insights across the business.

·         Monitor the existing metrics, analyse data, and lead partnership with other Data and Analytics teams in an effort to identify and implement system and process improvements

·         Play an analytical role where scalable data processing platforms used for exploratory data analysis and real-time analytics are developed and managed.

·         Oversee, design, and develop algorithms for real-time data processing within the business and create the frameworks that enable quick and efficient data acquisition.


Requirements –

·     3-5+ years of relevant industry experience in large back-end systems, data processing and SQL databases

·     Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL

·  Experience building code-driven infrastructure on public cloud platforms, preferably AWS

·         Understanding of SQL, dimensional modeling, and analytical data warehouses

·         Experience with automation frameworks/tools like Git, Jenkins

·         Familiarity with containers and infrastructure-as-code principles

·         Problem solver with excellent written and interpersonal skills; ability to make sound, complex decisions in a fast-paced, technical environment

·         Bachelor’s degree in Computer Science, Engineering or related field, or equivalent training or work experience



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Data Engineer
Location: Johannesburg
Salary:
Our client is urgently recruiting for an experienced data engineer with AWS experience to join their team.
8 days ago


Senior Data Engineer (Spark & Python Specialist) - Remote
Location: South Africa
Salary: Annually
Our client is seeking a senior Cloud data engineer to join their engineering team at the company. In this role, you will be a key technical contributor responsible for building, optimizing, and maintaining high-performance data processing engines. You will apply your deep expertise in Spark Best Practices to develop modular, portable PySpark applications, ensuring the companies platform remai...
22 days ago


Senior Data Engineer (Spark & Python Specialist)
Location: South Africa
Salary: Market Related Monthly
Role:Our client is seeking a senior Cloud data engineer to join their engineering team at the company. In this role, you will be a key technical contributor responsible for building, optimizing, and maintaining high-performance data processing engines. You will apply your deep expertise in Spark Best Practices to develop modular, portable PySpark applications, ensuring the companies platform ...
22 days ago


Senior Data Engineer
Location: Johannesburg
Salary:
49 days ago


Senior Data Engineer (Kafka Streaming, Spark, Iceberg on Kubernetes)
Location: Johannesburg
Salary: market related
As a senior data engineer, you will design, build, and optimize next-generation data pipelines and platforms.
62 days ago


Senior Data Engineer
Location: Johannesburg
Salary:
69 days ago


Senior Infrastructure & Data Protection Engineer | Johannesburg | Permanent
Location: Johannesburg
Salary:
15 days ago


Azure Data Engineer (Mid to Senior)
Location: Johannesburg
Salary: market related
This role focuses on designing, building, and supporting data solutions using Azure technologies and Power BI.
47 days ago


Senior Enterprise Data Engineer
Location: Johannesburg
Salary:
49 days ago


Senior Data Integration Engineer
Location: Johannesburg
Salary:
49 days ago


Create a free job alert for Senior Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions