Specialist Data Engineer

 

Recruiter:

Tower Group

Job Ref:

CPT003857/RC

Date posted:

Wednesday, May 26, 2021

Location:

Johannesburg, South Africa

Salary:

350 Hourly


SUMMARY:
Our Client, a leader in the Banking Sector, is looking for a Specialist Data Engineer, to be based in Sandton, Gauteng, R400 p/h.

POSITION INFO:

Job Description:

This role provides an exciting opportunity to roll out a new strategic initiative within the firm - Enterprise Infrastructure Big Data Service. The Big Data Developer serves as a development and support expert with responsibility for the design, development, automation, testing, support and administration of the Enterprise Infrastructure Big Data Service. The roles require experience with both Hadoop and Kafka. This will involve building and supporting a real time streaming platform utilized by the clients data engineering community. You will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.

Job Profile: Specialist Data Engineer

Experience required:

You will have the opportunity of working directly across the firm with developers, operations staff, data scientists, architects and business constituents to develop and enhance the big data service.

  • Min 5 years’ development experience
  • Strong technical / programming experience
  • Development and deployment of data applications
  • Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
  • Creation of data ingestion pipelines between legacy data warehouses and the big data stack
  • Automation of application back-end workflows
  • Building and maintaining backend services created by multiple services framework
  • Maintain and enhance applications backed by Big Data computation applications
  • Be eager to learn new approaches and technologies
  • Strong problem solving skills
  • Strong programming skills, proven track record of coding ability and experience (hands-on back end development)
  • Ability to effectively code in at least two programming languages (eg. C#, Java, Python etc)
  • Excellent understanding of programming concepts
  • Background in computer science, engineering, physics, mathematics or equivalent
  • Worked on Big Data platforms (Vanilla Hadoop, Cloudera or Hortonworks)
  • Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript
  • Solid understanding of Object Oriented Design and ability to properly apply general design patterns and paradigms

Preferred:

  • Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
  • Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Data Engineer (Spark & Python Specialist) - Remote
Location: South Africa
Salary: Annually
Our client is seeking a Senior Cloud data engineer to join their engineering team at the company. In this role, you will be a key technical contributor responsible for building, optimizing, and maintaining high-performance data processing engines. You will apply your deep expertise in Spark Best Practices to develop modular, portable PySpark applications, ensuring the companies platform remai...
22 days ago


Senior Data Engineer (Spark & Python Specialist)
Location: South Africa
Salary: Market Related Monthly
Role:Our client is seeking a Senior Cloud data engineer to join their engineering team at the company. In this role, you will be a key technical contributor responsible for building, optimizing, and maintaining high-performance data processing engines. You will apply your deep expertise in Spark Best Practices to develop modular, portable PySpark applications, ensuring the companies platform ...
22 days ago


Microsoft Fabric Specialist (Data Engineering, Governance & DWH) (Onsite – JHB) (Contract)
Location: Johannesburg
Salary:
6 days ago


API Specialist (Integration, Middleware & Data Flows) (Onsite – JHB) (Contract)
Location: Johannesburg
Salary:
6 days ago


Technical Specialist - Storage, Backup, Data Management
Location: Sandton
Salary: R80k - 100k per month
Technical specialist across storage, backup, and data management environments
7 days ago


Data Management Specialist
Location: Pretoria
Salary:
We are partnering with a leading financial institution as they advance their Enterprise Information Management Programme to strengthen data as a strategic asset across the organisation. As part of this journey to embed robust Information Management capabilities and execute on a forward-looking Information Strategy, our client is seeking experienced data Management specialists to support critical p...
11 days ago


Data management Specialist X 5 (12 Months' Contract)
Location: Pretoria
Salary: Market related
To design and implement processes, procedures and technology required for complex, large-scale data
12 days ago


Data Specialist
Location: Johannesburg
Salary: Annually
A high-growth, data-driven organisation is looking to hire multiple dynamic and solutions-oriented data specialists to join their expanding team. These roles offer exceptional exposure across the business, with the opportunity to work on diverse challenges and contribute meaningfully to data-driven decision-making.
19 days ago


Data Specification Specialist (Hybrid)
Location: Midrand
Salary:
33 days ago


Senior Data & Predictive Analytics Specialist
Location: Midrand
Salary:
We are seeking a highly skilled Senior data & Predictive Analytics specialist to lead the design and delivery of advanced analytics solutions that shape strategic and operational decision‑making. The role focuses on building predictive models, translating business strategy into data-led initiatives, and providing deep customer insights across segmentation, behaviour, profitability, and telem...
43 days ago


Create a free job alert for Specialist Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions