Specialist Data Engineer

Recruiter:

Tower Group

Job Ref:

CPT003857/RC

Date posted:

Wednesday, May 26, 2021

Location:

Johannesburg, South Africa

Salary:

350 Hourly

SUMMARY:
Our Client, a leader in the Banking Sector, is looking for a Specialist Data Engineer, to be based in Sandton, Gauteng, R400 p/h.

POSITION INFO:

Job Description:

This role provides an exciting opportunity to roll out a new strategic initiative within the firm - Enterprise Infrastructure Big Data Service. The Big Data Developer serves as a development and support expert with responsibility for the design, development, automation, testing, support and administration of the Enterprise Infrastructure Big Data Service. The roles require experience with both Hadoop and Kafka. This will involve building and supporting a real time streaming platform utilized by the clients data engineering community. You will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.

Job Profile: Specialist Data Engineer

Experience required:

You will have the opportunity of working directly across the firm with developers, operations staff, data scientists, architects and business constituents to develop and enhance the big data service.

Min 5 years’ development experience
Strong technical / programming experience
Development and deployment of data applications
Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
Creation of data ingestion pipelines between legacy data warehouses and the big data stack
Automation of application back-end workflows
Building and maintaining backend services created by multiple services framework
Maintain and enhance applications backed by Big Data computation applications
Be eager to learn new approaches and technologies
Strong problem solving skills
Strong programming skills, proven track record of coding ability and experience (hands-on back end development)
Ability to effectively code in at least two programming languages (eg. C#, Java, Python etc)
Excellent understanding of programming concepts
Background in computer science, engineering, physics, mathematics or equivalent
Worked on Big Data platforms (Vanilla Hadoop, Cloudera or Hortonworks)
Excellent understanding of specific coding / scripting languages e.g. Java, C#, Python, Perl, JavaScript
Solid understanding of Object Oriented Design and ability to properly apply general design patterns and paradigms

Preferred:

Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Quality Assurance Specialist (Data & Sales)
Location: Johannesburg
Salary:
Signa Opportunity is recruiting unemployed youth for quality workplace experience through the Youth Employment Service (YES) initiative.About the YES InitiativeThe President launched the initiative in 2018 and is a partnership with the government and labor department to collectively devise a national plan to build economic pathways for South Africa’s youth by creating workplace opportun...
16 days ago

Product Business Solutions Specialist (BI/Data)
Location: Johannesburg
Salary:
Global Organisation in the Transport / Courier Industry requires a Business Solutions specialist (BI/data) who will be responsible for analysing business challenges, customer requirements, and performance trends to develop and implement effective business solutions.
16 days ago

Senior Data Specialist
Location: Johannesburg
Salary: 800 000 Annually
My client is looking for a data engineer to join the team — and we’re rounding up someone who knows their way around some serious data!
24 days ago

AI & Data Specialist
Location: South Africa
Salary: Market Related Monthly
Fully Remote WorkingRequirements:Experience in data architecture, data engineering, and AI/ML deployments.Strong experience with OCI data Science, Oracle AI Services, or equivalent enterprise cloud data platforms.Hands-on OCI experience is mandatory.
27 days ago

Mid/Senior Data Support Specialist
Location: Sandton
Salary:
82 days ago

Software Engineering Team Lead (JavaScript)
Location: Johannesburg
Salary: Monthly
Step into a role where technology meets leadership, collaboration fuels growth, and your impact shapes enterprise solutions. We’re looking for a passionate JavaScript Team Lead to guide delivery teams, mentor rising talent, and drive world-class web and mobile applications across diverse industries.
2 days ago

Senior Helpdesk Support Technician
Location: Pretoria
Salary: Monthly
Are you an experienced Desktop Support Technician who enjoys solving complex technical issues and providing exceptional support to end users? This is an exciting opportunity to take ownership of escalated incidents, mentor junior technicians, and play a key role in maintaining a secure, reliable, and efficient IT environment.
9 days ago

Network and Security Engineer
Location: Johannesburg
Salary: Monthly
Are you a Network & Security engineer who enjoys solving complex infrastructure and cybersecurity challenges? This is an exciting opportunity to work across networking, security, virtualisation, and modern infrastructure technologies while helping to build and maintain a secure, resilient, and high-performing technology environment.
9 days ago

Technician
Location: Johannesburg
Salary: Monthly
Are you a hands-on IT Support & Systems Technician who enjoys solving technical challenges, supporting business-critical systems, and working across desktop, server, and infrastructure environments? This is an exciting opportunity to join a technology-driven organisation where you will play a key role in maintaining reliable, secure, and efficient IT operations.
9 days ago

Solutions Expert Leader
Location: Johannesburg
Salary: Monthly
Are you a solutions-driven Project and Systems Leader with experience in logistics, transport, or business applications? This is an exciting opportunity to lead strategic software implementation projects, drive continuous improvement initiatives, and manage a specialist team responsible for delivering business-critical solutions across a dynamic operational environment.
9 days ago

Specialist Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Specialist Data Engineer in Johannesburg