Big data Developer

Recruiter:

Indsafri

Job Ref:

JHB000256/MK

Date posted:

Tuesday, June 7, 2022

Location:

Johannesburg, South Africa

JOB SUMMARY:
The client is looking for the best candidate with big data experience to join their team.

JOB DESCRIPTION:

Role Description
This role provides an exciting opportunity to roll out a new strategic initiative within the firm-Enterprise Infrastructure Big Data Service. The Big Data Developer serves as a development and support expert with responsibility for the design, development, automation, testing, support and administration of the Enterprise Infrastructure Big Data Service. The roles require experience with both Hadoop and Kafka. This will involve building and supporting a real time streaming platform utilized by data engineering community. The incumbent will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.

Candidate Description
The incumbent will have the opportunity of working directly across the firm with developers, operations staff, data scientists, architects and business constituents to develop and enhance the big data service.

Development and deployment of data applications
Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
Creation of data ingestion pipelines between legacy data warehouses and the big data stack
Automation of application back-end workflows
Building and maintaining backend services created by multiple services framework
Maintain and enhance applications backed by Big Data computation applications
Be eager to learn new approaches and technologies
Strong problem solving skills
Strong programming skills
Background in computer science, engineering, physics, mathematics or equivalent
Worked on Big Data platforms (Vanilla Hadoop, Cloudera or Hortonworks)
Preferred: Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
Preferred: Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer / Data Scientist – Midrand / Semi-Remote – R600 PH
Location: Pretoria
Salary: 1152000
data Engineer / data Scientist – Midrand / Semi-Remote – R600 PH
11 days ago

Data Engineer (Databricks, AWS, Python) – JHB – up to R450k per annum
Location: Johannesburg
Salary: 450000
data Engineer (databricks, AWS, Python) – JHB – up to R450k per annum
15 days ago

Data Scientist – Johannesburg – up to R800k per annum
Location: Johannesburg
Salary: 800000
data Scientist – Johannesburg – up to R800k per annum
21 days ago

AI Engineer
Location: Johannesburg
Salary: Monthly
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.We are looking for a AI Engineer / AI developer to join our financial services client based in Sandton for a 6-months contract role.
23 days ago

Intermediate Cloud Data Engineer – Johannesburg – up to R600k per annum
Location: Johannesburg
Salary: 600 000
Intermediate Cloud data Engineer – Johannesburg – up to R600k per annum
24 days ago

Intermediate Web (UI) Developer (C#) – Centurion (In-Office Full Time) – up to R470k per annum
Location: Pretoria
Salary: 470000
Intermediate Web (UI) developer (C#) – Centurion (In-Office Full Time) – up to R470k per annum
44 days ago

Data Engineer/ Scientist – Johannesburg – up to R580 per hour
Location: Johannesburg
Salary: 1113600
data Engineer/ Scientist – Johannesburg – up to R580 per hour
45 days ago

Data Scientist – Pretoria – up to R900k per annum
Location: Pretoria
Salary: 900000
data Scientist – Pretoria – up to R900k per annum
46 days ago

Intermediate Cloud Data Engineer – Johannesburg – up to R600k per annum
Location: Johannesburg
Salary: 600 000
Intermediate Cloud data Engineer – Johannesburg – up to R600k per annum
51 days ago

Mulesoft Specialist Platform Engineer – Johannesburg – R500 PH
Location: Johannesburg
Salary: 960000
Mulesoft Specialist Platform Engineer – Johannesburg – R500 PH
53 days ago

Big data Developer

Similar jobs you might be interested in:

Create a free job alert for Big data Developer in Johannesburg