Big data Developer

Recruiter:

Indsafri

Job Ref:

JHB000256/MK

Date posted:

Tuesday, June 7, 2022

Location:

Johannesburg, South Africa

JOB SUMMARY:
The client is looking for the best candidate with big data experience to join their team.

JOB DESCRIPTION:

Role Description
This role provides an exciting opportunity to roll out a new strategic initiative within the firm-Enterprise Infrastructure Big Data Service. The Big Data Developer serves as a development and support expert with responsibility for the design, development, automation, testing, support and administration of the Enterprise Infrastructure Big Data Service. The roles require experience with both Hadoop and Kafka. This will involve building and supporting a real time streaming platform utilized by data engineering community. The incumbent will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.

Candidate Description
The incumbent will have the opportunity of working directly across the firm with developers, operations staff, data scientists, architects and business constituents to develop and enhance the big data service.

Development and deployment of data applications
Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
Creation of data ingestion pipelines between legacy data warehouses and the big data stack
Automation of application back-end workflows
Building and maintaining backend services created by multiple services framework
Maintain and enhance applications backed by Big Data computation applications
Be eager to learn new approaches and technologies
Strong problem solving skills
Strong programming skills
Background in computer science, engineering, physics, mathematics or equivalent
Worked on Big Data platforms (Vanilla Hadoop, Cloudera or Hortonworks)
Preferred: Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
Preferred: Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

2050 - AWS Data Engineer
Location: Pretoria
Salary: Neg Monthly
Large company in Pretoria looking to fill this urgent role. Contracthybrid (2/3 times at the office)
1 day ago

AWS Data Engineer (Expert)
Location: Midrand
Salary:
Join our team as an AWS data Engineer (Expert) and leverage your skills in building and maintaining big data Pipelines using advanced cloud platforms. We seek innovative problem-solvers with expertise in Python, SQL, and AWS services to drive our data initiatives forward. Be part of a collaborative environment where your contributions ensure accurate and secure data management.
1 day ago

Intermediate Data Engineer - Johannesburg – up to R700k per annum
Location: Johannesburg
Salary: 700000
Intermediate data Engineer - Johannesburg – up to R700k per annum
5 days ago

Mulesoft Integration Platform Engineer
Location: Johannesburg
Salary:
Join an exciting and dynamic team of API Gateway Platform Engineers, who are responsible for shaping the technical API economy for the bank.
8 days ago

Platform Engineer (Mulesoft Integration)
Location: Johannesburg
Salary: Hourly
We are in search of a PLATFORM ENGINEER with expertise in Mulesoft Integration for one of our banking industry clients, for a 12-month rolling employment contract. The incumbent will be joining the Platforms and Engineering Gateway technology tribe responsible for the development, design and run of the Mulesoft API and Integration platform residing onâpremises and AWS Cloud.Apply platform e...
8 days ago

AWS Data Engineer (Senior) 2517
Location: Pretoria
Salary: Monthly
AWS data Engineer
12 days ago

Data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
Location: Johannesburg
Salary: 1000000
data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
26 days ago

Enterprise Sales Manager (Network products)
Location: Johannesburg
Salary: 1000 Annually
Responsible for delivering growth in revenue from existing customers and on-boarding new customers in the region. You are the Customer champion and the face of our client in ensuring customer satisfaction and positioning our client as their partner of choice.Â Leverage your regional expertise within Enterprise. Defend existing revenue streams by minimising churn of services. Drive cross-functiona...
6 days ago

Data Scientist
Location: Johannesburg
Salary:
Are you a talented data Scientist seeking an exciting opportunity to revolutionize the banking industry? Join a dynamic team at a leading financial institution as we harness the power of data to drive innovation and enhance customer experiences!
8 days ago

Solutions Architect
Location: Midrand
Salary:
Falcorp Technologies is a black empowerment Digital Technology company in South Africa offering Technology Consulting, Application Services, Infrastructure Services, Portal and Content Management, and Systems Integration Services. Our focus is on enabling business enterprises through cutting-edge innovative IT solutions that provide strategic differentiation and operational superior...
8 days ago

Big data Developer

Similar jobs you might be interested in:

Create a free job alert for Big data Developer in Johannesburg