Big data Developer

 

Recruiter:

Indsafri

Job Ref:

JHB000256/MK

Date posted:

Tuesday, June 7, 2022

Location:

Johannesburg, South Africa


JOB SUMMARY:
The client is looking for the best candidate with big data experience to join their team.

JOB DESCRIPTION:

Role Description
This role provides an exciting opportunity to roll out a new strategic initiative within the firm-Enterprise Infrastructure Big Data Service. The Big Data Developer serves as a development and support expert with responsibility for the design, development, automation, testing, support and administration of the Enterprise Infrastructure Big Data Service. The roles require experience with both Hadoop and Kafka. This will involve building and supporting a real time streaming platform utilized by data engineering community. The incumbent will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.

Candidate Description
The incumbent will have the opportunity of working directly across the firm with developers, operations staff, data scientists, architects and business constituents to develop and enhance the big data service.
  • Development and deployment of data applications
  • Design & Implementation of infrastructure tooling and work on horizontal frameworks and libraries
  • Creation of data ingestion pipelines between legacy data warehouses and the big data stack
  • Automation of application back-end workflows
  • Building and maintaining backend services created by multiple services framework
  • Maintain and enhance applications backed by Big Data computation applications
  • Be eager to learn new approaches and technologies
  • Strong problem solving skills
  • Strong programming skills
  • Background in computer science, engineering, physics, mathematics or equivalent
  • Worked on Big Data platforms (Vanilla Hadoop, Cloudera or Hortonworks)
  • Preferred: Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean)
  • Preferred: Experience with some of the following: Apache Hadoop, Spark, Hive, Pig, Oozie, ZooKeeper, MongoDB, CouchbaseDB, Impala, Kudu, Linux, Bash, version control tools, continuous integration tools

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Application Developer (.NET)
Location: Johannesburg
Salary:
Ready to take your .NET expertise to the next level? Join a dynamic team in Sandton and work on impactful projects that make a real difference in healthcare and pharmaceutical sectors. This is your chance to thrive in a hybrid environment with flexibility and top-tier benefits!
4 days ago


C# Developer
Location: Johannesburg
Salary:
Are you a detail‑obsessed developer who loves building systems that actually interact with the real world? Tired of pushing virtual numbers around in the financial sector? Here’s your chance to build software that moves trucks, tracks goods, captures data, and keeps South Africa’s large‑scale logistics operations running. If you’re looking for a role where your ideas matter, ...
4 days ago


Senior Angular Developer
Location: Centurion
Salary: 70000.00 Monthly
Our client is seeking a highly skilled Senior Angular developer with strong experience in Angular 16+ and NgRx. The ideal candidate is technically sharp, a confident communicator, and ready to contribute to complex, high-impact projects in a collaborative environment.
4 days ago


C# .NET Software Developer
Location: Johannesburg
Salary: 40000.00 Monthly
Are you a detail-oriented developer who thrives on building high-performance, mission-critical applications? Our client, a specialist software provider in the logistics and supply chain sector, is seeking a C# .NET Software developer to join their compact, dynamic team in the East Rand (Ekurhuleni), Gauteng.
7 days ago


Mobile Software Developer
Location: Johannesburg
Salary: 35000.00 Monthly
Are you passionate about building high-quality mobile applications and bringing innovative ideas to life? Our client is seeking a skilled Mobile Software developer to join their Research and Development team in Roodepoort.
7 days ago


Senior Python Developer
Location: Sandton
Salary:
44 days ago


Intermediate/Senior Java Developer
Location: Pretoria
Salary: 60000.00 Monthly
Our client is seeking an Intermediate/Senior Java developer to join their dynamic team in a hybrid capacity based in Lynnwood Manor, Pretoria. This is an excellent opportunity to work on high-performance web applications, lead development initiatives, and contribute to innovative solutions in a fast-paced, collaborative environment. The role offers challenging projects and strong career growth opp...
15 days ago


Senior BI Developer - Hybrid
Location: Sandton
Salary:
77 days ago


Senior Specialist Data Scientist
Location: Johannesburg
Salary: 1 200 000
Mission/ Core purpose of the Job:To determine insights and develop statistical models from large quantities of structured and unstructured data to shape or meet specific business needs and goals.Trainingdata science and advanced analytics.data base modelling and data warehousing principles (SQL)big data tools (Spark, Hive, etc)Strong Programming skills (R, SAS, Python, C++, Java, etc…)Compu...
Today


Business Development Manager
Location: Midrand
Salary:
Are you an accomplished and results-driven sales professional with a strong track record of driving revenue growth? Our client is looking for a Business Development Manager to join a fast-growing software services company in Midrand, Gauteng. This is a key role for a strategic thinker who can identify market opportunities and turn them into tangible business success.
1 day ago


Create a free job alert for Big data Developer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions