Big Data Hadoop Developer

 

Recruiter:

PBT Group

Job Ref:

ADL0003

Date posted:

Tuesday, August 17, 2021

Location:

Johannesburg, South Africa

Salary:

Market Related


SUMMARY:
PBT Group has an opportunity for a Big Data Hadoop Developer with solid experience in Spark.

POSITION INFO:

PBT Group has an opportunity for a Big Data Hadoop Developer with solid experience in Spark.

 

With over two decades of expert knowledge and experience as information management specialists, PBT is a recognised leader in Business Intelligence and data warehousing and has extended its competency base to cover data quality and advanced analytics.

 

We pride ourselves to be a company who attracts, recruits and retains consultants of an exceptional calibre, not only within BI, but also within focused areas of Application Development.

 

We have worked in more than 25 countries around the world and are currently implementing large-scale projects throughout Africa, the Middle East and Australia.

 

Duties:

- Support and Administration of existing Big Data solution – this include production, development and DR environments

- Analysis, Design, Development and maintenance of ETL processes – this will include development of NiFi flows for feed integration, Design of appropriate tables, development of Spark processes to load data and ongoing maintenance of these.

- Development of Linux scripts to automate support and maintenance tasks

 

Skills Required:

- 5+ years working in software development

- 2+ years developing, deploying and maintaining high volume production big data solutions

- 2+ years developing solutions in Spark using Scala & Python, Spark SQL, Spark Streaming

- 2+ years’ experience programming in Java

- Oozie workflow development and maintenance

- Experience using Ambari to administer a Big Data environment

- NiFi flow development, administration and maintenance

- HBase administration and table design

- Table design and DB administration in Apache Phoenix

- Analytics with Hive

- Security administration using Ranger

- Development of Kafka producers and consumers

- Strong database, SQL, ETL and data analysis skills

- Ability to work within a team

- Experience with basic Linux administration

 

Nice to have:

- Experience maintaining a Hortonworks environment

- HDP Certified Administrator qualification

- Master''''''''s degree in Computer Science or equivalent.

- Knowledge of EMC Isilon is an asset

- Experience with Bash Scripting

 

Qualifications/ Certification:

- Bachelor''''''''s degree in Computer Science or equivalent



 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary:
Where big data Becomes big Impact. If you believe data should drive solutions — not just storage — this opportunity is built for you. Step into a role where robust engineering meets real‑world business outcomes, and where your ability to build powerful, scalable data ecosystems shapes the future of decision‑making. This is your chance to design, automate, and optimise data pip...
18 days ago


Senior Data Scientist
Location: Johannesburg
Salary:
19 days ago


Manager: Data Analytics
Location: Johannesburg
Salary:
Our client in the Telecoms sector is looking for a Manager: data Analytics on a contract duration of 6 to 12 months.
25 days ago


Manager: Data Science
Location: Johannesburg
Salary:
Our client in the Telco sector is seeking a professional Manager: data Science on a contract duration of 6 to 12 months
25 days ago


Senior Data Scientist
Location: Johannesburg
Salary:
40 days ago


AI Engineer
Location: Johannesburg
Salary:
50 days ago


Data Scientist
Location: Johannesburg
Salary:
Are you a data-driven problem solver who thrives on uncovering insights, building predictive models, and shaping strategic decisions?We’re looking for a highly analytical and innovative data Scientist who can transform complex datasets into meaningful intelligence. If you enjoy collaborating with cross‑functional teams and bringing technical excellence into real‑world business applicatio...
60 days ago


Senior Implementation Consultant
Location: Johannesburg
Salary:
An exciting opportunity for a senior insurance professional who enjoys translating business requirements into practical system solutions while working closely with corporate clients and internal stakeholders.
2 days ago


Intermediate DevOps Engineer
Location: Johannesburg
Salary:
A strong opportunity for an experienced DevOps professional who enjoys building reliable platforms improving delivery pipelines and supporting scalable digital solutions within a complex enterprise environment.
3 days ago


Customer Success Consultant
Location: Johannesburg
Salary:
Looking to grow long term client value while working closely with established business partners in a fast moving services environment. This opportunity offers exposure to relationship management sales support and account development with room for professional growth.
3 days ago


Create a free job alert for Big Data Hadoop Developer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions