Data Engineer Johannesburg

Recruiter:

Career Circuit

Job Ref:

Data Engineer Johan..

Date posted:

Tuesday, April 19, 2022

Location:

Johannesburg, South Africa

Salary:

Market Related

JOB SUMMARY:
Data Engineer Johannesburg

JOB DESCRIPTION:

Think like a scientist; build like a software engineer. Our data engineers create robust and scalable computing environments which bring data-driven technologies to our users. We are constantly challenging ourselves to build more effective data architectures, flexing our freedom to incorporate new technologies and expand our computing power.

Strong candidates will have a mix of the following:

vFluency in Python and some variety of SQL.

vA strong degree in computer science, or a quantitative discipline.

vExperience in designing and setting up large data systems, with an ability to assess the tradeoffs in architectural decisions.

vExperience with distributed processing frameworks (Hadoop, Spark, etc).

vKnowledge of large data architectures (data warehouses, lakes, meshes, etc).

vExperience working in cloud environments, especially Azure.

vExperience in building and optimizing big data pipelines.

vDesigning and implementing data warehouses, data lakes and data meshes.

vAdvanced knowledge of relational, non-relational databases with strong experience in SQL.

vWorking knowledge of streaming, message queuing and highly scalable data stores.

vUnderstanding of DevOps processes, CI/CD and agile development.

vExperience in testing and observability in the context of big data.

vExperience with distributed processing frameworks (Apache Spark, Hive, Kafka, etc).

vHaving worked in a cloud environment (Azure, AWS).

vSpecific technologies: - Python, R, Scala - SQL (MS SQL Server, Postgres) - Apache Spark, Hadoop, Hive - Databricks, EMR.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer
Location: Johannesburg
Salary: Hourly
Our client, a well-established global financial services group with a long-standing presence in South Africa, operating within a highly regulated, data-driven environment, is seeking an Intermediate data engineer to join their team on a 12-month contract. This role offers the opportunity to work in a collaborative environment, combining technical SQL expertise with data-driven insights to sup...
Today

Data Engineer/API Developer
Location: Sandton
Salary:
Today

Junior AWS Data Engineer
Location: Randburg
Salary: R150 Hourly
Our esteemed client is looking for a Junior AWS data engineer for their Hadoop team!
3 days ago

Data Engineer/Scientist - 3407
Location: Pretoria
Salary: Neg Monthly
ð AWS data engineer | Cloud & AnalyticsWe’re looking for an AWS data engineer to build scalable data pipelines, cloud solutions, and dashboards that drive real business decisions.
4 days ago

Senior Backend Engineer (Data & Systems)
Location: Centurion
Salary:
Ready to build the engines that power spatial intelligence? ð Tired of building basic CRUD apps? ð Join a specialized boutique tech hub in Gauteng and architect the high-performance data systems that map out the future of logistics and retail across Africa. We need a Senior Backend Polyglot who can master complex ETL pipelines and turn massive datasets into actionable intelligence. If y...
4 days ago

Lead Data Engineer
Location: Johannesburg
Salary: R90 000 - R115 000
data engineer - Lead
3 days ago

Senior SharePoint Data Engineer
Location: Johannesburg
Salary:
6 days ago

Data Engineer (Microsoft Fabric)
Location: Johannesburg
Salary: Annually
The data engineer will be responsible for enhancing business intelligence, optimising operations and driving data driven decision making. Your Microsoft Fabric experience will help lead the initial phases of a warehouse rework project and support ongoing expansion of our newly created data warehouse within the Microsoft Fabric platform.
7 days ago

Data Engineer
Location: Johannesburg
Salary: Annually
The data engineer will be responsible for developing data architecture and integration pipelines to ensure information accuracy, quality and accessibility.
8 days ago

Data Engineer
Location: Johannesburg
Salary: R 1 000 000 Annually
Are you an experienced data engineer ready to take on a high-impact role? Join a forward-thinking organisation in Sandton and help design scalable data solutions that drive business intelligence. If you have GCP and Big data expertise, this is your chance to make a difference!
9 days ago

Data Engineer Johannesburg

Similar jobs you might be interested in:

Create a free job alert for Data Engineer Johannesburg in Johannesburg