Intermediate Data Engineer

Recruiter:

Network Recruitment

Job Ref:

ITE006128/ANR

Date posted:

Thursday, July 11, 2024

Location:

Johannesburg, South Africa

Salary:

R 54 200

SUMMARY:
Are you a data enthusiast with a passion for designing and optimizing robust data systems? We are looking for a skilled Data Engineer to join our team. Your expertise will drive the development and management of our cloud and on-premises data pipelines, ensuring the seamless flow of high-quality data across our organization.

POSITION INFO:
Intermediate Data Engineer
Johannesburg

Responsibilities:

Develop and manage data pipelines to support data scientists, analysts, actuaries, and other initiatives.
Ensure accurate, efficient, and cost-effective development of robust data systems in line with the organization's data strategy.
Implement data validation processes to maintain clean, high-quality data.
Establish and enforce guidelines for data collection, integration, and retention.
Monitor data sources, processing, and environment for inconsistencies or anomalies, and resolve data quality problems.
Leverage Azure DevOps Repos for version control and foster a collaborative development environment.
Implement CI/CD practices using Azure Pipelines to automate and streamline build and deployment processes.
Ensure seamless integration between code repositories and deployment pipelines.
Build and nurture relationships across the business to ensure alignment and commitment to data engineering objectives.
Engage effectively with stakeholders to drive the success of data initiatives.
Participate in assessment and development planning activities, formal and informal training, and coaching.
Maintain an understanding of relevant technology, external regulation, and industry best practices through ongoing education and professional development.
Up-skill in all facets of data engineering.

Skills:

Expert knowledge in Azure data services including Azure Data Factory, Azure Databricks, Data Lake, SQL Databases, Azure DevOps Boards and Repos.
Proficiency in large-scale data processing with Apache Spark.
Knowledge of GCP and AWS is desirable but not essential.
Proficiency in Python and SQL is imperative.
Exposure to PySpark is advantageous.

Qualifications:

Grade 12/SAQA Accredited Equivalent (Essential)
3-year Degree in Information Technology/Sciences/Informatics/Computer Sciences (Essential)
Master’s Degree in Information Technology/Sciences/Informatics/Computer Sciences (Advantageous)

Experience:

2 to 5 years of experience in data engineering, data science, or computer science (Essential)
Experience in the Financial Services Industry, specifically Short-Term Insurance (Advantageous)

We appreciate your interest, however if you have not had any response within 2 weeks, please consider your application unsuccessful.
We also invite you to contact us to discuss your next career move in IT.

IT Consultant

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Intermediate Data Engineer
Location: Johannesburg
Salary: 670000 Annually
Our client is looking for a data engineer to join their team in Bryanston. You should have a Degree in Computer Science, Information Systems, engineering with at least 3 - 6 years experience. You need experience in databricks and Python as well as ELT tools. Send your CV now!
6 days ago

Data Engineer
Location: Johannesburg
Salary: Hourly
Our client, a well-established global financial services group with a long-standing presence in South Africa, operating within a highly regulated, data-driven environment, is seeking an intermediate data engineer to join their team on a 12-month contract. This role offers the opportunity to work in a collaborative environment, combining technical SQL expertise with data-driven insights to sup...
20 days ago

Data & BI Support Analyst
Location: Johannesburg
Salary:
Drive smarter decisions through data, insight, and innovation.If you are a data-driven problem solver who enjoys turning complex information into clear, actionable insights, then this is for you. Our client, a leading specialist in providing services and equipment to clients in the beverage and commercial arena, is looking for a data & BI Support Analyst to partner with their BI Manager and he...
16 days ago

Junior BI Developer
Location: Johannesburg
Salary:
Are you detail-driven, curious, and eager to grow your career in Business Intelligence?Our client, a leading direct selling company, is seeking a Junior BI Developer to join their development team and help design, deliver, and maintain BI solutions that power smarter decision-making across the organisation.This is the perfect role for someone with foundational Microsoft data skills who is ready to...
4 days ago

DevOps Engineer (Intermediate)
Location: Johannesburg
Salary:
Big impact. Serious tech.Help drive a modern DevOps capability in an independent unit within a leading financial services group. Hybrid working with flexibility and trust.
14 days ago

FullStack Developer with AML and Financial Services -Software Engineer (Azure)
Location: Johannesburg
Salary:
55 days ago

Intermediate Software Engineer - Full Stack / Python
Location: Johannesburg
Salary: 50 000 Monthly
Role: intermediate Software engineer - Full Stack / PythonLocation: Remote roleOur client is a leading Cloud technology company who require an intermediate Full Stack Software engineer (Python), to join their growing engineering team. The role spans backend development, frontend integration, DevOps, and data-driven systems, contributing to the design and delivery of scalable, production-grade plat...
26 days ago

Patient Services Manager
Location: Johannesburg
Salary: R750K neg
Patient Services Manager - East Rand
Today

Front Office and Research Admin Assistant
Location: Pretoria
Salary: R21 000 CTC (Including benefits)
We are seeking a professional, well-presented, and personable Front Office Administrator to join an established and reputable company based in the Lynnwood area of Pretoria East.The ideal candidate will be well-spoken, friendly, and highly organised, with a passion for delivering exceptional customer service. This role will serve as the first point of contact for clients and visitors, while provid...
Today

Intermediate QA Tester
Location: Johannesburg
Salary: 30 000 Monthly
Are you a QA professional with experience in both Manual and Automation Testing? Join a fast-paced technology environment where quality is at the heart of every delivery.
1 day ago