Intermediate Data Engineer

Recruiter:

Network Recruitment

Job Ref:

ITE006128/ANR

Date posted:

Thursday, July 11, 2024

Location:

Johannesburg, South Africa

Salary:

R 54 200

SUMMARY:
Are you a data enthusiast with a passion for designing and optimizing robust data systems? We are looking for a skilled Data Engineer to join our team. Your expertise will drive the development and management of our cloud and on-premises data pipelines, ensuring the seamless flow of high-quality data across our organization.

POSITION INFO:
Intermediate Data Engineer Johannesburg Responsibilities: Develop and manage data pipelines to support data scientists, analysts, actuaries, and other initiatives. Ensure accurate, efficient, and cost-effective development of robust data systems in line with the organization's data strategy. Implement data validation processes to maintain clean, high-quality data. Establish and enforce guidelines for data collection, integration, and retention. Monitor data sources, processing, and environment for inconsistencies or anomalies, and resolve data quality problems. Leverage Azure DevOps Repos for version control and foster a collaborative development environment. Implement CI\/CD practices using Azure Pipelines to automate and streamline build and deployment processes. Ensure seamless integration between code repositories and deployment pipelines. Build and nurture relationships across the business to ensure alignment and commitment to data engineering objectives. Engage effectively with stakeholders to drive the success of data initiatives. Participate in assessment and development planning activities, formal and informal training, and coaching. Maintain an understanding of relevant technology, external regulation, and industry best practices through ongoing education and professional development. Up-skill in all facets of data engineering. Skills: Expert knowledge in Azure data services including Azure Data Factory, Azure Databricks, Data Lake, SQL Databases, Azure DevOps Boards and Repos. Proficiency in large-scale data processing with Apache Spark. Knowledge of GCP and AWS is desirable but not essential. Proficiency in Python and SQL is imperative. Exposure to PySpark is advantageous. Qualifications: Grade 12\/SAQA Accredited Equivalent (Essential) 3-year Degree in Information Technology\/Sciences\/Informatics\/Computer Sciences (Essential) Master's Degree in Information Technology\/Sciences\/Informatics\/Computer Sciences (Advantageous) Experience: 2 to 5 years of experience in data engineering, data science, or computer science (Essential) Experience in the Financial Services Industry, specifically Short-Term Insurance (Advantageous) We appreciate your interest, however if you have not had any response within 2 weeks, please consider your application unsuccessful. We also invite you to contact us to discuss your next career move in IT. IT Consultant

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Intermediate Data Engineer
Location: Johannesburg
Salary: 670000 Annually
Our client is looking for a data engineer to join their team in Bryanston. You should have a Degree in Computer Science, Information Systems, engineering with at least 3 - 6 years experience. You need experience in databricks and Python as well as ELT tools. Send your CV now!
27 days ago

C# Developer
Location: Pretoria
Salary:
Our client, an industry leader in diversified financial services and wealth management, is on the hunt for skilled C# Developers (intermediate to Senior level) to join their team on a 6-month contract. The ideal candidate is one who is passionate about building robust applications and working with modern technologies.
5 days ago

C# Developer
Location: Pretoria
Salary: Monthly
We are looking for an intermediate C# developer with about 3 years of experience.
11 days ago

Data Engineer
Location: Johannesburg
Salary:
data engineer - Johannesburg - City DeepA skilled data engineer is required to support and enhance data platforms, reporting environments, data integration solutions, and business intelligence capabilities. The ideal candidate will have 2–5 years’ experience in data engineering, BI, reporting, SQL development, or data analytics, with strong SQL skills and experience in reporting and an...
12 days ago

Credit Controller
Location: Johannesburg
Salary:
Are you a commercially minded Credit Controller who understands that effective credit management is about more than collections? Do you enjoy analysing risk, improving processes, and contributing to the financial health of a growing business?
Today

C# Developer
Location: Pretoria
Salary:
Our client, a leader in financial services and wealth management, is looking for skilled C# Developers to join their team. Ideal for those passionate about building robust applications using modern technologies.
1 day ago

Credit Controller
Location: Johannesburg
Salary: 300000 Annually
Are you a Credit Controller who thinks beyond “Please pay ASAP”? If you’re analytical, innovative and obsessed with building smarter processes, not just chasing debt, this fintech disruptor wants you on their cash flow command centre. This isn’t about dialling for Rands - It’s about managing risk, protecting relationships and engineering collections with precision.
2 days ago

Credit Controller
Location: Johannesburg
Salary: 300000 Annually
Are you a Credit Controller who understands that collections is as much strategy as it is persistence?If you’re someone who looks beyond “follow up and collect” and focuses on risk, relationships, and smarter processes, this could be your next move.
4 days ago

Sales & Service Representative
Location: Johannesburg
Salary: 15 000 Monthly
A Johannesburg-based company providing comprehensive industrial water treatment, including chemicals, equipment, and services for boiler systems, cooling towers, and chillers is in need of a Sales and Service Representative with a minimum of 2 years maintenance and sales experience within the water treatment industry.
4 days ago

Accountant
Location: Johannesburg
Salary:
Are you a driven and detail-oriented finance professional looking to grow your career in the property sector? This opportunity is perfect for a confident, hands-on individual who is eager to develop their skills within a dynamic and fast-paced environment.
6 days ago