Data Engineer

SUMMARY:
Datacentrix's Insurance client is seeking a skilled Data Engineer to join their team on a 12 month contracting basis to be based onsite in Parktown. As a Data Engineer, you will be responsible for developing and maintaining data warehouse solutions, ETL processes, and data modeling. You should have expertise in Advanced TSQL scripting, building SSIS pipelines, and working with various data formats such as CSV, TXT, XML, JSON, XLS, XLSX. The ideal candidate must have 8+ years experience in design, build and support of data engineering pipelines.

POSITION INFO:
Core requirements

• Advanced TSQL scripting: stored procedures, views, functions
• Building and maintaining SSIS pipeline
• Data warehousing & modelling
• Working with CSV, TXT, XML, JSON, XLS, XLSX. Etc
• Data Analysis
• Working with relational databases
• Building and maintaining SSRS reports
• Using GIT
• CI/CD pipelines
• Performance monitoring and tuning

• Maintain, support, and monitor existing production SSIS packages and SQL Queries and Stored Procedures, CICD pipelines to make sure all data loads on data warehouse meet data quality standards and business SLA requirements.
• Build, maintain, support, and monitor Synapse data engineering pipelines on data platform if required.
• Participate and contribute to data architecture design, data modelling, gathering and analysis of data requirements; understand document, communicate, and build appropriate solutions.
• Participate, design, build, deliver, and document data related projects with various environment specific data analytics technologies.
• Promote data engineering best practices with CICD pipelines and automation.
• Collaborate and work closely with team members and contribute significantly to building a high performing, collaborative, transparent, and result-driven data engineering team.
• Support the Data Engineering Practice Team Manager with best fit-to-purpose data engineering solutions, quality engineering artifacts and high standard documentation.
• Follow Data Ethics standards to protect personal information and do the right thing to meet our customers’, partners’, and community’s expectations.

• 8+ year demonstrable experience in design, build and support of data engineering pipelines in the data warehousing, data ingestion, cleansing, manipulation, modelling and Reporting.
• Experience in ETL using Microsoft technologies.
• Strong experience in writing MS SQL server queries, stored procedures, and SSIS Packages.
• Experience with SSRS would be an advantage.
• Experience of manipulating semi-structured data (XML, JSON)
• Strong knowledge and extensive experience in working in an Agile framework with CI/CD using modern DevOps / Data Ops integrated processes with YAML pipelines.
• Bachelor’s degree in computer/data science technical or related field is a must. Post-graduate is highly regarded.
• Knowledge of Azure Synapse data engineering pipelines, PySpark notebooks, data platform lake house architecture and Azure SQL ODS storage is desirable.

NB! This job is now closed. You can apply for other jobs by uploading your CV.