Data Engineer

SUMMARY:

About the job
Job Overview
 
This person is responsible for creating data pipelines to support downstream data delivery.  
A data pipeline is a series of automated, programmatic steps. These data pipelines gather data from numerous, potentially disparate data sources and bring everything together into a central place (data lake & warehouse) where it is made readily available for downstream consumption.  
The incumbent works with a variety of technologies on a day to day basis. The nature of the job requires constant upskilling and personal development.

POSITION INFO:

Outputs
 
There are two main outputs: 

1. Develop & maintain data pipelines in support of downstream data delivery. 
2. Perform analysis on organisational data & create reports to communicate the results. 

• Communicate and advocate for a data-driven mindset in the larger organisational community, especially the IT department. 
• Investigate and evaluate emerging technologies like robotic process automation (RPA), new AWS services, new data management approaches, machine learning advancements, etc.  
• Liaise with individuals in the organisation in support of all the above duties.  

• Relevant IT certificate/diploma/degree.
• Good programming skills in both Python and SQL. 
• Good database design skills and an understanding of data warehousing techniques and approaches. 
• Understanding of, and ability to access data from sources such as: 

1. Microsoft SQL Server 
2. Oracle 
3. MongoDB 
4. Amazon S3 
5. Windows and Linux file systems (Excel, delimited files, etc.) 
6. HTTP APIs 
7. SFTP sites 

• Ability to engineer cloud-first solutions in the Amazon Web Services cloud. 
• Interest in machine learning and advanced analytics, and the development of data pipelines in support thereof. 
• Understanding of the software development process, with proficiency in Git for version control and build & deployment pipelines in GitLab. 
• Ability to create reports and BI dashboards to communicate data & analysis results, using a variety of technologies, which might include: 

1. Microsoft SQL Server Reporting Services 
2. Microsoft PowerBI 

NB! This job is now closed. You can apply for other jobs by uploading your CV.