Data Engineer

·         OUTPUTS

• Assemble large, complex data sets to meet functional / non-functional business requirements.
• Source data from internal and external data sources, engaging with technical subject matter experts.
• Explore, analyse and profile data from our various internal and external data sources, and help data scientists to prepare data for analytics purposes.
• Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various ‘big data’ technologies.
• Resolve critical data modelling issues impacting the functionality of BI products in production.
• Help streamline a better data supply chain for advanced analytics that goes from experimentation into production.
• Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing models for greater scalability.
• Engage with a wide range of technical stakeholders including data scientists, business analysts, other data engineers and solutions architects.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes.

• The complexity and variety of the most common challenges and problems.

• Delivering in a complex analytic environment
• Working with a high need for information security
• Diligence required when resolving data and technical issues and interacting with other support teams.
• Demanding business community

• How the job will typically impact the business and where the impact will be felt.

Information is an asset and it can be used strategically to gain a competitive edge in the market, hence

• Timely delivery required – information is key to business decisions
• Accurate delivery required – information is key to business decisions
• Access to information – information is key to business decisions

·         REQUIREMENTS

• Knowledge:
• Experience:
• Competencies:
  • Analytical Thinking
  • Highly organised person
  • Structured investigation and troubleshooting skills
  • Never give up attitude
  • Team worker to lead by example
  • Documenting of process detail
  • Focus on the detail but understand the high-level deadlines to enable delivery on time with limited time
  • Functionally and operationally inclined.
  • Have a keen eye for detail, but able to think strategically.
  • Proactive and a fast learner with a thirst for continuous knowledge enhancement.
  • Love collaborating towards a common goal.
  • Committed and solution orientated.
  • Ability to articulate thoughts and problem statements well.
  • Ability to remain motivated despite curveballs and pressure.
  • Take ownership.

• You have a strong data modelling / engineering background with the ability to interpret business requirements and technical solutions to develop components of or complete data models.
• A solid background in SQL, information architecture and ETL procedures is required.
• Experience working on SAP Hana is preferred and highly advantageous.
• Experience with object-oriented/object functional scripting languages: Python, Java, C++, Scala or related is preferred but not essential.
• Data warehousing principles based on Kimball and Vault patterns
• Development experience in BI
• Agile Development
• Development using Java, SQL, etc

• 2+ years'' experience as a data engineer / modeller experience in a BI environment.

• Ability to comply to and manage reusable assets under the governance framework of the DSUA and MOU
• Excellent SQL skills
• Ability to code in Java, Python, R plus other languages - advances, including understanding of SDLC, GIT, Code management / standards / re use and API integration (Expert)