Senior Data Engineer

Purpose:

• Data is one of the most valuable resources a company owns, and savvy data engineers are required to build an infrastructure to keep it organized. This role requires a significant set of technical skills, including a deep knowledge of SQL database design and multiple programming languages. Should also have stellar communication skills as you will work across departments and determine what business leaders want to gain from the company’s large datasets.
• Work with data to solve business problems, building and maintaining the infrastructure to answer questions and improve processes.
• Help streamline our data workflows, adding value to our product offering and building out our customer lifecycle and retention models
• Work closely with the other BI teams to develop data models and pipelines for research, reporting, and machine learning.

Requirements:

• Bachelor’s degree in computer science, information technology, engineering or equivalent.
• 3 years of data engineering experience.
• Experience with designing and implementing Cloud (AWS) solutions including use of APIs available.
• Experience with Dev/OPS architecture, implementation and operation would be advantageous.
• 3 years of experience with Python, SQL, and data visualization/exploration tools,(Power BI, Tableau, SAP Business Objects)
• Sound understanding of Data modeling fundamentals & design
• Cloud based technologies (AWS, Snowflake)
• Knowledge of SAP Hana would be an advantage
• Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data.
• Data Modelling (Kimball, Inmon, DataVault)

Responsibilities:

• Work closely with business to help them understand the data in the environment and enable data insights to the business unit to drive change.
• Create and maintain functional requirements, system specifications and blueprints in support of data architecture and detailed design specifications for current and future designs.
• Designing, implementing, and maintaining scalable and robust patterns for ingesting and transforming complex datasets from a multitude of sources.
• Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
• Create and manage data feeds to 3^rd party system or enterprise applications
• Assist in identifying, designing, and implementing robust process improvement activities to drive efficiency and automation for greater scalability.
• Develop and maintain monthly and ad hoc reports as and when requested.
• Attend to queries or inquiries within the required timelines.
• Be able to work independently with minimal supervision.
• Build and maintain supportive relationships both internally and externally.
• Provides technical leadership to junior data engineers in the team.
• Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.
• Build and maintain positive relationships with all clients and service providers.
• Be able to explain technical concepts to non-technical business leaders.
• Devote the whole of your time, attention, and abilities during working hours to the discharge of your duties.
• Work concurrently on multiple projects to deliver value to business.