Senior Data Engineer

PURPOSE OF ROLE

• Data is one of the most valuable resources a company owns, and savy data engineers are required to build an infrastructure to keep it organized. This role requires a significant set of technical skills, including a deep knowledge of SQL database design and multiple programming languages. Should also have stellar communication skills as you will work across departments and determine what business leaders want to gain from the company’s large datasets.
• Work with data to solve business problems, building and maintaining the infrastructure to answer questions and improve processes within the SaltEB environment
• Help streamline our data workflows, adding value to our product offering and building out our customer lifecycle and retention models
• Work closely with the other BI teams to develop data models and pipelines for research, reporting, and machine learning
• Be an advocate for best practices and continued learning

RESPONSIBILITIES

• Work closely with business to help them understand the data in the environment and enable data insights to the business unit to drive change.
• Create and maintain functional requirements, system specifications and blueprints in support of data architecture and detailed design specifications for current and future designs.
• Designing, implementing, and maintaining scalable and robust patterns for ingesting and transforming complex datasets from a multitude of sources.
• Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
• Create and manage data feeds to 3rd party system or enterprise applications
• Assist in identifying, designing, and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.

REPORTING

• Develop and maintain monthly and ad hoc reports as and when requested

QUERY RESOLUTION

• Attend to queries or inquiries within the required timelines
• Aid internal and external clients or service providers where necessary

INNOVATIVE & TEAM PLAYER

• Be able to work independently with minimal supervision
• Build and maintain supportive relationships both internally and externally
• Provides technical leadership to junior data engineers in the team

RELATIONSHIP MANAGEMENT

• Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.
• Build and maintain positive relationships with all clients and service providers.
• Be able to explain technical concepts to non-technical business leaders.

TIME MANAGEMENT

• Devote the whole of your time, attention, and abilities during working hours to the discharge of your duties.
• Work concurrently on multiple projects to deliver value to business.

QUALIFICATIONS

• Matric
• Bachelor’s degree in computer science, information technology, engineering or equivalent
• 3+ years of data engineering experience
• Experience with designing and implementing Cloud (AWS) solutions including use of APIs available.
• Some experience with Dev/OPS architecture, implementation and operation would be advantageous.
• 3+ years of experience with Python, SQL, and data visualization/exploration tools,(Power BI, Tableau, SAP Business Objects)
• Sound understanding of Data modeling fundamentals & design
• Cloud based technologies (AWS, Snowflake)
• Knowledge of SAP Hana would be an advantage
• Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data.
• Data Modelling (Kimball, Inmon, DataVault)