Data Engineer

Our client is in the mining industry, and they are looking for a Data Engineer to join their team.

Our client lives their values of teamwork, respect, performance, and care, and they embody them through their work, actions, and behaviors.

They are a talented team with diverse and unique skills, and they value and embrace one another for that. They are uncomplicated, smart, agile, and collaborative in the way they work, and they offer meaningful and challenging work in a safe and inclusive environment. They care for the environment and communities they touch.

Ready to leverage your technical skills and passion for technology and contribute to a dynamic global team? Here's the opportunity for you to make an impact!

Reporting to the Lead: Data Engineering and Analytics, you will have primary responsibility for helping to shape a data driven culture in the company and assisting with a wide variety of problem solving across operational and functional solutions.

This position provides the opportunity for high value-creating activities with a focus on integrating applications and data throughout the organization.

The role will be responsible for identifying and gathering data from edge and business sources, creating, and implementing strategies for integrating various applications throughout the business, assisting with the creation and implementation of data and software architectures that serve the vision of the data analytics group, data cleaning and transformations using relevant tools and framework and implementing data security.

Our client believes in building a strong digital foundation including building out the capability, implementing data governance practices, improving data quality, managing master data, and ensuring the security of all data assets.

Here's what you will be doing:

General:

• Be a role model to the team and foster a team-oriented culture that promotes an overriding commitment to health, safety, environmental responsibility, sustainable development, and operational excellence.
• Demonstrated commitment to the company’s values.
• Drive results and efficiency through good decision-making, action and change management, and strong interpersonal / communication skills.

Key Accountabilities:

• Develop and document logical and physical data models based on requirements gathered by a deep understanding of the business problem being solved.
• Participate in requirements gathering sessions and stakeholder interviews and work with business / project analysts to translate business requirements into appropriate integration and persistence solutions in support of data science products.
• Responsible for designing, developing, testing, automating, monitoring, maintaining, and updating data integration and ingestion processes.
• Implement a unified data model for key data to enable integration of various applications.
• Perform data cleaning and transformation functions to ensure that data is ready for use in various applications.
• Develop, implement, and maintain our client’s data principles.
• Develop our client’s reference architecture for data integration and the related technology stack.
• Develop, maintain, and implement reusable data integration components across the technology landscape including IOT, on-premises and Cloud.
• Participate and contribute to uplifting the digital culture at our client through its Data Citizen activities.
• Responsible for data governance, implementing data quality procedures, master data management and the security of data assets at our client.
• Support the business and its vendors by servicing data requests and setting up data pipelines as required.
• Understand the data science delivery lifecycle.

Ideally, you will have:

Education and Experience:

• Tertiary qualification in Engineering or Computer Science.
• Experience in Azure cloud technologies would be beneficial.
• 4+ years industry experience.
• In-depth understanding of data structures and ETL along with real-world experience.
• Minimum of 2 years' hands-on experience on data engineering within a reputable team.

Knowledge, Skills and Abilities:

• Expert level knowledge and experience in data movement and data cleansing.
• Comfortable manipulating and analyzing complex, high-volume, high-dimensionality data from varying sources.
• Excellent SQL skills with capability to maintain databases.
• Strong programming skills (Python preferred) with experience using data manipulation frameworks such as Pandas, Numpy, Scipy and Scikitlearn (or similar).
• Comfort working with various structured and unstructured data formats.
• Technical knowledge of Business Intelligence tools, data warehousing, big data, reporting and analytics.
• Solid understanding of both relational and dimensional data models.
• Working knowledge of data and delta lake concepts.
• Knowledge of Databricks including delta tables and AutoML functionality.
• Previous experience with tools and languages such as Nifi, Azure Data Factory, Airflow, Prefect, and / or Sqoop.
• Expert knowledge on how to ingest and transform large volumes of complex industrial data into Azure, Cloudera, Hortonworks, etc. and making it available in a highly performing persistence layer.
• Cloud infrastructure knowledge and comfort with cloud-based data engineering tools (Azure preferred)
• Excellent communication and teamwork skills.
• Demonstrated agility, resilience, and self-motivation.
• Displays skills of critical thinking, analysis, problem solving and reasoning.
• Strong business acumen.
• Fosters knowledge sharing and cross-team collaboration within the organization.
• Able and willing to travel as required.

Area: Stellenbosch area.

Market related salary offered.

Starting date: As soon as possible.

Please apply online if you meet all the above requirements.

Please assume that your application was unsuccessful if you have not been contacted within 4 weeks from the date of this advertisement.