Data Engineer

SUMMARY:
Our client based in Sandton is seeking the expertise of a Data Engineer to ensure effective movement, collection, integration, storage and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such  as Enterprise Architecture, Database and Solution Architects, Business Intelligence Developers, Data Scientists and Product Owners, etc.)
 

POSITION INFO:
Education and Minimum Requirements

• Bachelor’s Degree in Computer Science, Engineering or Information Systems
• 3 to 5 years in Extract, Transform and Load (ETL) of data from source systems or experience in data integration for consumption use cases

• Cognitive| Analysis and Attention to Detail |Service
• The ability to be systematic and rule oriented in gathering, reviewing, evaluating and visualizing data from a variety of perspectives; includes the ability to work with precision
• Cognitive| Problem Solving| Service
• Cuts to the core of issues and applies effective analysis, logic and creativity to implement solutions
• Communication| Influencing And Impact (inc. Negotiation)|Service
• Creates impact and influences others to support an idea, concept or direction through being credible, trusted and authentic
• Communication| Presentation and Facilitation| Service
• Uses appropriate presentation and facilitation techniques to engage an audience and help them understand, retain and respond appropriately to the message
• Functional| Process And Technological Competence |Service
• Utilizes, identifies, engineers and leverages processes and technologies to meet business needs
• Functional| Research Competence| Service
• The capacity to work with research questions, gather and structure relevant data and present results as compelling, defensible arguments. Identifies and leverages multiple platforms and sources to stay abreast of and / or influence current thinking
• Interpersonal| Building Relationships| Service
• In the business of being human, builds sound relationships based on trust and openness
• Intrapersonal| Drive And Results Orientation| Service
• Is a self-starter who produces consistently high quality outputs within agreed deadlines
• Prompt and proactive in driving for results and sets challenging goals for self and others
• Technical| Data Management| Intermediate
• Loading, extraction, staging, transformations and quality assurance of data to support business decisions
• Technical| Data Warehouse development| Intermediate
• Practical Application
• Technical| Understanding of Business Systems Data| Intermediate
• Understand the underlying data of the various systems, what each field means and how the systems interact from a data perspective

• Deliver against operational and cost targets
• Prioritize resource allocation to minimize and reduce wastage
• Monitor costs for the financial year according to the operational plan
• Allocates and approves expenditure
• Review cost reports and resolves or explains variances to the budge
• Identify, control and escalate potential risks that may lead to increased costs
• Manage costs or expenses within approved budget to achieve cost efficiencies
• Build relationships that allow for the managing of expectations; the sharing of knowledge and diverse insights; and the creation of buy-in
• Engage in cross-functional relationships to obtain and to provide work support
• Conduct research on emerging technologies
• Recommend and implement technologies that improve cost effectiveness and systems flexibility
• Confer with end users, clients, or senior management to understand business requirements for complex development or enhancements
• Assist with gap analysis and business cases including cost and effort analysis
• Acquire and collect data via ETL (Extract, Transform and Load) processes from source systems into the Reservoir and Enterprise Data warehouse, adhering to the appropriate data platform standards
• Integrate data from multiple sources through the enterprise data platform architecture to meet the business objective
• Develop and maintain the physical data marts and databases
• Automate tasks related to data pipelines for the deployment of operational analytics
• Prepare and provision data for advanced analytical modelling by data scientists (as and when applicable)
• Perform data quality assessments and introduce monitors and alerts to ensure data quality is maintained throughout all managed systems
• Conduct hands-on work related to profiling, documenting and validating the clients
• Execute remediation actions as agreed with client
• Install or update required system components
• Implement the necessary components and frameworks required for automated deployments and task scheduling
• Build unit and systems tests to ensure successful delivery of components into production
• Manage the user acceptance testing UAT and associated signoff through change control
• Create change scripts and sets scripts up to be ready and implemented in production
• Participate in architecture forum and solutions design
• Utilize various components and tools which make up the data platform for enhanced service delivery
• Create requirements and design of the technical architecture, Design and development, testing, and deployment of the proposed solution
• Work with Senior Engineer to present technology solutions to senior leadership and influence architectures that will lead the transformation of our IT data analytics platform
• Learn from the Subject Matter Expert on technical environment or tools for own area of expertise
• Provide Analytic infrastructure or big data technologies related support to Data operations and Analytic teams Grow online technical knowledge platform, identify best practices and develop guidelines for optimum usage of tools
• Assist and work on projects to roll out and support to team members
• Participate and contribute to a development culture where information regarding successes, issues, trends and ideas are actively shared
• Build and sustain collaborative working relationships with relevant peers and stakeholders to achieve productivity synergies
• Participate in specialist communities of practice and contribute positively to own and organizational knowledge improvement
• Assess own performance against competencies and skills required delivery
• Identify development needs and select effective solutions to address own development need
• Prepare a personal development plan with management to implement and review as required
• Monitor own progress against development plan and measure impact of results

NB! This job is now closed. You can apply for other jobs by uploading your CV.