Data Engineer

 

Recruiter:

PBT Group

Job Ref:

3639425302

Date posted:

Tuesday, October 19, 2021

Location:

Johannesburg, South Africa

Salary:

Negotiable


SUMMARY:
-

POSITION INFO:

PBT Group has an opportunity for a Data Engineer to ensure effective movement, collection, integration, storage and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such as Enterprise Architecture, Database and Solution Architects, Business Intelligence Developers, Data Scientists and Product Owners, etc).

Â

Duties:

  • Control expenditure and identify process improvements to contain and reduce costs
  • Build working relationships across teams and functional lines to enhance work delivery, collaboration and innovation
  • Conduct research on architectural systems
  • Contribute to business analysis processes
  • Manage acquisition, consumption and deployment of data for operational use
  • Manage data and system integration and testing
  • Provide required support in designing and developing systems and solutions
  • Develop, encourage and nurture collaborative relationships across area of specialization
  • Participate in planned activities that are appropriate for own development

Â

Experience:

  • 3 to 5 years in Extract, Transform and Load (ETL) of data from source systems or experience in data integration for consumption use cases
  • Strong experience in Hybrid cloud environments, Strong experience in optimising ETL, Strong analysis and communication skills.
  • Hadoop, (HDFS, HIVE, Ambari, Zeppelin), | SQL, Python, Scala | (SSIS, Informatica, …) , Linux, Ab Initio, Control-m, Teradata, SAS, Redshift
  • Analysis And Attention to Detail: The ability to be systematic and rule oriented in gathering, reviewing, evaluating and visualising data from a variety of perspectives; includes the ability to work with precision
  • Problem Solving: Cuts to the core of issues and applies effective analysis, logic and creativity to implement solutions
  • Influencing And Impact (inc. Negotiation): Creates impact and influences others to support an idea, concept or direction through being credible, trusted and authentic
  • Presentation And Facilitation: Uses appropriate presentation and facilitation techniques to engage an audience and help them understand, retain and respond appropriately to the message
  • Process And Technological Competence: Utilises, identifies, engineers and leverages processes and technologies to meet business needs
  • Research Competence: The capacity to work with research questions, gather and structure relevant data and present results as compelling, defensible arguments. Identifies and leverages multiple platforms and sources to stay abreast of and / or influence current thinking
  • Building Relationships: In the business of being human, builds sound relationships based on trust and openness.
  • Drive And Results Orientation: Is a self-starter who produces consistently high-quality outputs within agreed deadlines. Prompt and proactive in driving for results and sets challenging goals for self and others
  • Data Management: Loading, extraction, staging, transformations and quality assurance of data to support business decisions.
  1. Ability to fully comply with data-content standards - accuracy of data should balance back to source/business. Runs Basic and Exception reports
  2. Ability to manipulate quantitative data into understandable format for the user
  3. Accurately conducts data profiling. Structures profiles in accordance with best practice and in line with business needs. Ability to provide guidance and advice in this regard
  4. Ability to spot errors/discrepancies/anomalies in the data. Initiate steps to improve accuracy and reliability of data
  5. Testing all monthly exception files against source to ensure the rules are correct.
  6. Sending monthly exception reports to users
  7. Proficient in loading, extraction, staging, transformations and quality assurance of data to support business decisions
  8. Ability to clean data and perform fuzzy matches
  • Data Warehouse development
  1. Understands and can apply knowledge of the skills terminology, concepts and principles.
  2. The focus is on applying and enhancing knowledge/skill.
  3. Can apply the skills independently in most situations
  4. Understands and can discuss the application and implications of changes to policies, processes and procedures in this area.
  • Design and development methodologies and skills, including coding language skills
  1. Is recognised as a subject matter expert in this knowledge/skill area
  2. Focus is on broader organisational or practice issues. Can provide practical and relevant ideas for improvement in policies/processes or procedures.
  3. Capable of coaching others in the application of this skill, translating complex concepts into easy-to-understand terms.
  4. Can assist in the development of reference and resource materials for this skill/knowledge area.
  • Understanding of Business Systems Data: Understand the underlying data of the various systems, what each field means and how the systems interact from a data perspective.
  • Demonstrates comprehensive knowledge of business data, how it is structured, relationships between elements of data and limitations within business systems data
  • Knowledge of some of the fields/logic used in calculations. Requires some guidance for complex calculations
  • Ability to identify anomalies in data and diagnose possible reasons at a high level

Â

Qualifications/ Certification:

  • A degree in Computer Science / Information Systems / Business Administration / Commerce or


 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Senior Data Engineer
Location: Johannesburg
Salary: Annually
The Senior data engineer will be responsible for leading the design, development and governance of the company's enterprise data infrastructure, transitioning from the current SSIS based ETL environment to a modern, scalable, azure-based cloud data warehouse.
3 days ago


Client Support Data Engineer
Location: Johannesburg
Salary: Market-related
Play a key role in supporting clients with data-driven solutions in a growing international software company.
3 days ago


Data Engineer (Contractor)
Location: Johannesburg
Salary: Market-related
Work on impactful data projects with a leading insurance client Johannesburg | R550 per hour | 08:0017:00 | 12-month contract with extension potential
7 days ago


AWS Data Engineer
Location: Johannesburg
Salary:
14 days ago


Azure Data Engineer
Location: Kempton Park
Salary:
14 days ago


Senior Data Engineer - Onsite - JHB or CPT - Contract
Location: South Africa
Salary: R600 - 690 per hour
Senior data engineer - Onsite - JHB or CPT - Contract
15 days ago


Big Data Data Engineer
Location: Johannesburg
Salary:
15 days ago


Data Engineer
Location: Johannesburg
Salary:
15 days ago


Senior Data Engineer
Location: Johannesburg
Salary: market related Monthly
Job Summary:Our client is seeking a highly skilled Senior data engineer with deep expertise in Snowflake and Matillion to design, build, and optimize scalable data pipelines and integration solutions. The ideal candidate will have a strong background in cloud data warehousing, ETL/ELT processes, and modern data architecture. Responsibilities:data Management and API integration.Design, develop...
16 days ago


Data Engineer
Location: Pretoria
Salary: R60 000 per month neg
data engineer - Centurion
17 days ago


Create a free job alert for Data Engineer in Johannesburg

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions