Data Engineer

Recruiter:

Specd

Job Ref:

JHB001460/JJ

Date posted:

Monday, June 27, 2022

Location:

Centurion, South Africa

JOB SUMMARY:
The Data Engineer will have a knack for data analysis, data manipulation and data modelling. The consultant will be responsible for understanding and driving the overall technical vision and planning of a client's organisation and translating business needs into technical strategy.

JOB DESCRIPTION:

Required Qualifications:

- Tertiary degree, diploma or certificate in a related field (BSc Computer Science, B.IT or Informatics related degrees).
- DP-203: Data Engineering on Microsoft Azure Certification.

Experience and Knowledge:

- 8-10 years’ working experience as a Data Engineer / Database Developer.
- Experience in data mining, large scale data modelling and business requirements gathering/analysis.
- Understanding and working experience in data integration and transformation.
- Experience implementing data modelling methodologies
- Working knowledge of data quality processes and master data management.
- Experience implementing design support systems using Database Management Systems (DBMS) such as SQL Server or Oracle.
- Proficiency in designing and implementing data integration and ETL solutions using SSIS, Azure Data Factory and / or SQL Server stored procedures.
- Understanding of several Big Data technologies
- Experience in database query languages such as T-SQL, ANSI SQL, PL/SQL.
- Some experience developing software solutions using Visual Basic, C++, C#, Java or Python.
- Experience using SQL Server management Studio and Visual Studio.
- Experience implementing solutions using Azure SQL databases, Azure Synapse (Previously SQL Data Warehouse), Azure Storage Accounts (Data Lake) and / or Databricks.
- Analytical mind and business acumen
- Additional skills in the following will be taken into consideration: Tableau, Power BI, strong math skills (e.g. statistics, algebra), Scala, Python or R.

Key Responsibilities:

- Identify valuable data sources and automate collection processes.
- Undertake preprocessing of structured and unstructured data.
- Analyze large amounts of information to discover trends and patterns.
- Data Modelling
- Database design.
- Database development.
- Data Warehouse Design - Build and Development.
- Database Administration.
- Database Performance Tuning and Optimisation.
- Present information using data visualization techniques.
- Propose solutions and strategies to business challenges.
- Collaborate with engineering and product development teams.
- An understanding and hands on experience on Hadoop/Spark based distributed storage and computing frameworks.
- Real-Time analytics and batch processing.
- Strong experience in architecting analytical applications in cloud environment such as Amazon Web Services and Microsoft Azure.

Competencies:

- Critical Thinking: Using logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problems.
- Active Learning: Understanding the implications of new information for both current and future problem-solving and decision-making.
- Systems Analysis: Determining how a system should work and how changes in conditions, operations, and the environment will affect outcomes.
- Complex Problem Solving: Identifying complex problems and reviewing related information to develop and evaluate options and implement solutions.
- Deductive Reasoning: The ability to apply general rules to specific problems to produce answers that make sense.
- Inductive Reasoning: The ability to combine pieces of information to form general rules or conclusions (includes finding a relationship among seemingly unrelated events).
- Excellent communication skills: Ability to engage with C-level stakeholders, both verbal and non-verbal and communicate a deep understanding of the business and a broad knowledge of technology and applications.
- Technical Literacy: Possess a high level of technical literacy, which helps them determine how a software solution fits into an organization’s current structure and assists in the development of specifications and requirements.
- Analytical Assessment: A high level of analysis to examine current systems and determine overall project needs and scope.
- Schedule Management: Extensive time management skills to determine development schedules and milestones and ensure that deliverables are completed on time for oneself and your team.
- Team Leadership: To oversee and direct development teams throughout the project development lifecycle, experience with team leadership and motivation is essential.
- Ability to translate strategy and strategic objectives into measurable and executable projects.
- Experience working on large project(s) incorporating processes and procedures and standards

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer (AWS and Redshift) - Johannesburg – up to R1mil
Location: Johannesburg
Salary: 1000000
data engineer (AWS and Redshift) - Johannesburg – up to R1mil
Today

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
Today

AWS Data Engineer - 0675
Location: Pretoria
Salary: Hourly
Are you ready to fuel innovation in the motor industry through cutting-edge data solutions? Our client is seeking a dynamic data engineer to accelerate their enterprise collaboration and data quality initiatives.
7 days ago

Senior AWS Data Engineer - 1154
Location: Pretoria
Salary: Hourly
Our client in the motor industry is looking to employ a Senior AWS data engineer. As a Big data engineer, you will be responsible for building and maintaining robust Big data Pipelines using our client's data Platforms.
7 days ago

AWS Data Engineer - 1432
Location: Pretoria
Salary: Hourly
Contract Starts: 01.06.2024Contract Ends: 31.12.2026Location: Midrand/Menlyn/Rosslyn/Home Office rotation
7 days ago

Data Engineer
Location: Midrand
Salary:
Our client in the banking sector seeks to employ a data engineer yo assemble large, complex data sets to meet functional/non-functional requirements, adhering to best big data practices.
8 days ago

0831_SAP Data Engineer (Focus: SAP BW) (Senior)
Location: Pretoria
Salary:
0831_SAP data engineer (Focus: SAP BW)Location: GautengContract Term: 1 June 2024 - 31 December 2026
9 days ago

Data Engineer
Location: Johannesburg
Salary:
Are you a seasoned data engineer with a strong focus on staging high-quality data? Are you passionate about leveraging your expertise in SQL, ETL toolsets, and database technologies to drive effective data management solutions? If so, we have an exciting opportunity for you!
10 days ago

Azure Data Engineer – Johannesburg – up to R1mil per annum
Location: Johannesburg
Salary: 1 000 000
Azure data engineer – Johannesburg – up to R1mil per annum
14 days ago

SQL Data Engineer
Location: Centurion
Salary: 1 Monthly
SQL data engineer
17 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Centurion