Senior Data Engineer – Remote – R1.2m Per Annum

Recruiter:

E-Merge

Job Ref:

GZ55908

Date posted:

Friday, November 11, 2022

Location:

Johannesburg, South Africa

Salary:

1200000

JOB SUMMARY:
Senior Data Engineer – Remote – R1.2m Per Annum

JOB DESCRIPTION:

A global data engineering business is on the look out for a Senior Data Engineer to join their growing team. They understand the complexities of transforming data and they help guide customers through their data journey while offering them comfort and simplicity on their digital transformation journey

You will be working on fixed-scope, fixed-timeline projects across AWS and GCP for large national and international customers, including banks, airlines, medical aid providers and telecommunications companies

If you want to be part of this business that transforms Data into value and modernises infrastructures, APPLY TODAY!!!!

Required Experience:

Hands-on experience in building ETL pipelines on Big Data, using modern cloud Data Engineering tools (6+ years):
- AWS Glue (highly preferred)
- GCP DataFlow (preferred)
- Azure Data Factory
Object Oriented Python programming (5+ years)
- Python package development
- Python class development
- Pythonic standards across the board
Working knowledge of PySpark (preferred) or Apache Beam
- Efficient use of the PySpark DataFrame API
- Knowledge of big data file formats (Parquet, ORC, AVRO) and partitioning strategies
Hands-on experience in writing SQL queries (5+ years)
- ANSI-SQL (preferred)
- Postgresql (preferred)
- MS-SQL
- MySQL
- Oracle
Database experience
- Amazon Redshift
- Google BigQuery
- Or equivalent
Infrastructure as code:
- Terraform (preferred)
- Cloudformation
- AWS CDK
Hands on experience in making use of additional cloud services:
- AWS Lambda (highly important)
- AWS IAM (highly important)
  - Cross account roles
  - IAM policies
- Amazon S3 (highly important)
- AWS Step Functions (important)
- Amazon SQS
- Amazon SNS
- Amazon DynamoDB
- Amazon Kinesis is a plus
Ability to scope a Data Solution end-to-end
Service integrations
Drawing architectural diagrams
Scalability, security, fault-tolerance

Required Qualifications:

BSc Computer Science/Engineering (or equivalent experience)
AWS or GCP Certifications (Associate and above)

Reference Number for this position is GZ55908 which is a permanent position offering up to R1.2m per annum negotiable on experience and ability. Contact Garth on -merge.co.za or call him on to discuss this and other opportunities.

Are you ready for a change of scenery? The e-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website

Similar jobs you might be interested in:

Senior Data Engineer
Location: Johannesburg
Salary:
**Job Title:** senior data engineer**Type:** permanent **Location:** Gauteng, Johannesburg **About Us:** We're a leading data solutions firm in South Africa, dedicated to fostering equality through actionable insights.**Responsibilities:** Design robust data architectures, manage seamless pipelines, integrate disparate data sources, optimize performance, lead collaborative efforts, and ensure data...
22 days ago

Senior Data Engineer
Location: Johannesburg
Salary:
A well-known marketing organization, with branches in multiple overseas countries, is looking for a senior data engineer to join their organization at their Johannesburg branch. The senior data engineer will be required to work on a hybrid module. Working within the data Science Team, the data engineer, you will be responsible for the organization's data structure.
1 day ago

Senior AWS Data Engineer - 1154
Location: Pretoria
Salary: Hourly
Our client in the motor industry is looking to employ a senior AWS data engineer. As a Big data engineer, you will be responsible for building and maintaining robust Big data Pipelines using our client's data Platforms.
8 days ago

0831_SAP Data Engineer (Focus: SAP BW) (Senior)
Location: Pretoria
Salary:
0831_SAP data engineer (Focus: SAP BW)Location: GautengContract Term: 1 June 2024 - 31 December 2026
10 days ago

Senior Data Scientist
Location: Johannesburg
Salary:
Our client, a Global Business is looking to onboard a senior data Scientist.To be successful in this role you need to excel in machine learning, software development, cross-functional and cross-domain collaboration and share a passion for enabling scalable solutions that deliver business value.Let's chat!! bianca@clarkhouse.co.za
3 days ago

Senior Project Manager - Investment Data Projects
Location: Johannesburg
Salary:
Responsibilities:This role is responsible for managing one or more projects within the constraints of scope, quality, time, and cost, within the project governance framework. The incumbent is individually accountable for achieving results through the efforts or others
11 days ago

Senior Data Analyst
Location: Johannesburg
Salary: R1.2
senior data Analyst
8 days ago

Senior Data Analyst
Location: Kempton Park
Salary:
Safair Operations, operating as FlySafair, has a vacancy for a senior data Analyst at our Head Office in Bonaero Park.Â The successful applicant will report to the Manager: Business Intelligence & Development.
23 days ago

Data Engineer
Location: Johannesburg
Salary:
Are you a seasoned data engineer with a strong focus on staging high-quality data? Are you passionate about leveraging your expertise in SQL, ETL toolsets, and database technologies to drive effective data management solutions? If so, we have an exciting opportunity for you!
11 days ago

Data Engineer
Location: Johannesburg
Salary:
A well-known marketing organization, with branches in multiple overseas countries, is looking for a senior data engineer to join their organization at their Johannesburg branch. The senior data engineer will be required to work on a hybrid module. Working within the data Science Team, the data engineer will be responsible for the organization's data structure.
29 days ago

Senior Data Engineer – Remote – R1.2m Per Annum

Similar jobs you might be interested in:

Create a free job alert for Senior Data Engineer – Remote – R1.2m Per Annum in Johannesburg