AWS Data Engineer – Johannesburg – up to R800k

SUMMARY:
AWS Data Engineer – Johannesburg – up to R800k

POSITION INFO:

A software firm with vast business domain knowledge and world-class skills to successfully deliver digital solutions for clients while maintaining a track record of solving real-world problems through innovative solutions.

If you are a data engineer with experience in AWS engineering coupled with expertise in AWS Elastic and Python looking to join a collaborative team, apply now!

Responsibilities:

• Collaborate with cross-functional teams to construct and manage a data lake on AWS for real-time and local market data feeds
• Implement and maintain Elasticsearch, Logstash, Beats, Kibana, Elastic Common Schema (ECS) and Elastic Security components
• Utilise AWS services such as Lambdas, S3, CodePipeline, and CodeCommit to automate data lake processes
• Develop and maintain data ingestion pipelines using Apache Flink and Apache Beam
• Deploy, configure, and optimise AWS services to support data storage, processing, and analysis
• Index data, design complex queries, create aggregations, and manage mappings within Elasticsearch
• Serve as the go-to expert for ELK implementation and configuration.
• Collaborate with teams to integrate Elasticsearch with other operational data platforms and tools, including Kafka, SIEM

Skills and Experience:

• Bachelor''s degree in Computer Science, Information Technology
• Extensive experience as a developer with a strong focus on AWS Elastic services and Python
• In-depth knowledge of Elasticsearch, Logstash, Kibana, Beats, Elastic Common Schema (ECS) and Elastic Security
• Familiarity with AWS services, including Lambdas, S3, CodePipeline, and CodeCommit
• Proven expertise in data pipeline development using Apache Flink and Apache Beam
• Proficiency in Python for scripting and automation

The Reference Number for this position is NG57847 which is a Permanent Hybrid position in the Johannesburg offering a salary negotiable from R600k to R800k per annum cost to company based on skills and experience. E-mail Nokuthula on nokuthulag@ e-Merge.co.za or call her for a chat on to discuss this and other opportunities.

Are you ready for a change of scenery? e-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the e-Merge IT website for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!