Data Engineer

Recruiter:

CME Recruitment

Job Ref:

CPT000172/CB

Date posted:

Tuesday, August 10, 2021

Location:

Capetown, South Africa

SUMMARY:
Data Engineer
Isle of Man (UK)

Please note: To reside on the Isle of Man you would need to apply for a visa and be fully prepared to relocate.

POSITION INFO:

Our client within financial services is currently developing a cloud based digital banking and investment platform. New and exciting position for a savvy Data Engineering to join the team.
You must be excited by the prospects of optimising or re-designing the company’s data architecture to support the next generation of products and data.
Must have advanced working SQL knowledge and experience within with relational databases, query authoring (SQL) as well as working with a variety of database technologies.
Strong analytic skills relating to working with unstructured datasets
Working knowledge of message queuing, stream processing, and highly scalable “Big Data” data stores
Strong project management and great organisational skills
Design processes supporting data transformation, data structures, metadata, dependency and workload management
Experience with Analytics platform – Google analytics or amplitude or similar SaS platform
Experience CRM Dynamics, maintenance and design
Great advantage to have the following:

Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with cloud services: RDS, Redshift, Snowflake
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, JavaScript Scala,

Duties will include but not limited to: -

Create and maintain optimal data pipeline architecture
Assist departments looking for data / monitoring report to design efficient data extraction queries
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
Design the process required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Cloud-based ''big data'' technologies
Build analytics tools that utilize the data pipeline to provide actionable insights into Database performance and early warning dashboards
Create data tools for analytics and business team members to assist them in building and optimizing our product into an innovative industry leader
Work with data and analytics experts to strive for greater functionality in our data systems
Maintain legacy database systems and investigate ways to improve / upgrade and enhance them

Call or email: --------Please upload your CV here--------> / +----- / +27 84 627 3603

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Data Engineer - AZURE
Location: Cape Town
Salary: 60 000 Monthly
the client is seeking an Azure data engineer who will be a cornerstone in constructing the backbone of our cloud-based fitness experiences. Your expertise will not only involve building and maintaining robust data solutions but also ensuring that these systems are insightful and interactive, utilizing Azure data Factory, databricks, and Power BI to transform data into action.
14 days ago

DevOps Data Engineer
Location: Cape Town
Salary:
15 days ago

Data Engineer
Location: Cape Town
Salary:
Requirements:Degree in BSc computer science, B.IT or informatics, BSc in Actuarial science or related degreeAsset Management experience ( Advantageous) Experience in Information & technology services Experience in data integration & transformation
25 days ago

DATA ENGINEER - AGRI-TECH (STELLENBOSCH)
Location: Stellenbosch
Salary:
Calling all QA warriors, code crusaders, and glitch gladiators!Our client, isn't just about growing crops, they're growing a revolution in Agri-Tech. And they need a superpowered Software Tester like you to join the fight against buggy software and ensure their tech is as fresh as their produce.Forget boring spreadsheets and endless tickets. This is a mission for those who thrive on excitement, im...
27 days ago

SOFTWARE TESTER - AGRI-TECH (STELLENBOSCH)
Location: Stellenbosch
Salary:
Our client, isn't just growing crops, they're cultivating a data revolution in Agri-Tech. And they need a powerhouse data engineer like you to transform raw data into golden insights that nourish their business and feed the future.Forget dusty data silos and endless spreadsheets. This is a mission for those who thrive on discovery, innovation, and using data to make a real difference in the world....
27 days ago

Emergency Response Expert
Location: Capetown
Salary:
Emergency Response Expert
4 days ago

Project Engineer - Order Processing (Mechanical)
Location: Cape Town
Salary: 450 00
Our client, a leading global manufacturer specializing in resource-saving evaporative cooling equipment, is looking for an experienced Order Process engineer to lead their team in Cape Town. The role entails overseeing the accurate and timely processing of all orders, particularly focusing on large and complex orders. As the liaison between field representatives, engineering, and manufacturin...
5 days ago

BI Engineer
Location: Cape Town
Salary:
Are you passionate about transforming data into actionable insights? Do you have a knack for designing and implementing robust business intelligence solutions?
8 days ago

BI Engineer
Location: Cape Town
Salary:
Are you passionate about transforming data into actionable insights? Do you have a knack for designing and implementing robust business intelligence solutions?
11 days ago

Senior Execution Framework Engineer
Location: Cape Town
Salary:
The Senior Execution Framework engineer design, prototype, implement and integrate systems that bring state-of-the-art algorithms to real-world scientific processing pipelines for the telescope. Telescope :processing functions" / "execution engine" / interfaces are key architectural features that are meant to not only enable scalability but also act as common ground for the integration of new and ...
11 days ago

Data Engineer

Similar jobs you might be interested in:

Create a free job alert for Data Engineer in Capetown