Data Engineer

SUMMARY:
Data Engineer
Isle of Man (UK)

Please note: To reside on the Isle of Man you would need to apply for a visa and be fully prepared to relocate.

POSITION INFO:

Our client within financial services is currently developing a cloud based digital banking and investment platform.   New and exciting position for a savvy Data Engineering to join the team.
You must be excited by the prospects of optimising or re-designing the company’s data architecture to support the next generation of products and data.
Must have advanced working SQL knowledge and experience within with relational databases, query authoring (SQL) as well as working with a variety of database technologies.
Strong analytic skills relating to working with unstructured datasets
Working knowledge of message queuing, stream processing, and highly scalable “Big Data” data stores
Strong project management and great organisational skills
Design processes supporting data transformation, data structures, metadata, dependency and workload management
Experience with Analytics platform – Google analytics or amplitude or similar SaS platform
Experience CRM Dynamics, maintenance and design
Great advantage to have the following:

• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with cloud services: RDS, Redshift, Snowflake
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, JavaScript Scala,

• Create and maintain optimal data pipeline architecture
• Assist departments looking for data / monitoring report to design efficient data extraction queries
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
• Design the process required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Cloud-based ''big data'' technologies
• Build analytics tools that utilize the data pipeline to provide actionable insights into Database performance and early warning dashboards
• Create data tools for analytics and business team members to assist them in building and optimizing our product into an innovative industry leader
• Work with data and analytics experts to strive for greater functionality in our data systems
• Maintain legacy database systems and investigate ways to improve / upgrade and enhance them

NB! This job is now closed. You can apply for other jobs by uploading your CV.