Cloud Data Engineer - Hybrid/Remote

Are you passionate about data engineering and the challenges of building complex data systems? Engineered systems that need to run big corporations and younger start-ups alike. My client is looking for Cloud Data Engineers to build data solutions, ranging from data warehousing to big data platforms. Your primary responsibilities will be to implement solutions in coordination with the rest of the team working on different layers of the solution’s architecture. Therefore, a commitment to collaborative problem solving, sophisticated design, and a quality product are essential.

They strongly believe in and follow Agile software development and DevOps best practices and principles.

The successful candidates will build high-quality, innovative and fully performing data solutions in compliance with best practices, standards, current technology stack and technical design.

Basic Qualifications

• Relevant qualification
• At least 2 years’ experience on Amazon AWS
• At least 3 years of experience in developing data ingestion, data processing, data engineering and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions
• Experience with public cloud architectures, pros/cons, and migration considerations
• Hands-on experience in AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, Spark/SparkSQL, and streaming technologies such as Apache Kafka, AWS Kinesis, Apache NiFI etc.
• Hands-on experience in programming languages such as Java, C#, Node.js, Python, PySpark, SQL, Unix shell/Perl scripting etc.
• Experience working with DevOps tools such as GitHub, GitLab, Jenkins, CodeBuild, CodePipeline, CodeDeploy, etc.

Methodologies and Frameworks

• Data Integration (ETL and ELT)
• Enterprise Data Warehousing and Enterprise Data Lake
• Data Management
• Data Visualisation and Presentation

Soft Skills

• Great communication skills
• Strong knowledge of the financial services industry, ideally in a consulting role
• Ability to work in different project methodologies: Waterfall and/or Agile