Data Engineer x 2

SUMMARY:
We are looking for a savvy Data Engineer to join our growing team of analytics experts.

POSITION INFO:

Phase 1: data validation between MSSQL and SalesForce, ensuring the volumes are aligned after several rules and transformations have been implemented. Rules in SalesForce have been applied. Rules in MSSQL will need to built using Stored Procs. Error handling will need to be considered using Elasticsearch / Kibana.

Phase 2:  validation of SalesForce data fields, ensuring data entities are correct, accurate and complete. Data will need to be pulled from SalesForce to Hadoop, and processed using Map Reduce and/or Spark. Error handling will need to be considered using Elasticsearch / Kibana.

Required experience:

• Spark / Map Reduce
• Elasticsearch / Kibana
• Java
• API engineering (REST)
• SQL
• DevOps (CI / CD)
• Data modelling

Preferred experience:

• SalesForce
• Data lifecycle management
• Metadata management (including lineage, provenance)
• Atlassian tools (Bamboo, BitBucket, Sonar)

NB! This job is now closed. You can apply for other jobs by uploading your CV.