Cloud Data Engineer - Onsite - Contract

SUMMARY:
Cloud Data Engineer

POSITION INFO:

Our Client a Global Tech firm is seeking a Cloud Data Engineer to join their team in Randburg on a contract basis.They offer stability, growth, attractive rates and a great working engineering.

Note this position is required to work fully onsite.

The Data Engineer is responsible for the transformation of data into a structured format that can be easily analysed in a query or report. The role is responsible for developing structured data sets that can be reused or compliment other data sets and reports. The individual analyses the data sources and data structure and will design and develop data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.

The Cloud Data Engineer, AWS Data Pipeline, AWS Storage Gateway and Digital Assets will work on the Amazon Web Services (AWS) infrastructure team. The engineer's primary focus is to provide data services that enhance our clients' businesses. You'll be a key member of the data pipeline team helping us deliver these solutions quickly and efficiently while ensuring they're reliable and scalable.

Key Roles and Responsibilities:

• Create data models in a structured data format to enable analysis thereof
• Design and develop scalable extract, transform and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources, Participate in the transformation of object and data models into appropriate database schemas within design constraints. Interpret installation standards to meet project needs and produce database components as required
• Create test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
• Develops and maintains mission-critical information extraction, analysis, and management systems
• Provides direct and responsive support for urgent analytic needs
• Translates loosely defined requirements into solutions.
• Uses open source technologies and tools to accomplish specific use cases encountered within the project
• Uses coding languages or scripting methodologies to solve a problem with a custom workflow
• Performs incremental testing actions on code, processes, and deployments to identify ways to streamline execution and minimize errors encountered

Knowledge, Skills and Attributes:

• Seasoned in the definition and management of scoping requirements, definition and prioritisation activities
• Good understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
• Specialist either in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
• Good understanding of data architecture landscape between physical and logical data models
• Analytical mind and business acumen
• Problem-solving aptitude

Academic Qualifications and Certifications:

• Bachelor's degree with 3 years related professional experience
• Relevant certifications, e.g., SAP, Microsoft Azure
• Must have at least 10 years of cloud data engineering experience
• Bachelors degree in Computer Science, Computer Engineering or a related field required
• 8 years of experience as a Cloud Data Engineer

Technologies

• Azure
• SQL
• Databricks

Required Experience:

• Seasoned experience as a data engineering, data mining within a fast-paced environment
• Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale
• Seasoned experience with architecture and design of secure, highly available and scalable systems.
• Proficient in automation, scripting and proven examples of successful implementation
• Seasoned experience in any applicable language, preferably .NET
• Proficient in working with SAP, SQL, MySQL databases and Microsoft SQL
• Seasoned experience working with data sets and ordering data through MS Excel functions, e.g. macros, pivots
• Seasoned experience working in internet technologies, e.g., SaaS

Skills Summary

Big Data Solutions, Business Analysis, Data Analysis, Data Analytics, DATABASICS, Data Lake, Data Modeling, Data Structures, Unstructured Data