Senior Data Engineer

SUMMARY:
Microsoft, Cloud, Big Data, Investments/asset management

POSITION INFO:

Senior Data Engineer

Permanent

Cape Town (Hybrid work environment)

An established and mature financial services team is looking for an experienced Data Engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you will strive for efficiency by aligning data systems with business goals and translate these into meaningful solutions.

To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages, principles and experience in data ingestion, and knowledge of learning methods and patterns.

If you are detail-oriented, with excellent organizational skills and experience in this field, we would like to hear from you.

Duties and Responsibilities

• Analyze and organize raw data
• Build and support data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results
• Prepare data for modeling, ingestion, and storage
• Build algorithms and prototypes
• Combine raw information from different sources
• Explore ways to enhance data quality and reliability
• Identify ways to improve data efficiency
• Identify opportunities for data acquisition
• Develop analytical tools and programs, and potentially prototypes and algorithms
• Develop, construct, test and maintain architectures
• Collaborate with software engineers, analysts, and architects on several projects
• Align architecture with business requirements
• Use large data sets to address business issues
• Identify ways to provide insights from data using hidden patterns and data analysis
• Use data to discover tasks that can be automated
• Deliver updates to stakeholders based on analytics
• Assembling large, complex sets of data that meet non-functional and functional business requirements
• Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues

Ideal Experience

• Minimum 2 years of experience with ETL tools, Azure Data Factory, Databricks, SQL, SSAS & T-SQL
• Previous experience as a data engineer or in a similar role
• Technical expertise with data models, data mining, and segmentation techniques
• Knowledge of programming languages (e.g., C# and Python)
• Hands-on experience with SQL database design
• Great numerical and analytical skills
• Experience with data visualization using Power BI, SAS VA, and Power Pivot
• Tabular models (DAX) in Visual Studio
• Strong in data Governance, including Master Data Management (MDM) and Data Quality tools and processes
• Good basic understanding of On-Premise, Cloud and Hybrid server architecture and infrastructure

Ideal Qualifications

• BS or MS degree in Computer Science, Information Systems, or related field.
• Microsoft Certified: Azure Data Engineer Associate
• Secondary certifications, including the Microsoft Certified Solutions Expert (MCSE), include a wide range of topics with specific sub-certifications including MCSE: Data Management and Analytics

Most Important Attribute

• Possess hunger and a big drive for constantly being up to date with technology and new features and changes
• Possess a ''can do - will do'' attitude, that guarantees the absolute best client experience
• Enjoy working in diverse teams

Systems Knowledge

• U-SQL. T-SQL
• Azure DevOps
• Python
• .NET
• C#

NB! This job is now closed. You can apply for other jobs by uploading your CV.