Lead Data Engineer

SUMMARY:
An exciting opportunity has become available for an experienced Lead Data Engineer to join a forward-thinking investment and technology-driven environment on a 12-month contract, based on-site in Centurion. This role is ideal for a senior-level data engineering professional ready to take on a pivotal leadership position in driving modern data solutions, team performance, and enterprise-wide data initiatives.

POSITION INFO:
Role Overview:
As the Lead Data Engineer, you will be responsible for leading the design, development, and optimization of data warehouse solutions and modern data engineering practices. You’ll lead a team of skilled SQL Developers, oversee the development of scalable ETL pipelines and robust data infrastructure, and ensure that data solutions support strategic, data-driven decision-making across the organization.

Key Responsibilities:

• Lead and mentor a team of SQL Developers focused on warehouse and data lake development
• Drive the design and implementation of scalable, efficient ETL/ELT processes and data models
• Oversee team performance, delivery timelines, and capacity planning
• Ensure adherence to best practices in SQL development and data engineering standards
• Collaborate with Data Architects, Analysts, and cross-functional teams to deliver high-quality data solutions
• Optimize and maintain SQL queries, stored procedures, and back-end database performance
• Automate deployment pipelines using GitLab CI/CD
• Stay updated on industry trends and emerging technologies to recommend and implement innovative data solutions
• Provide coaching, training, and ongoing support to team members to foster technical growth

• Bachelor’s Degree in Computer Science, Engineering, or a related field
• 8+ years of experience in data engineering and SQL development roles
• 3+ years in a leadership or team lead capacity
• 8+ years hands-on SQL development, including data warehousing, ETL, and performance tuning
• 6+ years of experience with Python for data processing and ETL pipeline development
• Proficiency with SQL Server, Oracle, PostgreSQL
• Strong understanding of ETL tools such as SSIS
• Deep knowledge of data warehousing principles and distributed computing

• Experience with AWS-native data tools (e.g., Glue, and Parquet)
• Familiarity with Informatica, Talend, or other ETL platforms
• Exposure to big data technologies such as Hadoop, Spark, and Kafka
• Experience with GitLab CI/CD automation workflows
• Programming knowledge in C#, Java, or Scala
• Certifications in cloud or data engineering (e.g., AWS Certified Data Analytics)