Senior Data Engineer

SUMMARY:
We're looking for a Senior Data Engineer with expertise in Spark, Scala, Java, and Gradle to design, develop, and maintain large-scale data pipelines and architectures. The ideal candidate will have a strong technical background, excellent problem-solving skills, and a passion for data engineering

POSITION INFO:
Responsibilities:

• Design and implement scalable data pipelines using Apache Spark, Scala, and Java
• Develop and maintain data architectures for batch and real-time processing
• Collaborate with cross-functional teams to identify and prioritize project requirements
• Optimize data processing performance, scalability, and reliability
• Ensure data quality, security, and compliance
• Mentor junior data engineers and contribute to knowledge sharing
• Stay up-to-date with industry trends and emerging technologies

• Relevant Degree
• 6+ years of experience in data engineering (Spark, Scala, Java)
• Apache Spark (Core, SQL, Streaming)
• Scala programming language
• Java (Java 8 and above)
• Gradle build tool
• Data architectures (batch, real-time, lambda)
• Data storage solutions
• Big Data technologies (Hadoop, Hive, Impala)
• Cloud platforms (AWS, Azure, Google Cloud)
• Agile development methodologies
• Version control systems (Git)
• Excellent problem-solving, analytical, and communication skills

• Apache Kafka, Apache Flink, or other streaming technologies
• NoSQL databases (MongoDB, Couchbase)
• Data science concepts (machine learning, R, Python)
• Containerization (Docker)
• Orchestration tools (Apache Airflow, Kubernetes)
• Certification in Spark, Scala, or Java development
• Familiarity with DevOps practices

NB! This job is now closed. You can apply for other jobs by uploading your CV.