Software Engineer - big data analytics platform

SUMMARY:
Our client that is based in Gauteng has a vacancy for a suitably qualified Software Engineer to work within a big data analytics platform.

POSITION INFO:
Responsible for the requirements, design, development, testing and documentation of new and legacy data ingestion, integration, processing, and storage software to meet the requirements of the company's IoT Platform Solution.
This IoT solution is a big data analytics platform for the mining industry which requires a focus on collecting, processing, contextualising, and managing data assets thus turning it into information, and finally leveraging this information to address the 4 pillars of analytics - descriptive, diagnostic, predictive, and prescriptive.

Responsibilities:

• Data ingestion
• Data integration
• Data processing
• Data storage
• Digital twin management
• Data management and governance

• Bachelor’s degree in computer/software engineering, computer science
• Masters or doctoral level degree (advantageous)
• 2-5 years’ experience in computer science, software, or computer engineering, applied math, physics, statistics, or related fields.
• Experience with wireless and network communication technologies such as Wi-Fi, GSM, LoRaWAN, Bluetooth, TCP/IP.
• 2-5 years’ experience with data lake and warehousing solutions.
• 2-5 years’ experience with either Python, Java, C++, C#, Sparql , SQL databases.
• 2-5 years’ experience with either Apache Kafka (producers/consumers/connectors), Apache NiFi, Apache Spark, Apache ActiveMQ, MQTT, Modbus, REST API.
• Experience with developing, building and releasing of containerised services and microservice architectures using Docker.
• Experience within big data platforms, structured, unstructured and semi-structure data management.
• Experience with data analytics, machine learning and AI (advantageous)
• Experience with workflow management tools and BPMN eg. Camunda (advantageous)
• Experience with distributed systems and cluseter orchestration systems such as Kubernetes.

NB! This job is now closed. You can apply for other jobs by uploading your CV.