GenAI / LLM Engineer

Recruiter:

A 1L Realization (Pty) Ltd

Job Ref:

JHB000994/Tshid

Date posted:

Thursday, July 2, 2026

Location:

Johannesburg, South Africa

SUMMARY:
Our client in the Telecoms sector is looking for a GenAI / LLM Engineer on a contract duration of 6 months.

Role Purpose

The GenAI / LLM Engineer is responsible for designing, developing and deploying Generative AI solutions that enable intelligent, conversational access to enterprise data products. The role builds and optimises Large Language Model (LLM) applications, Retrieval-Augmented Generation (RAG) solutions and AI agents that transform data catalogues and analytical products into conversational, agent-callable services, supporting DataCo's digital, analytics and monetisation strategy.

POSITION INFO:
Key Responsibilities Design, develop and deploy Generative AI and LLM-powered applications for enterprise data products. Build Retrieval-Augmented Generation (RAG) solutions that enable secure, context-aware access to enterprise knowledge and data assets. Develop conversational interfaces and AI assistants that allow users to interact with data products using natural language. Design AI agents and agent-callable services that integrate with enterprise applications, APIs and data platforms. Develop prompt engineering strategies, orchestration workflows and LLM evaluation frameworks to improve response quality and reliability. Integrate LLM solutions with enterprise data platforms, data catalogues, analytics environments and machine learning services. Optimise model performance, latency, scalability and operational efficiency for production environments. Implement AI governance, responsible AI practices, security controls and data privacy requirements. Collaborate with Data Scientists, Data Engineers, Platform Engineers, Solution Architects and Product Owners to deliver AI-enabled products. Monitor solution performance, continuously improve AI capabilities and maintain technical documentation. Qualifications & Experience Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Information Technology or a related discipline. 5-8 years' experience in software engineering, machine learning engineering or AI solution development. Hands-on experience developing applications using Large Language Models (LLMs) and Generative AI technologies. Experience implementing Retrieval-Augmented Generation (RAG), vector databases and semantic search solutions. Strong programming skills in Python and experience with AI frameworks such as LangChain, LangGraph, LlamaIndex or similar orchestration frameworks. Experience integrating REST APIs, cloud AI services and enterprise data platforms. Knowledge of Azure AI, Azure OpenAI, Databricks AI, OpenAI or equivalent enterprise AI platforms is highly desirable. Experience with MLOps, model deployment and monitoring is advantageous. Key Competencies Generative AI and Large Language Models (LLMs) Retrieval-Augmented Generation (RAG) AI agents and agentic workflows Prompt engineering and LLM optimisation Python development Vector databases and semantic search API integration and microservices Responsible AI, security and governance Cloud AI platforms (Azure AI, Databricks AI or equivalent) Agile delivery and cross-functional collaboration

Similar jobs you might be interested in:

GenAI / LLM Engineer
Location: Johannesburg
Salary:
Our client in the Telecoms sector is looking for a genai / llm engineer on a contract duration of 6 months. Role PurposeThe genai / llm engineer is responsible for designing, developing and deploying Generative AI solutions that enable intelligent, conversational access to enterprise data products. The role builds and optimises Large Language Model (llm) applications, Retrieval-Augmented Gene...
Today

AI Machine Learning Engineer (12 Months Contract)
Location: Pretoria
Salary:
We are recruiting for an AI Machine Learning engineer role.
1 day ago

AI Agent / Agentic Engineer
Location: Johannesburg
Salary:
Our client in the Telco sector is looking for an AI Agent / Agentic engineer on a contract duration of 6 months.Role PurposeThe AI Agent / Agentic engineer is responsible for designing, developing and deploying intelligent AI agents that automate business processes, accelerate Agile delivery and enhance enterprise data products. The role develops autonomous and semi-autonomous agents capable of re...
Today

Manager: Information Security â AI
Location: Johannesburg
Salary:
Our client in the Telecommunications & Networking is looking for a Manager: Information Security – AI on a contract duration of 6 months. As the Manager: Information Security – AI, you are responsible for supporting the security of AI across and helping safeguard the implementation of BRAIN policy the enterprise policy for safe, secure and responsible AI.Reporting to the Senio...
3 days ago

AI Specialist
Location: Johannesburg
Salary: Annually
Step into the future of AI innovation within a fast-evolving digital and customer experience environment. This exciting opportunity is ideal for an AI engineer passionate about building cutting-edge solutions across voice, chat, and generative AI. You will play a key role in developing intelligent automation, conversational AI systems, and advanced analytics solutions, with a strong focus on real-...
1 day ago

Manager: AI Security Engineer
Location: Johannesburg
Salary:
Our client in the Network Services is seeking a Manager: AI Security engineer on a contract duration of 6 months. The key objective of this role is to design, build and operate the security controls that protect Artificial Intelligence (AI) and Large Language Model (llm) systems. The role is hands-on and engineering-focused: developing and integrating AI security control components such as po...
3 days ago

Software Implementation Engineer (AI & Agentic Workflows)
Location: Ballito
Salary:
28 days ago

Machine Learning Engineer
Location: Johannesburg
Salary:
56 days ago

Frontend Developer
Location: Centurion
Salary:
Shape the future of web experiences by building intelligent, AI-powered front-end applications. If you’re a React or Angular expert with a passion for cutting-edge technology like chatbots and llm integrations, this is your opportunity to work on truly innovative products.
15 days ago

Back-End C# Developer
Location: Johannesburg
Salary:
Build the future of intelligent back-end systems in a fast-evolving digital services industry. This role is perfect for a Back-End C# Developer who thrives on combining cloud engineering with AI/llm innovation to create scalable, high-impact solutions that power modern customer experiences.
15 days ago