GEN AI Engineer

Location: Charlotte, North Carolina, US
Recruiter: Techmorgonite Software Solutions LLC
Date posted: Thursday, November 13, 2025

Job Description:
<p>GEN AI Engineer</p> <p>Charlotte, North Carolina</p> <p>Duration- 12 Months</p> <p>Must Have Technical/Functional Skills</p> <p>o Bachelors or Masters degree in Data Science, Computer Science, MIS ,related field, or equivalanet experience</p> <p>o 10+ yrs of experience designing and developing AI solution architecture to scale</p> <p>o Proven Hands-on experience in GenAI Ops-Operationalizing LLM and RAG applications in production</p> <p>o Strong hands-on experience with the Langchain framework</p> <p>o Experience specifically with the Open AI API, chat completions, embeddings,etc</p> <p>o Have a solid awareness on TensorRT and VLLM implementation.</p> <p>o Strong proficiency in python and data Science libraries(NumPy,Pandas,scikit-learn,PyTorch/TensorFlow)</p> <p>o Proven experience applying guardrails and observability to LLM or RAG-powered applications.</p> <p>o Experience with LLMs as Judges and SMLs for evaluation (attribution,adherence, bias, PII, etc)</p> <p>o Hands-on experience with OpenShift(or Kubernetes) for containerized AL workloads.</p> <p>o Experience measuring and optimizing inference latency.</p> <p>Roles & Responsibilities</p> <p>o Implement Guardrails and observability across RAG and LLM applications</p> <p>o Setup GenAI Ops workflows to continuously monitor inference latency, throughput, quality and safety metrics.</p> <p>o Define,track,and analyze RAG guardrail metrics using LLMs as Judges and SMLs(e.g. attribution, grounding,prompt injection,tone,PII leekage)</p> <p>o Implement annotation,structured feedback loops,fine-tuning, and alignment methods to calibrate judge models</p> <p>o Use langchain to orchestrate guardrail checks, manage prompt versioning and integrate judge model scoring workflows.</p> <p>o Work with Openshift to deploy,scale and monitor containerized genAI services.</p> <p>o Build observability dashboards and alerts(Grafana or equivalent) for AI reliability.</p>

Apply for this job on Techmorgonite Software Solutions LLC