Senior RAG AI Engineer - Azure & AKS (Freelance possible)

📋 Tasks and responsibilities

The organisation is developing a bilingual French/Dutch knowledge search service based on RAG for approximately 10,000 internal users. This solution is one of the first production services on the internal AI platform, with additional AI services planned afterwards.

Your role

As a Senior AI Engineer, you will contribute to the build phase and the early run phase of this service. Working closely with internal architecture stakeholders, you will turn a high-level design into a stable, evaluated and maintainable production-ready solution.

The platform follows a hybrid operating model, combining managed Azure services such as Azure OpenAI, Azure API Management and Azure AI Content Safety with self-hosted open-source components on AKS for the vector store, orchestration layer and ingestion pipeline. Application-scoped Azure resources are managed as Infrastructure-as-Code with Terraform and Azure DevOps pipelines.

What you will deliver

• Build the end-to-end RAG pipeline, including retrieval, reranking, LLM orchestration and citation handling.
• Implement the ingestion pipeline with connectors for Jahia CMS and SharePoint, as well as chunking and embedding processes.
• Set up security trimming and ACL propagation.
• Develop prompt templates and guardrails.
• Create the evaluation harness needed to assess solution quality and behaviour.
• Produce and maintain the Terraform and Helm artefacts required for deployment and operations.
• Help operate, monitor and fine-tune the service during the early run phase.

📝Your profile

Experience as: Senior Artificial Intelligence (AI) Engineer

Skills

• Azure DevOps
• Azure Kubernetes Service - AKS
• Azure OpenAI Service
• LLM / Large Language Models
• Python
• RAG (Retrieval-Augmented Generation)
• Terraform
• Vector databases

Languages

• Dutch or French
• English

💼 Offer

You will be part of a growing Belgian SME where initiative and personal development are encouraged. We will provide you with an enjoyable work environment with fun colleagues. We will work out a career plan with you, with attention and a budget for extra education/certification. You can count on an attractive salary, supplemented with extra-legal benefits, including a company car.
(Freelance is also possible)