Senior Data Engineer Python & AI Migration (Freelance possible)

📋 Tasks and responsibilities

To support the migration of legacy SAS-based ETL workloads to a modern Python data platform using technologies such as Parquet and Spark, this role contributes to the build-out of an AI-assisted, agent-driven migration factory. The objective is to support analysis, transformation, validation and the generation of Python artefacts throughout the migration lifecycle.

As a Senior Python Data Engineer, you will help deliver migration solutions and further improve the agentic workflows, orchestration mechanisms and validation processes that support this migration approach.

You will work closely with data engineers, architects and SAS specialists to strengthen the quality, scalability and efficiency of the migration process.

Core Domains of Expertise

1. Python Data Engineering

• Design, build and validate Python-based data transformation solutions.
• Review and optimise AI-generated Python code.
• Safeguard code quality, maintainability, performance and operational robustness.
• Handle complex migration scenarios where automated generation needs refinement.
• Contribute to data quality controls, schema management and Parquet optimisation.
• Support PySpark implementations where relevant.
• Apply Python performance tuning in data engineering contexts.
• Work on ETL and ELT processes for data acquisition and transformation.

2. AI-Assisted Development & Agent Harness Engineering

• Act as a key user and contributor within the AI-assisted migration pipeline.
• Help evolve the agent harness used to orchestrate specialised agents.
• Improve collaboration between agents responsible for SAS analysis, functional analysis generation, technical analysis generation, Python code generation, validation and testing.
• Increase workflow reliability, traceability and throughput.
• Strengthen human-in-the-loop validation mechanisms and feedback loops.
• Identify opportunities to further automate the process while preserving quality and control.

📝 Your profile

You are a senior Python Data Engineer with strong software and data engineering skills, combined with hands-on experience in AI-assisted development, agentic workflows and agent harness engineering. You are comfortable contributing both to delivery and to the further industrialisation of an AI-driven migration factory.

• You have at least 5 years of hands-on experience in Python development.
• You have solid experience in data engineering, including ETL / ELT processes, data quality controls and schema management.
• You have strong knowledge of Pandas, Polars, PyArrow, Parquet and testing frameworks.
• You have experience with Python programming and performance tuning.
• You are familiar with Python from a data engineering perspective, including Pandas and Apache Spark.
• Experience with PySpark is a strong asset.
• You have experience with AI-assisted software development tools such as GitHub Copilot or similar solutions.
• You are familiar with agentic workflows, multi-agent systems, agent harness engineering, workflow orchestration and human-in-the-loop validation.
• Experience with SAS BASE is a strong asset, as is the ability to understand legacy SAS programs.
• You understand concepts such as DATA steps, PROC SQL, SAS macros and ETL processing patterns.
• You collaborate effectively with SAS analysts and subject-matter experts during migration and validation activities.
• Experience as a confirmed Data Architect is an asset.

Languages

• Dutch
• English
• French

💼 Offer

You will be part of a growing Belgian SME where initiative and personal development are encouraged. We will provide you with an enjoyable work environment with fun colleagues. We will work out a career plan with you, with attention and a budget for extra education/certification. You can count on an attractive salary, supplemented with extra-legal benefits, including a company car.
(Freelance is also possible)