KNOWLEDGE AND SKILLS

Following skills and knowledge are required for the performance of the above listed tasks:

• Core Engineering Languages: Expert proficiency in SQL and Python (PySpark); strong working knowledge of Java for backend data processing or SDK integrations.

• Generic Data Engineering: Solid understanding of Software Engineering principles applied to data (DRY code, modularity, error handling, and logging).

• Data Structures: Proficiency in working with structured, semi-structured (JSON/XML), and unstructured data formats.

• DevOps & CI/CD: Practical experience with Git, branching strategies, and automating deployments through Azure DevOps or GitHub Actions.

• Distributed Computing: Strong grasp of Apache Spark internals, memory management, and execution plans.

• Languages: Good knowledge of written/spoken English (working language). Knowledge of French is an asset

SPECIFIC EXPERTISE

• Fabric Delta Lake Management: Expertise in optimizing and managing transaction logs within the Fabric Lakehouse.

• Multi-stack Integration: Proven ability to connect Fabric with non-Microsoft tools, utilizing generic JDBC/ODBC drivers or REST APIs.

• Performance Tuning: Deep experience in identifying bottlenecks in data flows and optimizing code for low-latency processing.

• Data Design Patterns: Practical experience implementing standard patterns like SCD (Slowly Changing Dimensions), Change Data Capture ingestion and idempotency in a Delta Lake environment.

CERTIFICATIONS & STANDARDS:

• Microsoft Focus: DP-700 (Microsoft Certified: Fabric Data Engineer Associate) – required.

• Generic/Cloud Focus: DP-203 (Azure Data Engineer) or equivalent certifications from Databricks (Data Engineer Associate) or AWS – a plus.

What can you expect from us?

Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.

100% Remote opportunities

We want you to have the flexibility to work where you feel most comfortable and productive.

International Career

• You can expect professional growth and to be connect with the world.

• We are represented in Portugal, Belgium, Luxembourg, and Denmark.

• And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)

Extra Benefits & Perks

If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!

As a plus, we provide Health and Life Insurance.