Senior Data Engineer, data foundation (Databricks)Mission. Owns the data foundation the AI products run on. First the group... Read more
Mission. Owns the data foundation the AI products run on. First the group client registry on Databricks: per-country resolver views, identity matching and numbering, history and event tables, data quality and the stewardship workflow. Then the financial data products the apps consume: ledgers, invoices, documents, time registration and tax data, published as versioned datasets with contracts that external software can rely on. Takes over the Belgian hub logic from the current data lead and extends it to NL and DE -> Builds a working MDM.
Must have
3+ years hands-on Databricks: Unity Catalog, Delta Lake, workflows and jobs, Asset Bundles, serverless compute, SQL warehouses.Strong SQL and PySpark; comfortable with incremental loads, slowly changing dimensions, robust jobs and schema evolution on production tables.Master data or entity resolution experience: deterministic and fuzzy matching, survivorship rules, golden records, merge and split handling, audit trail.Has built data products that other teams' software consumed: data contracts, versioning, backwards compatibility, service levels, deprecation.Data quality engineering: invariants, reconciliation counts, tests in CI, alerting on failed runs.Unstructured data: pipelines for documents and extracted fields (PDF, e-invoices, scans) alongside the tabular data.Git-based delivery: pull requests, code review, CI/CD for data pipelines (GitHub Actions).Privacy awareness: minimisation, pseudonymisation, GDPR roles; has worked with personal data under controls.Nice to have
Accounting data models: general ledger, VAT, annual accounts, practice-management and ERP systems.Belgian, Dutch or German company registers (KBO/BCE, KvK, Handelsregister), VAT numbers, Dun & Bradstreet or similar enrichment APIs.Databricks Vector Search, Databricks Apps or a small Python web UI for data stewards.Dutch; French or German a plus.
GCS is acting as an Employment Business in relation to this vacancy.
Read lessBelgiumContract
All your saved jobs are no longer available or you've already applied.
for the following search criteria