Senior Data Engineer, data foundation (Databricks)
Mission. Owns the data foundation the AI products run on. First the group client registry on Databricks: per-country resolver views, identity matching and numbering, history and event tables, data quality and the stewardship workflow. Then the financial data products the apps consume: ledgers, invoices, documents, time registration and tax data, published as versioned datasets with contracts that external software can rely on. Takes over the Belgian hub logic from the current data lead and extends it to NL and DE -> Builds a working MDM.
Must have
- 3+ years hands-on Databricks: Unity Catalog, Delta Lake, workflows and jobs, Asset Bundles, serverless compute, SQL warehouses.
- Strong SQL and PySpark; comfortable with incremental loads, slowly changing dimensions, robust jobs and schema evolution on production tables.
- Master data or entity resolution experience: deterministic and fuzzy matching, survivorship rules, golden records, merge and split handling, audit trail.
- Has built data products that other teams' software consumed: data contracts, versioning, backwards compatibility, service levels, deprecation.
- Data quality engineering: invariants, reconciliation counts, tests in CI, alerting on failed runs.
- Unstructured data: pipelines for documents and extracted fields (PDF, e-invoices, scans) alongside the tabular data.
- Git-based delivery: pull requests, code review, CI/CD for data pipelines (GitHub Actions).
- Privacy awareness: minimisation, pseudonymisation, GDPR roles; has worked with personal data under controls.
Nice to have
- Accounting data models: general ledger, VAT, annual accounts, practice-management and ERP systems.
- Belgian, Dutch or German company registers (KBO/BCE, KvK, Handelsregister), VAT numbers, Dun & Bradstreet or similar enrichment APIs.
- Databricks Vector Search, Databricks Apps or a small Python web UI for data stewards.
- Dutch; French or German a plus.
GCS is acting as an Employment Business in relation to this vacancy.
databricks data engineer - MDM
Other similar jobs
Popular job searches
Your next job
starts here.
JOB SPECIALISMS
LATEST JOBS
TOP SEARCHES
LOCATIONS
- Controls & Automation
- Engineering
- IT Support & Infrastructure
- Data
- BI & Data Analytics
- Project Management
- Hardware & Electronics
- DevOps
- Network security consultant
- IT Audit & Risk
- Software Development
- Testing & QA
LATEST JOBS
- Azure Platform Architect - Gen...
- Electrical Engineering Intern
- databricks data engineer - MDM
- Business Analyst( AI Products)
- Electrical engineering Co-op
- Data Analyst
- Automation Process Engineer
- Software Developer
- System Engineer
- Build Release Engineer
- Senior Risk Analyst
- Electrical Engineering co-op
TOP SEARCHES
LOCATIONS
- Engineer
- Data Scientist
- Senior Data Scientist
- Head of Data Science
- Trainee Data Scientist
- Data Science Graduate
- Senior Financial Accountant
- Management Accountant
- Cost Accountant
- Civil Engineer
- Senior Civil Engineer
- Civil Design Engineer