Data Engineer

Reference: MMAI71_1790957457

Senior Data Engineer
Location: Abu Dhabi, UAE - Remote Global
Type: Contract

Role Summary


We are seeking a Senior Data Engineer to architect and build the foundational data infrastructure for
a large-scale AI transformation programme. You will move beyond standard ETL tasks to design and
deploy enterprise-grade Data Lakehouses that serve as the "Single Source of Truth" for AI agents and
advanced analytics platforms.
You will lead the technical execution of data and platform foundation initiatives. Your mandate is to
map rigid enterprise systems (e.g., SAP S/4HANA, Ariba, etc.) and collaborate with teams to
understand complex unstructured data (technical drawings, regulatory text) while building high
performance pipelines and systems that power Intelligent Supply Chain forecasting and generative AI
tools.
You will operate within a structured "Sprint Zero" environment, ensuring data lineage, governance,
and security meet strict enterprise standards.

Key Responsibilities


1. Data Lakehouse Architecture (Supply Chain)
* ERP Integration: Architect and deploy ingestion pipelines to extract high-volume
transactional data from SAP S/4HANA, Ariba, and PLM systems, ensuring near real-time
availability for forecasting models.
* External Feed Integration: Build connectors for external market intelligence feeds (e.g., S&P
Global, Orbis, EcoVadis) to enrich internal procurement data with macroeconomic and
geopolitical signals.
* Unified Data Model: Design and implement a standardized procurement data model and
taxonomy across multiple entities, harmonizing fragmented datasets into a cohesive layer for
analytics.


2. Unstructured Data Pipelines
* Complex Ingestion: Engineer pipelines to ingest and process unstructured technical data,
including PDF tender documents, CAD metadata, and historical CONOPS, transforming them
into vector-ready formats for RAG (Retrieval-Augmented Generation) applications.
* Vector Database Management: Manage and optimize Vector Databases (e.g., Weaviate) to
store embeddings of archival proposals and engineering snippets, ensuring high-speed
retrieval for AI drafting assistants.
* Digital Thread Implementation: Establish data lineage and traceability protocols that link
requirements to physical components, supporting Model-Based Systems Engineering (MBSE)
Digital Thread initiatives.


3. Governance & Security
* Enterprise-Grade Security: Implement Role-Based Access Control (RBAC), audit logging,
and data redaction policies to ensure compliance with export controls and strict on-premise
security requirements.
* Quality Control: Deploy automated data quality frameworks to validate BOM (Bill of
Materials) completeness and cost data accuracy before it reaches AI models.
* Infrastructure Optimization: Optimize pipelines for on-premise GPU clusters and air-gapped
environments, ensuring efficiency within existing infrastructure limits.

Technical Requirements


* Core Stack: Expert proficiency in Python, SQL, and modern data engineering frameworks
(Apache Spark, Kafka, Airflow).
* Enterprise ERP: Strong experience extracting data from complex ERP environments,
specifically SAP S/4HANA and SAP Ariba. Familiarity with SAP BTP is a plus.
* Database Technologies: Deep understanding of Data Lakehouse architectures
(Databricks/Delta Lake), Relational Databases (PostgreSQL), and Vector Databases
(Weaviate/Milvus).
* Data Pipeline Development: Experience building pipelines for RAG solutions, conversational
agents, and classical ML models using tools such as dbt, Dagster, or Prefect.
* DevOps/DataOps: Proficiency with containerization (Docker, Kubernetes) and CI/CD
pipelines for deploying data workflows in secure environments.

Professional Qualifications


* Experience: 5+ years of experience in Data Engineering, with at least 2 years focused on
building pipelines for Machine Learning or Generative AI applications in an enterprise setting.
* Domain Knowledge: Experience in Supply Chain, Manufacturing, or Defence sectors is
highly desirable. Ability to understand Bill of Materials (BOM) structures and procurement
lifecycles.
* Problem Solving: Ability to navigate the "Governance Collision" between agile data work and
rigid systems engineering requirements, ensuring data deliverables meet formal Stage Gate
reviews.
* Collaboration: Proven ability to work alongside Data Scientists and Backend Engineers to
define data schemas that support predictive modelling and AI agents.

Why This Role?


You will be the architect of the data foundation behind advanced AI capabilities. Your work will directly
enable AI agents to support procurement workflows, forecasting, analytics, and engineering decision
making. If you are ready to build the robust infrastructure that turns raw data into strategic advantage,
this role is for you.

GCS is acting as an Employment Business in relation to this vacancy.

COMPETITIVE SALARY
Added 02/10/2026
Reference: MMAI71_1790957457

Other similar jobs

databricks data engineer - MDM

Added 18/11/2026

Senior Data Engineer, data foundation (Databricks)Mission. Owns the data foundation the AI products run on. First the group client registry on Databricks: per-country resolver views, identity matching and numbering, history and event tables, data quality and the stewardship workflow. Then the financial data products the apps consume: ledgers, invoices, documents, time registration and tax data, published as versioned datasets with contracts that external software can rely on. Takes over the Belgian hub logic from the current data lead and extends it to NL and DE -> Builds a working MDM.Must have3+ years hands-on Databricks: Unity Catalog, Delta Lake, workflows and...

Learn more

Data Center Quality Engineer

Added 26/10/2026

Data Center Quality Engineer - Fiber / Racks / Structured CablingLocation: New Albany, OHSchedule: Full-time onsiteContract: Long-term projectWe're supporting a large-scale data center build and looking for hands-on infrastructure professionals with strong quality instincts.You do not necessarily need to come from a formal QA/QC title. We're interested in candidates who have worked directly with rack deployments, fiber/copper cabling, structured cabling, hardware installation, inspections, testing, troubleshooting, and technician oversight and understand what good installation quality looks like.The focus of the role is simple: inspect the work, catch defects early, document them clearly, make sure they're corrected, and confirm the infrastructure is...

Learn more

Senior BI Engineer - Quicksight and Data Modelling

Added 20/10/2026

Hiring AlertSenior BI EngineerWe are looking for a Senior BI Engineer - Quicksight with strong data modeling experience, and owning and rebuilding the manufacturing reporting layer, ensuring accurate, trusted, and automated operational reporting. The ideal candidate will work closely with operations, software engineering, and data engineering teams to validate business metrics, redesign datasets, and deliver scalable QuickSight dashboards.Key ResponsibilitiesStrong data modeling experience, including designing fact and dimension schemas from business requirements and creating intuitive data models for business users.Designing the data model. Identify a sensible, simple model (fact and dimension tables) that would yield those dashboardsAssess existing QuickSight dashboards, Athena/Redshift...

Learn more

QC Engineer - Data Center Infrastructure

Added 19/10/2026

⚡ QA/QC Engineer - Data Center Infrastructure | New Albany, OHI'm looking for 2 QA/QC Engineers to join CommScope's data center team supporting Meta infrastructure deployments in New Albany.This role is ideal for someone who understands how data center infrastructure is actually installed in the field and can confidently identify when something does not match the drawing, standard, or expected workmanship.The work centers around:🧰 QA of rack deployments inside data halls🧵 Inspecting fiber + copper installs, labeling, polarity, cleanliness, and test results📐 Reading rack elevations, layouts, pathways, and infrastructure drawings🏗️ Inspecting prefabricated/offsite-built racks and modules before shipment📋 Building punch lists,...

Learn more

Data Center QA Engineer

Added 19/10/2026

🚨 Hiring: Data Center QA/QC Engineer | New Albany, OHI'm supporting CommScope on an urgent search for 2 QA/QC Engineers supporting large-scale Meta data center buildouts in New Albany, Ohio.This is a hands-on onsite quality role responsible for making sure infrastructure is built and installed correctly before final sign-off - across both prefabricated/offsite builds and onsite data hall deployments.You'll be involved with:🔹 Inspecting rack deployments, placement, labeling, cable management, and workmanship🔹 Reviewing data center layouts, rack elevations, pathways, and infrastructure drawings🔹 Verifying fiber and copper cabling, terminations, labeling, cleanliness, and test results🔹 Running QA checklists / punch lists and tracking...

Learn more

Data Engineer

Added 13/10/2026

Data Engineer (Python / Distributed Data Platforms)📍 Relocation to Malta Required | 💼 Permanent | 🏠 Remote from MaltaWe have partnered with a growing European technology company that is investing heavily in its data platform and engineering capabilities.As part of their expansion, they are seeking Data Engineers across multiple levels, including:Data Engineer II (3-5 years)Data Engineer III (5-8 years)Staff Data Engineer (10-12 years)This is an opportunity to build and scale modern distributed data platforms capable of handling large-scale data workloads while working with a cutting-edge open-source technology stack.What You'll Be DoingDesign and develop scalable batch and real-time data pipelinesBuild reliable...

Learn more

Data Engineer

Added 13/10/2026

Data Engineer (Python / Distributed Data Platforms)📍 Relocation to Malta Required | 💼 Permanent | 🏠 Remote from MaltaWe have partnered with a growing European technology company that is investing heavily in its data platform and engineering capabilities.As part of their expansion, they are seeking Data Engineers across multiple levels, including:Data Engineer II (3-5 years)Data Engineer III (5-8 years)Staff Data Engineer (10-12 years)This is an opportunity to build and scale modern distributed data platforms capable of handling large-scale data workloads while working with a cutting-edge open-source technology stack.What You'll Be DoingDesign and develop scalable batch and real-time data pipelinesBuild reliable...

Learn more

Data Engineer

Added 12/10/2026

Data Engineer (Python / Distributed Data Platforms)📍 Relocation to Malta Required | 💼 Permanent | 🏠 Remote from MaltaWe have partnered with a growing European technology company that is investing heavily in its data platform and engineering capabilities.As part of their expansion, they are seeking Data Engineers across multiple levels, including:Data Engineer II (3-5 years)Data Engineer III (5-8 years)Staff Data Engineer (10-12 years)This is an opportunity to build and scale modern distributed data platforms capable of handling large-scale data workloads while working with a cutting-edge open-source technology stack. What You'll Be DoingDesign and develop scalable batch and real-time data pipelinesBuild...

Learn more

Data center engineer

Added 06/10/2026

Position SummaryWe are seeking a hands-on Data center engineerto support critical IT infrastructure and operations within its data center environment. The technician will be responsible for hardware deployment, troubleshooting, asset management, rack and stack activities, network connectivity validation, break/fix support, and execution of operational procedures that ensure maximum uptime of data center services.The ideal candidate possesses strong hardware troubleshooting abilities, understands enterprise IT infrastructure, can follow detailed SOPs, and is comfortable working in a fast-paced, mission-critical environment where attention to detail and reliability are essential.Key ResponsibilitiesData Center OperationsInstall, rack, stack, cable, and decommission servers, network devices, and storage equipment.Perform hardware...

Learn more

Data center engineer

Added 06/10/2026

Position SummaryWe are seeking a hands-on Data Center engineerto support critical IT infrastructure and operations within its data center environment. The technician will be responsible for hardware deployment, troubleshooting, asset management, rack and stack activities, network connectivity validation, break/fix support, and execution of operational procedures that ensure maximum uptime of data center services.The ideal candidate possesses strong hardware troubleshooting abilities, understands enterprise IT infrastructure, can follow detailed SOPs, and is comfortable working in a fast-paced, mission-critical environment where attention to detail and reliability are essential.Key ResponsibilitiesData Center OperationsInstall, rack, stack, cable, and decommission servers, network devices, and storage equipment.Perform hardware...

Learn more

Senior Data Engineer

Added 02/10/2026

Senior Data Engineer Role (Python / Spark / Databricks) - Hybrid - Contract - Banking Role - Senior Data EngineerRate - £850 p/d (Inside IR35)Duration - 6 months with very likely extensionLocation - Hybrid / Liverpool Street (London) - 3 days per week in a Liverpool Street officeAbout the RoleGlobal financial institution seeking a highly skilled Senior Data Engineer to join a growing data engineering function responsible for delivering critical data platforms and analytics capabilities across the business.This is a genuinely hands-on engineering role, requiring strong expertise in Python, Databricks, Spark/PySpark and SQL. The successful candidate will be actively involved...

Learn more

Senior Data Engineer

Added 24/09/2026

Senior Data Engineer Role (Python / Spark / Databricks) - Hybrid - Contract - Banking Role - Senior Data EngineerRate - £850 p/d (Inside IR35)Duration - 6 months with very likely extensionLocation - Hybrid / Liverpool Street (London) - 3 days per week in a Liverpool Street officeAbout the RoleGlobal financial institution seeking a highly skilled Senior Data Engineer to join a growing data engineering function responsible for delivering critical data platforms and analytics capabilities across the business.This is a genuinely hands-on engineering role, requiring strong expertise in Python, Databricks, Spark/PySpark and SQL. The successful candidate will be actively involved...

Learn more

Data Center Engineer

Added 22/09/2026

About the RoleWe are seeking a hands-on Data Center Engineer to support the commissioning, deployment, maintenance, and troubleshooting of critical infrastructure systems in a data center environment. This role focuses on BMS, BAS, EPMS, and other facility control systems that support cooling, power, and environmental operations.Key ResponsibilitiesCommission and deploy control system hardware and software.Perform testing, startup, and validation of controllers, sensors, and field devices.Troubleshoot controls, networking, communication, and monitoring systems.Investigate and resolve system alarms, faults, and performance issues.Maintain system documentation, configurations, and asset records.Support preventive maintenance and reliability initiatives.Follow established safety, operational, and change management procedures.Required Skills4+ years of experience...

Learn more

Senior Software Engineer - Data, Machine Learning & Applications

Added 09/09/2026

Senior Software Engineer - Data, Machine Learning & ApplicationsJob SummaryWe are seeking a versatile Senior Software Engineer with experience in application development, databases, data processing, and Machine Learning systems. This role will focus on designing and building robust, scalable technical solutions while ensuring high standards for software quality and performance.The ideal candidate combines strong software engineering fundamentals with experience working with relational databases, SQL, data solutions, and modern application development technologies.ResponsibilitiesDesign, develop, test, and maintain scalable software and Machine Learning applications.Write clean, efficient, and well-documented code that meets performance and business requirements.Participate in application architecture, system design, and technical solution...

Learn more

Senior Software Engineer - Quality, Applications & Data

Added 08/09/2026

Senior Software Engineer - Quality, Applications & DataWe are seeking an experienced Senior Software Engineer to design, develop, test, and support high-quality software applications and data solutions. This individual will play a key role throughout the full software development lifecycle, with responsibilities spanning software development, quality assurance, test automation, database development, and Machine Learning applications.The ideal candidate will bring a strong technical foundation in modern programming languages and frameworks, software testing methodologies, relational databases, and system design.ResponsibilitiesDevelop and execute formal test plans to ensure the delivery of high-quality software applications.Participate in test planning, test case development, test automation, and test...

Learn more
At least 8 characters, 1 uppercase, 1 lowercase and 1 special character or number
Your file must be a doc, docx or pdf. No larger than 5MB.