Senior Data EngineerDublin, Ireland | Hybrid | 12-month ContractAbout the CompanyOur client is a large, global technology-driven organisation... Read more
Dublin, Ireland | Hybrid | 12-month Contract
About the CompanyOur client is a large, global technology-driven organisation operating in a highly regulated, data-rich industry, delivering services at scale to millions of customers worldwide.
About the RoleAs a Senior Data Engineer, you will develop and maintain data pipelines that extract, transform, and load (ETL) data from a wide variety of sources into centralised data platforms such as a data warehouse or data lake. You will ensure the smooth, reliable flow of data from source to destination systems while upholding rigorous data quality and integrity standards, working within a highly regulated environment.
Primary ResponsibilitiesData integration: integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers. Handle ingestion, transformation, and consolidation to create a unified, reliable data foundation for analysis and reporting.Data transformation and processing: develop transformation routines to clean, normalise, and aggregate data. Handle complex data structures and missing or inconsistent data, preparing data for analysis, reporting, and machine learning use cases.Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.Implement data governance and data de-identification frameworks in line with company and regulatory standards.Partner with data analytics and product leaders to design best practices and standards for developing and productionising analytic pipelines.Partner with infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new cloud-based tools and techniques (Azure, Snowflake, and others).Monitoring and support: monitor data pipelines and systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling to ensure data integrity and system reliability.Required QualificationsExtensive experience designing data solutions, with a solid understanding of architectural patterns, system design principles, data modelling, and large-scale solution development.Extensive hands-on experience developing data processing jobs (PySpark/SQL) demonstrating strong software engineering principles.Proven experience with Azure Databricks and Snowflake.Experience orchestrating data pipelines using tools such as Azure Data Factory, Airflow, or similar.Proven experience working with Spark.Advanced SQL skills and deep experience with relational databases (e.g., SQL Server), including optimisation, stored procedures, and performance tuning for high-volume applications.Experience with DevOps tooling, Git workflows, and building CI/CD pipelines.Experience applying data governance controls, data masking, and data de-identification rules within a highly regulated environment.Excellent communication and interpersonal skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.Preferred QualificationsExperience analysing and improving workflows: evaluating process maps and flowcharts, identifying inefficiencies, and recommending enhancements to procedures, technology, and tools.Familiarity with languages such as Java or Scala.A motivated self-starter who manages their own tasks and takes ownership.Experience working in agile/scrum teams.Strong Python skills for data manipulation, cleaning, transformation, and analysis of structured data.Familiarity with production-quality ML/AI model development and deployment.Data architecture experience.GCS is acting as an Employment Business in relation to this vacancy.
Read lessAbout the RoleOur client is a global data and artificial intelligence (AI) organisation that partners with leading businesses... Read more
Our client is a global data and artificial intelligence (AI) organisation that partners with leading businesses to transform operations, enhance decision-making, and drive growth through advanced analytics and digital solutions.
With a large international presence and a strong reputation across industries such as financial services, healthcare, retail, and insurance, the organisation delivers innovative, data-driven solutions at scale.
Location: Dublin, Republic of Ireland (Hybrid)
Employment Type: Contract
We are seeking a hands-on Databricks Data Engineer to support a major data transformation programme focused on automating reporting and dashboard solutions.
This is a delivery-focused role where you will work with structured and unstructured data to build and maintain scalable data pipelines within a modern cloud-based platform using Databricks medallion architecture.
You will collaborate closely with data architects and business stakeholders to develop high-quality, reliable data engineering solutions.
Data Pipeline Development
Design, build, and maintain data ingestion and transformation pipelines using DatabricksWork across both structured and unstructured data sourcesMedallion Architecture Implementation
Develop pipelines across Bronze, Silver, and Gold layersEnsure data is optimised for analytics and reportingData Integration & Processing
Deliver batch and streaming pipelines using Databricks, Spark, and Azure Data Factory (or similar tools)Stakeholder Collaboration
Work with architects and business stakeholders to translate requirements into scalable solutionsData Quality & Validation
Implement checks, validation rules, and monitoring to ensure data accuracyPerformance Optimisation
Improve pipeline performance, scalability, and cost-efficiencyGovernance & Standards
Follow data governance, lineage, and metadata best practicesTesting & Deployment
Support testing, release, and production deployment of solutionsDocumentation
Maintain clear and structured technical documentationContinuous Improvement
Stay up to date with modern data engineering practices and toolsEducation & Experience
Bachelor's degree in IT, Computer Science, or related field3-6 years' experience in data engineering or similar rolesTechnical Skills
Hands-on experience with Databricks and SparkExperience building ETL/ELT pipelines (ADF or similar tools)Strong database experience (e.g., SQL Server, PostgreSQL, Oracle, Synapse)Exposure to cloud platforms (Azure preferred)Additional Knowledge
Understanding of BI tools such as Power BI or TableauExperience in financial services or regulated environments is beneficial
GCS is acting as an Employment Business in relation to this vacancy.
Read lessThe TeamThe team sits within network technology organisation, building advanced data platforms that support digital twin capabilities across... Read more
The team sits within network technology organisation, building advanced data platforms that support digital twin capabilities across the access network. The group combines network design data, telemetry, mapping technologies, and large-scale engineering systems to improve troubleshooting, planning, operational efficiency, and competitive market analysis.
The team develops highly scalable platforms that ingest and process complex operational data, expose intelligence through APIs, and enable smarter decision-making across the business.
This is a technically strong team solving real-world infrastructure challenges using modern software engineering and data technologies.
ResponsibilitiesDesign, build, and maintain scalable ETL / ELT pipelines processing large enterprise datasets.Develop robust data products using Databricks, Spark, and cloud-based data platforms.Build configurable ingestion frameworks and multi-environment deployment pipelines.Engineer APIs that expose network intelligence products to internal teams and systems.Work with complex relational, structured, and semi-structured datasets representing network assets, telemetry, and operational events.Improve data quality, exception handling, observability, and pipeline resilience across multiple upstream data sources.Write production-grade software with strong engineering standards, testing, and automation.Collaborate with GIS, network engineering, and operational teams to solve business-critical problems.Support the evolution of digital twin and next-generation network intelligence platforms.Skills & ExperienceRequiredStrong software engineering background (Python preferred).Experience building production systems and scalable backend applications.ETL / ELT pipeline engineering experience.Experience with Spark, Databricks, or similar distributed data platforms.API development experience (REST / backend services).Strong SQL and data modelling skills.Experience handling large, imperfect enterprise datasets.Strong problem-solving skills and ability to work with complex systems.Experience with Airflow, AWS EMR, Snowflake, or similar modern data tools.GIS / geospatial data experience.Telecom, utilities, infrastructure, or network data experience.CI/CD and DevOps engineering practices.Experience building internal data products or platform services.Ideal CandidateA strong software engineer with an interest in data engineering, or a data engineer with excellent coding discipline. Candidates with transferable adjacent skills are highly valued over exact tool matching alone. Someone who can build scalable systems, work through messy data challenges, and thrive in a complex enterprise environment.
GCS is acting as an Employment Business in relation to this vacancy.
Read lessSenior Software Engineer / Data Platform Engineer (Databricks, Graph, APIs)Location: Philadelphia, PA The team sits within the network... Read more
Senior Software Engineer / Data Platform Engineer (Databricks, Graph, APIs)
Location: Philadelphia, PA
The team sits within the network technology organisation and is responsible for building advanced data platforms that support digital twin capabilities across the access network. The group combines network design data, telemetry, mapping technologies, and graph intelligence to improve troubleshooting, planning, operational efficiency, and market competitiveness.
The team works on highly scalable engineering products including large data pipelines, graph databases, APIs, and mapping platforms. Their work enables smarter network decisions, faster fault resolution, and better use of operational resources.
This is a technically strong team focused on solving complex real-world problems using modern engineering and data technologies.
Responsibilities
Design, build, and maintain scalable ETL / ELT pipelines processing large enterprise datasets.Develop robust data products within Databricks and Spark environments.Build configurable ingestion frameworks and multi-environment deployment pipelines.Engineer APIs that expose network intelligence products to internal users and systems.Work with graph databases such as Neo4j to model relationships across network assets, devices, and telemetry.Improve data quality, exception handling, and pipeline resilience across multiple data sources.Write production-grade software with strong engineering standards, testing, and automation.Collaborate with technical teams to translate complex operational problems into scalable engineering solutions.Help evolve digital twin and next-generation network intelligence platforms.Skills & Experience
Required
Strong software engineering background (Python)Neo4j graph database experienceExperience building production systems and scalable backend applications.ETL / ELT pipeline engineering experience.Experience with Spark, Databricks, or similar distributed data platforms.API development experience (REST / backend services).Strong problem-solving skills and ability to work with complex data.Experience with Airflow, AWS EMR, or similar orchestration/data tools.Telecom, infrastructure, or network data experience.CI/CD and DevOps engineering practices.Experience handling large, imperfect enterprise datasets.Ideal Candidate
A strong software engineer with an interest in data engineering, or a data engineer with excellent coding discipline. Candidates with transferable adjacent skills are highly valued over exact tool matching alone.
GCS is acting as an Employment Business in relation to this vacancy.
Read lessSenior Azure Data EngineerDay‑Rate Contract | Dublin (Hybrid) | Immediate StartWe are currently supporting a large, Dublin‑based organisation... Read more
Day‑Rate Contract | Dublin (Hybrid) | Immediate Start
We are currently supporting a large, Dublin‑based organisation in the appointment of a Senior Azure Data Engineer to join an established data engineering function on a contract basis. This position will play a strategic role in shaping, delivering, and operating data pipelines across a modern Azure data estate.
The successful contractor will contribute to the design and integration of data from a wide range of internal and external sources, while also supporting and extending existing SQL Server and cloud‑based ingestion frameworks. You will work alongside engineering, analytics, and data science professionals to deliver resilient, scalable data solutions into production environments.
Key ResponsibilitiesInterpret business and technical requirements to architect scalable, enterprise‑grade data solutionsDesign, develop, and optimise ETL / ELT pipelines across SQL Server and Azure platformsMaintain, enhance, and evolve existing data warehouses, data marts, and processing workflowsDeliver multiple data engineering initiatives concurrently, ensuring high standards of quality and reliabilitySupport delivery by addressing dependencies, resolving technical blockers, and enabling smooth executionPromote and deploy data solutions into production, including outputs from analytics and data science teamsImplement enhancements and change requests across established Azure data platformsMonitor progress, identify delivery risks, and proactively troubleshoot issues within data environmentsRequired ExperienceStrong software engineering background with delivery experience in Agile environmentsExtensive experience designing and implementing enterprise‑scale ETL solutionsDeep technical expertise in SSIS, Azure Data Factory, Azure Synapse Analytics, and Power AutomateHands‑on experience using Python and/or PySpark within data engineering workflowsProven ability to configure and work with Azure Synapse connectors (e.g. SQL, HTTP, SFTP, on‑prem sources)Solid experience working with Azure Data Lake and modern cloud data storage platformsIf this role suits you or someone in your network, please apply or reach out for a confidential chat.
GCS is acting as an Employment Business in relation to this vacancy.
Read lessI am looking for a Senior Data Platform with experience in Azure and Databricks for a client of... Read more
I am looking for a Senior Data Platform with experience in Azure and Databricks for a client of mine based in Amsterdam.
6 months contract with the option to extend.
Netherlands based candidates only and this is a freelance/zzp role.
For further information please apply or reach out to me on [email protected]
GCS is acting as an Employment Business in relation to this vacancy.
Read lessAll your saved jobs are no longer available or you've already applied.
for the following search criteria
