Senior Data Engineer Location: Dublin, Ireland (Hybrid - 3 days in office) Employment Type: Full-TimeAbout UsWe're an innovative... Read more
Senior Data Engineer
Location: Dublin, Ireland (Hybrid - 3 days in office)
Employment Type: Full-Time
About Us
We're an innovative smart grid technology company building systems that connect and optimise energy assets as part of a Virtual Power Plant, helping accelerate the decarbonisation of the energy system. Our in-house software and hardware platform spans embedded controllers with rich sensor data collection deployed on customer sites, through to backend applications for control, automation, and data analytics - all the way to customer-facing visualisation and reporting tools.
We're a leader in the evolving smart grid space, offering Load Shifting, Demand Response, and Frequency Response services. As the electricity network evolves to intelligently balance producers and consumers of all sizes, we're building the technology to meet the needs of a fast-changing energy landscape - and growing our IT team to support the next stage of our growth.
The Role
We're looking for a Senior Data Engineer to join our Data and Analytics IT team. You'll work in an agile environment to build a Data Lake and Data Warehouse solution supporting our Data Science and Business Management teams - integrating data from external sources, IoT sensors across our install base, and business systems including CRM and billing.
This integrated data will power solutions for energy optimisation, energy trading, and predictive fault detection, as well as Power BI reporting for internal and external stakeholders. You'll play a key role in our Smart Grid Platform's evolution - from analysis and design through to implementation and delivery of industry-leading big data and data warehousing solutions, built on Azure's cloud services.
Ideally, you've taken projects through the full development lifecycle on Azure - from design through to production.
What You'll Do
Lead the design and delivery of innovative data solutions using the latest Azure ecosystem servicesApply industry best practices and your own experience to build a data platform that enables business growthLiaise with internal and external stakeholders to gather and document technical requirementsContribute ideas to strengthen standards and processes, and proactively look for ways to improve solutions and process efficiencyWhat You'll Bring
3+ years' professional experience, including 3+ years with Azure or AWS (Azure Data certification a plus)Experience with Data Warehouse design and the Kimball methodologyETL experience using SSIS and Azure Data FactoryHands-on experience with SQL Server, SQL Data Warehouse, and Azure Data LakeSkill in SQL Server schema design and performance optimisationPython programming for data engineering and cleansing (Spark/Databricks experience a plus)Experience with Power BI and DAXSolid understanding of data security on AzureA proven ability to translate complex business requirements into scalable, resilient, end-to-end data system designs (HA/DR)Familiarity with: SQL Server, ETL design, Azure Data Lake, Azure Data Factory, Azure SQL Server, Azure SynapseCore languages: T-SQL, PowerShell, Azure API, DAXNice to Have
Experience in the renewable energy sectorA third-level degree in Maths, Physics, Engineering, Computer Science, or a related fieldCommercial experience in data warehousing and business intelligence projectsExperience with large, complex datasets across multiple languages (T-SQL, Python, R, etc.)Experience translating diverse business domains into dimensional designs for analytics and reportingBasic exposure to machine learning, data visualisation, or AI techniques, and experience collaborating with Data Science/ML teamsData governance experienceGCS is acting as an Employment Agency in relation to this vacancy.
Read lessDublin, Dublin County, Republic of IrelandFull Time
Senior Java Data Engineer (AWS | Databricks | Spring Boot) - ContractLocation: Philadelphia, PA (Hybrid) Duration: ContractBuild the... Read more
GCS is acting as an Employment Business in relation to this vacancy.
Read lessWashington, District of Columbia, United States of AmericaContract
Senior Data EngineerDublin, Ireland | Hybrid | 12-month ContractAbout the CompanyOur client is a large, global technology-driven organisation... Read more
Dublin, Ireland | Hybrid | 12-month Contract
About the CompanyOur client is a large, global technology-driven organisation operating in a highly regulated, data-rich industry, delivering services at scale to millions of customers worldwide.
About the RoleAs a Senior Data Engineer, you will develop and maintain data pipelines that extract, transform, and load (ETL) data from a wide variety of sources into centralised data platforms such as a data warehouse or data lake. You will ensure the smooth, reliable flow of data from source to destination systems while upholding rigorous data quality and integrity standards, working within a highly regulated environment.
Primary ResponsibilitiesData integration: integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers. Handle ingestion, transformation, and consolidation to create a unified, reliable data foundation for analysis and reporting.Data transformation and processing: develop transformation routines to clean, normalise, and aggregate data. Handle complex data structures and missing or inconsistent data, preparing data for analysis, reporting, and machine learning use cases.Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.Implement data governance and data de-identification frameworks in line with company and regulatory standards.Partner with data analytics and product leaders to design best practices and standards for developing and productionising analytic pipelines.Partner with infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new cloud-based tools and techniques (Azure, Snowflake, and others).Monitoring and support: monitor data pipelines and systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling to ensure data integrity and system reliability.Required QualificationsExtensive experience designing data solutions, with a solid understanding of architectural patterns, system design principles, data modelling, and large-scale solution development.Extensive hands-on experience developing data processing jobs (PySpark/SQL) demonstrating strong software engineering principles.Proven experience with Azure Databricks and Snowflake.Experience orchestrating data pipelines using tools such as Azure Data Factory, Airflow, or similar.Proven experience working with Spark.Advanced SQL skills and deep experience with relational databases (e.g., SQL Server), including optimisation, stored procedures, and performance tuning for high-volume applications.Experience with DevOps tooling, Git workflows, and building CI/CD pipelines.Experience applying data governance controls, data masking, and data de-identification rules within a highly regulated environment.Excellent communication and interpersonal skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.Preferred QualificationsExperience analysing and improving workflows: evaluating process maps and flowcharts, identifying inefficiencies, and recommending enhancements to procedures, technology, and tools.Familiarity with languages such as Java or Scala.A motivated self-starter who manages their own tasks and takes ownership.Experience working in agile/scrum teams.Strong Python skills for data manipulation, cleaning, transformation, and analysis of structured data.Familiarity with production-quality ML/AI model development and deployment.Data architecture experience.GCS is acting as an Employment Business in relation to this vacancy.
Read lessRepublic of IrelandContract
About the RoleOur client is a global data and artificial intelligence (AI) organisation that partners with leading businesses... Read more
Our client is a global data and artificial intelligence (AI) organisation that partners with leading businesses to transform operations, enhance decision-making, and drive growth through advanced analytics and digital solutions.
With a large international presence and a strong reputation across industries such as financial services, healthcare, retail, and insurance, the organisation delivers innovative, data-driven solutions at scale.
Location: Dublin, Republic of Ireland (Hybrid)
Employment Type: Contract
We are seeking a hands-on Databricks Data Engineer to support a major data transformation programme focused on automating reporting and dashboard solutions.
This is a delivery-focused role where you will work with structured and unstructured data to build and maintain scalable data pipelines within a modern cloud-based platform using Databricks medallion architecture.
You will collaborate closely with data architects and business stakeholders to develop high-quality, reliable data engineering solutions.
Data Pipeline Development
Design, build, and maintain data ingestion and transformation pipelines using DatabricksWork across both structured and unstructured data sourcesMedallion Architecture Implementation
Develop pipelines across Bronze, Silver, and Gold layersEnsure data is optimised for analytics and reportingData Integration & Processing
Deliver batch and streaming pipelines using Databricks, Spark, and Azure Data Factory (or similar tools)Stakeholder Collaboration
Work with architects and business stakeholders to translate requirements into scalable solutionsData Quality & Validation
Implement checks, validation rules, and monitoring to ensure data accuracyPerformance Optimisation
Improve pipeline performance, scalability, and cost-efficiencyGovernance & Standards
Follow data governance, lineage, and metadata best practicesTesting & Deployment
Support testing, release, and production deployment of solutionsDocumentation
Maintain clear and structured technical documentationContinuous Improvement
Stay up to date with modern data engineering practices and toolsEducation & Experience
Bachelor's degree in IT, Computer Science, or related field3-6 years' experience in data engineering or similar rolesTechnical Skills
Hands-on experience with Databricks and SparkExperience building ETL/ELT pipelines (ADF or similar tools)Strong database experience (e.g., SQL Server, PostgreSQL, Oracle, Synapse)Exposure to cloud platforms (Azure preferred)Additional Knowledge
Understanding of BI tools such as Power BI or TableauExperience in financial services or regulated environments is beneficial
GCS is acting as an Employment Business in relation to this vacancy.
Read lessRepublic of IrelandContract
All your saved jobs are no longer available or you've already applied.
for the following search criteria