Senior Data Engineer

Reference: RP/DATA_1790266610

Senior Data Engineer Role (Python / Spark / Databricks) - Hybrid - Contract - Banking

Role - Senior Data Engineer

Rate - £850 p/d (Inside IR35)

Duration - 6 months with very likely extension

Location - Hybrid / Liverpool Street (London) - 3 days per week in a Liverpool Street office

About the Role

Global financial institution seeking a highly skilled Senior Data Engineer to join a growing data engineering function responsible for delivering critical data platforms and analytics capabilities across the business.

This is a genuinely hands-on engineering role, requiring strong expertise in Python, Databricks, Spark/PySpark and SQL. The successful candidate will be actively involved in the design, development, optimisation and support of enterprise-scale data platforms, working alongside engineers, architects and business stakeholders to deliver robust and scalable solutions.

The role offers the opportunity to work on complex data challenges within a modern cloud-based environment, leveraging the latest data engineering technologies and best practices.

Key Responsibilities

Data Engineering & Development

  • Design, develop and maintain scalable data pipelines using Python, Databricks and PySpark
  • Build and optimise ETL/ELT solutions processing large-scale datasets
  • Develop high-quality, reusable code and engineering frameworks
  • Deliver robust, performant and maintainable data solutions
  • Troubleshoot and resolve complex production and performance issues
  • Support the ongoing enhancement and modernisation of enterprise data platforms

Databricks & Data Platform Engineering

  • Develop and support Databricks-based data solutions and Lakehouse architectures
  • Utilise Delta Lake and Spark technologies to deliver scalable data processing capabilities
  • Optimise distributed data processing workloads for performance and reliability
  • Implement data quality controls and monitoring solutions
  • Contribute to platform stability, scalability and operational excellence

Solution Delivery

  • Work closely with business and technology stakeholders to understand requirements and deliver effective solutions
  • Participate in Agile delivery processes including sprint planning, refinement and estimation
  • Support the delivery of strategic data initiatives across multiple business areas
  • Collaborate with architects, engineers and product teams to deliver high-quality outcomes
  • Identify and resolve technical risks and implementation challenges

Engineering Best Practice

  • Promote software engineering best practices including testing, code reviews and version control
  • Support CI/CD adoption and deployment automation
  • Contribute to coding standards and engineering governance
  • Drive continuous improvement across development and support processes
  • Mentor junior engineers and contribute to knowledge sharing within the team

Required Skills & Experience

  • Strong commercial experience as a Data Engineer or Senior Data Engineer
  • Expert-level Python development skills
  • Extensive hands-on experience with Databricks in enterprise environments
  • Strong Apache Spark and PySpark expertise
  • Advanced SQL development and optimisation skills
  • Experience designing and building large-scale ETL and data integration solutions
  • Strong understanding of distributed computing concepts and data processing frameworks
  • Experience working with modern cloud platforms including Azure, AWS or GCP
  • Knowledge of software engineering principles, testing and code quality practices
  • Experience working within Agile development environments
  • Excellent problem-solving and troubleshooting capabilities

Desirable Experience

  • Experience within investment banking, financial services or other highly regulated environments
  • Exposure to risk, trading, treasury or regulatory data domains
  • Experience with Kafka, streaming technologies or real-time data processing
  • Databricks certifications
  • Experience with Airflow, Databricks Workflows or similar orchestration tools
  • CI/CD pipeline development and DevOps practices
  • Docker and Kubernetes
  • Experience supporting data science or machine learning workloads

This role will suit a Senior Data Engineer who enjoys remaining close to the technology and has strong recent experience building production-grade solutions using Python, Databricks, Spark/PySpark and SQL in enterprise environments.

GCS is acting as an Employment Business in relation to this vacancy.

£600.00 - £850.00
Per day
GBP600 - GBP850 per day + Inside IR35
Added 24/09/2026
Reference: RP/DATA_1790266610

Other similar jobs

Senior Software Engineer - Data, Machine Learning & Applications

Added 09/09/2026

Senior Software Engineer - Data, Machine Learning & ApplicationsJob SummaryWe are seeking a versatile Senior Software Engineer with experience in application development, databases, data processing, and Machine Learning systems. This role will focus on designing and building robust, scalable technical solutions while ensuring high standards for software quality and performance.The ideal candidate combines strong software engineering fundamentals with experience working with relational databases, SQL, data solutions, and modern application development technologies.ResponsibilitiesDesign, develop, test, and maintain scalable software and Machine Learning applications.Write clean, efficient, and well-documented code that meets performance and business requirements.Participate in application architecture, system design, and technical solution...

Learn more

Senior Software Engineer - Quality, Applications & Data

Added 08/09/2026

Senior Software Engineer - Quality, Applications & DataWe are seeking an experienced Senior Software Engineer to design, develop, test, and support high-quality software applications and data solutions. This individual will play a key role throughout the full software development lifecycle, with responsibilities spanning software development, quality assurance, test automation, database development, and Machine Learning applications.The ideal candidate will bring a strong technical foundation in modern programming languages and frameworks, software testing methodologies, relational databases, and system design.ResponsibilitiesDevelop and execute formal test plans to ensure the delivery of high-quality software applications.Participate in test planning, test case development, test automation, and test...

Learn more

Senior Data Engineer

Added 27/08/2026

Senior Data Engineer Location: Dublin, Ireland (Hybrid - 3 days in office) Employment Type: Full-TimeAbout UsWe're an innovative smart grid technology company building systems that connect and optimise energy assets as part of a Virtual Power Plant, helping accelerate the decarbonisation of the energy system. Our in-house software and hardware platform spans embedded controllers with rich sensor data collection deployed on customer sites, through to backend applications for control, automation, and data analytics - all the way to customer-facing visualisation and reporting tools.We're a leader in the evolving smart grid space, offering Load Shifting, Demand Response, and Frequency Response services....

Learn more

Senior Java Data Engineer

Added 29/07/2026

Senior Java Data Engineer (AWS | Databricks | Spring Boot) - ContractLocation: Philadelphia, PA (Hybrid) Duration: ContractBuild the Data Platform Behind Enterprise AnalyticsWe're looking for an experienced Java Data Engineer to join a growing Data Engineering team responsible for building the next generation of cloud-based data solutions. In this role, you'll help modernize enterprise data platforms by developing scalable ETL pipelines, enhancing legacy applications, and delivering reliable data assets that power business intelligence and analytics.This position is ideal for someone who enjoys working across software engineering and data engineering, building cloud-native solutions using AWS, Databricks, and Snowflake while leveraging Java,...

Learn more

Senior Data Engineer

Added 02/07/2026

Senior Data EngineerDublin, Ireland | Hybrid | 12-month ContractAbout the CompanyOur client is a large, global technology-driven organisation operating in a highly regulated, data-rich industry, delivering services at scale to millions of customers worldwide.About the RoleAs a Senior Data Engineer, you will develop and maintain data pipelines that extract, transform, and load (ETL) data from a wide variety of sources into centralised data platforms such as a data warehouse or data lake. You will ensure the smooth, reliable flow of data from source to destination systems while upholding rigorous data quality and integrity standards, working within a highly regulated environment.Primary...

Learn more

Senior Data Administrator

Added 14/09/2026

Senior Data Administrator | 3-Month Contract (Potential to Go Permanent)Are you an experienced Data Administrator with a passion for data, systems, and reporting? We're seeking a talented professional to join a growing education organisation, supporting data operations across multiple sites and helping drive data-led decision making.Key ResponsibilitiesManage and optimise MIS, reporting, and cloud-based data systems.Support statutory and external reporting requirements.Ensure GDPR compliance, data integrity, and governance standards.Develop dashboards, reports, and actionable insights for key stakeholders.Provide training and support to users across the organisation.Act as a senior escalation point for data-related queries and issues.Skills & Experience✅ Proven experience in educational data...

Learn more

Senior data architect

Added 07/09/2026

Snowflake Data ArchitectRole OverviewWe are seeking an experienced Snowflake Data Architect to design, develop, and govern scalable, secure, and high-performing cloud data platforms. The ideal candidate will have strong expertise in Snowflake, data architecture, cloud technologies, data modelling, and modern data engineering practices.The Snowflake Data Architect will work closely with data engineers, analysts, business stakeholders, and technology teams to define data architecture strategies and deliver robust data solutions that support analytics, reporting, data science, and business intelligence initiatives.Key ResponsibilitiesDesign and implement scalable, secure, and high-performance data architectures using Snowflake.Define enterprise data architecture, data models, data flows, integration patterns, and technology...

Learn more

Data Center Engineer

Added 22/09/2026

About the RoleWe are seeking a hands-on Data Center Engineer to support the commissioning, deployment, maintenance, and troubleshooting of critical infrastructure systems in a data center environment. This role focuses on BMS, BAS, EPMS, and other facility control systems that support cooling, power, and environmental operations.Key ResponsibilitiesCommission and deploy control system hardware and software.Perform testing, startup, and validation of controllers, sensors, and field devices.Troubleshoot controls, networking, communication, and monitoring systems.Investigate and resolve system alarms, faults, and performance issues.Maintain system documentation, configurations, and asset records.Support preventive maintenance and reliability initiatives.Follow established safety, operational, and change management procedures.Required Skills4+ years of experience...

Learn more

Data Analytics Engineer

Added 04/09/2026

AI-Enabled Data Analytics EngineerWe are currently seeking an experienced AI-Enabled Data Analytics Engineer to join a fast-growing team focused on delivering scalable analytics, automation, and AI-driven solutions that enhance business decision-making.This is an exciting opportunity for a hands-on engineer with strong expertise in Databricks, Python, SQL, and PySpark, combined with practical experience using modern AI-assisted development tools such as GitHub Copilot, ChatGPT, Claude Code, Cursor, and VS Code.Key ResponsibilitiesDesign, develop, and optimise scalable data pipelines and analytics solutions within Databricks.Build robust data transformation, automation, and reporting solutions using Python, SQL, and PySpark.Leverage AI-assisted development tools to accelerate coding, testing, debugging,...

Learn more

Data center engineer

Added 24/08/2026

Project OverviewSeeking an experienced ISP Engineer to support the design and development of Inside Plant (ISP) infrastructure for multiple network facilities and data center environments. The role focuses on creating and updating engineering drawings, developing design packages, and supporting infrastructure expansion projects involving fiber optic networks and data center equipment layouts.Key ResponsibilitiesCreate and update ISP engineering drawings using AutoCAD.Convert as-built documentation into engineering templates and design deliverables.Develop and maintain detailed network and data center infrastructure layouts.Produce and manage Statements of Work (SOWs) and associated design packages.Support architecture and infrastructure design activities for network facilities.Coordinate with engineering teams to ensure designs...

Learn more

Data center engineer

Added 24/08/2026

Project OverviewSeeking an experienced ISP Engineer to support the design and development of Inside Plant (ISP) infrastructure for multiple network facilities and data center environments. The role focuses on creating and updating engineering drawings, developing design packages, and supporting infrastructure expansion projects involving fiber optic networks and data center equipment layouts.Key ResponsibilitiesCreate and update ISP engineering drawings using AutoCAD.Convert as-built documentation into engineering templates and design deliverables.Develop and maintain detailed network and data center infrastructure layouts.Produce and manage Statements of Work (SOWs) and associated design packages.Support architecture and infrastructure design activities for network facilities.Coordinate with engineering teams to ensure designs...

Learn more

Junior Data Engineer

Added 21/08/2026

Junior Data EngineerLocation: Netherlands (Hybrid)Employment Type: PermanentOverviewWe are looking for an ambitious Junior Data Engineer to join a rapidly growing international professional services organisation that is investing heavily in data, technology, and innovation.This is an excellent opportunity to develop your Data Engineering career within a business that combines the agility and pace of a scale-up with the stability and resources of a larger organisation. You'll gain hands-on experience building data solutions, working with modern technologies, and supporting a business that is scaling across multiple European markets.Key ResponsibilitiesSupport the development and maintenance of the company's data platform and data pipelines.Work with...

Learn more

Junior Data Engineer

Added 20/08/2026

Junior Data EngineerLocation: Utrecht (Hybrid)Employment Type: PermanentOverviewWe are looking for an ambitious Junior Data Engineer to join a rapidly growing international professional services organisation that is investing heavily in data, technology, and innovation.This is an excellent opportunity to develop your Data Engineering career within a business that combines the agility and pace of a scale-up with the stability and resources of a larger organisation. You'll gain hands-on experience building data solutions, working with modern technologies, and supporting a business that is scaling across multiple European markets.Key ResponsibilitiesSupport the development and maintenance of the company's data platform and data pipelines.Work with...

Learn more

Data Engineer

Added 05/08/2026

We are looking for an experienced Data Engineer to join the Supply/Yield Data Engineering team and support a large-scale data modernization and analytics transformation programme through 2026.This role will focus on designing, developing, and maintaining data pipelines that bring data into Databricks, support Inventory and Yield analytics initiatives, and enable business-critical reporting within Tableau Cloud. The successful candidate will also contribute to the migration of reporting assets from Looker to Tableau while helping modernize existing legacy data engineering solutions.Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines to ingest and transform data into Databricks.Build and support scalable data pipelines using AWS, Databricks,...

Learn more

Data Center Engineer

Added 04/08/2026

Data Center EngineerLocation: Seattle Washington Employment Type: ContractJoin a World-Class Mission Critical Operations TeamWe are seeking an experienced Data Center Engineer to lead engineering operations within a large-scale, mission-critical data center environment. This role is designed for professionals who thrive in high-availability operations and have a proven track record managing critical infrastructure, driving reliability initiatives, and leading technical teams.If you have worked in Amazon Data Centers we would like to speak with you.Key ResponsibilitiesLead day-to-day engineering and facility operations for a mission-critical data center.Ensure maximum availability and reliability of electrical and mechanical infrastructure.Manage maintenance activities, change management, and operational readiness...

Learn more
At least 8 characters, 1 uppercase, 1 lowercase and 1 special character or number
Your file must be a doc, docx or pdf. No larger than 5MB.