Senior QA Data Engineer

Reference: PN77_1740738587

Role- Sn QA Data Engineer

Type- Contract (Outside IR35)
Nature- Hybrid (2/3 days in London per week)

Key Responsibilities:

Pantheon requires an experienced and enthusiastic Senior QA Automation Engineer to design and implement new automation systems and features, as well as modify and maintain existing systems for adaption to business and/or technology changes.

To be successful in the role you will be expected to:

  • Plan, design & execute testing activities for new features being implemented as well as for the changes to existing systems
  • Be hands-on in the creation of test cases and test execution.
  • Be a strong advocate for test automation with extensive experience in delivering working solutions.
  • Create manual and automated test cases to verify functional and non-functional requirements of solutions in various stages of the development life cycle.
  • Find critical bugs and verify reported issues, identifying their underlying cause and seeing them through to resolution and liaising with other teams where appropriate.
  • Producing descriptive and concise bug reports that evidence the functionality of a solution.
  • Communicating status information and issues to a variety of stakeholders, adapting appropriately depending on the audience.

Knowledge & Experience Required:

  • Data Quality & Validation in Azure
    • Verify Data Pipelines in Azure Data Factory (ADF) and Databricks to ensure data accuracy.
    • Test ETL/ELT Processes: Validate transformations, data ingestion, and data movement.
    • Schema Validation: Ensure table structures and constraints match expectations in SQL Server.
    • Data Completeness & Consistency checks between source and destination databases.
    • Data Profiling: Detect anomalies, missing values, or duplicate records.
  • Automated Testing Framework using Python.
    • Develop automated data validation tests using PyTest, PySpark and Pandas
    • Implement Integration Tests for SQL queries and transformations.
    • Build reusable test scripts for data pipeline validation in Azure Data Factory & Databricks.
    • Test Data Lineage & Auditing using logging and monitoring tools.
  • SQL & Database Testing
    • Write complex SQL queries to validate transformations and business rules.
    • Compare source and target tables for data accuracy after transformations.
    • Verify indexes, constraints, and stored procedures in SQL Server.
    • Validate Performance & Query Optimization for large datasets.
  • CI/CD for Data Testing
    • Integrate Automated Tests in CI/CD pipelines using Azure DevOps or GitHub Actions.
    • Schedule Data Quality Checks in Databricks Workflows or ADF Pipelines.
    • Automate Deployment Testing for data models, ETL pipelines, and transformations.

  • Extensive experience in testing software, systems, and data solutions (for example Data Warehouses) with a focus on Test automation.
  • Ability to think creatively, problem-solve and innovate.
  • Extensive experience in testing BI reports, dashboards, datasets, and data models.
  • Experience in agile software development methodologies.
  • Solid understanding of the testing pyramid and experience in implementing it at various levels
  • Experience building an Automation Framework from scratch and creating and maintaining automated tests.
  • Experience in mentoring QAs on automation tools, and frameworks and performing code reviews.
  • Experience working closely with BA and Developer to derive the Acceptance criteria and participating in 3 amigos sessions.

Essential skills:

  • Cloud: Azure Data Factory, Azure Databricks, Azure SQL Server
  • Database/Storage: SQL Server, Azure Synapse, Delta Lake
  • Programming: Python (PySpark, Pandas), SQL, C#, REST APIs
  • Monitoring: Azure Monitor, Log Analytics, Databricks
  • CI/CD: Azure DevOps, GitHub Actions
  • Automation/Frameworks: PyTest, DataDiffPy, GreatExpectation, POSTMAN
  • Advanced SQL

Desired Experience:

The ideal candidate will have financial services experience in the private equity, infrastructure & real assets, or private debt space. However, this is not a stringent requirement.

Desired skills:

  • Experience working on and Testing Traditional ETL tools (SAP Business Objects Data Services, INFORMATICA, SSIS, etc.)
  • Experience testing Business Objects & Crystal Reports
  • Selenium
  • Use of BDD and/or TDD framework
  • Testing Power BI dashboards, reports, and datasets.

GCS is acting as an Employment Business in relation to this vacancy.

£550.00 - £590.00
Per day
GBP550 - GBP590 per day + (Outside IR35)

London

Contract

Added 28/02/2025
Reference: PN77_1740738587

Senior QA Data Engineer

London
Contract

Other similar jobs

Senior Manager - Data Governance & Analytics

Added 18/06/2025

Overview:Join a global distribution and supply chain leader undergoing a large-scale digital transformation, focused on building a data-driven enterprise. You'll drive data innovation, improve governance, and help deliver enterprise-wide analytics capabilities to empower self-service and informed decision-making. Role: Senior Manager - Data Governance & AnalyticsType: Permanent roleLocation: Dublin, Ireland (Hybrid) Key Responsibilities:Define and implement data strategy and governance frameworks.Support delivery of self-service analytics and data platforms.Drive adoption of cloud, AI/ML, and modern data tools.Align data initiatives with business goals and engage senior stakeholders. Requirements:5-8 years' experience in data governance or consulting in large organizations.Strong knowledge of data strategy, governance, and...

Learn more

Senior Data Protection Advisor

Added 10/06/2025

My client is hiring a Senior Data Protection Advisor to deliver expert data protection and privacy compliance services across a wide range of client organisations. This role involves leading advisory projects, ensuring GDPR and broader regulatory compliance, and supporting internal teams with practical, risk-based guidance. Reporting to a Service Manager or Practice Lead, the successful candidate will play a key role in managing data protection strategy, risk assessments, and client relationships.Key Responsibilities * Independently deliver client advisory work, including privacy notices, briefing papers, consent models, and policy reviews. * Conduct data protection impact assessments (DPIAs), gap and risk analyses, and...

Learn more

DevOps Data Engineer

Added 24/06/2025

Overview: We're seeking a skilled DevOps Data Engineer for a fully remote contract role. You'll support the development of an automated data platform enabling real-time ingestion, validation, and reporting. The ideal candidate will have strong experience with Azure-based data engineering tools, Python scripting, and scalable pipeline design. Key Responsibilities:Develop and maintain ETL/ELT pipelines for ingesting benchmark data (e.g., CSVs from Qualtrics).Implement automated data quality checks across pipeline stages.Build event-driven workflows using Azure Data Factory and Databricks.Support automated reporting integrations (Power BI and PowerPoint).Optimize storage and processing within Azure Data Lake and SQL-based systems.Collaborate on data modelling (star/snowflake schemas) with architects...

Learn more

Data Engineer

Added 24/06/2025

I am searching for a Data Engineer for a client of mine for a freelance role. Candidates must have experience in DBT and Snowflake. Long term freelance role based in the Netherlands. For further information, please reach out to me on [email protected] or just apply direct.GCS is acting as an Employment Business in relation to this vacancy.

Learn more

Data Engineer

Added 06/06/2025

Data Engineer - Contract RoleWe're seeking an experienced Data Engineer to deliver high-quality, scalable data solutions that support business goals. This contract role offers the chance to work on impactful projects in a fast-paced, data-driven environment.Key Responsibilities & Requirements:Data Solution Delivery: Design, build, and maintain secure, efficient data pipelines and analytics tools across the full development lifecycle.Technical Skills: 5+ years' experience with SQL, strong Python or R skills, and hands-on knowledge of ETL tools (e.g. Informatica, SSIS) and BI platforms (e.g. Tableau, Power BI). Experience with Snowflake, AWS, or Dataiku is a plus.Collaboration & Communication: Work closely with technical and...

Learn more

Data Engineer - Detachering

Added 27/05/2025

I am searching for a Data Engineer for a client for a payroll position. Candidates MUST be Netherlands based. They are looking for both Senior and Junior profiles.If the candidate is Senior;- Software engineering experience with Java or Python.- Dashboard development experience with Power BI or Splunk.- Devops experience (Azure, Kafka, Kubernetes, Databricks).- Docker experience.- Pyspark or Spark SQL experience and Testing experience.If the candidate is Junior;- Preference for candidates out of college.- Degree in software engineering.- Knowledge of dashboarding tools, Power BI or Splunk- Ability to explain their personal projects/internshipsFor further information, please reach out to me on LinkedIn...

Learn more

Snr Data Engineer

Added 14/05/2025

Our client, a major energy company in the UAE, is seeking an experienced Senior Data Engineer to join their team for a 12-month rolling contract.This position offers a fantastic opportunity for candidates looking to work in a dynamic, fast-paced environment while benefiting from tax-free income, comprehensive relocation support, visas, and healthcare. If you have a passion for building scalable data infrastructure and have client-facing experience, this could be the perfect opportunity for you.Key Responsibilities:Data Infrastructure & Architecture: Design, develop, and maintain scalable data pipelines, databases, and data warehouses.Client-Facing: Collaborate directly with clients to understand their business needs and provide data-driven...

Learn more

Senior DevSecOps Engineer - Fully Remote - Financial Services

Added 24/06/2025

The Role:12-month contract with potential for extensionFully remote working modelUp to 450 EurosImmediate StartI'm currently working with a Banking Client aiming to upskill their team with the introduction of an experienced Senior Engineer on a contract basis.As a Senior DevSecOps Engineer, you will be responsible for driving the Design, Implementation, and operational readiness of CI/CD Pipelines during the application migration, ensuring they are secure.Key ResponsibilitiesIndependently manage the full migration lifecycle, including build, test, and deployment automation.Validate systems for security, stability, and readiness for production deployment and sign-off.Assess current CI/CD pipelines and propose enhancements that align with industry standards, regulatory requirements,...

Learn more

Senior Software Engineer

Added 17/06/2025

Lead Software Engineer Permanent Role - Salary to circa £90,000Hybrid Working with 2 days a week on Client Site in Cheshire Currently looking to recruit a highly experienced Software Engineer for an established FS Client in Cheshire - In this role you will design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues. You will also collaborate with cross-functional teams to deliver solutions - Lead the development of reliable/scalable applications - Mentor Junior team members. Successful candidates will need experience in the following:Core language: Java/Spring Boot, TypeScript/React/Angular, Golang, or...

Learn more

Senior DevOps Engineer - JFrog Artifactory SME - fully remote

Added 06/06/2025

Senior DevOps Engineer - JFrog Artifactory SME - 6 month contract - Fully remote6 month contract - Fully remote About the RoleWe're looking for a Senior DevOps Engineer with deep expertise in JFrog Artifactory to join our growing DevOps team. This role is ideal for someone who thrives in high-availability environments and has hands-on experience architecting and managing active-active HA clusters, federated repositories, and edge nodes in a single-domain setup.You'll be our go-to SME for everything JFrog, working closely with engineering, security, and release teams to ensure efficient artifact management, developer enablement, and policy enforcement across our CI/CD pipelines. Key...

Learn more

Senior Cyber Security Engineer

Added 06/06/2025

As a Senior Cyber Security Engineer, you will play a key role in supporting the design, implementation, and maintenance of Cyber Security Engineering solutions, controls, and processes across IT and OT environments. You will be responsible for supporting cyber security platform administration, enhancing our security posture, and ensuring that new capabilities are securely deployed in alignment with business objectives. This includes collaborating with stakeholders, supporting compliance efforts, and helping to drive proactive cyber risk reduction.This role requires a deep understanding of security engineering concepts, infrastructure technologies, and best practices. The ideal candidate will have strong communication skills, a solid grasp...

Learn more

Senior Backend Engineer(PHP)

Added 17/04/2025

Senior Backend Developer (PHP) - Dublin (Hybrid/Remote) Full-time | PermanentWe are looking for a Senior Backend Developer to join our client's team. What You'll Do:Build and scale backend systems for data processing.Own features end-to-end, from planning to deployment.Mentor team members and support code reviews.Solve complex problems at scale using best engineering practices.What We're Looking For:6+ years of PHP development experience.Strong knowledge of OOP, SOLID, and design patterns.Experience with distributed systems, queues, and performance optimization.Bonus: experience with DevOps, distributed messaging and streaming toolsGCS is acting as an Employment Agency in relation to this vacancy.

Learn more

Senior iOS Engineer

Added 26/03/2025

Role: Senior iOS EngineerType: Permanent roleWork Model: Remote-first, with quarterly onsite visits to Dublin Role Description:We are looking for a Senior iOS Engineer to join our team and help build exceptional mobile experiences. You will work with Swift, SwiftUI, and modern iOS frameworks to develop and maintain key features across our apps. This role goes beyond coding-you'll contribute to product development, collaborate with cross-functional teams, and help shape our engineering practices. Key Responsibilities:Develop and maintain features in our iOS applications.Ensure a clean, scalable, and well-tested codebase.Work closely with product, design, and Android teams in an agile environment.Stay up to date...

Learn more

Data Center Technician

Added 23/06/2025

📢 We're Hiring: Data Centre Technician 📍 Location: Ludwigsfelde, GermanyAre you passionate about technology and ready to work at the forefront of cloud infrastructure? We're looking for a skilled and motivated Data Centre Technician to support and expand one of the largest cloud computing environments in the world.This role offers a rare opportunity to work in a state-of-the-art, high-density data centre where your expertise will directly impact the growth and performance of next-generation cloud technologies.What You'll DoAs a Data Centre Technician, you will play a crucial role in maintaining and improving infrastructure performance. Your responsibilities will include:Installing, troubleshooting, and maintaining...

Learn more

Business Data Analyst

Added 10/06/2025

Contract Details:Role Type: Business Data AnalystContract Length: 3-6 monthsLocation: Hybrid; ideally someone based in the Leinster region, with on-site workshops once per monthIdeal Candidate Profile:5-10 years' experience in Data Analysis, Business. Testing, or related rolesStrong background in Data Warehousing or migration projectsFamiliarity with BI environments and reporting toolsCapable of working across both technical and business domains (50/50 split)Not a pure coder-must excel in analysis and communicationLocal availability for monthly in-person workshops is preferredHands on Tableau experience.Experience with SQL.GCS is acting as an Employment Business in relation to this vacancy.

Learn more
Required for two factor authentication
At least 8 characters, 1 uppercase, 1 lowercase and 1 special character or number
Your file must be a doc, docx or pdf. No larger than 5MB