Data Engineer

Reference: 3567866_1785423901

Overview

We are looking for an experienced Data Engineer to join the Supply/Yield Data Engineering team and support a large-scale data modernization and analytics transformation programme through 2026.

This role will focus on designing, developing, and maintaining data pipelines that bring data into Databricks, support Inventory and Yield analytics initiatives, and enable business-critical reporting within Tableau Cloud. The successful candidate will also contribute to the migration of reporting assets from Looker to Tableau while helping modernize existing legacy data engineering solutions.

Key Responsibilities

  • Design, develop, and maintain ETL/ELT pipelines to ingest and transform data into Databricks.
  • Build and support scalable data pipelines using AWS, Databricks, and Snowflake.
  • Work closely with business and technical stakeholders to understand requirements and translate them into robust data solutions.
  • Develop core data assets and datasets that support analytics and reporting consumed through Tableau Cloud.
  • Support the Inventory ART programme by delivering Data Engineering solutions and increasing team capacity during migration activities.
  • Enhance and optimize existing legacy data engineering jobs and processes.
  • Contribute to the migration of reporting solutions from Looker to Tableau.
  • Create and maintain technical documentation, specifications, and implementation guides.
  • Perform testing, validation, and quality assurance activities to ensure data accuracy and reliability.
  • Provide post-delivery support, incident resolution, and troubleshooting for production workloads.
  • Implement Infrastructure as Code (IaC) solutions using Terraform.
  • Build and manage CI/CD pipelines using Concourse or GitHub Actions to enable reliable and automated deployments.
  • Help identify and mitigate risks, including reducing Single Points of Failure (SPOF) through documentation, automation, and knowledge sharing.
  • Collaborate with fellow engineers to establish and promote engineering best practices.

Required Skills & Experience

  • Strong experience in Data Engineering and ETL/ELT development.
  • Hands-on experience with Databricks.
  • Strong SQL skills with experience working on large datasets.
  • Experience building data pipelines within AWS environments.
  • Experience with Snowflake data warehousing.
  • Experience with Spark/PySpark.
  • Hands-on experience with Terraform and Infrastructure as Code (IaC).
  • Knowledge of CI/CD practices and tools such as GitHub Actions, Concourse, Jenkins, or similar.
  • Experience supporting and troubleshooting production data pipelines.
  • Strong understanding of testing, data quality, and operational support processes.
  • Excellent problem-solving and collaboration skills.

Nice to Have

  • Experience with Tableau or Tableau Cloud.
  • Experience supporting Looker to Tableau migrations.
  • Experience working within Supply Chain, Inventory, Yield, or Manufacturing domains.
  • Data modelling and analytics engineering experience.
  • Experience modernizing legacy data platforms and applications.

Technology Stack

  • Databricks
  • AWS
  • Snowflake
  • SQL
  • Spark / PySpark
  • Terraform
  • GitHub Actions / Concourse
  • Tableau Cloud
  • Looker (Migration Support)

Project Highlights

  • Work on a strategic data modernization programme running through 2026.
  • Build the core data pipelines powering Inventory, Supply, and Yield analytics.
  • Support a major Looker-to-Tableau reporting migration.
  • Develop cloud-native solutions using modern data engineering technologies.
  • Play a key role in improving automation, reliability, scalability, and operational excellence across the data platform.

GCS is acting as an Employment Business in relation to this vacancy.

COMPETITIVE SALARY

Pittsburgh

Contract

Added 30/07/2026
Reference: 3567866_1785423901

Data Engineer

Pittsburgh
Contract

Other similar jobs

Data Engineers & Data Analysts

Added 01/07/2026

Data Engineers & Data AnalystsNotre client recherche actuellement des Data Engineers et des Data Analysts pour participer à un projet passionnant orienté data. Il s'agit d'une excellente opportunité de contribuer à la mise en place et à l'exploitation de plateformes de données modernes afin de soutenir les analyses métier et la prise de décision. Localisation : BelgiqueMode de travail : Hybride Postes disponibles Data EngineersConstruire et maintenir des pipelines de données et des architectures évolutivesConcevoir des data lakes, data warehouses et solutions basées sur le cloudGarantir la qualité, la performance et la fiabilité des données Data AnalystsAnalyser et interpréter les...

Learn more

Data Engineers & Data Analysts

Added 01/07/2026

Data Engineers & Data AnalystsOnze klant is momenteel op zoek naar zowel Data Engineers als Data Analysts voor een boeiend data‑gedreven project. Dit is een uitstekende kans om bij te dragen aan het bouwen en benutten van moderne dataplatformen ter ondersteuning van businessinzichten en besluitvorming.Locatie: BelgiëWerkmodel: Hybrid Beschikbare rollenData EngineersBouwen en onderhouden van schaalbare datapijplijnen en data-architecturenOntwerpen van data lakes, datawarehouses en cloudgebaseerde oplossingenWaarborgen van datakwaliteit, prestaties en betrouwbaarheid Data AnalystsAnalyseren en interpreteren van data om bruikbare inzichten te genererenOntwikkelen van dashboards en rapportagesSamenwerken met stakeholders om data-gedreven beslissingen te ondersteunen Belangrijkste vereistenData Engineers: Python, ETL-processen en ervaring met cloudtechnologieënData...

Learn more

Senior AWS Big Data Architect (Cloud Data Platforms & Streaming Analytics)

Added 12/05/2026

Senior AWS Big Data Architect (Cloud Data Platforms & Streaming Analytics)Location: Chicago Work Arrangement: Hybrid Employment Type: ContractOverviewWe are seeking a highly specialized AWS Big Data Architect to lead the design and implementation of enterprise-scale cloud data platforms and real-time analytics solutions. This role requires deep expertise across AWS data services, distributed processing frameworks, streaming technologies, and large-scale data architecture.The ideal candidate will have extensive experience building modern lakehouse architectures, optimizing high-volume ETL pipelines, and enabling scalable analytics and machine learning workloads within cloud-native environments.Key ResponsibilitiesArchitect and implement scalable big data solutions on AWSDesign modern data lake and lakehouse architecturesBuild...

Learn more

Senior Software Engineer/Data Platform Engineer (Databricks, Graph, APIs)

Added 30/04/2026

Senior Software Engineer / Data Platform Engineer (Databricks, Graph, APIs)Location: Philadelphia, PA The team sits within the network technology organisation and is responsible for building advanced data platforms that support digital twin capabilities across the access network. The group combines network design data, telemetry, mapping technologies, and graph intelligence to improve troubleshooting, planning, operational efficiency, and market competitiveness.The team works on highly scalable engineering products including large data pipelines, graph databases, APIs, and mapping platforms. Their work enables smarter network decisions, faster fault resolution, and better use of operational resources.This is a technically strong team focused on solving complex real-world...

Learn more

Data Analyst/Engineer

Added 30/07/2026

Location: Cork, Ireland or Fully Remote Employment Type: Contract - 12 month Summary:We are looking for a data engineer who also has a strong interest in data analytics. A solid background in Python is essential, as well as experience performing data analytics that will shape the future of our products. You will play a key role in developing and monitoring AI features, improving data pipelines, and ensuring our supplier sourcing tool delivers high-quality, reliable results.Key ResponsibilitiesCollaborate with the business team to design and enhance AI features that provide value for our clients.Build, maintain, and optimize AI tools and data pipelines...

Learn more

Data Engineer

Added 30/07/2026

OverviewWe are looking for an experienced Data Engineer to join the Supply/Yield Data Engineering team and support a large-scale data modernization and analytics transformation programme through 2026.This role will focus on designing, developing, and maintaining data pipelines that bring data into Databricks, support Inventory and Yield analytics initiatives, and enable business-critical reporting within Tableau Cloud. The successful candidate will also contribute to the migration of reporting assets from Looker to Tableau while helping modernize existing legacy data engineering solutions.Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines to ingest and transform data into Databricks.Build and support scalable data pipelines using AWS, Databricks,...

Learn more

Data Engineer

Added 30/07/2026

Job DescriptionWe are looking for an experienced Data Engineer to join the Supply/Yield Data Engineering team and support a large-scale data modernization and analytics transformation programme through 2026.This role will focus on designing, developing, and maintaining data pipelines that bring data into Databricks, support Inventory and Yield analytics initiatives, and enable business-critical reporting within Tableau Cloud. The successful candidate will also contribute to the migration of reporting assets from Looker to Tableau while helping modernize existing legacy data engineering solutions.Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines to ingest and transform data into Databricks.Build and support scalable data pipelines using AWS,...

Learn more

Data Engineer

Added 30/07/2026

Job DescriptionWe are looking for an experienced Data Engineer to join the Supply/Yield Data Engineering team and support a large-scale data modernization and analytics transformation programme through 2026.This role will focus on designing, developing, and maintaining data pipelines that bring data into Databricks, support Inventory and Yield analytics initiatives, and enable business-critical reporting within Tableau Cloud. The successful candidate will also contribute to the migration of reporting assets from Looker to Tableau while helping modernize existing legacy data engineering solutions.Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines to ingest and transform data into Databricks.Build and support scalable data pipelines using AWS,...

Learn more

Senior Java Data Engineer

Added 29/07/2026

Senior Java Data Engineer (AWS | Databricks | Spring Boot) - ContractLocation: Philadelphia, PA (Hybrid) Duration: ContractBuild the Data Platform Behind Enterprise AnalyticsWe're looking for an experienced Java Data Engineer to join a growing Data Engineering team responsible for building the next generation of cloud-based data solutions. In this role, you'll help modernize enterprise data platforms by developing scalable ETL pipelines, enhancing legacy applications, and delivering reliable data assets that power business intelligence and analytics.This position is ideal for someone who enjoys working across software engineering and data engineering, building cloud-native solutions using AWS, Databricks, and Snowflake while leveraging Java,...

Learn more

Machine Learning & Data Engineer

Added 28/07/2026

Machine Learning & Data EngineerRemote (USA)About the RoleWe are seeking a talented and motivated Machine Learning Engineer I to join our growing team. This is an exciting opportunity for an early-career professional who is passionate about building machine learning solutions that create meaningful user experiences at scale.The ideal candidate enjoys solving complex problems, writing production-quality code, and collaborating with cross-functional teams to develop and deploy intelligent systems. You will work closely with data scientists, software engineers, and product teams to build and optimize machine learning models that drive business impact.Key ResponsibilitiesDevelop, train, and deploy machine learning models for personalization, recommendations,...

Learn more

Data Engineer

Added 24/07/2026

Contract Data EngineerCork, Ireland | Hybrid (2 Days On-Site) | €450-€550 Per DayOverviewA leading multinational organisation is seeking an experienced Contract Data Engineer to join a major cloud data platform transformation programme. Working within a growing platform engineering team, you will help design and build a modern lakehouse architecture that powers real-time analytics, machine learning, and AI-driven products across the business.This is a hands-on engineering role where you'll be contributing from day one, working alongside analytics engineers, data architects, and ML teams to deliver scalable, production-grade data solutions.Contract DetailsLocation: Cork City Centre (Hybrid - 2 days on-site)Contract Length: 6 months...

Learn more

Data Engineer

Added 23/07/2026

Data EngineerNotre client recherche un Data Engineer pour concevoir, maintenir et optimiser des pipelines de données et des architectures évolutives. Le poste se concentre sur la fourniture de solutions de données fiables afin de soutenir l'analyse et la prise de décision métier.Localisation: BelgiqueMode de travail: Hybride Responsabilités principalesDévelopper et maintenir des pipelines de données ETL/ELTConcevoir et gérer des data lakes, data warehouses et solutions lakehouseGarantir la qualité, la sécurité et la performance des donnéesCollaborer avec les équipes analytics et businessPrendre en charge le traitement de données en temps réel et en batchMettre en œuvre des pratiques de monitoring, automatisation et...

Learn more

Junior Data Engineer

Added 21/07/2026

Junior Data EngineerDe functieVoor een groeiende organisatie zijn wij op zoek naar een Junior Data Engineer die wil meebouwen aan moderne data-oplossingen en de verdere ontwikkeling van een datagedreven omgeving.In deze rol werk je samen met ervaren collega's aan het verzamelen, verwerken en beschikbaar maken van data voor diverse business teams. Je krijgt de kans om je technische vaardigheden verder te ontwikkelen en ervaring op te doen met data-integratie, rapportering en data-platformen.Dit is een ideale opportuniteit voor iemand die aan het begin van zijn of haar carrière staat en een sterke interesse heeft in data en technologie. VerantwoordelijkhedenOndersteunen bij het...

Learn more

Data Engineer

Added 17/07/2026

Data EngineerNotre client recherche un Data Engineer pour concevoir, maintenir et optimiser des pipelines de données et des architectures évolutives. Le poste se concentre sur la fourniture de solutions de données fiables afin de soutenir l'analyse et la prise de décision métier.Localisation: BelgiqueMode de travail: Hybride Responsabilités principalesDévelopper et maintenir des pipelines de données ETL/ELTConcevoir et gérer des data lakes, data warehouses et solutions lakehouseGarantir la qualité, la sécurité et la performance des donnéesCollaborer avec les équipes analytics et businessPrendre en charge le traitement de données en temps réel et en batchMettre en œuvre des pratiques de monitoring, automatisation et...

Learn more

Data Engineer

Added 13/07/2026

Key ResponsibilitiesDesign, build, and maintain scalable ETL/ELT data pipelines.Develop and optimise data integration processes from multiple internal and external data sources.Build and maintain cloud-based data platforms and data warehouses.Ensure data quality, integrity, governance, and security across the data estate.Work closely with Data Scientists and Analytics teams to provide high-quality datasets for reporting and machine learning initiatives.Monitor, troubleshoot, and optimise data pipeline performance.Contribute to the design and implementation of modern data architecture and best practices.Support ongoing data transformation and digital innovation projects.Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.About YouExperience working as a Data Engineer...

Learn more
At least 8 characters, 1 uppercase, 1 lowercase and 1 special character or number
Your file must be a doc, docx or pdf. No larger than 5MB.