Job Description:

· Design, develop, and implement scalable data pipelines and associated processes using Google Cloud Platform (GCP) services

· Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions

· Build and maintain data architecture to support the new data product

· Optimize and enhance data processing workflows for performance, reliability, and scalability

· Ensure data quality, integrity, and security throughout the data lifecycle

· Monitor and troubleshoot data pipelines and systems to ensure smooth operation

· Document technical specifications, processes, and workflows for future reference and knowledge sharing

Requirements:

· Realtime and batch data integration development experience using GCP services

· Experience extracting, transforming, and loading data from various types of sources

· Demonstrated ability to lead projects and teams, with experience as a technical lead or similar leadership role

· Realtime and batch data integration development experience using GCP services

· Experience extracting, transforming, and loading data from various types of sources

· Demonstrated ability to lead projects and teams, with experience as a technical lead or similar leadership role

· SQL

· Google BigQuery

· Google Cloud Data Pipeline Tools (such as Google Cloud DataStream, Dataflow etc.)

· Google Cloud Composer

· Google Cloud Run

· GitHub

· Python

· Terraform