Lead Data Engineer - GCP

Job Description

We are looking for a Senior GCP Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP) . The ideal candidate should have strong hands-on expertise in Python, SQL, data pipelines, and GCP data services .

Key Responsibilities

• Design and develop scalable and reliable data pipelines using GCP services.
• Develop data processing and transformation solutions using Python and SQL .
• Build and optimize ETL/ELT pipelines for large-volume datasets.
• Work with business and technical teams to understand data requirements and deliver robust solutions.
• Perform data modeling, data validation, and performance optimization.
• Monitor and troubleshoot data pipelines and resolve production issues.
• Implement data quality, security, and governance best practices.
• Participate in code reviews and contribute to technical design and architecture discussions.

Qualifications

• 6+ years of experience in Data Engineering.
• Strong hands-on experience with Google Cloud Platform (GCP) .
• Strong programming experience in Python .
• Strong expertise in SQL , including complex queries, joins, CTEs, window functions, and query optimization.
• Experience developing ETL/ELT data pipelines .
• Hands-on experience with one or more GCP services such as: • BigQuery
• Cloud Storage (GCS)
• Cloud Composer / Airflow
• Dataflow
• Pub/Sub
• Dataproc

• Experience with Apache Spark / PySpark is preferred.
• Good understanding of data warehousing, data modeling, and distributed data processing.
• Experience with Git and CI/CD practices.

Nice to Have

• Experience with Terraform or Infrastructure as Code.
• Exposure to GCP Dataform .
• Experience with real-time/streaming data pipelines.
• Knowledge of cloud security and IAM.
• Experience working in Agile environments.

Additional Information

All your information will be kept confidential according to EEO guidelines.