GCP Cloud Data Engineer

Domain - Information Technology & Software Development

Job Title: GCP Cloud Data Engineer

Location: Bangalore / Pune / Trivandrum / Chennai (Hybrid)

Notice Period: Immediate to 15 days

Experience Required: 8-12 years (5+ years of relevant experience)

Job Overview:

We are seeking experienced GCP Cloud Data Engineers with a strong background in cloud migration, data pipelines, and data integrations. The role requires hands-on experience in GCP migration, BigQuery, and Python. The ideal candidate should have expertise in building and managing ETL pipelines, integrating data from multiple sources, and working on telecom/data analysis and migration projects. GCP Data Engineer certification is preferred, and experience working on Agile projects is a plus.

Key Responsibilities:

1. GCP Cloud Migration:

o Lead and execute GCP cloud migration projects.

o Migrate data from on-premises systems or other cloud environments to Google Cloud Platform.

o Ensure successful data migration, transformation, and loading into BigQuery and other GCP services.

2. BigQuery and Python Development:

o Develop and optimize BigQuery solutions for data warehousing and analytics.

o Utilize Python for scripting, automation, and data transformation tasks.

o Write optimized queries to handle large datasets and perform data analysis in BigQuery.

3. ETL Pipelines and Data Integration:

o Design, build, and maintain ETL pipelines to move data across different systems and platforms.

o Integrate data from various sources, including databases, flat files, and APIs into ODS/DW (Operational Data Stores / Data Warehouses).

o Ensure data quality, consistency, and reliability throughout the integration process.

4. Collaboration and Agile Projects:

o Work closely with cross-functional teams, including data architects, data scientists, and stakeholders, to understand data requirements.

o Participate in Agile/Scrum processes, contributing to sprint planning, retrospectives, and daily standups.

o Provide technical expertise and support for data migration and integration efforts within telecom/data analysis projects.

5. Data Engineering and Best Practices:

o Implement best practices for GCP data engineering, including data governance, security, and optimization strategies.

o Troubleshoot and resolve performance issues in data pipelines and cloud infrastructure.

o Monitor data pipelines to ensure they are functioning efficiently and can handle high volumes of data.

Mandatory Skills:

• GCP Migration: Extensive experience in GCP migration projects, handling large-scale data migrations from on-premise or other cloud environments.

• BigQuery and Python: Strong proficiency in BigQuery for data storage, querying, and analysis, and Python for data processing, scripting, and automation.

• Cloud Data Engineering: 5+ years of experience in cloud data engineering, designing, and maintaining data pipelines.

Desired Skills:

• SQL Knowledge: Strong SQL skills for querying databases, data validation, and optimization of complex queries.

• ETL Pipeline Development: Experience in building and managing ETL pipelines, data integrations, and creating data warehouses.

• GCP Certification: GCP Data Engineer certification is preferred.

• Agile Projects: Experience working on Agile projects, preferably within the telecom or data analysis domains.

Domain:

• Telecom / Data Analysis and Migration: Prior experience working on telecom-related projects, handling large datasets and data analysis in a migration context is a plus.

Work Mode:

• Hybrid: Work from Bangalore, Pune, Trivandrum, or Chennai, with a hybrid work arrangement.