GCP Data Engineer

Position Overview

We seek an experienced GCP Data Engineer to join our team in Bangalore, focusing on crafting and managing robust data pipelines leveraging Google Cloud Platform technologies. The ideal candidate will have a strong background in data engineering with expertise in batch and real-time data workflows.

Responsibilities

• Architect and implement scalable data pipelines using GCP infrastructure.
• Design and develop both batch and streaming data processing jobs utilizing Dataflow.
• Handle large-scale datasets efficiently through Dataproc, including Spark and Hadoop frameworks.
• Manage data storage and analytical operations within BigQuery environments.
• Integrate data from diverse sources including Cloud Storage, Pub/Sub messaging, external APIs, and various databases.
• Tune and optimize SQL queries to enhance pipeline throughput and efficiency.
• Maintain active monitoring, troubleshooting, and ongoing maintenance of data pipelines to ensure reliability.
• Work in close collaboration with data analysts, data scientists, and application development teams to support data-driven solutions.

Required Skills and Qualifications

• Proficiency with Google Cloud Platform services, specifically Dataflow, BigQuery, and Dataproc.
• Strong experience in designing data pipelines and handling large datasets.
• Ability to optimize SQL queries and improve data processing performance.

Additional Information

Applicants should hold a B.Tech or B.E. degree in any engineering discipline. The role is based in Bangalore. Candidates should have 6 to 12 years of relevant experience.