Data Engineer+ GCP

Synechron — Hyderabad -Gachibowli (Orion)

Overall Responsibilities Design, develop, and maintain scalable data pipelines and workflows using GCP services Build and optimize data models, schemas, and warehouses (BigQuery, Cloud SQL, etc.) aligned with business needs Collaborate with data analysts, data scientists, and business stakeholders to gather requirements and deliver effective solutions Ensure data quality, security, and compliance across all data environments Automate data workflows, monitor system health, and troubleshoot issues proactively Optimize infrastructure for performance and cost-efficiency within GCP Document architecture, processes, and best practices for data engineering solutions Stay current with GCP advancements and incorporate new features and tools for continuous improvement Software Requirements Proficiency in SQL and programming languages such as Python, Java, or Scala for data processing Hands-on experience with GCP data services including BigQuery, Cloud Dataflow, Cloud Data Fusion, Cloud Storage, and Dataproc Knowledge of ETL/ELT processes, data modeling, and data warehousing concepts Experience designing and implementing scalable and secure data pipelines on GCP Familiarity with containerization (Docker) and orchestration (GKE, Kubernetes) Understanding of data security, encryption, and compliance policies in cloud environments Experience with Apache Spark, Kafka, or Pub/Sub for real-time data streaming Knowledge of machine learning workflows on GCP (Vertex AI, AI Platform) Exposure to Cloud Identity & Access Management (IAM) and cybersecurity best practices Category-wise Technical Skills Data Processing & Frameworks: GCP data services: BigQuery, Dataflow, Dataproc, Data Fusion, Cloud Storage Programming languages: Python, Java, Scala Real-time streaming: Pub/Sub, Kafka (preferred) Batch processing frameworks: Apache Spark, Dataflow Cloud & Infrastructure: GCP Identity & Access Management (IAM), VPC, Cloud Networking Deployment automation: Terraform, Deployment Manager Contain

View on HireSetu