Senior Data Engineer - Senior Manager

State Street — Bangalore, India

Prior experience in Data engineering, ETL, Data Ingestion and data warehousing and analytics with 8+ Years of experience. Design, develop, and support end‑to‑end data pipelines using cloud‑based platforms such as AWS, Redshift ,Databricks, and Snowflake. Build scalable data ingestion, transformation, and validation frameworks using Python, SQL, and Shell scripting. Develop and optimize data pipelines for performance, reliability, and data quality Strong background in data warehousing, ETL/data pipelines, and cloud‑based data warehouse solutions. Hands‑on experience delivering end‑to‑end data pipeline solutions encompassing architecture design, implementation, testing, deployment, monitoring, and operational support. Build and operate scalable batch and streaming pipelines using the Snowflake and/or Databricks tech stack, Spark , or Informatica ETL (where reused) to deliver analytics-ready datasets on AWS Cloud Platform. Design, implement, and optimize Iceberg -based tables, partitions, and metadata structures for consistent and performant analytical access Experience with MDM, Data Quality frameworks, and data management tools, including hands‑on implementation of automated data validation, quality rules, reconciliation checks, and lineage capture to ensure governed, reliable, and trusted analytical data across enterprise platforms. Work with Platform Engineering to standardize deployment via CI/CD, productionize jobs, and adopt platform guardrails and observability patterns Collaborate with architects and application teams to define data strategies and deliver logical/physical data models aligned to analytical workloads Optimize pipeline and query performance through appropriate database partitioning, archiving, and purging patterns Participate in on-call / major incident management, perform backfills where required, and support production stability for owned data products Ensure compliance with data security, governance, and SDLC standards Continuously identif

View on HireSetu