Delivery Lead – Data Engineering & Databricks (Architecture Focus) - Assistant Vice President
State Street — Hyderabad, India
Role Summary & Role Description: The Delivery Lead will drive end-to-end delivery of data engineering platforms with a strong focus on Databricks and modern cloud-based architectures. This role combines delivery leadership with deep technical ownership of solution architecture, ensuring scalable, secure, and high-performing data solutions aligned to business outcomes. The individual will lead cross-functional global teams and act as a bridge between business stakeholders, architects, and engineering teams. Key Responsibilities: Own and drive end-to-end delivery of data engineering and analytics initiatives with strong governance and execution discipline. Define and implement scalable data architecture using Databricks, cloud platforms, and big data technologies. Lead solution design discussions and translate business requirements into robust technical architecture. Establish delivery frameworks including Agile execution, release planning, and risk management. Provide leadership to globally distributed teams and ensure alignment across engineering, QA, and business teams. Drive stakeholder communication with clear reporting on delivery progress, risks, and mitigation plans. Promote engineering excellence, code quality, and performance optimization practices across teams. Data Engineering & Databricks Expertise (Primary Skill): Strong hands-on experience with Databricks for building and managing data pipelines and workflows. Expertise in Spark (Python/Scala) and distributed data processing frameworks. Experience designing and implementing ETL/ELT pipelines on cloud platforms (AWS/Azure). Deep understanding of data lakehouse architecture, Delta Lake, and modern data platforms. Ability to optimize data processing performance, scalability, and cost-efficiency. Experience in data governance, lineage, metadata management, and regulatory compliance requirements. Architecture & Design Skills: Proven experience in designing enterprise-scale data architecture and solutions. St
View on HireSetu