Sr Engineer Data Engineering

TransUnion — Hyderabad

TransUnion's Job Applicant Privacy Notice Team Overview We are seeking a highly experienced and motivated Lead Data Analyst with a strong background in SQL and Spark SQL, Unix shell scripting, supporting ETL setup, Big Data technologies, and AI to lead and mentor a team. You will be responsible for delivery of data. This role requires a deep understanding of data processing, data warehousing, and machine learning principles, along with hands-on experience in cloud environments like AWS and GCP usage. You will be a technical leader, driving best practices, providing mentorship, and ensuring the successful delivery of high-quality, scalable, and maintainable solutions.

This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week. Role Overview And Core Responsibilities · Architect and oversee SQL/Spark SQL, Unix commands and data operations-based data analysis solutions. · Lead ETL strategy and ensure robust data pipelines. · Utilize Linux commands for system operations, troubleshooting, and deployment tasks. · Work within cloud environments (AWS, GCP) to manage infrastructure, data workflows, and deployments. · Partner with business leaders to define KPIs and analytical frameworks. · Drive data governance and quality initiatives. · Ensure data accuracy and consistency across systems. · Lead and mentor a team of delivery. · Analyze Java logs to identify and try to resolve performance bottlenecks and application issues. Required Knowledge And Experiences · 9+ years of experience in data analysis with deep SQL/Spark SQL and unix and expertise. · Proven experience in ETL setup and data pipeline management. · Strong stakeholder management and leadership skills. · Experience in strategic analytics and decision support. Bonus Points: · Experience with specific industries (e.g., e-commerce, finance, healthcare). · Contributions to open-source p

View on HireSetu