Principal data engineer

Job Description

We are seeking a Principal Data Engineer with 10-15 years of hands-on experience in designing, building, and optimizing large-scale data pipelines and enterprise data platforms, preferably within a fast-paced technology environment based in Pune. The ideal candidate will have deep expertise in Azure cloud services including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage, with the ability to architect end-to-end data solutions that support business-critical analytics workloads. Strong proficiency in SQL and ETL development is essential, including designing complex transformation logic, optimizing query performance, and managing data quality across structured and semi-structured datasets. Experience integrating data from diverse sources using REST APIs is required, including building robust ingestion frameworks that handle authentication, pagination, rate limiting, and error recovery at scale. Hands-on experience with Power BI for building enterprise-grade dashboards and semantic models, combined with familiarity leveraging Claude AI capabilities for intelligent data processing or conversational analytics use cases, is highly desirable. Proficiency in RDBMS technologies including My SQL, Oracle, MSSQL, and Postgre SQL is expected, with the ability to design normalized schemas, manage stored procedures, and tune database performance for high-volume transactional and analytical workloads. The role demands strong leadership capabilities to guide cross-functional engineering teams, conduct design reviews, establish data engineering best practices, and mentor junior and mid-level engineers across the data platform team. Candidates must demonstrate experience working in Agile delivery environments, contributing to sprint planning, technical roadmaps, and stakeholder discussions to align data infrastructure with evolving product and business intelligence needs.