Exp: 4.5 yrs Azure DE Roles & Responsibilities Design, build, and maintain scalable data pipelines and modern data platforms on Hadoop or cloud environments. Develop and optimize end-to-end ETL/ELT workflows for structured and unstructured data using modern data engineering frameworks. Architect robust data flows that improve scalability, reliability, and operational efficiency. Drive DataOps best practices by automating data provisioning, testing, monitoring, and deployment processes. Establish data governance standards, CI/CD pipelines, automated testing, and monitoring for production-grade data solutions. Collaborate with Enterprise Architecture and cross-functional teams to evaluate and implement the right data technologies and platform strategies. Build and maintain dimensional data models to support analytics and business intelligence initiatives. Develop highly optimized SQL queries to process and analyze large-scale datasets. Work with Python/PySpark and distributed computing technologies to process high-volume data efficiently. Lead data engineering work streams with a product mindset, ensuring high-quality and scalable data solutions. Continuously improve platform performance, deployment frequency, and data reliability through engineering best practices.
This listing is sourced from a third-party job board. Applying will redirect you to the original posting.