Location: Hyderabad
Experience: 2–5 years
Notice Period: Immediate to 15 days
We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have strong experience in building data pipelines, working with modern data platforms, and implementing scalable cloud-based solutions. This role requires hands-on expertise in SQL, Python, Py Spark, and AWS, along with solid understanding of data modelling and transformation frameworks.
Key Responsibilities
Design, develop, and optimize scalable data pipelines and ETL workflows. Build and manage data models using DBT and integrate datasets for analytics and reporting. Work with Snowflake to write efficient SQL queries and manage data warehousing activities. Develop distributed data processing solutions using Py Spark on Databricks. Implement data ingestion frameworks using Python, APIs, and AWS services. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Ensure data quality, reliability, and performance across pipelines. Deploy and maintain data workflows using CI/CD and version control best practices.Mandatory Skills
· Minimum 2 years of hands-on experience in:
o SQL (Snowflake)
o DBT
o Py Spark (Databricks)
o Python with strong understanding of OOP concepts
o AWS services: S3, ECS, SQS, Lambda, EMR
Experience with file formats: CSV, JSON, Parquet Experience with API integrations using Python Strong communication skillsSecondary / Good-to-Have Skills
Experience with Sigma or Tableau for data visualization Linux CLI proficiency Python web scraping experience Exposure to Datadog for monitoring Experience with Git Hub for version control and CI/CD Knowledge of Terraform Computer Science degree from a reputed academic institutionThis listing is sourced from a third-party job board. Applying will redirect you to the original posting.
Amazon Flex