Hello, Job opening at Ai Palette-Bengaluru, please find job details below :- Job Title – Senior Data Engineer Experience Level: 5-8 years Location: Bangalore Key Responsibilities Build and maintain Python-based ETL pipelines and data automation scripts using pandas and numpy Write and optimize SQL queries in Postgre SQL, support schema changes, and maintain data integrity Develop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestration Build data validation and quality check scripts to ensure pipeline reliability Support Elasticsearch index maintenance, data ingestion, and basic mapping updates Integrate LLM-generated outputs into structured data pipelines and storage systems Write unit tests for data pipelines and instrument code for observability Guide junior engineers on data pipeline initiatives Collaborate with the product team to design and improve the data layer Key Qualifications 4-8 years of experience in data engineering, backend engineering, or a related technical role Python (strong): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformation SQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basics Postgre SQL experience: basic schema understanding, data types, JSONB familiarity is a plus Experience building automation scripts for data processing, validation, or reporting Familiarity with at least one orchestration tool (Airflow, Prefect, or similar) Git, Docker, and standard development workflows Writes test cases as part of development Thanks & Regards, Salim (Human Resources)
This listing is sourced from a third-party job board. Applying will redirect you to the original posting.