Data Engineer

Talemexa Pvt Ltd is seeking a Data Engineer to design, develop, and maintain dependable data pipelines. The role supports dashboards, analytics, and data-driven models by ensuring data is accurate, accessible, timely, and ready for use.

Responsibilities:

• Design, build, test, and maintain scalable ETL and ELT data pipelines
• Extract, transform, and load data from multiple sources into centralized data platforms
• Develop and maintain data models within cloud-based data warehouses
• Work with platforms such as Snowflake, Google BigQuery, Amazon Redshift, or Apache Spark, depending on project requirements
• Use Python and SQL to process, transform, validate, and analyze large datasets
• Configure and manage workflow orchestration using Apache Airflow or similar tools
• Monitor data quality, pipeline freshness, completeness, and data lineage
• Identify and resolve data pipeline failures, inconsistencies, and performance bottlenecks
• Optimize data processing workflows to improve reliability, efficiency, and infrastructure cost
• Implement data validation, automated testing, and error-handling mechanisms
• Maintain clear technical documentation for data models, pipelines, dependencies, and operational procedures
• Collaborate with data analysts, data scientists, software engineers, and business stakeholders to understand data requirements
• Support the delivery of reliable datasets for reporting, analytics, dashboards, and machine learning applications

Requirements:

• The ideal candidate has at least four years of experience in data engineering, strong Python and SQL skills, and practical knowledge of ETL/ELT workflows, data orchestration, and cloud data platforms
• 4+ years of professional experience in data engineering or a related technical role
• Strong programming skills in Python and SQL
• Hands-on experience designing and maintaining ETL/ELT pipelines
• Experience with Apache Airflow or a similar workflow orchestration tool
• Familiarity with cloud data warehouses such as Snowflake, BigQuery, or Amazon Redshift
• Knowledge of Apache Spark or distributed data processing concepts
• Understanding of data modeling, data warehousing, and data transformation techniques
• Experience with data quality checks, pipeline monitoring, and automated testing
• Strong documentation, analytical thinking, and troubleshooting skills
• Ability to collaborate effectively with technical teams and manage competing priorities
• Data Engineering and Pipeline Development
• Python Programming
• SQL and Query Optimization
• ETL/ELT Processes
• Apache Airflow and Workflow Orchestration
• Snowflake, BigQuery, and Amazon Redshift
• Apache Spark and Distributed Data Processing
• Cloud Data Warehousing
• Data Modeling and Transformation
• Data Quality Monitoring and Validation
• Data Lineage and Documentation
• Pipeline Performance and Cost Optimization
• Automated Testing and Troubleshooting
• Cross-Functional Collaboration