Key skills
PythonAIMachine LearningETLData EngineeringAnalyticsKafkaHadoopAWSJiraAgileSDLCLeadershipCommunication
About this role
Qode.world is a company specializing in data engineering solutions, and they are seeking a Senior Data Engineer with expertise in Informatica and PySpark. The role involves designing and developing ETL processes, managing large-scale data processing, and collaborating with clients to deliver data solutions.
Responsibilities:
- Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization
- Advanced skills in PySpark for large-scale data processing, transformation, and analytics
- Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce)
- Proficiency in Python and Kafka for streaming and batch data pipelines
- Strong understanding of database concepts, data design, data modeling, and ETL workflows
- Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading
- Hands-on experience with Agile methodology and Jira for project delivery
- Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC
Requirements:
- 8–10 years in Data Engineering and Data Analysis
- Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization
- Advanced skills in PySpark for large-scale data processing, transformation, and analytics
- Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce)
- Proficiency in Python and Kafka for streaming and batch data pipelines
- Strong understanding of database concepts, data design, data modeling, and ETL workflows
- Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading
- Hands-on experience with Agile methodology and Jira for project delivery
- Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC
- Master's or Bachelor's degree in Computer Science or related field
- Strong problem-solving skills and ability to work in cross-functional teams
- Exposure to AWS data components and analytics
- Familiarity with machine learning models and AI concepts
- Experience with data modeling tools such as Erwin