Key skills
PythonSQLETLELTSnowflakeAWSECSEC2LambdaS3GlueAPI GatewayGitVersion ControlCI/CDStakeholder ManagementCommunication
About this role
EXL is a company focused on data management, and they are seeking a Data Engineer to design and develop scalable data pipelines and applications. The role involves building ETL frameworks and ensuring code quality through reviews and best practices.
Responsibilities:
- Design, develop, and maintain scalable data pipelines, applications, and utilities using Python and PySpark
- Build robust ETL/ELT frameworks and data processing solutions for large-scale datasets
- Develop reusable components, libraries, and automation solutions following coding standards and best practices
- Write clean, maintainable, and efficient code with proper error handling and logging
- Participate in code reviews and ensure adherence to development standards
Requirements:
- Experience (In Years): 3-6
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field
- Strong hands-on development experience in Python
- Experience with PySpark and large-scale data processing
- Strong understanding of software engineering principles, coding standards, design patterns, and best practices
- Experience with AWS Cloud services such as Glue, Lambda, S3, EC2, API Gateway, ECS, etc
- Hands-on experience with Snowflake or other cloud data platforms
- Solid understanding of relational and non-relational databases
- Experience developing Microservices
- Knowledge of CI/CD pipelines, Git, version control, and DevOps practices
- Strong SQL and data modeling skills
- Excellent analytical, debugging, and problem-solving skills
- Strong communication and stakeholder management skills