PanAgora Asset Management is committed to transforming financial lives and offers a flexible work environment that celebrates internal mobility. The Senior Data Engineer will design, build, and maintain data infrastructure and ingestion frameworks, collaborating with teams to implement scalable data solutions on AWS for data-driven reporting.
Responsibilities:
- Design, develop, and maintain scalable data and file ingestion frameworks
- Collaborate with cross-functional value stream teams, analysts, and business stakeholders to understand and refine data requirements and translate them into technical solutions
- Optimize data ingestion frameworks for performance and reliability
- Implement data governance and security best practices
- Troubleshoot data integrity and performance issues
- Participate in code reviews and enforce coding standards
- Mentor more junior engineers and provide technical guidance on complex projects
- Contribute to architectural decisions and design discussions
- Advise on and work on strategic initiatives to mitigate and alleviate core data application issues, including opportunities for process automation
- Stay updated with the latest trends and technologies in data engineering and apply them to improve the data framework
- Collaborate with colleagues on best practices and data application issues
- Complete other duties as assigned
Requirements:
- Bachelor's degree in Computer Science or a related field, such as Information Systems, Mathematics, or Software Engineering, or an equivalent combination of training and experience
- 4-6 years of data engineering experience with a proven track record of designing and implementing scalable ingestion frameworks
- Proficiency in ETL development and design using Python, PySpark, and big data technologies such as Hadoop or Spark
- Strong SQL knowledge and RDBMS experience with a recognized database such as Postgres, Redshift, or MySQL
- Hands-on experience with the AWS platform using DynamoDB, EMR Serverless, Lambdas, or related services
- Deep understanding of data modeling, ETL processes, and data warehousing concepts
- Excellent written and verbal communication skills, with the ability to explain complex technical concepts to non-technical stakeholders
- Experience working with Agile methodology and scrum processes
- Excellent problem-solving skills and the ability to work independently and lead more junior engineers
- 3+ years of IT experience in financial services or another highly regulated industry
- Use of JIRA in Agile development
- Knowledge of DevOps and CI/CD best practices
- Experience with new technologies such as QuickSight or Co-Pilot
- Ability to communicate in a friendly and professional manner with customers and colleagues, remain calm in stressful situations, independently troubleshoot program errors regardless of technology, and write user-friendly explanations of highly technical functionality
- Customer focus, including delivering internal and external customer service excellence, listening skills, patience, empathy, authenticity, proactivity, and perseverance with external and internal customers
- Ability to uphold commitment to delivering optimal solutions in a timely manner while balancing customer needs with the best interests of the organization
- Ability to maintain a positive approach despite challenges, constraints, and customer emotions
- Ability to build collaborative and cooperative relationships and effectively manage conflict
- Ability to find common ground and build trust with co-workers, managers, partners, and customers through inclusiveness and appreciation for diverse backgrounds, cultures, thoughts, and experiences
- Ability to operate with integrity and communicate respectfully in language, writing, and actions
- Ability to show interest in and support the success of others, provide encouragement, and celebrate wins
- Ability to address conflict openly and respectfully through proper channels