Senior Data Engineer (REMOTE OR MA BASED)
United States of America
Full Time
2 hours ago
$100,000 - $125,000 USD
No H1B
Key skills
Data integrationData warehouse designETL pipelinesMedallion ArchitectureData LakeData modelingData governanceData securityAPIsSFTPFTPSStreaming DataDB ConnectorsSOAPRESTAzure Data ServicesAzure Synapse AnalyticsAzure SQL DatabaseAzure Data Lake StoragepySparkSparkSQLDelta TablesSQLPythonAzureAWSGCPMicrosoft DP-203Microsoft DP-700PowerBIAzure DevOpsMicrosoft FabricETLData EngineeringAnalyticsAzure SQLAgileCommunicationCritical ThinkingCollaboration
About this role
The Hanover Insurance Group is committed to delivering on their promises for over 170 years. They are seeking a Senior Data Engineer to drive complex projects, mentor less experienced engineers, and collaborate with cross-functional teams on data and reporting requests.
Responsibilities:
- Complete data integration, data warehouse design, and build scalable ETL pipelines
- Display data engineering best practices for data storage, integration, transformation, and access within cloud and on-premises platforms
- Have a strong understanding of Medallion Architecture and Data Lake best practices
- Have knowledge of data modeling, governance, and security best practices
- Ensure data security and compliance within industry standards
- Have familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST)
- Develop and maintain documentation for data integration and ETL solutions
- Build solutions within Azure Data Services (Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage)
- Create solutions using pySpark/SparkSQL, and Delta Tables
- Create documentation for data processes
- Collaborate with data scientists, analysts, and stakeholders
- Coach, mentor, and serve as technical guidance for junior team members
- Work within agile development methodologies and use DevOps best practices
Requirements:
- Bachelor's degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent
- 5 plus years professional experience in data engineering, data architecture, and/or data integration
- Advanced proficiency in SQL and Python
- Experience working with Azure, AWS, GCP, or other cloud
- Strong problem-solving, communication, and collaboration skills
- Critical thinking and attention to detail
- Must be eligible to work in the United States without requiring sponsorship now or in the future (ie. US Citizen or green card holder)
- Microsoft DP-203 or DP-700 certification
- Experience in optimizing data pipelines for scale, performance, reliability, and cost efficiency
- PowerBI experience
- Azure DevOps experience
- Azure Synapse Analytics and/or Microsoft Fabric experience
- Masters in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent
- Actuarial or pricing experience within insurance industry