EPAM SystemsRemote
Senior Data Engineer
United States of America
Full Time
3 hours ago
H1B Sponsor Likely
Key skills
Azure Data FactoryAzure DatabricksAzure SQL DatabaseAzure Key VaultAzure Log AnalyticsAzure Data Lake Store Gen2SQL ServerLogic AppAzure Analysis ServicesDBTData Pipeline MigrationData ValidationUser Acceptance Testing (UAT)GoSQLData LakeAnalyticsDatabricksdbtAzureVaultAzure SQL
About this role
EPAM Systems is looking for a Senior Data Engineer to join their Azure Data Lake Migration Project. In this role, you will support various transition activities and play a key role in modernizing data infrastructure while enabling cloud-based integrations.
Responsibilities:
- Support transition activities covering Data Platform Deployment (lift and shift of pipelines), pipeline migration (reconfiguration of code), Validation, UAT, and Hypercare provision
- Develop new pipelines to link Maximo, Synergi, and ATS
- Change connections from DB to cloud-based applications
- Reconfigure and migrate existing pipelines to the new cloud environment
- Collaborate with the Transition Team to ensure smooth deployment and delivery
- Perform validation and UAT to guarantee data integrity and pipeline reliability
- Provide Hypercare support after go-live to address post-migration issues
Requirements:
- 5+ years of experience as a Data Engineer
- Expertise in Azure Data Factory, Azure Databricks, and Azure SQL Database
- Capability to support pipeline migration, validation, UAT, and Hypercare activities
- Proficiency in English at an Upper-Intermediate level (B2) or higher
- Familiarity with Azure Key Vault, Azure Log Analytics, and Azure Data Lake Store Gen2
- Knowledge of SQL Server, Logic App, and Azure Analysis Services
- Skills in DBT for data transformation