EPAM SystemsRemote
Senior Data Engineer - Snowflake & Databricks
United States of America
Full Time
1 hour ago
H1B Sponsor Likely
Key skills
SnowflakeDatabricksSQLPythonApache SparkDelta LakeData IntegrationETL ProcessesRelational Data ModelingDimensional Data ModelingGitETLELTData EngineeringData LakeAnalyticsBusiness IntelligenceSparkAWSAzureGoogle CloudVersion ControlCommunication
About this role
EPAM Systems is seeking a Senior Data Engineer with strong experience in data engineering and analytics projects. The role involves developing, maintaining, and optimizing data integration and transformation processes, while contributing to modern analytics solutions under the guidance of senior architects and consultants.
Responsibilities:
- Develop ETL/ELT processes to integrate data from a variety of sources
- Build and maintain data pipelines in Snowflake and Databricks
- Create data transformations using SQL and Python
- Support data loading, validation, and monitoring activities
- Help optimize queries and data processing workflows
- Collaborate on the implementation of data models for analytics and reporting
- Participate in quality assurance and testing activities
- Document developments, data flows, and technical components
- Address incidents and perform ongoing enhancements to implemented solutions
- Work closely with architects, technical leads, and business stakeholders
Requirements:
- 3+ years of experience in Data Engineering or Business Intelligence
- Hands-on experience with Snowflake, including development of database objects, advanced SQL queries, data loading and ELT processes, and basic knowledge of Streams, Tasks, and Snowpipe
- Hands-on experience with Databricks, including notebook development, data processing with Apache Spark, use of Delta Lake, and development in Python and SQL
- Solid understanding of relational and dimensional data modeling
- Experience with data integration and ETL processes
- Proficiency with Git for version control
- Strong analytical thinking and a problem-solving mindset
- Eagerness to learn new technologies and methodologies
- Effective communication with both technical and functional teams
- Team-oriented approach
- Strong organizational and follow-through skills
- Proficiency in English at an Upper-Intermediate level (B2) or higher
- Experience with cloud environments such as AWS, Azure, or Google Cloud
- Basic knowledge of Data Lake and Lakehouse architectures
- Familiarity with data orchestration tools
- Understanding of data quality and data governance concepts
- Certifications or coursework in Snowflake, Databricks, or cloud platforms