URGENT REQ:
Senior Databricks Developer (Greenplum Migration)
Client: Epsilon
Location: Chicago, IL (Hybrid 2 Days Onsite per Week)
Start Date: August 10, 2026
Employment Type: Contract
We are seeking an experienced Senior Databricks Developer to join a high-impact enterprise data modernization initiative for our client, Epsilon. The ideal candidate will have proven experience migrating large-scale data platforms from Greenplum to Databricks and a strong background in cloud-based data engineering.
Key Responsibilities
Lead the migration of enterprise data warehouses from Greenplum to the Databricks Lakehouse Platform.
Design, develop, and optimize scalable ETL/ELT pipelines using Databricks, Apache Spark, and PySpark.
Analyze existing Greenplum databases, SQL scripts, and stored procedures, and transform them into efficient Databricks solutions.
Build robust data ingestion, transformation, validation, and reconciliation frameworks.
Optimize Spark jobs and Databricks clusters for performance, scalability, and cost efficiency.
Collaborate with architects, business analysts, and cross-functional teams to deliver high-quality data solutions.
Ensure data quality, governance, security, and compliance throughout the migration lifecycle.
Participate in architecture discussions, code reviews, troubleshooting, and production support.
Create technical documentation, migration strategies, and implementation best practices.
Required Qualifications
7+ years of Data Engineering or Big Data development experience
Strong hands-on expertise with Databricks
Extensive experience with Apache Spark and PySpark
Mandatory: Experience migrating Greenplum to Databricks
Advanced SQL development and query optimization skills
Experience with Delta Lake, Unity Catalog, and Databricks Workflows
Experience building enterprise-scale ETL/ELT pipelines
Knowledge of Azure or AWS cloud platforms
Familiarity with Git, CI/CD, and Agile development methodologies
Excellent communication, collaboration, and problem-solving skills
Preferred Skills
Cloud data warehouse migration experience
Data governance and security best practices
Experience with orchestration tools such as Airflow or Azure Data Factory
