Data Engineering (Azure Databricks) with AI

Location: Plano, TX

Duration: 18 Months + Extension

Bill Rate: $80-$92/hour

Job Type: C2C/1099 Contract

Client: To Be Discussed Later

Work Authorization: H-1B, OPT-EAD, GC-EAD, -EAD

Key Responsibilities :-

• Lead onshore and offshore data engineering teams across mixed vendor groups, including Capgemini and other partners.
• Translate business and architecture requirements into technical designs and engineering tasks.
• Develop and optimize ETL/ELT pipelines, data transformations, and Databricks workflows.
• Ensure code quality, performance tuning, testing, and adherence to engineering best practices.
• Coordinate with architects, project managers, business stakeholders, and vendor teams.
• Provide mentoring and technical direction to junior and mid-level data engineers.
• Participate in code reviews, issue resolution, deployment, and production support.
• Support data validation, reconciliation, cutover planning, and post-migration stabilization.

Required Qualifications

• 8+ years of experience in data engineering, data warehousing, ETL/ELT, or analytics engineering.
• 2+ years of experience leading onshore/offshore engineering teams.
• Strong hands-on expertise with **Databricks, Apache Spark, SQL, and Python/PySpark**.
• Experience supporting data platform migration or modernization initiatives.
• Familiarity with **Google Cloud Platform and Azure** cloud platforms.
• Strong understanding of data pipelines, data lakehouse concepts, and large-scale data processing.
• Experience working with global delivery teams and multiple vendor partners.
• Strong communication, problem-solving, and technical troubleshooting skills.
• Strong AI/ML and Generative AI architecture experience.
• Enterprise solution and cloud architecture expertise.
• Experience designing production-grade AI platforms and applications.
• Strong understanding of LLMs, AI/ML frameworks, MLOps, and cloud services.
• Excellent communication and stakeholder-management skills.