Databricks Platform Engineer

Job Title: Databricks Platform Engineer

Work Location: (Any nearest Infosys Office) Hybrid

Contract duration: Long term contract

Visa: /Only

Detailed JD:

• Design, configure, and manage the Databricks platform, including workspace setup, cluster administration, job orchestration, and platform optimization.
• Establish platform standards, best practices, and reusable frameworks to support enterprise-scale data engineering and analytics workloads.
• Enable development teams through CI/CD automation, deployment standards, technical guidance, and platform support.
• Implement and manage security, governance, access controls, and Unity Catalog to ensure compliance with enterprise standards.
• Integrate Databricks with cloud environments, data lakes, BI tools, orchestration platforms, and enterprise applications.
• Monitor platform performance, reliability, utilization, and costs while driving automation and continuous improvement initiatives.

Mandatory Skills

Education:

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related quantitative field. 

Mandatory Skills

• 5+ years of experience in data engineering, platform engineering, or data platform administration.
• 3+ years of hands-on experience with Databricks administration, platform engineering, or architecture.
• Strong experience with Apache Spark, distributed data processing, and workload optimization.
• Experience with Azure Databricks and cloud platforms such as Azure, AWS, or Google Cloud Platform.
• Hands-on experience with Unity Catalog, RBAC, security, governance, and access management frameworks.
• Experience with CI/CD pipelines, Infrastructure as Code (Terraform), automation, and DevOps practices.

Preferred Skills

• Experience with Delta Lake, Lakehouse Architecture, and modern enterprise data platforms.
• Knowledge of streaming and real-time data processing frameworks such as Structured Streaming, Kafka, or Event Hubs.
• Databricks and cloud platform certifications (Databricks Certified Professional, Azure Data Engineer, or Azure Solutions Architect) and experience supporting large-scale enterprise data platforms.

Nice-to-Have Skills

• Experience with Delta Lake, Lakehouse architecture, and modern data platform implementations.
• Knowledge of streaming frameworks such as Structured Streaming or Kafka.
• Databricks, Azure, or cloud platform certifications.