Job Title: AWS Databricks Platform Administrator
Location: Raritan, NJ
Experience: 9+ Years
Job Summary
We are looking for an experienced AWS Databricks Platform Administrator to manage, secure, monitor, and optimize enterprise Databricks environments hosted on AWS. The ideal candidate will have strong hands-on experience in Databricks administration, AWS infrastructure, platform security, automation, cost optimization, and production support.
Key Responsibilities
Administer and maintain Databricks workspaces, clusters, jobs, SQL warehouses, Unity Catalog, and access controls.
Manage AWS services, including S3, IAM, VPC, KMS, CloudWatch, and CloudTrail.
Implement security policies, user access management, data governance, and compliance controls.
Automate infrastructure provisioning and platform operations using Terraform, Python, and CI/CD pipelines.
Monitor platform performance, troubleshoot issues, and ensure system reliability.
Optimize Databricks and AWS resource utilization to control cloud costs.
Support production incidents, root-cause analysis, upgrades, and disaster recovery activities.
Collaborate with data engineering, cloud infrastructure, security, and application teams.
Maintain technical documentation, operational procedures, and platform standards.
Required Skills
Mandatory: AWS S3, Databricks, and Amazon Redshift.
Strong hands-on experience with Databricks platform and workspace administration.
Knowledge of Unity Catalog, Delta Lake, clusters, jobs, and SQL warehouses.
Experience with AWS IAM, VPC, KMS, CloudWatch, and CloudTrail.
Working knowledge of Terraform, Python, scripting, and CI/CD automation.
Experience in platform monitoring, security, performance optimization, and production support.
Understanding of cloud networking, access management, and data governance.
Qualifications
9+ years of overall IT experience in cloud infrastructure, platform engineering, DevOps, or production administration.
5+ years of hands-on Databricks administration experience preferred.
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
Preferred Candidate: A senior platform administrator with strong AWS and Databricks expertise, including Amazon S3 and Redshift, who can manage enterprise environments and ensure secure, reliable, and cost-effective operations.