Senior DataOps Engineer

Arkhya Tech. Inc. is seeking a Senior DataOps Engineer to drive enterprise DataOps capabilities on Azure Databricks. The role focuses on building reliable data pipelines, implementing CI/CD automation, and ensuring data quality and governance compliance.

Responsibilities:

• Build and manage end-to-end data pipelines using Azure Databricks (PySpark, SQL)
• Implement workflow orchestration (Airflow / ADF / Databricks Workflows)
• Establish DataOps practices: monitoring, alerting, and production support
• Drive CI/CD pipelines and environment promotion (Dev $B"\•(B Prod)
• Ensure data quality, lineage, and governance compliance
• Manage incident resolution, RCA, and SLA adherence
• Optimize pipeline performance, scalability, and cost

Requirements:

• Azure Databricks (Mandatory) – PySpark, SQL
• Azure Services – ADF, ADLS, Synapse
• Data Orchestration – Airflow / ADF / Databricks Workflows
• CI/CD Tools – Azure DevOps / GitHub / Git
• Strong expertise in ETL/ELT pipelines, DataOps, and production support
• Experience with data quality, monitoring, and observability frameworks
• Experience with Snowflake / BigQuery / multi-cloud environments
• Exposure to MLOps / AI data pipelines
• Knowledge of Medallion Architecture (Bronze–Silver–Gold)