Key skills
DatabricksPySparkQMetrySpark architectureData lakesCloud platformsCI/CD pipelinesSparkScrumCI/CDLeadershipCollaboration
About this role
Nasscomm is seeking an Automation Engineer with expertise in Databricks and PySpark to work on testing data pipelines and big data workflows. The role involves managing test processes, collaborating with team members, and integrating automated tests into workflows.
Responsibilities:
- Expertise in Databricks and PySpark for testing data pipelines, distributed systems, and big data workflows
- Proficiency in QMetry for test management, defect tracking, and reporting
- Strong understanding of Spark architecture, data lakes, and cloud platforms
- Experience with CI/CD pipelines and integration of automated tests into Databricks workflows
- Leadership and collaboration skills to guide QA team members and ensure alignment across product, scrum master and tech lead
Requirements:
- Expertise in Databricks and PySpark for testing data pipelines, distributed systems, and big data workflows
- Proficiency in QMetry for test management, defect tracking, and reporting
- Strong understanding of Spark architecture, data lakes, and cloud platforms
- Experience with CI/CD pipelines and integration of automated tests into Databricks workflows
- Leadership and collaboration skills to guide QA team members and ensure alignment across product, scrum master and tech lead