Databricks Engineer

UST is a technology and digital solutions company focused on transformation and AI-driven innovation. The Databricks Engineer will develop scalable data processing solutions, Databricks pipelines, ETL/ELT workflows, and RESTful APIs using Python and Java while ensuring data quality, reliability, and performance.

Responsibilities:

• Develop reusable and efficient code for large-scale data processing workloads
• Design, develop, and maintain scalable data processing solutions using Python and Java
• Build and optimize data ingestion, transformation, and orchestration pipelines
• Ensure data quality, reliability, and performance across data platforms
• Develop and maintain Databricks notebooks and workflows
• Design, implement, and optimize ETL/ELT pipelines in Databricks
• Monitor pipeline health, troubleshoot failures, and improve processing efficiency
• Collaborate with data architects to implement scalable lakehouse solutions
• Design and develop RESTful APIs for data access and integration

Requirements:

• with strong hands-on experience, Python experience working on Java BE, Rest API, familiarity with Databricks pipelines and notebooks is a must
• Experience range : 8-10 Years
• Bachelor's Degree in computer science or equivalent experience
• Data Analysis, Databricks, Java, Python, ETL, REST, Test Data Management, Python
• Good understanding of data analytics and data processing
• Experience with data synthesis/generation