Developing and delivering complex requirements to accomplish business goals
Ensuring that software is developed to meet functional, non-functional and compliance requirements
Leading requirements analysis, high level/low level designs, development, and implementation of data integration solutions involving Spark/Scala and Informatica products
Coding solutions and unit testing to deliver requirements/story per defined acceptance criteria
Designing, developing, and modifying architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Mentoring other software engineers and coaching team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
Automating manual release activities
Designing, developing, and maintaining automated test suites (integration, regression, performance)

10+ years of data delivery/integration experience
3 years hands on experience in Scala
3 years of hands-on experience in Spark
Very good understanding of Hadoop components, architecture & tool sets
Spark and Scala Informatica
Must have Architected, developed & implemented solutions using real time streaming technologies (Spark Streaming/Kafka)
Good knowledge of spark configurations and Spark/Scala performance tuning
Strong working knowledge on Hive, Impala, Oozie
Experience working with Exadata & Oracle SQL Tuning
Experience developing Streaming/Near Real time and Batch data integration solutions.
Hands on experience in UNIX Shell Scripting
Working experience in scheduling jobs with Autosys

Software Engineer III

Key skills