Data Engineer (DB2 / Hive / Spark)

Ascii Group, LLC is seeking a Data Engineer with deep hands-on expertise in DB2, Hive, and Apache Spark. The role involves building, optimizing, and maintaining large-scale batch data processing pipelines while ensuring data integrity and performance optimization.

Responsibilities:

• DB2 Database & Stored Procedures: Develop, optimize, and maintain complex SQL scripts and DB2 stored procedures for high-volume data environments
• Data Processing & ETL Pipelines: Design, build, and execute robust batch data processing and transformation pipelines using Apache Spark (PySpark or Scala) and Hive
• Data Quality & Cleansing: Perform end-to-end data cleansing, validation, and consistency checks to ensure enterprise data integrity across processing layers
• Performance Optimization: Troubleshoot performance bottlenecks in DB2 queries, Hive execution plans, and Spark batch jobs to maximize throughput and resource efficiency
• Cross-Functional Collaboration: Partner with data architecture and analytical teams to gather requirements, deliver data products, and support data warehousing initiatives

Requirements:

• IBM DB2 (Heavy Data Environments), Complex SQL Queries, Stored Procedures Development
• Apache Hive, Hadoop Ecosystem, Batch Processing Frameworks
• Apache Spark (PySpark or Scala)
• Data Cleansing, Data Transformation, Data Validation, Performance Tuning
• 5–10 Years in Data Engineering / ETL Development
• Hands-on experience with enterprise ETL tools (Informatica PowerCenter, IBM InfoSphere DataStage)
• Exposure to cloud platforms (AWS, Azure, GCP) and cloud data lakes/warehouses
• Strong background in data modeling and data warehousing architecture