Job Title: Senior Data Integration Engineer/Designer/Architect
Location: Peoria, IL (Hybrid)
Duration: 12 Months
- SnapLogic
- AWS
- Python
- Snowflake
- DataStage
1.Design Responsibilities
Solution & Technical Design
- Translate business requirements into scalable, maintainable, and secure technical designs across DataStage, SnapLogic, AWS, Python, and Snowflake ecosystems.
- Create high-level and low-level design documents covering data flows, mappings, process orchestration, and integration patterns.
- Develop data models, transformation logic, and interface specifications for batch, real-time, and event-driven pipelines.
- Ensure designs align with enterprise architecture standards, security guidelines, and best practices.
- Collaborate with product owners, analysts, and architects to finalize solution design and validate technical feasibility.
2.Senior Development Responsibilities
Hands-on Development & Implementation
- Build and enhance ETL/ELT pipelines in IBM DataStage, SnapLogic, and Python.
- Develop scalable Snowflake SQL, stored procedures, and performance-optimized ELT logic.
- Implement AWS services (Lambda, S3, SNS, SQS, IAM, CloudWatch,Cloudformation, EventBridge) as part of cloud-native data pipelines.
- Code reusable frameworks, utilities, and components to accelerate team productivity.
- Conduct peer code reviews, mentor team members, and establish coding standards.
Quality & Delivery
- Perform unit testing and support integration/UAT activities.
- Optimize workflows for performance, cost-efficiency, and maintainability.
- Ensure version control, CI/CD integration, and documentation are consistently maintained.
- GitHub CI/CD integration
3.Production Support & Issue Resolution Responsibilities
Incident & Problem Management
- Serve as the point for any production issues across DataStage, SnapLogic, Snowflake, AWS, and Tidal.
- Responsible for analyzing and fixing production issues in any system.
- Analyze root causes, identify systemic issues, and propose permanent fixes.
- Develop automated monitoring, alerting, using Python/AWS.
Stability & Reliability
- Work closely with operations teams to ensure SLAs, uptime, and performance thresholds are met.
- Improve recovery processes, failover mechanisms, and operational resiliency.
- Troubleshoot orchestration and scheduling issues in Tidal Enterprise Scheduler.
4.Architecture Input & Technical Leadership Responsibilities
Architecture Contributions
- Provide architectural guidance for new integrations, data warehouse initiatives, and migration projects.
- Recommend best practices for cloud adoption, pipeline modernization, and platform evolution.
- Contribute to reference architectures, standards, reusable patterns, and decision frameworks.
Strategic Technology Guidance
- Evaluate emerging tools and technologies in data engineering, integration, cloud, and orchestration.
- Champion automation, observability, data quality, and performance optimization initiatives.
- Collaborate with enterprise architects and infrastructure teams to ensure future-proof design choices.
5.Cross-functional Collaboration Responsibilities
- Work with QA, business analysts, and project managers to enable smooth delivery.
- Assist and collaborate with offshore teams to ensure alignment, effective knowledge transfer, and smooth delivery across time zones.
- Communicate technical concepts clearly to both technical and non-technical stakeholders.
Tools & Technology Scope
- ETL/ELT: IBM DataStage, SnapLogic
- Cloud: AWS (Compute, Storage, Serverless, Orchestration, IAM, Monitoring)
- Data Warehouse: Snowflake
- Programming: Python, SQL
- Scheduling: Tidal Enterprise Scheduler
- Other: Git, CI/CD tools, DevOps pipelines, monitoring platforms
Mail: Dileep (at) humacinc (dot) com