AWS Data Engineer

Smart Info Solutions LLC is seeking a highly skilled AWS Data Engineer to help build, scale, and optimize enterprise-grade data platforms for the Federal Reserve Bank. The role involves designing and implementing scalable data pipelines, modern cloud infrastructure, and ensuring compliance with federal security standards.

Responsibilities:

• Design, build, and maintain robust ETL/ELT pipelines for efficient data ingestion and processing into AWS data lake and platform environments
• Write, architect, and deploy reusable Terraform modules from scratch to provision and manage cloud infrastructure (not just update or maintain existing code)
• Implement and optimize high-performance database architectures using DynamoDB and/or PostgreSQL
• Write complex, optimized Python scripts and advanced SQL queries to handle large-scale, high-throughput data processing
• Ensure all cloud components adhere to strict federal security standards and architectural best practices

Requirements:

• US Citizen (USC) or Green Card (GC) Holder Required
• Enhanced Federal Background Check Required
• Extensive experience with core AWS data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, Lambda, Kinesis)
• Must be able to build Terraform infrastructure and modules from scratch
• Advanced proficiency in Python and Advanced SQL for data manipulation, pipeline orchestration, and optimization
• Strong hands-on experience with high-performance databases, specifically DynamoDB and/or PostgreSQL
• Deep understanding of enterprise data platform architectures, data lake concepts, partitioning strategies, and storage formats (e.g., Parquet, ORC, Avro)