Key skills
AWS GlueAWS LambdaAmazon RedshiftAmazon S3Amazon AthenaAWS Glue Data CatalogAWS IAMAWS CloudWatchSQLPythonpandasNumPyETL/ELT pipeline designData quality monitoringMetadata managementData lineageData governanceInfrastructure as codeCloudFormationTerraformMedallion Lakehouse architectureData Mesh architectureAWS Lake FormationAmazon DataZoneAWS Glue Data QualityData observabilitySchema registriesFISMA complianceFedRAMP complianceNIST complianceDevSecOpsCI/CD pipelinesAWS Certified Data EngineerAWS Certified Solutions ArchitectAgile teamworkPandasETLELTData EngineeringAnalyticsRedshiftAWSLambdaS3IAMCloudWatchGlueAthenaPostgreSQLAgileCI/CD
About this role
iAdeptive Technologies is looking for a skilled and motivated Data Engineer to join their program team supporting a federal agency client. The role involves designing, building, and maintaining a modern AWS-based data platform while ensuring data governance, quality, security, and compliance in a federal environment.
Responsibilities:
- Design, build, and maintain scalable AWS data pipelines and ETL/ELT processes
- Develop and support Bronze, Silver, and Gold lakehouse data layers
- Implement data quality, metadata, lineage, and governance controls throughout the data lifecycle
- Partner with Data Owners and Data Stewards to implement data standards, classifications, and business rules
- Build reusable data products with defined ownership, quality measures, and access requirements
- Implement secure data access, retention, and compliance controls
- Integrate internal systems and external APIs while ensuring data reliability and traceability
- Support investigation and resolution of data issues, including documenting defects, affected datasets, corrective actions, and preventive controls
- Deploy infrastructure as code and integrate data quality, security, and compliance into CI/CD pipelines
- Troubleshoot data issues, perform root-cause analysis, and support remediation efforts
- Provide technical guidance on data engineering and governance
Requirements:
- 3 to 5 years of experience in data engineering, data integration, and cloud-based data platforms
- Advanced SQL proficiency across relational and analytical platforms such as PostgreSQL, Amazon Redshift, and Athena
- Hands-on experience with AWS data services, including Glue, Lambda, Redshift, S3, Athena, Glue Data Catalog, IAM, and CloudWatch
- Proficiency in Python for data processing and automation, including libraries such as pandas and NumPy
- Demonstrated experience designing, optimizing, and monitoring ETL/ELT pipelines and large-scale datasets
- Experience implementing automated data-quality rules, reconciliation controls, exception handling, and data-quality monitoring
- Experience with metadata management, schema evolution, data lineage, dataset classification, or enterprise data catalogs
- Experience implementing secure data access, encryption, audit logging, and least-privilege controls
- Experience with infrastructure as code using CloudFormation, Terraform, or equivalent technologies
- Ability to translate business rules, governance requirements, and data standards into scalable technical solutions
- Ability to work effectively with governance, business, architecture, security, privacy, analytics, and engineering teams in an agile environment
- Experience with Medallion Lakehouse or Data Mesh architectures
- Experience with AWS Lake Formation, Amazon DataZone, or AWS Glue Data Quality
- Experience building governed data products
- Familiarity with data observability, data contracts, and schema registries
- Experience supporting Data Governance programs or governance boards
- Knowledge of FISMA, FedRAMP, NIST, or other federal compliance frameworks
- Familiarity with DevSecOps and CI/CD practices
- AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect certification