Data Cloud Engineer (Remote)

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer to support a Department of Defense modernization initiative. The role designs and implements secure, scalable data solutions across Azure and AWS, including cloud data pipelines, data lakes, and analytics-ready environments.

Responsibilities:

• Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies
• Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL
• Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files
• Implement full and incremental data loading strategies, including Change Data Capture (CDC)
• Design and support enterprise data lakes, data warehouses, and analytics-ready environments
• Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management
• Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines
• Support CI/CD implementation and automated deployment processes
• Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives
• Ensure solutions remain compliant with DoD security requirements and best practices

Requirements:

• Active Secret Clearance
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline
• 10+ years of experience designing and supporting enterprise-scale data engineering solutions
• Strong expertise with PySpark, Spark SQL, Python, and SQL
• Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue
• Experience with data ingestion, integration, and transformation of structured and unstructured data
• Experience implementing CDC methodologies and incremental load frameworks
• Knowledge of data governance, access controls, and data quality methodologies
• Experience supporting production environments and troubleshooting operational issues
• Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases
• Experience supporting federal or DoD cloud modernization programs
• Familiarity with RMF, STIG, and FedRAMP compliance frameworks
• Experience working in Agile development environments