Data Engineer
United States of America
Full Time
5 days ago
$93,000 - $176,000 USD
No H1B
Key skills
PythonSQLETLData EngineeringData WarehousingAnalyticsSnowflakeBigQueryRedshiftDatabricksSparkHadoopAWSAzureGoogle CloudKubernetesDockerLambdaS3GlueCloud StorageElasticsearchELK StackAgileScrum
About this role
Accenture Federal Services is dedicated to helping the US federal government enhance national security and public welfare. The Data Engineer role involves designing and maintaining scalable data pipelines, integrating diverse data sources, and collaborating with cross-functional teams to develop data solutions that support analytics and reporting needs.
Responsibilities:
- Design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies
- Develop efficient data processing and transformation workflows to support analytics and reporting needs
- Integrate diverse data sources including APIs, databases, and cloud storage into unified datasets
- Work closely with cross-functional teams (data science, analytics, business units) to design and implement data solutions that align with business goals
- Implement robust validation, monitoring, and observability processes to ensure data accuracy, completeness, and reliability
- Contribute to data governance, security, and automation initiatives within the data ecosystem
- Leverage AWS services (e.g., S3, Glue, Lambda, Redshift) to build and deploy data solutions in a cloud-native environment
Requirements:
- Experience with cloud-based ETL services (e.g. AWS Glue, Google Cloud Dataflow, Azure Data Factory)
- Experience with Cloud data warehousing technologies (e.g. Amazon Redshift, Google BigQuery, Snowflake)
- Experience with Python, SQL, Spark, and PySpark
- Experience with data platforms like Databricks, Palantir, and Snowflake
- Familiarity with data orchestration and data quality processes
- Must be a US Citizen
- Secret clearance or above
- Experience working with federal clients
- Experience with COTS and open-source data engineering tools such as ElasticSearch and NiFi
- Experience with Docker/Kubernetes Hadoop/Spark, NiFi, ELK stack
- Experience with Agile / Scrum
- Data engineering certification such as Palantir Foundry Data Engineer, Azure Data Engineer Associate, Google Professional Data Engineer, IBM Certified Data Engineer, or similar