Data Engineer - REMOTE
United States of America
Full Time
4 weeks ago
$98,000 - $123,000 USD
No H1B
Key skills
Big DataData EngineeringData ModelingData ToolsSQLMS SQL ServerSSISETL PipelinesHadoopSparkKafkaPostgresCassandraAzkabanLuigiAirflowAWS Cloud ServicesEC2EMRRDSRedshiftAzure Cloud ServicesGCPStormSpark-StreamingSolrLuceneElasticsearchPythonJavaC++ScalaData Pipeline ManagementData Streaming SystemsMessage QueuingStream ProcessingData WarehousingData Modeling ToolsAgile Software DevelopmentCustomer ServiceCNoSQLMachine LearningETLAnalyticsBIAWSAzureSQL ServerAgile
About this role
General Dynamics Information Technology is a global technology and professional services company that delivers consulting, technology, and mission services to the U.S. government. They are seeking a Data Engineer Senior to help clients turn data into actionable insights by developing enterprise-grade data platforms, services, and pipelines.
Responsibilities:
- Deliver insights to help our clients turn data into action as a Data Engineer Senior at GDIT
- Your work will provide transformative solutions to our clients’ big-data obstacles and help advance the mission
- As a Data Engineer you will help ensure today is safe and tomorrow is smarter
- Work with our clients to develop enterprise grade data platforms, services, and pipelines
- Lead and architect migration of data environments with performance and reliability
- Assess and understand the ETL jobs, workflows, BI tools, and reports
- Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products
- Experience in crafting database / data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP)
- Support an Agile software development lifecycle
- Contribute to the growth of our Data Exploitation Practice!
Requirements:
- Ability to obtain a position of public trust with the US government
- Requires a Bachelor's degree in Data Science or closely related discipline and 5 years of experience
- US Citizenship Required
- 2-4 years of experience working with MS SQL Server and SSIS to build ETL pipelines
- 2-4 years industry experience coding commercial software and a passion for solving complex problems
- 2-4 years direct experience in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc
- Relational SQL and NoSQL databases, including Postgres and Cassandra
- Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc
- AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)
- Data streaming systems: Storm, Spark-Streaming, etc
- Search tools: Solr, Lucene, Elasticsearch
- Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
- Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases
- Experience with message queuing, stream processing, and highly scalable ‘big data' data stores
- Experience manipulating, processing, and extracting value from large, disconnected datasets
- Experience manipulating structured and unstructured data for analysis
- Experience constructing complex queries to analyze results using databases or in a data processing development environment
- Experience with data modeling tools and process
- Experience architecting data systems (transactional and warehouses)
- Experience aggregating results and/or compiling information for reporting from multiple datasets
- Experience working in an Agile environment
- Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models