Data Engineer
United States of America
Full Time
2 hours ago
No H1B
Key skills
Data analysisData engineeringETL pipelinesSQLSparkUnixPythonPySpark SQLJavaC#Data visualizationQlikSenseTableauPower BIDatabricksData mappingUnity CatalogAWS IAMAWS S3AWS EC2AWS GlueAgile developmentOracle 12cMS SQL ServerDB2DoD system developmentCETLData EngineeringBIAWSEC2S3IAMGlueOracleSQL ServerAgileCritical ThinkingProblem Solving
About this role
Information Gateways Inc. is seeking a Data Engineer to support enterprise data management activities. The role involves analyzing complex business and data requirements, developing data solutions, and providing technical assistance in data validation and testing processes.
Responsibilities:
- Support enterprise data management activities
- Understand and analyze complex business and data requirements
- Develop a broad understanding of the upstream and downstream systems and processes, including impact and gap analysis of current databases and reporting systems
- Provide technical assistance as subject matter expert in identifying, evaluating and developing data solutions that meet business requirements
- Help with data validation and testing approach, systems testing, and provide post-production support to the data engineering processes and pipelines
Requirements:
- Active Secret clearance is required
- Bachelor's degree in computer science, Information Systems, another related discipline, or equivalent work experience in the software development field will be considered
- 4+ years of data analysis and data engineering experience
- 2+ years of experience building ETL pipelines from multiple database systems using SQL, Spark, Unix, Python, PySpark SQL, Java or C# languages
- 3+ years of experience using data visualization tools such as QlikSense, Tableau, Power BI etc
- Experience using Databricks
- Demonstrated experience with data analysis and tagging for mapping across multiple databases and systems
- Strong problem solving and critical thinking skills
- Strong analytical background
- Ability to use Python and SQL in DataBricks
- SECRET security clearance required
- Unity Catalog a plus (they are doing a WDP (Workload Data Platform) DataBricks migration to Unity Catalog
- AWS Cloud experience preferred (IAM, S3, EC2, and Glue etc)
- Experience with Agile development
- Experience with RDBMS such as Oracle 12c, MS SQL Server, DB2 etc
- DoD system development experience preferred