Data Engineer II

MediQuant is a company that focuses on healthcare data solutions, and they are seeking a Data Engineer II to manage and extract data from legacy systems. The role includes preparing and loading data into a Microsoft SQL Server environment, conducting quality assurance checks, mentoring junior team members, and improving extraction processes.

Responsibilities:

• Extracts all data from legacy database systems. (*)
• Using existing software tools, can establish connectivity to client legacy database
• Kicks off extract process and monitors process during runtime
• Uses Structured Query Language (SQL) commands to browse and view database before extraction, as well as queries database-level statistics to help estimate the volume of data to be extracted
• Compares the layout of the legacy database with the layout of the extraction to ensure that all tables and expected row counts match
• Performs quality assurance checks on extractions to ensure work is accurate and reliable before it is passed on to the next team
• Loads various discrete and non-discrete data sources into a Microsoft SQL Server environment. (*)
• Uses existing tools to load flat file data into a SQL Server Database
• Converts different file types, documents or images into PDF format
• Reviews incoming datasets to check for errors and ensure validity. (*)
• Acts as a second validator after the person who extracted the data; reviews the database layouts and verifies that no data is missing from the legacy system
• Uses MQ scoping language from the contract to determine if the dataset delivered falls within the expected scope, or if the dataset delivered does not match the expected deliverable
• Collaborates with both the Client/Extractor and the DM/IC to ensure a smooth transition of the data between the extraction and the modeling
• Responsible for locating data and communicating to the team as the location of the data changes during the review process
• Runs accurate, detailed comparisons between table lists from the legacy system and the extracted dataset. Works with other team members to compare to past extract projects throughout MediQuant history
• Troubleshooting and Problem Solving. (*) – Identifies problems and proactively intervenes to mitigate or eliminate potential for negative impact
• Effectively checks work for accuracy, understanding where opportunities for errors exist. Takes ownership to ensure own work is error-free
• Independently researches and problem-solves; recognizes when additional help is needed and pro-actively reaches out to mentors/leaders for help
• Uses strong data analysis skills to debug data anomalies
• Works collaboratively with project teams to innovate and find solutions to complex issues
• Documents issues and resolutions for and “lessons learned” to avoid repeating
• Applies technical knowledge and seeks to fully understand the client’s expectations by asking questions
• Liaise with application/tool developers, PMO, IT, or other sources to create tools needed to streamline workflows
• Organization and Time Management. (*) – Handles multiple projects and tasks and prioritizes deadlines
• Identifies and utilizes all resources available when priorities conflict or when external challenges are lining up against the deadline. Must be able to clearly communicate the issues to the PM and Lead
• Handles a fluctuating workload and can prioritize during times of peak demand and conflicting priorities. Knows when to seek assistance to ensure deadlines are met and quality is delivered
• Keeps organized notes and uses project management tools to keep project team updated with the latest statuses and roadblocks
• Attributes 90% of available time to billable initiatives for named clients, making sure that time is properly allocated on their timesheet
• Mentoring. (*)
• Actively mentors DE I team members, teaching the extract and load processes and assisting in issue resolution
• Works closely with Lead to understand training plan and goals for each DE I and supports plan execution
• Develops documentation during own work to explain steps for resolving errors and troubleshooting extracts; Makes documentation available to team, including DE I team members, to help them learn
• Process Improvement. (*)
• Works alongside DE III to actively improve and refine the extraction and load processes
• Examines codebase of existing MediQuant tools and edits new functionalities or debugs discovered issues during tool use
• Assists DE III in developing standard procedures and processes; supports rolling out new procedures through mentoring

Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, preferred. High School Diploma or GED with 3-5 years of applicable experience in computer science related field required
• Advanced knowledge of SQL Scripting skills, able to query and transform data
• Proficiency in one of the following programming languages: Python, Java, C#
• Familiar with PowerShell/Bash scripting
• Excellent organizational and documentation skills
• At least 1 year of experience in Healthcare IT or clinical environments, familiar with healthcare terminology
• Advanced knowledge of healthcare data terminology used in both Clinical and Financial systems to help with scope review and understanding the datasets that are under review
• Preferred Experience with Legacy Systems (for example, but not limited to): Meditech (Magic, Client Server, 6.0, etc.), Cerner (MS4, Siemens Invision, Millennium, Soarian, etc.), McKesson (Star, Series, Paragon, etc.), Allscripts (Pro, Touchworks, etc.), GE Centricity, NextGen, CPSI, eClinicalWorks, SunQuest, Medhost
• Preferred Experience with Databases (for example, but not limited to): Intersystems Cache, Sybase, PostgreSQL, IBM DB2, Oracle, MySQL, Microsoft SQL Server
• Detailed knowledge of common database error messages, able to identify extract errors and derive a solution through either research or previous knowledge
• Able to understand database catalog, schema, and table layouts
• Able to work with large directories of files, extract metadata stored in the directory listing, and export resulting output in a tabular format, linking the metadata to the corresponding file path
• Knowledge of scripting tools (i.e. Python, Java, C#, PowerShell/Bash, etc.) and ability to write scripts to read, write, copy, rename, move, sort, or otherwise process many non-discrete data files
• Proficient with ODBC drivers and is able to set up ODBC connectivity to various database types
• Ability to solve problems using logical thought processes and devising creative solutions
• High attention to accuracy and detail
• Ability and desire to work in a strong team culture
• Knowledge with HIPAA regulations involving PHI and HITECH
• Strong customer service and information technology acumen