Data Engineer

Qualis1 Inc. is seeking a Data Engineer to support scalable data processing and engineering initiatives. The role focuses on building and maintaining ETL pipelines, working with distributed data processing technologies, managing AWS-based data services, and implementing data quality and workflow orchestration practices.

Requirements:

• · Ability to read, write, speak and understand English
• · Strong communication and collaboration skills
• · Expertise in Scala (preferred) or Java, with proficiency in Python
• · Strong experience with Apache Spark for distributed data processing
• · Proficiency in building and maintaining ETL pipelines at scale
• · Experience with AWS services: S3, Glue, Athena, EMR
• · Strong understanding of relational databases and SQL
• · Knowledge of data architecture, data warehousing, partitioning strategies, and columnar storage formats (e.g., Parquet)
• · Experience implementing data quality checks and validation frameworks
• · Experience with workflow orchestration tools (Airflow preferred)
• · Proficiency with Linux-based operating systems and shell scripting
• · Experience with Git-based version control and collaborative development workflows
• · Demonstrated ability and desire to continually expand skill set, and learn from and teach others