Data Engineer

Southwest Airlines is committed to providing a stable work environment and encouraging creativity and innovation. They are seeking a Data Engineer for their AIDT Delivery & Operations Team to design, build, and manage scalable data pipelines while delivering analysis that drives meaningful decision-making.

Responsibilities:

• Assemble large, complex sets of data that meet non-functional and functional business requirements
• Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
• Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
• Work with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
• Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
• Generate or adapt equipment and technology to serve user needs
• May perform other job duties as directed by Employee's Leaders

Requirements:

• High School Diploma or GED
• Bachelor's degree in Computer Science, Engineering, Information systems or similar fields of study or equivalent advanced level experience
• Intermediate level experience, fully functioning broad knowledge in: Cloud infrastructure, DataLake
• ETL experience ensuring source to target data integrity
• Various filetypes (Delimited Text, Fixed Width, XML, JSON, Parque)
• ServiceBus, setting up ingress and egress within a subscription, or relevant AWS Cloud services administrative experience
• Unit Testing, Code Quality tools, CI/CD Technologies, Security and Container Technologies
• Agile development experience and Agile ceremonies and practices
• Ability to perform work duties from [limited space work station/desk/office area] for extended periods of time
• Ability to communicate and interact with others in the English language to meet the demands of the job
• Ability to use a computer and other office productivity tools with sufficient speed and accuracy to meet the demands of the job
• Must maintain a well-groomed appearance per Company appearance standards as described in established guidelines
• Must be a U.S. citizen or have authorization to work in the United States as defined by the Immigration Reform Act of 1986
• Must be at least 18 years of age
• Must be able to comply with Company attendance standards as described in established guidelines
• Must be able to travel and /or attend Company and non-Company facilities and remote locations such as remote-based offices as necessary
• Proficiency in Python (including PySpark) and SQL
• Experience using cloud computing tools, particularly AWS Lambda, AWS Glue, and EMR (or equivalent cloud data‑processing services)
• Experience ingesting real‑time streaming data using tools such as Confluent Kafka
• Experience orchestrating ETL workflows using AWS Step Functions or EventBridge
• Familiarity with Data Warehousing methodologies and Relational Databases
• Experience developing robust data pipelines with error handling, monitoring, and quality checks
• Strong knowledge of modern data formats such as Parquet
• Ability to perform Exploratory Data Analysis (EDA) to assess data quality, identify patterns, and generate actionable insights