Farmers Insurance is a company dedicated to delivering peace of mind and making a real difference in people's lives. They are seeking a Senior Data Engineer responsible for acquiring, curating, and publishing data for analytical or operational uses, ensuring data is ready for consumption by various users. The role involves consulting on data projects, developing data pipelines, and coaching junior associates while working independently with various technologies.
Responsibilities:
- Consults on data projects of varying complexity, with minimal coaching and guidance, to understand design requirement and existing business processes to lead in the design, development, and implementation of data products
- Practices code management and integration with current architectural and data governance guidelines with minimal oversight
- Produces advanced data building blocks, data models, and data flows for varying client requests such as dimensional data, standard and ad hoc reporting, data feeds, dashboard reporting, and data science research exploration independently
- Creates business user access methods to structured and unstructured data
- Utilizes techniques such as mapping data to a common data model, natural language processing, transforming data as necessary to satisfy business rules, AI, statistical computations, and validation of data content
- Translates business data stories into a technical story breakdown structure and work estimate for a schedule or planned agile sprint
- Projects are advanced with interaction across multiple dependencies
- Coaching and assistance required on an as needed basis
- Develops and maintains advanced to complex scalable data pipelines for both streaming and batch requirements and builds out new API integrations to support increased demands of data volume and complexity
- Preps/cleanses data to optimize for downstream reporting via Farmers standard visualization or AI/ML tools with coaching and assistance as requested
- Applies extensive knowledge of data governance concepts and applies them across multiple scenarios
- Delivers on complex projects with some vague timelines
- Develops data project plans and executes independently
- Performs other duties as assigned
Requirements:
- High School Diploma or equivalent required
- 5-7 years of related experience required
- Possesses strong technical aptitude
- Advanced experience in SQL, Spark (Scala or Python), Spark SQ or equivalent
- Advanced experience in dimensional modeling- – Snowflake database technology
- Advanced Experience building data pipelines to transform data as business logic
- Advanced knowledge and understanding with pipeline orchestration– dBT, AWS, SSIS
- Advanced understanding of cloud computing environments
- Advanced experience with BI visualizations such as Power BI, Tableau etc
- Strong verbal communication and listening skills
- Demonstrated experience interacting with executive and senior leadership stakeholders around the topics of data access, quality, appropriate use, metric definitions and standardization
- Bachelor's degree preferred