Lead Consultant, Data Engineer

Lovelytics is a data and AI consulting company that helps enterprises modernize their data and put AI into production. The Lead Consultant, Data Engineer will deliver client engagements involving data warehousing, ETL development, data integrations, and data modeling, while using and migrating to technologies such as Databricks, AWS, and Azure. The role also involves leading work streams, designing data pipelines, contributing to streaming solutions, and implementing security and CI/CD practices.

Responsibilities:

• Utilize consulting and technical skills to be able to work in a client-facing project environment independently
• Be responsible for your own execution and sometimes lead individual work streams on client engagements as assigned and under supervision of engagement lead
• Collaborate with other team members to successfully deliver on projects
• Work effectively and directly communicate with both internal and client and/or partner teams
• Develop full ownership of your execution on client engagements, you'll become involved in the project planning and solution stages of engagements as well
• Design and implement complex ETL/ELT pipelines with evidence of improved data processing times
• Successfully lead small data warehousing projects with measurable performance enhancements under the management of an engagement lead
• Contribute to real-time data processing solutions and managed streaming data
• Implement security and compliance measures for data pipelines
• Design and implement version control and branching strategies and integrate them into CI/CD for promoting and testing in higher environments

Requirements:

• B.S. in Computer Science or equivalent
• 3+ years' experience in data engineering and big data. At least 2 years working directly with clients and external stakeholders
• Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks A must
• Data modeling and database design skills and knowledge of version control
• Excellent verbal and written communication skills
• Is able to apply technical skills to engagement needs
• Works with engagement leads and directors to gain exposure in the design and architecture of solutions
• Understands and utilizes Lovelytics tools and client tools