XTN-DC44512 | BIG DATA ENGINEER

KMC Careers is seeking a Big Data Engineer to provide technical expertise for the research, development, and modification of extract, transform, load processes in support of a Big Data infrastructure. The role involves collaborating with data strategists and scientists, troubleshooting complex issues, and mentoring less experienced team members.

Responsibilities:

• Research, develop, document, and modify Big Data Lake processes and jobs per data architecture and modeling requirements; collaborate with Data and Analytics data strategists and data scientists
• Collaborate with business stakeholders to understand data needs including data velocity, veracity, and access patterns
• Provide technical expertise to implement Data and Analytics specifications
• Serve on cross-functional project teams and provide the data and big data perspective on executing key deliverables
• Troubleshoot complex, escalated issues including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
• Proactively maintain and tune all code according to Big Data and EDW best practices to prevent issues
• Review and ensure appropriate documentation for all new development and modifications of the Big Data Lake processes and jobs
• Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data
• Educate business stakeholders on the usage and benefits of the EDW, Big Data Lake and related technologies
• Mentor and guide less experienced team members and provide feedback on project work
• Model behaviors that support the company’s common purpose; ensure guests and team members are supported at the highest level
• Ensure all activities are in compliance with rules, regulations, policies, and procedures
• Complete other duties as assigned

Requirements:

• Bachelor's degree in computer science, engineering, information technology, or related field, required
• Minimum five years of technology operations experience required
• Strong SQL knowledge and skills required
• Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required
• Strong knowledge of relational modeling and features including triggers, stored procedures, and constraints required
• Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required
• Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required
• Excellent analytical skills and the ability to identify solutions to complex data problems
• Ability to provide excellent customer service
• Excellent written and verbal communication skills
• Willingness to learn and embrace new technologies
• Ability to mentor and motivate a diverse team; ensure team and individual accountability and performance standards are met
• Ability to prioritize, multitask and manage multiple projects successfully in a fast-paced and dynamic environment
• Strong organizational skills with attention to detail
• Ability to communicate and interact effectively with different levels of the organization to negotiate, problem solve, complete projects and influence decision making
• Self-motivated with ability to work both independently and within teams in order to establish and meet deadlines, goals, and objectives
• Strong knowledge of Amazon Web Services (AWS) or similar Cloud Big Data platform