Key skills
PythonJavaScalaSparkKafkaAirflowAWSGlueAthenaCommunicationCollaboration
About this role
Twilio is a company focused on shaping the future of communications and delivering innovative solutions to businesses worldwide. They are seeking a Software Engineer to join their Data Platform team, where the role involves designing, building, and optimizing a data-driven platform in collaboration with cross-functional teams.
Responsibilities:
- Design, build, and maintain infrastructure and scalable frameworks to support data ingestion, processing, and analysis
- Collaborate with stakeholders, analysts, and product teams to understand business requirements and translate them into technical solutions
- Architect and implement data solutions using modern data technologies such as Kafka, Spark, Hive, Hudi, Presto, Airflow, and cloud-based services like AWS Lakeformation, Glue and Athena
- Design and implement frameworks and solutions for performance, reliability, and cost-efficiency
- Ensure data quality, integrity, and security throughout the data lifecycle
- Stay current with emerging technologies and best practices in big data technologies
- Mentor early in career engineers and contribute to a culture of continuous learning and improvement
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 5+ years of experience in software development or a related field
- Strong proficiency in programming languages such as Python, Java, or Scala
- Strong experience with building frameworks for big data technologies such as Spark, Kafka, Hive, and distributed computing systems
- Experience with AWS technologies at scale
- Solid understanding of software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices
- Excellent problem-solving and analytical skills
- Strong verbal & written communication skills, with the ability to work effectively in a cross-functional team environment
- Bias to action, ability to iterate and ship rapidly
- Passion to build data products, prior projects in this area