Develop software solutions for complex ETL data pipelines and scalable APIs
Develop data pipelines to extract, transform, and load (ETL) data from multiple sources into a centralized data repository
Improve and refine data pipelines for efficiency, reliability, and scalability
Monitor and troubleshoot data pipeline issues and ensure data integrity
Develop RESTful APIs & microservices to support multiple operations
Follow best practices for security, scaling, cost effectiveness and testing
Create unit and integration tests
Contribute to documentation on use of the APIs
Resolve technical issues and bugs in applications
Identify performance bottlenecks and improve code and databases
Collaborate with engineers, analysts, cross-functional teams and partners to understand data requirements and deliver relevant insights
Improve data processing and query performance for data retrieval and analytics
Perform code review and provide constructive feedback within ethical boundaries
Stay up to date with the latest data engineering technologies, and best practices
Recommend new technologies for data engineering improvements
Ensure data security by implementing access controls, encryption, and comply with data privacy regulations

7+ years of software development experience at multiple capacities
2+ years of experience in big data technologies (we use Airflow, EMR/Spark, Snowflake, Hadoop/Hive)
Experience with data streaming (we use Kinesis/Kafka)
Proficiency in programming languages (we use Python, Java/Scala)
Experience building RESTful APIs and microservices
Experience with relational databases (we use MySQL, PostgreSQL)
Background on cloud technologies (we use AWS, S3/EBS, Lambda, EKS, CloudWatch)
Familiarity with observability platforms (we use Splunk, Datadog)
Sound knowledge of design patterns and methodologies across multiple platforms
Knowledge and support of modern development practices, such as Agile and Open-Source technologies
Excellent debugging skills.
Bachelor's in computer science or equivalent

Senior Software Developer – Data, Backend Development

Key skills