Software Engineer, Distributed Systems (Core)

Recruiting from Scratch is representing a dynamic software development firm that is transforming how businesses sync and utilize customer data across various platforms. They are seeking a Software Engineer, Distributed Systems (Core) to design and implement backend systems, optimize data workflows, and collaborate with teams to enhance system functionalities.

Responsibilities:

• Design and implement robust backend systems to synchronize customer data from warehouses into key business tools
• Utilize Kafka for real-time data streaming and processing, ensuring seamless data flow across applications
• Deploy and manage containerized applications using Kubernetes and Docker for enhanced scalability and reliability
• Optimize data processing workflows with Spark, improving performance and reducing latency in data handling
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications for system enhancements
• Participate in code reviews and contribute to best practices in software development and architecture

Requirements:

• 7+ years of experience in backend engineering, with a strong focus on distributed systems
• Proficiency in Kafka, Kubernetes, Docker, and Spark, with hands-on experience in implementing these technologies in production environments
• Demonstrated ability to design and develop scalable systems that handle large volumes of data
• Strong problem-solving skills and the ability to work collaboratively in a fast-paced, remote environment
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their services related to data processing and storage
• Familiarity with CI/CD pipelines and DevOps practices to streamline deployment processes
• Knowledge of data warehousing concepts and tools