SalesforceRemote
Staff Software Engineer, Data Ingestion - Slack
United States of America
Full Time
5 days ago
$197,000 - $314,000 USD
No H1B
Key skills
PythonJavaGoScalaSQLAIClaudeAgenticData EngineeringSparkKafkaAirflowAWSTerraformKubernetesDockerECSEKSS3GrafanaSalesforceCRMMentoringCommunicationCustomer Success
About this role
Salesforce is the #1 AI CRM, where humans with agents drive customer success together. They are seeking a Staff Software Engineer to join the Data Ingestion Team, responsible for building and operating a platform that ingests data from various sources into their Lakehouse using modern Streaming and Lakehouse technologies.
Responsibilities:
- Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets
- Design and implement Slack’s Lakehouse solutions and enable production use cases for customers
- Improve the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and tools
- Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration)
- As one of the tech leads, comfortably collaborate with cross functional partners and lead technical initiatives independently end to end
- Be a role model and a multiplier, coaching and mentoring other engineers across the team and the org
- Write, review, or provide feedback on a technical design proposal from others
Requirements:
- U.S. citizenship and willing to undergo a background check for GovSlack authorization. We can not provide visa sponsorship for this role
- 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent
- You have hands on experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3 or equivalent
- You are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalent
- You are skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etc
- You are familiar with AI-assisted software development and automation and have hands on experience of Claude Code/Codex or equivalent
- You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders