Cohere is the leading security-first enterprise AI company, focused on building cutting-edge foundation AI models and end-to-end products. The Software Engineer, Data Infrastructure role involves building and maintaining the high-performance data layer for AI training workloads, requiring collaboration with expert researchers and engineers.
Responsibilities:
- Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it
- Collaborate daily with researchers and engineers who are some of the best in the world at what they do
Requirements:
- 4+ years of experience working on data storage infrastructure
- Strong command of Python
- Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)
- The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
- Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink
- Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds
- Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists
- Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt