AI Data Engineer

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. The AI Data Engineer will build and operate large-scale data systems powering modern AI training and evaluation pipelines, with a focus on ingestion, transformation, quality assurance, lineage, and high-throughput data delivery. The role also requires operating petabyte-scale data systems and applying strong software engineering practices to support AI workloads.

Responsibilities:

• Build and operate the large-scale data systems that power modern AI training and evaluation pipelines
• Focusing on ingestion, transformation, quality assurance, lineage, and high-throughput delivery of data to training jobs across diverse modalities

Requirements:

• Bachelor's or Master's degree in Computer Science or a related field
• Six or more years of data engineering experience, with significant work supporting ML or AI workloads
• Strong proficiency in Python and at least one JVM or systems language
• Deep experience with modern data processing frameworks such as Spark, Ray, or Beam
• Hands-on experience operating petabyte-scale storage and pipeline systems
• Strong understanding of distributed systems, data modeling, and storage formats
• Experience with dataset versioning, lineage, and reproducibility for ML workflows
• Familiarity with high-throughput data loading for accelerator-based training
• Strong software engineering practices including testing, CI/CD, and code review
• Excellent communication and cross-functional collaboration skills
• Experience with multimodal datasets at large scale
• Familiarity with data quality tooling and dataset evaluation methodology
• Exposure to privacy-preserving data systems and regulated data handling
• Open-source contributions to data infrastructure projects
• Experience supporting frontier model training pipelines