Research Engineer

Taste Labs builds data and infrastructure to help AI models develop better judgment, starting with design. The Research Engineer will develop and run full-stack ML research, training, evaluation, and infrastructure pipelines, and collaborate with AI labs on frontier projects.

Responsibilities:

• Train reward models, classifiers, judges, and verifiers for subjective domains (e.g. design, writing, visual style)
• Develop frontier evaluations and benchmarks for subjective domains
• Run post-training experiments on open-source models to test new data formats and post-training techniques
• Setup the infrastructure to run this
• Collaborate with AI labs and creative experts to design pilots and experiments around taste
• Own the end to end pipeline
• Publish blogs and whitepapers