Design and run experiments to explore new methods for evaluating Large Language Models (LLMs) and agents.
Investigate quality, factuality, safety, and compliance with specific requirements.
Develop experimental pipelines for LLM-as-a-Judge.
Perform quantitative analyses of experimental results, document findings, and propose methodological improvements.

Education: Master's degree
Fields of study: Computer Science, Computer Engineering, Information Systems, Data Science, Statistics, Applied Mathematics, or related areas in Computing, Artificial Intelligence, and Machine Learning.
Proficiency in Python programming.
Knowledge of Machine Learning and Deep Learning fundamentals.
Familiarity with Large Language Models (LLMs) and Generative AI.
Experience with AI model development libraries (PyTorch and/or Hugging Face Transformers).
Ability to read and comprehend scientific papers in English.

Master's Research Fellow – LLM, Model Evaluation, Python, Prompt Engineering

Key skills