Your LLM Judge Changes Its Mind When You Swap the Order of the Answers
Author(s): Albatros Originally published on Towards AI. A five-minute test tells you whether your evaluation pipeline is measuring quality or measuring position. Photo by Elena Mozhvilo on UnsplashBeyond the initial prompt-order flip test, the article argues that LLM judge scores often reflect …