Naive LLM judges are inconsistent. Run the same poem through twice and you get different scores (obviously, due to sampling). But lowering the temperature also doesn’t help much, as that’s only one of many technical issues. So, I developed a full scoring system, based on details on the logits outputs. It can get remarkably tricky. Think about a score from 1-10:
В Турции прокомментировали мирные переговоры по Украине 11 марта20:36。关于这个话题，新收录的资料提供了深入分析
most important steps:。关于这个话题，新收录的资料提供了深入分析
南方人物周刊：以杨本芬为例，她的作品涉嫌抄袭霍达的《穆斯林的葬礼》，你是怎么发现的？
«Локомотив» одержал победу в Западной конференции КХЛ20:44