Evaluation (9 results) - AI Tools

Search results for "Evaluation"

Found 9 results (8 tools · 1 articles · 0 skills). Sorted by relevance by .

AI Tools (8)

FlagEval: The internationally authoritative large model evaluation system and Libra open platform

121
FlagEval: The internationally authoritative large model evaluation system and Libra open platform
AI Tools

FlagEval (Libra) is a large-scale model evaluation system and open platform initiated by Beijing Zhiyuan Artificial Intelligence Research Institute, aiming to establish scientific, fair, and open evaluation benchmarks and methods. The platform has innovatively constructed a three-dimensional

2026-05-31

CMMLU: Authoritative Chinese Language Model Knowledge Understanding Ability Evaluation Benchmark

109
CMMLU: Authoritative Chinese Language Model Knowledge Understanding Ability Evaluation Benchmark
AI Tools

CMMLU (Chinese Massive Multitask Language Understanding) is a large-scale language understanding benchmark designed specifically for the Chinese language context, covering 67 subject topics from beginner to advanced professional levels, including natural sciences, social sciences, engineering

2026-05-30

AGI Eval: A large model evaluation community and authoritative third-party evaluation platform

107
AGI Eval: A large model evaluation community and authoritative third-party evaluation platform
AI Tools

AGI Eval is a large model evaluation community jointly created by top universities and institutions such as Shanghai Jiao Tong University, Tongji University, East China Normal University, and DataWhale, with the mission of "assisting evaluation and making AI a better partner for humanity". The

2026-05-31

OpenCompass: An Open Source Large Model Comprehensive Evaluation System and Sinan Open Platform

92
OpenCompass: An Open Source Large Model Comprehensive Evaluation System and Sinan Open Platform
AI Tools

OpenCompass is an open-source large model evaluation system launched by Shanghai Artificial Intelligence Laboratory, providing one-stop evaluation services for large language models, multimodal models, and scientific intelligence models. The platform supports one click distributed evaluation of

2026-05-31

MMLU: The International Authoritative Benchmark for Multi Task Language Understanding Ability of

85
MMLU: The International Authoritative Benchmark for Multi Task Language Understanding Ability of
AI Tools

MMLU (Massive Multitask Language Understanding) is a large-scale multi task language understanding evaluation dataset jointly released by the University of California, Berkeley and other institutions. It covers 57 disciplinary fields, including humanities, social sciences, natural sciences,

2026-05-31

PromptPilot: A professional prompt optimization and automation tuning platform for AI instruction

85
PromptPilot: A professional prompt optimization and automation tuning platform for AI instruction
AI Tools

PromptPilot is a systematic prompt word engineering platform launched by Volcano Engine, aimed at addressing the pain point of "how to efficiently ask AI questions". It provides full lifecycle management covering Prompt generation, debugging, evaluation, and iteration, supports one click rewriting

2026-05-30

HELM: Stanford University led comprehensive evaluation framework for large language models and high

84
HELM: Stanford University led comprehensive evaluation framework for large language models and high
AI Tools

HELM (Holistic Evaluation of Language Models) is a comprehensive language model evaluation framework initiated by the Stanford University Center for Fundamental Model Research (CRFM), aimed at systematically evaluating large language models through multidimensional, standardized, and reproducible

2026-05-30

SuperCLUE—A benchmark for Chinese large models: from foundational capabilities to AI agents, a single test reveals who is "swimming naked."

7
SuperCLUE—A benchmark for Chinese large models: from foundational capabilities to AI agents, a single test reveals who is "swimming naked."
AI Tools

SuperCLUE is a comprehensive evaluation benchmark for general-purpose Chinese large models, released by the CLUE team. It provides authoritative, multi-dimensional capability assessments and rankings for Chinese large models by regularly publishing monthly and semi-annual reports based on three key benchmarks—open-domain multi-turn dialogue, closed-domain objective questions, and anonymous head-to-head battles—as well as dimensions such as mathematical reasoning, code generation, and AI agents.

2026-07-10

AI News (1)