U -d@sddlmZeGdddZddZeddGdd d ZeddGd d d ZeddGd d d ZddddgZdZdZ dZ dZ dZ dZ dZ dZddZddZddZd d!Zd"d#Zd$S)%) dataclassc@s2eZdZUeed<eed<eed<dZeed<dS) ColumnContentnametypeZdisplayed_by_defaultFhiddenN)__name__ __module__ __qualname__str__annotations__boolrr r g/apdcephfs_cq3/share_1290939/bohaoli/benchmark/hugging_face_leaderboard/SEED-Bench/src/utils_display.pyrs rcCsdd|jDS)NcSs4g|],\}}|dddkr|dddkr|qS)N__r ).0kvr r r szfields..)__dict__items)Z raw_classr r rfields srT)frozenc@seZdZedddZedddZedddZedddZed ddZed ddZ ed ddZ ed dd Z eddd dZ eddd Z eddd Zeddd Zeddd d ZedddZdS)AutoEvalColumnTr TModelmarkdownuAverage ⬆️numberZARCZ HellaSwagZMMLUZ TruthfulQATypeFZ Precisionz Hub Licensez #Params (B)u Hub ❤️z Model shaZmodel_name_for_queryN)rrr rZmodel_type_symbolmodelaveragearcZ hellaswagZmmluZ truthfulqa model_type precisionlicenseparamslikesrevisiondummyr r r rrs           rc@sHeZdZedddZedddZedddZedddZedddZd S) EloEvalColumnrrTz GPT-4 (all)rz Human (all)zHuman (instruct)zHuman (code-instruct)N) rrr rr Zgpt4Z human_allZhuman_instructZhuman_code_instructr r r rr* s     r*c@sTeZdZedddZedddZedddZedddZed dd Zed ddZ d S) EvalQueueColumnr rTr(r privater r$ weight_typeZOriginalstatusN) rrr rr r(r,r$r-r.r r r rr+)s      r+zhuggingface/llama-7bzhuggingface/llama-13bzhuggingface/llama-30bzhuggingface/llama-65bz,https://huggingface.co/TheBloke/koala-13B-HFz2https://huggingface.co/lmsys/vicuna-13b-delta-v1.1zEhttps://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5z.https://huggingface.co/databricks/dolly-v2-12bzhttps://huggingface.co/modelsz@https://ai.facebook.com/blog/large-language-model-llama-meta-ai/z7https://huggingface.co/CarperAI/stable-vicuna-13b-deltaz0https://crfm.stanford.edu/2023/03/13/alpaca.htmlcCsd|d|dS)Nzzr )link model_namer r rmodel_hyperlink?sr1cCsd|}|tkr&t}|dd}n"|dkr8t}d}n|dkrHt}d}|dkrVt}n(|d krdt}n|d krrt}n |d kr~t}t||S) Nzhttps://huggingface.co//z$HuggingFaceH4/stable-vicuna-13b-2904zstable-vicuna-13bz!HuggingFaceH4/llama-7b-ift-alpacaz alpaca-13bz dolly-12bz vicuna-13bz koala-13bz oasst-12b) LLAMAS LLAMA_LINKsplit VICUNA_LINK ALPACA_LINK DOLLY_LINK KOALA_LINK OASST_LINKr1)r0r/r r rmake_clickable_modelCs& r<cCs d|dS)Nz<



r )errorr r r styled_error\sr?cCs d|dS)Nz?

r=r )warnr r rstyled_warning_srAcCs d|dS)Nz>

r=r )messager r rstyled_messagebsrCN) dataclassesrrrrr*r+r4r:r7r;r9Z MODEL_PAGEr5r8r1r<r?rArCr r r rs.