a d@sUdZddlmZddlmZddlmZddlmZddl m Z m Z ddl m Z ddlmZmZmZmZdd lmZmZmZmZmZmZmZmZdd lmZdd lmZgd gd dZ de!d<e"e#de$gddZ%eddGdddZ&e&dddde&dddde&dddde&d ddde&d!dd"de&d#d$d"de&d%d&d"de&d%d&d"dege&d'd'e&d(d(e&d)d)d* Z'egZ(eZ)eeeeee eeeee eeeee gZ*d"S)+zConfig for analyzing GPT-MT.) annotations)Callable) dataclass)input_capital_char_ratio)avg_exact_match exact_match)output_max_word_freq)doc_context_length input_length label_length output_length)avg_bert_scoreavg_chrf avg_cometavg_length_ratio bert_scorechrfcomet length_ratio) search_space)remove_leading_language)ZcsendeendefrZencsendeZenhaZenisZenjaenruZenukenzhfrdeZhaenZisenZjaenruenZukenzhen)rrrrrrrr)all_lang_pairsZlimited_lang_pairszdict[str, list[str]] lang_pairsr) text-davinci-003-zeroshottext-davinci-003-RR-1-shottext-davinci-003-RR-5-shottext-davinci-003-QR-1-shottext-davinci-003-QR-5-shotgpt-3.5-turbo-0301-zeroshotgpt-4-0314-zeroshotgpt-4-0314-zeroshot-postprocess MS-Translator google-cloudwmt-best)r model_presetT)frozenc@sFeZdZUdZded<ded<dZded<dZded <dZd ed <dS) GptMtConfigzConfig for gpt-MT models.strpathZ base_modelNz str | Noneprompt_strategyz int | None prompt_shotsz!list[Callable[[str], str]] | Nonepost_processors)__name__ __module__ __qualname____doc____annotations__r1r2r3r9r9S/Users/acabrera/dev-research/22-zeno/demos/huggingface/translation-report/config.pyr.Ys   r.ztext-davinci-003/RR/1-shotztext-davinci-003ZRRztext-davinci-003/RR/5-shotztext-davinci-003/QR/1-shotQRztext-davinci-003/QR/5-shotztext-davinci-003/zeroshotNzgpt-3.5-turbo-0301/zeroshotzgpt-3.5-turbo-0301zgpt-4-0314/zeroshotz gpt-4-0314r)r*r+) r"r#r$r%r!r&r'r(r)r*r+)+r7 __future__rcollections.abcr dataclassesrZ2zeno_build.evaluation.text_features.capitalizationrZ/zeno_build.evaluation.text_features.exact_matchrrZ-zeno_build.evaluation.text_features.frequencyrZ*zeno_build.evaluation.text_features.lengthr r r r Z+zeno_build.evaluation.text_metrics.critiquer rrrrrrrzeno_build.experimentsrmodelingrr r8CombinatorialSearchSpaceConstant Categorical main_spacer.Z model_configsZsweep_distill_functionsZsweep_metric_function!zeno_distill_and_metric_functionsr9r9r9r:s     (  $