gh@SSKJrJr SSKJrJr SSKr"SS5rg))DictAny) AutoTokenizer"AutoModelForSequenceClassificationNcL\rSrSrS S\4SjjrS\\\4S\\\44SjrSr g) EndpointHandlerpathc[R"[RR5(aSOS5Ul[R "U5Ul[R "U5UlURRUR5 URR5 URRRUl g)Ncudacpu) torchdevicer is_availablerfrom_pretrained tokenizerrmodeltoevalconfigid2label)selfr s @/home/ray/efs/team/kelly/query2pack/query_to_pack_toy/handler.py__init__EndpointHandler.__init__sllUZZ-D-D-F-F6ER &66t<7GGM  dkk"  ))22 datareturncURSS5nU(dSS0$URUSSSSS9nUR5VVs0sH upEXERUR5_M" nnn[ R "5 UR"S0UD6n[ R"URS S 9n[ R"US S 9R5nURRU5=(d$ URR[U55n US U4R5n SSS5 W [W S 5S .$s snnf!,(df  N#=f)NinputserrorzNo input provided.ptT)return_tensorspadding truncation max_length)dimr)label confidence)getritemsrrrno_gradrsoftmaxlogitsargmaxitemrstrround) rr input_textr kvoutputsprobs top_class_idtop_class_labeltop_class_probs r__call__EndpointHandler.__call__s(XXh+ 12 2    4:<<>B>41!TT$++&&>B ]]_jj*6*GMM'..b9E <<26;;=L"mm// =eARARSVWcSdAeO"1l?388:N %2  C _s'E B0E E)rrrrN).) __name__ __module__ __qualname____firstlineno__r6rrrr@__static_attributes__r.rrrrs13S3 T#s(^ S#X rr)typingrr transformersrrrrr.rrrJsJ # # r