InferencerΒΆ
Inferencer Classes
- BaseInferencer
- PPLInferencer
- GenInferencer
GenInferencerGenInferencer.modelGenInferencer.tokenizerGenInferencer.max_model_token_numGenInferencer.batch_sizeGenInferencer.acceleratorGenInferencer.output_json_filepathGenInferencer.output_json_filenameGenInferencer.api_nameGenInferencer.call_apiGenInferencer.gen_field_replace_tokenGenInferencer.generation_kwargsGenInferencer.inference()
- CoTInferencer
CoTInferencerCoTInferencer.modelCoTInferencer.tokenizerCoTInferencer.max_model_token_numCoTInferencer.batch_sizeCoTInferencer.acceleratorCoTInferencer.output_json_filepathCoTInferencer.output_json_filenameCoTInferencer.api_nameCoTInferencer.call_apiCoTInferencer.gen_field_replace_tokenCoTInferencer.generation_kwargsCoTInferencer.cot_listCoTInferencer.inference()