'AsyncRequest' object has no attribute '_json_response_data'
(.env) girish@mypc:/media/girish/Lekha/Phind-CodeLlama-34B-v2-GPTQ/oobabooga_linux/one-click-installers/text-generation-webui$ python server.py
2023-09-08 05:31:34.088192: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-09-08 05:31:35.359894: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
2023-09-08 05:31:37 INFO:Loading the extension "gallery"...
Running on local URL: http://127.0.0.1:7860
To create a public link, set share=True in launch().
2023-09-08 05:32:06 INFO:Loading TheBloke_Phind-CodeLlama-34B-v2-GPTQ_gptq-4bit-32g-actorder_True...
2023-09-08 05:32:07 INFO:The AutoGPTQ params are: {'model_basename': 'model', 'device': 'cuda:0', 'use_triton': False, 'inject_fused_attention': True, 'inject_fused_mlp': True, 'use_safetensors': True, 'trust_remote_code': False, 'max_memory': None, 'quantize_config': None, 'use_cuda_fp16': True, 'disable_exllama': False}
'AsyncRequest' object has no attribute '_json_response_data'
Killed
Python version 3.11.4
Ubuntu 23.04
When I tries to add the model, it get failed by above error message.