(env_hface) dhankar@dhankar-1:~/.../localGPT$ pip install auto-gptq==0.2.2
Collecting auto-gptq==0.2.2
Downloading auto_gptq-0.2.2.tar.gz (52 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 52.7/52.7 kB 495.9 kB/s eta 0:00:00
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [23 lines of output]
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "/tmp/pip-install-9oongqhw/auto-gptq_1d48fc6749a140afa00510500088c036/setup.py", line 70, in <module>
from torch.utils import cpp_extension
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 19, in <module>
from .hipify import hipify_python
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages/torch/utils/hipify/hipify_python.py", line 34, in <module>
from .cuda_to_hip_mappings import CUDA_TO_HIP_MAPPINGS
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages/torch/utils/hipify/cuda_to_hip_mappings.py", line 34, in <module>
rocm_path = subprocess.check_output(["hipconfig", "--rocmpath"]).decode("utf-8")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/subprocess.py", line 466, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/subprocess.py", line 548, in run
with Popen(*popenargs, **kwargs) as process:
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/subprocess.py", line 1026, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/home/dhankar/anaconda3/envs/env_hface/lib/python3.11/subprocess.py", line 1950, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
NotADirectoryError: [Errno 20] Not a directory: 'hipconfig'
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
(env_hface) dhankar@dhankar-1:~/.../localGPT$ pip install auto-gptq
Collecting auto-gptq
Obtaining dependency information for auto-gptq from https://files.pythonhosted.org/packages/38/d3/f404ee986f2e1f9fa744296365b0bfbbf3d3a779a2b2dc92e54e919ca297/auto_gptq-0.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Downloading auto_gptq-0.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (18 kB)
Requirement already satisfied: accelerate>=0.19.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (0.21.0)
Requirement already satisfied: datasets in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (2.14.3)
Requirement already satisfied: numpy in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (1.25.2)
Collecting rouge (from auto-gptq)
Downloading rouge-1.0.1-py3-none-any.whl (13 kB)
Requirement already satisfied: torch>=1.13.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (2.0.1)
Requirement already satisfied: safetensors in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (0.3.1)
Requirement already satisfied: transformers>=4.31.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (4.34.0.dev0)
Requirement already satisfied: peft in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from auto-gptq) (0.6.0.dev0)
Requirement already satisfied: packaging>=20.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from accelerate>=0.19.0->auto-gptq) (23.1)
Requirement already satisfied: psutil in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from accelerate>=0.19.0->auto-gptq) (5.9.5)
Requirement already satisfied: pyyaml in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from accelerate>=0.19.0->auto-gptq) (6.0.1)
Requirement already satisfied: filelock in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (3.12.2)
Requirement already satisfied: typing-extensions in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (4.7.1)
Requirement already satisfied: sympy in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (1.12)
Requirement already satisfied: networkx in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (3.1)
Requirement already satisfied: jinja2 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from torch>=1.13.0->auto-gptq) (2.0.0)
Requirement already satisfied: setuptools in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.13.0->auto-gptq) (68.0.0)
Requirement already satisfied: wheel in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.13.0->auto-gptq) (0.38.4)
Requirement already satisfied: cmake in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from triton==2.0.0->torch>=1.13.0->auto-gptq) (3.27.0)
Requirement already satisfied: lit in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from triton==2.0.0->torch>=1.13.0->auto-gptq) (16.0.6)
Requirement already satisfied: huggingface-hub<1.0,>=0.16.4 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from transformers>=4.31.0->auto-gptq) (0.16.4)
Requirement already satisfied: regex!=2019.12.17 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from transformers>=4.31.0->auto-gptq) (2023.6.3)
Requirement already satisfied: requests in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from transformers>=4.31.0->auto-gptq) (2.31.0)
Requirement already satisfied: tokenizers<0.15,>=0.14 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from transformers>=4.31.0->auto-gptq) (0.14.0)
Requirement already satisfied: tqdm>=4.27 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from transformers>=4.31.0->auto-gptq) (4.65.0)
Requirement already satisfied: pyarrow>=8.0.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (12.0.1)
Requirement already satisfied: dill<0.3.8,>=0.3.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (0.3.7)
Requirement already satisfied: pandas in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (2.0.3)
Requirement already satisfied: xxhash in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (3.3.0)
Requirement already satisfied: multiprocess in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (0.70.15)
Requirement already satisfied: fsspec[http]>=2021.11.1 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (2023.6.0)
Requirement already satisfied: aiohttp in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from datasets->auto-gptq) (3.8.5)
Requirement already satisfied: six in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from rouge->auto-gptq) (1.16.0)
Requirement already satisfied: attrs>=17.3.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (3.2.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (4.0.2)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (1.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from aiohttp->datasets->auto-gptq) (1.3.1)
Requirement already satisfied: idna<4,>=2.5 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from requests->transformers>=4.31.0->auto-gptq) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from requests->transformers>=4.31.0->auto-gptq) (1.26.16)
Requirement already satisfied: certifi>=2017.4.17 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from requests->transformers>=4.31.0->auto-gptq) (2023.7.22)
Requirement already satisfied: MarkupSafe>=2.0 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from jinja2->torch>=1.13.0->auto-gptq) (2.1.3)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from pandas->datasets->auto-gptq) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from pandas->datasets->auto-gptq) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from pandas->datasets->auto-gptq) (2023.3)
Requirement already satisfied: mpmath>=0.19 in /home/dhankar/anaconda3/envs/env_hface/lib/python3.11/site-packages (from sympy->torch>=1.13.0->auto-gptq) (1.3.0)
Downloading auto_gptq-0.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 15.4 MB/s eta 0:00:00
Installing collected packages: rouge, auto-gptq
Successfully installed auto-gptq-0.4.2 rouge-1.0.1
(env_hface) dhankar@dhankar-1:~/.../localGPT$
(env_hface) dhankar@dhankar-1:~/.../localGPT$
