残念ながら必要なライブラリSentencePieceのビルドに失敗するようだ。
情報源
コード
パスを定義する。
PATH_TEST_REPO='/tmp/work/test_tukuyomi_repo/' PATH_TUKUYOMI='/tmp/work/' mkdir -p "$PATH_TEST_REPO" mkdir -p "$PATH_TUKUYOMI"
つくよみちゃんトークソフトのコードを入手する。
cd "$PATH_TUKUYOMI" git clone https://github.com/shirowanisan/tsukuyomichan-talksoft
仮想環境をつくってそこにインストールする。
cd "$PATH_TEST_REPO" python3 -m venv env . ./env/bin/activate pip install -r "${PATH_TUKUYOMI}tsukuyomichan-talksoft/requirements.txt"
エラーになった。以下、インストールログ。
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple Collecting espnet==0.9.7 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/5b/5b/7e294397e50ccd938f62810abe68c20e0677933b50dac3402dfa532e646b/espnet-0.9.7-py3-none-any.whl (723kB) 100% |████████████████████████████████| 727kB 489kB/s Collecting parallel_wavegan==0.4.8 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 2)) Downloading https://www.piwheels.org/simple/parallel-wavegan/parallel_wavegan-0.4.8-py3-none-any.whl (54kB) 100% |████████████████████████████████| 61kB 107kB/s Collecting pyopenjtalk==0.1.0 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 3)) Downloading https://www.piwheels.org/simple/pyopenjtalk/pyopenjtalk-0.1.0-cp37-cp37m-linux_armv7l.whl (5.4MB) 100% |████████████████████████████████| 5.4MB 61kB/s Collecting simpleaudio==1.0.4 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 4)) Using cached https://www.piwheels.org/simple/simpleaudio/simpleaudio-1.0.4-cp37-cp37m-linux_armv7l.whl Collecting gdown (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 5)) Downloading https://www.piwheels.org/simple/gdown/gdown-3.13.0-py3-none-any.whl Collecting wandb (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/e0/b4/9d92953d8cddc8450c859be12e3dbdd4c7754fb8def94c28b3b351c6ee4e/wandb-0.10.32-py2.py3-none-any.whl (1.8MB) 100% |████████████████████████████████| 1.8MB 193kB/s Collecting matplotlib==3.1.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/matplotlib/matplotlib-3.1.0-cp37-cp37m-linux_armv7l.whl (11.6MB) 100% |████████████████████████████████| 11.7MB 32kB/s Collecting tensorboardX>=1.8 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/07/84/46421bd3e0e89a92682b1a38b40efc22dafb6d8e3d947e4ceefd4a5fabc7/tensorboardX-2.2-py2.py3-none-any.whl (120kB) 100% |████████████████████████████████| 122kB 1.1MB/s Collecting editdistance==0.5.2 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/editdistance/editdistance-0.5.2-cp37-cp37m-linux_armv7l.whl (220kB) 100% |████████████████████████████████| 225kB 283kB/s Collecting ctc-segmentation>=1.4.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/ctc-segmentation/ctc_segmentation-1.6.7-cp37-cp37m-linux_armv7l.whl (129kB) 100% |████████████████████████████████| 133kB 313kB/s Collecting typeguard>=2.7.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/a0/88/2a1613174e7d05540358b2f19881f369bfe6ba737f0a673177e69eb623df/typeguard-2.12.1-py3-none-any.whl Requirement already satisfied: setuptools>=38.5.1 in ./env/lib/python3.7/site-packages (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) (40.8.0) Collecting tensorboard>=1.14 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/44/f5/7feea02a3fb54d5db827ac4b822a7ba8933826b36de21880518250b8733a/tensorboard-2.5.0-py3-none-any.whl (6.0MB) 100% |████████████████████████████████| 6.0MB 72kB/s Collecting PyYAML>=5.1.2 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/pyyaml/PyYAML-5.4.1-cp37-cp37m-linux_armv7l.whl (45kB) 100% |████████████████████████████████| 51kB 94kB/s Collecting h5py>=2.10.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/h5py/h5py-3.2.1-cp37-cp37m-linux_armv7l.whl (5.4MB) 100% |████████████████████████████████| 5.4MB 66kB/s Collecting torch-complex (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/81/eb/2af6146200534f83f5695fefe21a61234203fb2c6bbe9d8b7ca87636fbf1/torch_complex-0.2.1-py3-none-any.whl Collecting scipy>=1.4.1 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/scipy/scipy-1.7.0-cp37-cp37m-linux_armv7l.whl (64.8MB) 100% |████████████████████████████████| 64.8MB 5.9kB/s Collecting configargparse>=1.2.1 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/e8/a2/b6947a20b67c64b080b999badd231ff4785d1c709a66cfaf8d5e70811a14/ConfigArgParse-1.4.1-py3-none-any.whl Collecting nara-wpe>=0.0.5 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/4b/d4/11dddfd5f41017df8eda83cbcafab14ba8bf32d23e7697bf9d2bd343d979/nara_wpe-0.0.7-py3-none-any.whl Collecting pillow>=6.1.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/pillow/Pillow-8.2.0-cp37-cp37m-linux_armv7l.whl (1.3MB) 100% |████████████████████████████████| 1.3MB 161kB/s Collecting nltk>=3.4.5 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/5e/37/9532ddd4b1bbb619333d5708aaad9bf1742f051a664c3c6fa6632a105fd8/nltk-3.6.2-py3-none-any.whl (1.5MB) 100% |████████████████████████████████| 1.5MB 256kB/s Collecting humanfriendly (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/92/7e/a06472f484fa589933f39bfb41a7b849ca49f6d8e4fdfe978e27f0e3075c/humanfriendly-9.2-py2.py3-none-any.whl (86kB) 100% |████████████████████████████████| 92kB 1.5MB/s Collecting soundfile>=0.10.2 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/eb/f2/3cbbbf3b96fb9fa91582c438b574cff3f45b29c772f94c400e2c99ef5db9/SoundFile-0.10.3.post1-py2.py3-none-any.whl Collecting sentencepiece<0.1.90,>=0.1.82 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/2c/2f/d018c659de3983277962bb64b9f4cb105f96f7fcc73e33b6603fb50b1f00/sentencepiece-0.1.86.tar.gz (495kB) 100% |████████████████████████████████| 501kB 643kB/s Complete output from command python setup.py egg_info: Package sentencepiece was not found in the pkg-config search path. Perhaps you should add the directory containing `sentencepiece.pc' to the PKG_CONFIG_PATH environment variable No package 'sentencepiece' found Failed to find sentencepiece pkgconfig ---------------------------------------- Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-di1lw1_9/sentencepiece/
sudo apt-get install cmake build-essential pkg-config libgoogle-perftools-dev
pkg-configというツールを事前にインストールしておく必要があったようだ。
再度インストール。
pip install -r "${PATH_TUKUYOMI}tsukuyomichan-talksoft/requirements.txt"
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple Collecting espnet==0.9.7 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Using cached https://files.pythonhosted.org/packages/5b/5b/7e294397e50ccd938f62810abe68c20e0677933b50dac3402dfa532e646b/espnet-0.9.7-py3-none-any.whl Collecting parallel_wavegan==0.4.8 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 2)) Using cached https://www.piwheels.org/simple/parallel-wavegan/parallel_wavegan-0.4.8-py3-none-any.whl Collecting pyopenjtalk==0.1.0 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 3)) Using cached https://www.piwheels.org/simple/pyopenjtalk/pyopenjtalk-0.1.0-cp37-cp37m-linux_armv7l.whl Collecting simpleaudio==1.0.4 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 4)) Using cached https://www.piwheels.org/simple/simpleaudio/simpleaudio-1.0.4-cp37-cp37m-linux_armv7l.whl Collecting gdown (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 5)) Using cached https://www.piwheels.org/simple/gdown/gdown-3.13.0-py3-none-any.whl Collecting soundfile>=0.10.2 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/eb/f2/3cbbbf3b96fb9fa91582c438b574cff3f45b29c772f94c400e2c99ef5db9/SoundFile-0.10.3.post1-py2.py3-none-any.whl Collecting nltk>=3.4.5 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/5e/37/9532ddd4b1bbb619333d5708aaad9bf1742f051a664c3c6fa6632a105fd8/nltk-3.6.2-py3-none-any.whl (1.5MB) 100% |████████████████████████████████| 1.5MB 256kB/s Collecting typeguard>=2.7.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/a0/88/2a1613174e7d05540358b2f19881f369bfe6ba737f0a673177e69eb623df/typeguard-2.12.1-py3-none-any.whl Collecting PyYAML>=5.1.2 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://www.piwheels.org/simple/pyyaml/PyYAML-5.4.1-cp37-cp37m-linux_armv7l.whl (45kB) 100% |████████████████████████████████| 51kB 92kB/s Collecting humanfriendly (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/92/7e/a06472f484fa589933f39bfb41a7b849ca49f6d8e4fdfe978e27f0e3075c/humanfriendly-9.2-py2.py3-none-any.whl (86kB) 100% |████████████████████████████████| 92kB 2.2MB/s Collecting wandb (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Using cached https://files.pythonhosted.org/packages/e0/b4/9d92953d8cddc8450c859be12e3dbdd4c7754fb8def94c28b3b351c6ee4e/wandb-0.10.32-py2.py3-none-any.whl Collecting configargparse>=1.2.1 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/e8/a2/b6947a20b67c64b080b999badd231ff4785d1c709a66cfaf8d5e70811a14/ConfigArgParse-1.4.1-py3-none-any.whl Collecting matplotlib==3.1.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Exception: Traceback (most recent call last): File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 143, in main status = self.run(options, args) File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 338, in run resolver.resolve(requirement_set) File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/resolve.py", line 102, in resolve self._resolve_one(requirement_set, req) File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/resolve.py", line 256, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/resolve.py", line 209, in _get_abstract_dist_for self.require_hashes File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 283, in prepare_linked_requirement progress_bar=self.progress_bar File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/download.py", line 836, in unpack_url progress_bar=progress_bar File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/download.py", line 673, in unpack_http_url progress_bar) File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/download.py", line 868, in _download_http_url stream=True, File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/requests-2.21.0-py2.py3-none-any.whl/requests/sessions.py", line 546, in get return self.request('GET', url, **kwargs) File "/tmp/work/test_tukuyomi_repo/env/lib/python3.7/site-packages/pip/_internal/download.py", line 396, in request return super(PipSession, self).request(method, url, *args, **kwargs) File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/requests-2.21.0-py2.py3-none-any.whl/requests/sessions.py", line 533, in request resp = self.send(prep, **send_kwargs) File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/requests-2.21.0-py2.py3-none-any.whl/requests/sessions.py", line 646, in send r = adapter.send(request, **kwargs) File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/CacheControl-0.11.7-py2.py3-none-any.whl/cachecontrol/adapter.py", line 37, in send cached_response = self.controller.cached_request(request) File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/CacheControl-0.11.7-py2.py3-none-any.whl/cachecontrol/controller.py", line 111, in cached_request resp = self.serializer.loads(request, cache_data) File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/CacheControl-0.11.7-py2.py3-none-any.whl/cachecontrol/serialize.py", line 114, in loads return getattr(self, "_loads_v{0}".format(ver))(request, data) File "/tmp/work/test_tukuyomi_repo/env/share/python-wheels/CacheControl-0.11.7-py2.py3-none-any.whl/cachecontrol/serialize.py", line 176, in _loads_v2 cached = json.loads(zlib.decompress(data).decode("utf8")) zlib.error: Error -5 while decompressing data: incomplete or truncated stream
matplotlibでエラーになったのか？ それだけ個別に入れてみる。
pip install matplotlib
あれ、成功したぞ？
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple Collecting matplotlib Downloading https://www.piwheels.org/simple/matplotlib/matplotlib-3.4.2-cp37-cp37m-linux_armv7l.whl (10.2MB) 100% |████████████████████████████████| 10.3MB 37kB/s Collecting kiwisolver>=1.0.1 (from matplotlib) Downloading https://www.piwheels.org/simple/kiwisolver/kiwisolver-1.3.1-cp37-cp37m-linux_armv7l.whl (1.4MB) 100% |████████████████████████████████| 1.4MB 278kB/s Collecting python-dateutil>=2.7 (from matplotlib) Downloading https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl (227kB) 100% |████████████████████████████████| 235kB 1.0MB/s Collecting pyparsing>=2.2.1 (from matplotlib) Downloading https://files.pythonhosted.org/packages/8a/bb/488841f56197b13700afd5658fc279a2025a39e22449b7cf29864669b15d/pyparsing-2.4.7-py2.py3-none-any.whl (67kB) 100% |████████████████████████████████| 71kB 1.5MB/s Collecting cycler>=0.10 (from matplotlib) Downloading https://files.pythonhosted.org/packages/f7/d2/e07d3ebb2bd7af696440ce7e754c59dd546ffe1bbe732c8ab68b9c834e61/cycler-0.10.0-py2.py3-none-any.whl Collecting numpy>=1.16 (from matplotlib) Using cached https://www.piwheels.org/simple/numpy/numpy-1.20.3-cp37-cp37m-linux_armv7l.whl Collecting pillow>=6.2.0 (from matplotlib) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://www.piwheels.org/simple/pillow/Pillow-8.2.0-cp37-cp37m-linux_armv7l.whl (1.3MB) 100% |████████████████████████████████| 1.3MB 272kB/s Collecting six>=1.5 (from python-dateutil>=2.7->matplotlib) Using cached https://files.pythonhosted.org/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl Installing collected packages: kiwisolver, six, python-dateutil, pyparsing, cycler, numpy, pillow, matplotlib Successfully installed cycler-0.10.0 kiwisolver-1.3.1 matplotlib-3.4.2 numpy-1.20.3 pillow-8.2.0 pyparsing-2.4.7 python-dateutil-2.8.1 six-1.16.0
まあいいや。とにかく再度インストール。
pip install -r "${PATH_TUKUYOMI}tsukuyomichan-talksoft/requirements.txt"
え？ またsentencepieceでエラーになったんだけど？
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple Collecting espnet==0.9.7 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Using cached https://files.pythonhosted.org/packages/5b/5b/7e294397e50ccd938f62810abe68c20e0677933b50dac3402dfa532e646b/espnet-0.9.7-py3-none-any.whl Collecting parallel_wavegan==0.4.8 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 2)) Using cached https://www.piwheels.org/simple/parallel-wavegan/parallel_wavegan-0.4.8-py3-none-any.whl Collecting pyopenjtalk==0.1.0 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 3)) Using cached https://www.piwheels.org/simple/pyopenjtalk/pyopenjtalk-0.1.0-cp37-cp37m-linux_armv7l.whl Collecting simpleaudio==1.0.4 (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 4)) Using cached https://www.piwheels.org/simple/simpleaudio/simpleaudio-1.0.4-cp37-cp37m-linux_armv7l.whl Collecting gdown (from -r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 5)) Using cached https://www.piwheels.org/simple/gdown/gdown-3.13.0-py3-none-any.whl Collecting librosa>=0.8.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://files.pythonhosted.org/packages/54/19/a0e2bdc94bc0d1555e4f9bc4099a0751da83fa6e1e6157ec005564f8a98a/librosa-0.8.1-py3-none-any.whl (203kB) 100% |████████████████████████████████| 204kB 1.1MB/s Collecting configargparse>=1.2.1 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/e8/a2/b6947a20b67c64b080b999badd231ff4785d1c709a66cfaf8d5e70811a14/ConfigArgParse-1.4.1-py3-none-any.whl Collecting torch-complex (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/81/eb/2af6146200534f83f5695fefe21a61234203fb2c6bbe9d8b7ca87636fbf1/torch_complex-0.2.1-py3-none-any.whl Collecting kaldiio>=2.17.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/kaldiio/kaldiio-2.17.2-py3-none-any.whl Collecting pyworld>=0.2.10 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Downloading https://www.piwheels.org/simple/pyworld/pyworld-0.3.0-cp37-cp37m-linux_armv7l.whl (718kB) 100% |████████████████████████████████| 727kB 198kB/s Collecting humanfriendly (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/92/7e/a06472f484fa589933f39bfb41a7b849ca49f6d8e4fdfe978e27f0e3075c/humanfriendly-9.2-py2.py3-none-any.whl (86kB) 100% |████████████████████████████████| 92kB 561kB/s Collecting wandb (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Using cached https://files.pythonhosted.org/packages/e0/b4/9d92953d8cddc8450c859be12e3dbdd4c7754fb8def94c28b3b351c6ee4e/wandb-0.10.32-py2.py3-none-any.whl Collecting editdistance==0.5.2 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://www.piwheels.org/simple/editdistance/editdistance-0.5.2-cp37-cp37m-linux_armv7l.whl (220kB) 100% |████████████████████████████████| 225kB 299kB/s Collecting h5py>=2.10.0 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://www.piwheels.org/simple/h5py/h5py-3.2.1-cp37-cp37m-linux_armv7l.whl (5.4MB) 100% |████████████████████████████████| 5.4MB 66kB/s Collecting nara-wpe>=0.0.5 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/4b/d4/11dddfd5f41017df8eda83cbcafab14ba8bf32d23e7697bf9d2bd343d979/nara_wpe-0.0.7-py3-none-any.whl Collecting sentencepiece<0.1.90,>=0.1.82 (from espnet==0.9.7->-r /tmp/work/tsukuyomichan-talksoft/requirements.txt (line 1)) Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Cache entry deserialization failed, entry ignored Downloading https://files.pythonhosted.org/packages/2c/2f/d018c659de3983277962bb64b9f4cb105f96f7fcc73e33b6603fb50b1f00/sentencepiece-0.1.86.tar.gz (495kB) 100% |████████████████████████████████| 501kB 701kB/s Complete output from command python setup.py egg_info: Package sentencepiece was not found in the pkg-config search path. Perhaps you should add the directory containing `sentencepiece.pc' to the PKG_CONFIG_PATH environment variable No package 'sentencepiece' found Failed to find sentencepiece pkgconfig ---------------------------------------- Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-t1k9amtg/sentencepiece/
ならsentencepieceだけ個別に入れてみる。
$ pip install sentencepiece
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting sentencepiece
Cache entry deserialization failed, entry ignored
Cache entry deserialization failed, entry ignored
Downloading https://files.pythonhosted.org/packages/aa/71/bb7d64dcd80a6506146397bca7310d5a8684f0f9ef035f03affb657f1aec/sentencepiece-0.1.96.tar.gz (508kB)
100% |████████████████████████████████| 512kB 688kB/s
Building wheels for collected packages: sentencepiece
Running setup.py bdist_wheel for sentencepiece ... error
Complete output from command /tmp/work/test_tukuyomi_repo/env/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-onxq655j/sentencepiece/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/pip-wheel-s538vupw --python-tag cp37:
usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: -c --help [cmd1 cmd2 ...]
or: -c --help-commands
or: -c cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
Failed building wheel for sentencepiece
Running setup.py clean for sentencepiece
Failed to build sentencepiece
pipが古いのが原因らしい。なのでpipをアップデートする。
pip install --upgrade pip
... Successfully installed pip-21.1.2
再度sentencepieceを入れようとする。
pip install sentencepiece
エラー。くそ長い。
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple Collecting sentencepiece WARNING: Cache entry deserialization failed, entry ignored Downloading sentencepiece-0.1.96.tar.gz (508 kB) |████████████████████████████████| 508 kB 1.5 MB/s Using legacy 'setup.py install' for sentencepiece, since package 'wheel' is not installed. Installing collected packages: sentencepiece Running setup.py install for sentencepiece ... error ERROR: Command errored out with exit status 1: command: /tmp/work/test_tukuyomi_repo/env/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-wu509ewz/install-record.txt --single-version-externally-managed --compile --install-headers /tmp/work/test_tukuyomi_repo/env/include/site/python3.7/sentencepiece cwd: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/ Complete output (529 lines): running install running build running build_py creating build creating build/lib.linux-armv7l-3.7 creating build/lib.linux-armv7l-3.7/sentencepiece copying src/sentencepiece/__init__.py -> build/lib.linux-armv7l-3.7/sentencepiece copying src/sentencepiece/sentencepiece_model_pb2.py -> build/lib.linux-armv7l-3.7/sentencepiece copying src/sentencepiece/sentencepiece_pb2.py -> build/lib.linux-armv7l-3.7/sentencepiece running build_ext Package sentencepiece was not found in the pkg-config search path. Perhaps you should add the directory containing `sentencepiece.pc' to the PKG_CONFIG_PATH environment variable No package 'sentencepiece' found Cloning into 'sentencepiece'... Note: checking out 'd8711f55d9b2cb9c77a00adcc18108482b29b675'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by performing another checkout. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -b with the checkout command again. Example: git checkout -b <new-branch-name> -- VERSION: 0.1.96 -- The C compiler identification is GNU 8.3.0 -- The CXX compiler identification is GNU 8.3.0 -- Check for working C compiler: /usr/bin/cc -- Check for working C compiler: /usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /usr/bin/c++ -- Check for working CXX compiler: /usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- Looking for pthread.h -- Looking for pthread.h - found -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE -- Found TCMalloc: /usr/lib/arm-linux-gnueabihf/libtcmalloc_minimal.so -- Configuring done -- Generating done -- Build files have been written to: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/build Scanning dependencies of target sentencepiece-static Scanning dependencies of target sentencepiece_train-static [ 1%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/arenastring.cc.o [ 3%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/arena.cc.o [ 4%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/bytestream.cc.o [ 6%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/builder.cc.o [ 7%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/unicode_script.cc.o [ 9%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/trainer_factory.cc.o [ 11%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/coded_stream.cc.o [ 12%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/common.cc.o [ 14%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/trainer_interface.cc.o [ 15%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/extension_set.cc.o [ 17%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/unigram_model_trainer.cc.o In file included from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/trainer_interface.cc:15: /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__unguarded_linear_insert(_RandomAccessIterator, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Compare = __gnu_cxx::__ops::_Val_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1821:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __unguarded_linear_insert(_RandomAccessIterator __last, ^~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__insertion_sort(_RandomAccessIterator, _RandomAccessIterator, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1840:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __insertion_sort(_RandomAccessIterator __first, ^~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1840:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 In file included from /usr/include/c++/8/bits/stl_algo.h:61, from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/trainer_interface.cc:15: /usr/include/c++/8/bits/stl_heap.h: In function ‘void std::__adjust_heap(_RandomAccessIterator, _Distance, _Distance, _Tp, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Distance = int; _Tp = std::pair<std::__cxx11::basic_string<char>, long long int>; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_heap.h:214:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __adjust_heap(_RandomAccessIterator __first, _Distance __holeIndex, ^~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/trainer_interface.cc:21: /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, long long int>&}; _Tp = std::pair<std::__cxx11::basic_string<char>, long long int>; _Alloc = std::allocator<std::pair<std::__cxx11::basic_string<char>, long long int> >]’: /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> >::iterator’ {aka ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’} changed in GCC 7.1 vector<_Tp, _Alloc>:: ^~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::emplace_back(_Args&& ...) [with _Args = {const std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, long long int>&}; _Tp = std::pair<std::__cxx11::basic_string<char>, long long int>; _Alloc = std::allocator<std::pair<std::__cxx11::basic_string<char>, long long int> >]’: /usr/include/c++/8/bits/vector.tcc:109:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 _M_realloc_insert(end(), std::forward<_Args>(__args)...); ^~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/bits/stl_algo.h:61, from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/trainer_interface.cc:15: /usr/include/c++/8/bits/stl_heap.h: In function ‘void std::__make_heap(_RandomAccessIterator, _RandomAccessIterator, _Compare&) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_heap.h:326:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __make_heap(_RandomAccessIterator __first, _RandomAccessIterator __last, ^~~~~~~~~~~ /usr/include/c++/8/bits/stl_heap.h:326:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_heap.h:326:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 In file included from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/trainer_interface.cc:15: /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__introsort_loop(_RandomAccessIterator, _RandomAccessIterator, _Size, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Size = int; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __introsort_loop(_RandomAccessIterator __first, ^~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h:1954:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__introsort_loop(__cut, __last, __depth_limit, __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1672:23: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__make_heap(__first, __middle, __comp); ~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h: In function ‘std::vector<std::pair<_T1, _T2> > sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]’: /usr/include/c++/8/bits/stl_algo.h:1968:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__introsort_loop(__first, __last, ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ std::__lg(__last - __first) * 2, ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ __comp); ~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1885:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__insertion_sort(__first, __first + int(_S_threshold), __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1890:23: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__insertion_sort(__first, __last, __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:64, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/trainer_interface.cc:21: /usr/include/c++/8/bits/stl_vector.h: In member function ‘sentencepiece::util::Status sentencepiece::TrainerInterface::LoadSentences()’: /usr/include/c++/8/bits/stl_vector.h:1085:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 _M_realloc_insert(end(), __x); ^~~~~~~~~~~~~~~~~ [ 19%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/generated_enum_util.cc.o [ 20%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/word_model_trainer.cc.o [ 22%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/generated_message_table_driven_lite.cc.o In file included from /usr/include/c++/8/bits/stl_algo.h:61, from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:15: /usr/include/c++/8/bits/stl_heap.h: In function ‘void std::__adjust_heap(_RandomAccessIterator, _Distance, _Distance, _Tp, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >; _Distance = int; _Tp = std::pair<long long int, long long int>; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = long long int; V = long long int]::<lambda(const std::pair<long long int, long long int>&, const std::pair<long long int, long long int>&)> >]’: /usr/include/c++/8/bits/stl_heap.h:214:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 __adjust_heap(_RandomAccessIterator __first, _Distance __holeIndex, ^~~~~~~~~~~~~ In file included from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:15: /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__insertion_sort(_RandomAccessIterator, _RandomAccessIterator, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = long long int; V = long long int]::<lambda(const std::pair<long long int, long long int>&, const std::pair<long long int, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1840:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 __insertion_sort(_RandomAccessIterator __first, ^~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1840:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__unguarded_linear_insert(_RandomAccessIterator, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Compare = __gnu_cxx::__ops::_Val_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1821:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __unguarded_linear_insert(_RandomAccessIterator __last, ^~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__insertion_sort(_RandomAccessIterator, _RandomAccessIterator, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1840:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __insertion_sort(_RandomAccessIterator __first, ^~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1840:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 In file included from /usr/include/c++/8/bits/stl_algo.h:61, from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:15: /usr/include/c++/8/bits/stl_heap.h: In function ‘void std::__adjust_heap(_RandomAccessIterator, _Distance, _Distance, _Tp, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Distance = int; _Tp = std::pair<std::__cxx11::basic_string<char>, long long int>; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_heap.h:214:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __adjust_heap(_RandomAccessIterator __first, _Distance __holeIndex, ^~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {long long int&, const long long int&}; _Tp = std::pair<long long int, long long int>; _Alloc = std::allocator<std::pair<long long int, long long int> >]’: /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > >::iterator’ {aka ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’} changed in GCC 7.1 vector<_Tp, _Alloc>:: ^~~~~~~~~~~~~~~~~~~ In file included from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:33, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:30: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘void saisxx_private::induceSA(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<unsigned int*, std::vector<unsigned int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = long long int*; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 induceSA(string_type T, sarray_type SA, bucket_type C, bucket_type B, ^~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘void saisxx_private::induceSA(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<unsigned int*, std::vector<unsigned int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘int saisxx_private::computeBWT(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<unsigned int*, std::vector<unsigned int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = long long int*; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 computeBWT(string_type T, sarray_type SA, bucket_type C, bucket_type B, ^~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘int saisxx_private::computeBWT(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<unsigned int*, std::vector<unsigned int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const std::pair<long long int, long long int>&}; _Tp = std::pair<long long int, long long int>; _Alloc = std::allocator<std::pair<long long int, long long int> >]’: /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > >::iterator’ {aka ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’} changed in GCC 7.1 vector<_Tp, _Alloc>:: ^~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > >::iterator’ {aka ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’} changed in GCC 7.1 [ 23%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/generated_message_util.cc.o In file included from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:33, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:30: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘void saisxx_private::induceSA(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = long long int*; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 induceSA(string_type T, sarray_type SA, bucket_type C, bucket_type B, ^~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘void saisxx_private::induceSA(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:88:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘int saisxx_private::computeBWT(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = long long int*; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 computeBWT(string_type T, sarray_type SA, bucket_type C, bucket_type B, ^~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘int saisxx_private::computeBWT(string_type, sarray_type, bucket_type, bucket_type, index_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; bucket_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:121:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘int saisxx_private::suffixsort(string_type, sarray_type, index_type, index_type, index_type, bool) [with string_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:162:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 suffixsort(string_type T, sarray_type SA, ^~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:162:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:162:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:193:13: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 induceSA(T, SA, C, B, n, k); ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:208:13: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 induceSA(T, SA, C, B, n, k); ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:208:13: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:260:18: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 if(suffixsort(RA, SA, fs + n - m * 2, m, name, false) != 0) { return -2; } ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:286:34: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 if(isbwt == false) { induceSA(T, SA, C, B, n, k); } ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:287:29: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 else { pidx = computeBWT(T, SA, C, B, n, k); } ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:303:34: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 if(isbwt == false) { induceSA(T, SA, C, B, n, k); } ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:303:34: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:304:29: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 else { pidx = computeBWT(T, SA, C, B, n, k); } ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:304:29: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In function ‘int saisxx_private::suffixsort(string_type, sarray_type, index_type, index_type, index_type, bool) [with string_type = __gnu_cxx::__normal_iterator<unsigned int*, std::vector<unsigned int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:162:1: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 suffixsort(string_type T, sarray_type SA, ^~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:193:13: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 induceSA(T, SA, C, B, n, k); ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:208:13: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 induceSA(T, SA, C, B, n, k); ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:208:13: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:260:18: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 if(suffixsort(RA, SA, fs + n - m * 2, m, name, false) != 0) { return -2; } ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:286:34: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 if(isbwt == false) { induceSA(T, SA, C, B, n, k); } ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:287:29: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 else { pidx = computeBWT(T, SA, C, B, n, k); } ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:303:34: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 if(isbwt == false) { induceSA(T, SA, C, B, n, k); } ~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:303:34: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:304:29: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 else { pidx = computeBWT(T, SA, C, B, n, k); } ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:304:29: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {std::pair<long long int, long long int>}; _Tp = std::pair<long long int, long long int>; _Alloc = std::allocator<std::pair<long long int, long long int> >]’: /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > >::iterator’ {aka ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’} changed in GCC 7.1 vector<_Tp, _Alloc>:: ^~~~~~~~~~~~~~~~~~~ In file included from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:30: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx: In function ‘index_type esaxx_private::suffixtree(string_type, sarray_type, sarray_type, sarray_type, sarray_type, index_type) [with string_type = __gnu_cxx::__normal_iterator<unsigned int*, std::vector<unsigned int> >; sarray_type = __gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >; index_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:37:12: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 index_type suffixtree(string_type T, sarray_type SA, sarray_type L, sarray_type R, sarray_type D, index_type n){ ^~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:37:12: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:37:12: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:37:12: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/vector.tcc:109:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 _M_realloc_insert(end(), std::forward<_Args>(__args)...); ^~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:64, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/stl_vector.h:1085:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 _M_realloc_insert(end(), __x); ^~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/vector.tcc:109:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 _M_realloc_insert(end(), std::forward<_Args>(__args)...); ^~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:15: /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__heap_select(_RandomAccessIterator, _RandomAccessIterator, _RandomAccessIterator, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = long long int; V = long long int]::<lambda(const std::pair<long long int, long long int>&, const std::pair<long long int, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1668:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 __heap_select(_RandomAccessIterator __first, ^~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1668:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h:1668:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__introsort_loop(_RandomAccessIterator, _RandomAccessIterator, _Size, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >; _Size = int; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = long long int; V = long long int]::<lambda(const std::pair<long long int, long long int>&, const std::pair<long long int, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 __introsort_loop(_RandomAccessIterator __first, ^~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h:1954:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 std::__introsort_loop(__cut, __last, __depth_limit, __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1933:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 std::__heap_select(__first, __middle, __last, __comp); ~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h: In function ‘std::vector<std::pair<_T1, _T2> > sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = long long int; V = long long int]’: /usr/include/c++/8/bits/stl_algo.h:1968:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 std::__introsort_loop(__first, __last, ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ std::__lg(__last - __first) * 2, ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ __comp); ~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1885:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 std::__insertion_sort(__first, __first + int(_S_threshold), __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1890:23: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 std::__insertion_sort(__first, __last, __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/bits/stl_algo.h:61, from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:15: /usr/include/c++/8/bits/stl_heap.h: In function ‘void std::__make_heap(_RandomAccessIterator, _RandomAccessIterator, _Compare&) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_heap.h:326:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __make_heap(_RandomAccessIterator __first, _RandomAccessIterator __last, ^~~~~~~~~~~ /usr/include/c++/8/bits/stl_heap.h:326:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 In file included from /usr/include/c++/8/algorithm:62, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:15: /usr/include/c++/8/bits/stl_algo.h: In function ‘void std::__introsort_loop(_RandomAccessIterator, _RandomAccessIterator, _Size, _Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >; _Size = int; _Compare = __gnu_cxx::__ops::_Iter_comp_iter<sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]::<lambda(const std::pair<std::__cxx11::basic_string<char>, long long int>&, const std::pair<std::__cxx11::basic_string<char>, long long int>&)> >]’: /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 __introsort_loop(_RandomAccessIterator __first, ^~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1940:5: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 /usr/include/c++/8/bits/stl_algo.h:1954:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__introsort_loop(__cut, __last, __depth_limit, __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1672:23: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__make_heap(__first, __middle, __comp); ~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h: In function ‘std::vector<std::pair<_T1, _T2> > sentencepiece::Sorted(const std::vector<std::pair<_T1, _T2> >&) [with K = std::__cxx11::basic_string<char>; V = long long int]’: /usr/include/c++/8/bits/stl_algo.h:1968:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__introsort_loop(__first, __last, ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ std::__lg(__last - __first) * 2, ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ __comp); ~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1885:25: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__insertion_sort(__first, __first + int(_S_threshold), __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_algo.h:1890:23: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<std::__cxx11::basic_string<char>, long long int>*, std::vector<std::pair<std::__cxx11::basic_string<char>, long long int> > >’ changed in GCC 7.1 std::__insertion_sort(__first, __last, __comp); ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~ In file included from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:33, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:30: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx: In member function ‘sentencepiece::unigram::TrainerModel::SentencePieces sentencepiece::unigram::Trainer::MakeSeedSentencePieces() const [with node_int_type = long long int]’: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/sais.hxx:330:41: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 try { err = saisxx_private::suffixsort(T, SA, index_type(0), n, k, false); } ~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ In file included from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:30: /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:120:38: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 nodeNum = esaxx_private::suffixtree(T, SA, L, R, D, n); ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~ /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:120:38: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/third_party/esaxx/esa.hxx:120:38: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<long long int*, std::vector<long long int> >’ changed in GCC 7.1 In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model_trainer.cc:23: /usr/include/c++/8/bits/vector.tcc:109:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<std::pair<long long int, long long int>*, std::vector<std::pair<long long int, long long int>, std::allocator<std::pair<long long int, long long int> > > >’ changed in GCC 7.1 _M_realloc_insert(end(), std::forward<_Args>(__args)...); ^~~~~~~~~~~~~~~~~ [ 25%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/char_model_trainer.cc.o [ 26%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/bpe_model_trainer.cc.o [ 28%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/implicit_weak_message.cc.o [ 30%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/int128.cc.o [ 31%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/io_win32.cc.o [ 33%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/message_lite.cc.o [ 34%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/parse_context.cc.o [ 36%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/sentencepiece_trainer.cc.o [ 38%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/repeated_field.cc.o [ 39%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/status.cc.o [ 41%] Building CXX object src/CMakeFiles/sentencepiece_train-static.dir/pretokenizer_for_training.cc.o [ 42%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/statusor.cc.o [ 44%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/stringpiece.cc.o [ 46%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/stringprintf.cc.o [ 47%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/structurally_valid.cc.o [ 49%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/strutil.cc.o [ 50%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/time.cc.o [ 52%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/wire_format_lite.cc.o [ 53%] Linking CXX static library libsentencepiece_train.a [ 53%] Built target sentencepiece_train-static [ 55%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/zero_copy_stream.cc.o [ 57%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/zero_copy_stream_impl.cc.o [ 58%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc.o [ 60%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/builtin_pb/sentencepiece.pb.cc.o [ 61%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/builtin_pb/sentencepiece_model.pb.cc.o [ 63%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/bpe_model.cc.o [ 65%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/char_model.cc.o [ 66%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/error.cc.o [ 68%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/filesystem.cc.o [ 69%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/model_factory.cc.o [ 71%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/model_interface.cc.o [ 73%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/normalizer.cc.o [ 74%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/sentencepiece_processor.cc.o [ 76%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/unigram_model.cc.o [ 77%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/util.cc.o [ 79%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/word_model.cc.o [ 80%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/absl/strings/string_view.cc.o [ 82%] Building CXX object src/CMakeFiles/sentencepiece-static.dir/__/third_party/absl/flags/flag.cc.o In file included from /usr/include/c++/8/vector:69, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/common.h:26, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/sentencepiece_processor.cc:19: /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const double&}; _Tp = double; _Alloc = std::allocator<double>]’: /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<double>::iterator’ {aka ‘__gnu_cxx::__normal_iterator<double*, std::vector<double> >’} changed in GCC 7.1 vector<_Tp, _Alloc>:: ^~~~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:64, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/common.h:26, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/sentencepiece_processor.cc:19: /usr/include/c++/8/bits/stl_vector.h: In member function ‘void std::discrete_distribution<_IntType>::param_type::_M_initialize() [with _IntType = int]’: /usr/include/c++/8/bits/stl_vector.h:1085:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<double*, std::vector<double> >’ changed in GCC 7.1 _M_realloc_insert(end(), __x); ^~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_vector.h:1085:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<double*, std::vector<double> >’ changed in GCC 7.1 _M_realloc_insert(end(), __x); ^~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:69, from /usr/include/c++/8/queue:61, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model.cc:20: /usr/include/c++/8/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const double&}; _Tp = double; _Alloc = std::allocator<double>]’: /usr/include/c++/8/bits/vector.tcc:413:7: note: parameter passing for argument of type ‘std::vector<double>::iterator’ {aka ‘__gnu_cxx::__normal_iterator<double*, std::vector<double> >’} changed in GCC 7.1 vector<_Tp, _Alloc>:: ^~~~~~~~~~~~~~~~~~~ In file included from /usr/include/c++/8/vector:64, from /usr/include/c++/8/queue:61, from /tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/bundled/sentencepiece/src/unigram_model.cc:20: /usr/include/c++/8/bits/stl_vector.h: In member function ‘void std::discrete_distribution<_IntType>::param_type::_M_initialize() [with _IntType = int]’: /usr/include/c++/8/bits/stl_vector.h:1085:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<double*, std::vector<double> >’ changed in GCC 7.1 _M_realloc_insert(end(), __x); ^~~~~~~~~~~~~~~~~ /usr/include/c++/8/bits/stl_vector.h:1085:4: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator<double*, std::vector<double> >’ changed in GCC 7.1 _M_realloc_insert(end(), __x); ^~~~~~~~~~~~~~~~~ [ 84%] Linking CXX static library libsentencepiece.a [ 84%] Built target sentencepiece-static Scanning dependencies of target spm_export_vocab Scanning dependencies of target spm_decode Scanning dependencies of target spm_encode Scanning dependencies of target spm_normalize [ 85%] Building CXX object src/CMakeFiles/spm_decode.dir/spm_decode_main.cc.o [ 87%] Building CXX object src/CMakeFiles/spm_export_vocab.dir/spm_export_vocab_main.cc.o [ 88%] Building CXX object src/CMakeFiles/spm_encode.dir/spm_encode_main.cc.o [ 90%] Building CXX object src/CMakeFiles/spm_normalize.dir/spm_normalize_main.cc.o [ 92%] Linking CXX executable spm_export_vocab /usr/bin/ld: libsentencepiece.a(arena.cc.o): in function `google::protobuf::internal::ArenaImpl::Init(bool)': arena.cc:(.text+0x94): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[2]: *** [src/CMakeFiles/spm_export_vocab.dir/build.make:86: src/spm_export_vocab] エラー 1 make[1]: *** [CMakeFiles/Makefile2:127: src/CMakeFiles/spm_export_vocab.dir/all] エラー 2 make[1]: *** 未完了のジョブを待っています.... [ 93%] Linking CXX executable spm_normalize [ 95%] Linking CXX executable spm_decode /usr/bin/ld: libsentencepiece.a(arena.cc.o): in function `google::protobuf::internal::ArenaImpl::Init(bool)': arena.cc:(.text+0x94): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[2]: *** [src/CMakeFiles/spm_normalize.dir/build.make:88: src/spm_normalize] エラー 1 make[1]: *** [CMakeFiles/Makefile2:209: src/CMakeFiles/spm_normalize.dir/all] エラー 2 /usr/bin/ld: libsentencepiece.a(arena.cc.o): in function `google::protobuf::internal::ArenaImpl::Init(bool)': arena.cc:(.text+0x94): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[2]: *** [src/CMakeFiles/spm_decode.dir/build.make:86: src/spm_decode] エラー 1 make[1]: *** [CMakeFiles/Makefile2:263: src/CMakeFiles/spm_decode.dir/all] エラー 2 [ 96%] Linking CXX executable spm_encode /usr/bin/ld: libsentencepiece.a(arena.cc.o): in function `google::protobuf::internal::ArenaImpl::Init(bool)': arena.cc:(.text+0x94): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[2]: *** [src/CMakeFiles/spm_encode.dir/build.make:86: src/spm_encode] エラー 1 make[1]: *** [CMakeFiles/Makefile2:236: src/CMakeFiles/spm_encode.dir/all] エラー 2 make: *** [Makefile:152: all] エラー 2 [ 66%] Built target sentencepiece-static [ 68%] Linking CXX executable spm_export_vocab /usr/bin/ld: libsentencepiece.a(arena.cc.o): in function `google::protobuf::internal::ArenaImpl::Init(bool)': arena.cc:(.text+0x94): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[2]: *** [src/CMakeFiles/spm_export_vocab.dir/build.make:86: src/spm_export_vocab] エラー 1 make[1]: *** [CMakeFiles/Makefile2:127: src/CMakeFiles/spm_export_vocab.dir/all] エラー 2 make: *** [Makefile:152: all] エラー 2 Package sentencepiece was not found in the pkg-config search path. Perhaps you should add the directory containing `sentencepiece.pc' to the PKG_CONFIG_PATH environment variable No package 'sentencepiece' found Failed to find sentencepiece pkg-config ---------------------------------------- ERROR: Command errored out with exit status 1: /tmp/work/test_tukuyomi_repo/env/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hr4ja2bd/sentencepiece_0eeece80ed3f4da1847c93f2bcaffe95/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-wu509ewz/install-record.txt --single-version-externally-managed --compile --install-headers /tmp/work/test_tukuyomi_repo/env/include/site/python3.7/sentencepiece Check the logs for full command output.
ダメだ。原因不明。
sentencepieceをCソースコードからビルドしてみる。
git clone https://github.com/google/sentencepiece.git cd sentencepiece mkdir build cd build cmake .. make -j $(nproc) sudo make install sudo ldconfig -v
成功したっぽい。以下のように.soファイルが作成されていた。たぶんこれが本体だろう。
- /tmp/work/sentencepiece/build/src/libsentencepiece.so
でもreadmeにあるspm_trainコマンドがないんだよなぁ。本当に成功しているの？
次にpython/ディレクトリをみてみる。なんかsetup.pyがあるから、これを使ってインストールできるんじゃない？ やってみる。
cd /tmp/work/sentencepiece/python/ python3 setup.py install
失敗した。例によって以下のエラーである。
... Package sentencepiece was not found in the pkg-config search path. Perhaps you should add the directory containing `sentencepiece.pc' to the PKG_CONFIG_PATH environment variable No package 'sentencepiece' found Failed to find sentencepiece pkg-config
ダメだ。これ以上どうしたらいいかわからない。
所感
SentencePieceのビルドがエラーになって失敗した。
めちゃくちゃ時間かけたのに……。
対象環境
- Raspbierry pi 4 Model B
- Raspberry Pi OS buster 10.0 2020-08-20 ※
- bash 5.0.3(1)-release
$ uname -a Linux raspberrypi 5.4.83-v7l+ #1379 SMP Mon Dec 14 13:11:54 GMT 2020 armv7l GNU/Linux
$ python3 -V Python 3.7.3 $ pip3 -V pip 21.1.2 ...
