Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tiktoken #828

Open
mhsmith opened this issue Mar 23, 2023 · 6 comments
Open

tiktoken #828

mhsmith opened this issue Mar 23, 2023 · 6 comments
Labels
packages

Comments

@mhsmith
Copy link
Member

mhsmith commented Mar 23, 2023

Originally posted by @axvx in #658 (comment)

Hey why I see the following error:

Failed to install tiktoken from https://files.pythonhosted.org/packages/91/ed/c6596b42188c03b671ea4d8b6912c1f280ac2991664235039d3a18069d6a/tiktoken-0.3.2.tar.gz#sha256=a51b5449e883e409cf2f4a846a6a97962d5656a354a5532c330811c833ac3b37.

The Python section in my gradle file is like this:

  python {
        version "3.8"
        pip {
            install "matplotlib"
            install "langchain"
            install "openai"
            install "tiktoken"

        }
    }
@mhsmith mhsmith mentioned this issue Mar 23, 2023
Open
@mhsmith mhsmith changed the title Hey why I see the following error: tiktoken Mar 23, 2023
@mhsmith
Copy link
Member Author

mhsmith commented Mar 23, 2023 •
edited
Loading

This package contains native components, so it would have to be built into an Android wheel file.

If you'd like to try doing this yourself, follow the instructions here. However, our package build tool doesn't currently have working support for Rust – see #1030 for details.

If anyone else wants this package too, let us know by clicking the thumbs-up button above.

@mhsmith mhsmith mentioned this issue Mar 26, 2023
Closed
@Matthaeus07
Copy link

Hey @mhsmith! I noticed that on the PyPI page, there are several .whl files which I can download.
(https://pypi.org/project/tiktoken/0.3.3/#files)

Are those the files which I can build into my app?

@mhsmith
Copy link
Member Author

mhsmith commented Apr 1, 2023

Unfortunately none of those files are compatible with Android. You'd have to build an Android wheel by following the instructions above.

@Matthaeus07
Copy link

Matthaeus07 commented Apr 1, 2023 •
edited
Loading

Hello! Thank you for your quick response!

I have now tried building the wheel file but I ran into the following error when running this command:
./build-wheel.py --python 3.10 --abi arm64-v8a tiktoken

build-wheel.py: python3.10 -m pip --disable-pip-version-check install setuptools-rust==1.5.2
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: setuptools-rust==1.5.2 in /home/mtw/.local/lib/python3.10/site-packages (1.5.2)
Requirement already satisfied: setuptools>=62.4 in /home/mtw/.local/lib/python3.10/site-packages (from setuptools-rust==1.5.2) (67.0.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/mtw/.local/lib/python3.10/site-packages (from setuptools-rust==1.5.2) (4.5.0)
Requirement already satisfied: semantic-version<3,>=2.8.2 in /home/mtw/.local/lib/python3.10/site-packages (from setuptools-rust==1.5.2) (2.10.0)
build-wheel.py: cd /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3
build-wheel.py: rm -rf /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a
build-wheel.py: Using cached sdist
build-wheel.py: tar -C /tmp/build-wheel-3evd4zih -xf tiktoken-0.3.3.tar.gz
build-wheel.py: mv /tmp/build-wheel-3evd4zih/tiktoken-0.3.3 /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src
build-wheel.py: rm -rf /tmp/build-wheel-3evd4zih
build-wheel.py: mv /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/pyproject.toml /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/pyproject-chaquopy-disabled.toml
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/include
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib
build-wheel.py: unzip -q -d /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy /home/mtw/Schreibtisch/chaquopy-master/maven/com/chaquo/python/target/3.10.6-1/target-3.10.6-1-arm64-v8a.zip include/* jniLibs/*
build-wheel.py: mv /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/jniLibs/arm64-v8a/* /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib
build-wheel.py: rm -r /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/jniLibs
build-wheel.py: ln -s libssl_chaquopy.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libssl.so
build-wheel.py: ln -s libcrypto_chaquopy.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libcrypto.so
build-wheel.py: ln -s libpython3.10.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libpython3..so
build-wheel.py: ln -s libsqlite3_chaquopy.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libsqlite3.so
build-wheel.py: abi=arm64-v8a; api_level=21; prefix=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy; . /home/mtw/Schreibtisch/chaquopy-master/server/pypi/../../target/build-common.sh; export
build-wheel.py: /home/mtw/android-sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/llvm-ar rc /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libpthread.a
build-wheel.py: /home/mtw/android-sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/llvm-ar rc /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/librt.a
build-wheel.py: cd /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src
build-wheel.py: python3.10 -m pip --disable-pip-version-check wheel --no-deps -v -e .
/home/mtw/.local/lib/python3.10/site-packages/_distutils_hack/__init__.py:33: UserWarning: Setuptools is replacing distutils.
  warnings.warn("Setuptools is replacing distutils.")
Obtaining file:///home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src
  Running command python setup.py egg_info
  running egg_info
  creating /tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info
  writing /tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info/dependency_links.txt
  writing top-level names to /tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info/top_level.txt
  writing manifest file '/tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching 'Makefile'
  adding license file 'LICENSE'
  writing manifest file '/tmp/pip-pip-egg-info-znbp92s_/tiktoken.egg-info/SOURCES.txt'
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: tiktoken
  Running command python setup.py bdist_wheel
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux_aarch64-cpython-310
  creating build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/core.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/load.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/model.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/__init__.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/registry.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  creating build/lib.linux_aarch64-cpython-310/tiktoken_ext
  copying tiktoken_ext/openai_public.py -> build/lib.linux_aarch64-cpython-310/tiktoken_ext
  copying tiktoken/py.typed -> build/lib.linux_aarch64-cpython-310/tiktoken
  running build_ext
  running build_rust
  error: can't find Rust compiler

  If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.

  To update pip, run:

      pip install --upgrade pip

  and then retry package installation.

  If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /usr/bin/python3.10 -u -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize
  
  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)
  
  __file__ = %r
  sys.argv[0] = __file__
  
  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"
  
  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-3ykjn14q
  cwd: /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/
  Building wheel for tiktoken (setup.py) ... error
  ERROR: Failed building wheel for tiktoken
  Running setup.py clean for tiktoken
  Running command python setup.py clean
  Chaquopy: clean command disabled
Failed to build tiktoken
ERROR: Failed to build one or more wheels
build-wheel.py: Error: Command returned exit status 1

It seemed like I was missing Rust so I went on and installed that via the command in the Dockerfile.
wget https://static.rust-lang.org/rustup/dist/x86_64-unknown-linux-gnu/rustup-init && chmod +x rustup-init && ./rustup-init -y && rm rustup-init

Unfortunately when I run the build command again I get this error:

build-wheel.py: python3.10 -m pip --disable-pip-version-check install setuptools-rust==1.5.2 setuptools==67.6.1
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: setuptools-rust==1.5.2 in /home/mtw/.local/lib/python3.10/site-packages (1.5.2)
Requirement already satisfied: setuptools==67.6.1 in /home/mtw/.local/lib/python3.10/site-packages (67.6.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/mtw/.local/lib/python3.10/site-packages (from setuptools-rust==1.5.2) (4.5.0)
Requirement already satisfied: semantic-version<3,>=2.8.2 in /home/mtw/.local/lib/python3.10/site-packages (from setuptools-rust==1.5.2) (2.10.0)
build-wheel.py: cd /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3
build-wheel.py: rm -rf /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a
build-wheel.py: Using cached sdist
build-wheel.py: tar -C /tmp/build-wheel-8nqcfqmn -xf tiktoken-0.3.3.tar.gz
build-wheel.py: mv /tmp/build-wheel-8nqcfqmn/tiktoken-0.3.3 /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src
build-wheel.py: rm -rf /tmp/build-wheel-8nqcfqmn
build-wheel.py: mv /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/pyproject.toml /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/pyproject-chaquopy-disabled.toml
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/include
build-wheel.py: mkdir -p /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib
build-wheel.py: unzip -q -d /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy /home/mtw/Schreibtisch/chaquopy-master/maven/com/chaquo/python/target/3.10.6-1/target-3.10.6-1-arm64-v8a.zip include/* jniLibs/*
build-wheel.py: mv /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/jniLibs/arm64-v8a/* /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib
build-wheel.py: rm -r /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/jniLibs
build-wheel.py: ln -s libssl_chaquopy.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libssl.so
build-wheel.py: ln -s libcrypto_chaquopy.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libcrypto.so
build-wheel.py: ln -s libpython3.10.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libpython3..so
build-wheel.py: ln -s libsqlite3_chaquopy.so /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libsqlite3.so
build-wheel.py: abi=arm64-v8a; api_level=21; prefix=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy; . /home/mtw/Schreibtisch/chaquopy-master/server/pypi/../../target/build-common.sh; export
build-wheel.py: /home/mtw/android-sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/llvm-ar rc /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/libpthread.a
build-wheel.py: /home/mtw/android-sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/bin/llvm-ar rc /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/requirements/chaquopy/lib/librt.a
build-wheel.py: cd /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src
build-wheel.py: python3.10 -m pip --disable-pip-version-check wheel --no-deps -v -e .
/home/mtw/.local/lib/python3.10/site-packages/_distutils_hack/__init__.py:33: UserWarning: Setuptools is replacing distutils.
  warnings.warn("Setuptools is replacing distutils.")
Obtaining file:///home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src
  Running command python setup.py egg_info
  running egg_info
  creating /tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info
  writing /tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info/dependency_links.txt
  writing top-level names to /tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info/top_level.txt
  writing manifest file '/tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info/SOURCES.txt'
  reading manifest template 'MANIFEST.in'
  warning: no files found matching 'Makefile'
  adding license file 'LICENSE'
  writing manifest file '/tmp/pip-pip-egg-info-606nzrdp/tiktoken.egg-info/SOURCES.txt'
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: tiktoken
  Running command python setup.py bdist_wheel
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux_aarch64-cpython-310
  creating build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/core.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/load.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/model.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/__init__.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  copying tiktoken/registry.py -> build/lib.linux_aarch64-cpython-310/tiktoken
  creating build/lib.linux_aarch64-cpython-310/tiktoken_ext
  copying tiktoken_ext/openai_public.py -> build/lib.linux_aarch64-cpython-310/tiktoken_ext
  copying tiktoken/py.typed -> build/lib.linux_aarch64-cpython-310/tiktoken
  running build_ext
  running build_rust
  cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module -- --crate-type cdylib
      Updating crates.io index
     Compiling target-lexicon v0.12.6
     Compiling autocfg v1.1.0
     Compiling once_cell v1.17.1
     Compiling proc-macro2 v1.0.54
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/target-lexicon-0.12.6/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' -C metadata=c8f2e6f7e30e46c3 -C extra-filename=-c8f2e6f7e30e46c3 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/target-lexicon-c8f2e6f7e30e46c3 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `rustc --crate-name autocfg /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/autocfg-1.1.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=b37d6e56950c9d16 -C extra-filename=-b37d6e56950c9d16 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro2-1.0.54/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="proc-macro"' -C metadata=024db726573c5e88 -C extra-filename=-024db726573c5e88 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/proc-macro2-024db726573c5e88 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `rustc --crate-name once_cell --edition=2021 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/once_cell-1.17.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="race"' --cfg 'feature="std"' -C metadata=53cd5fce86b56e64 -C extra-filename=-53cd5fce86b56e64 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling unicode-ident v1.0.8
       Running `rustc --crate-name unicode_ident --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/unicode-ident-1.0.8/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=338235c55ffbb767 -C extra-filename=-338235c55ffbb767 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling quote v1.0.26
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/quote-1.0.26/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=98f1ad977aa03ed7 -C extra-filename=-98f1ad977aa03ed7 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/quote-98f1ad977aa03ed7 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling memchr v2.5.0
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/memchr-2.5.0/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=e8ad66f3cd6d70df -C extra-filename=-e8ad66f3cd6d70df --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/memchr-e8ad66f3cd6d70df -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/proc-macro2-024db726573c5e88/build-script-build`
     Compiling libc v0.2.140
       Running `rustc --crate-name build_script_build /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/libc-0.2.140/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=29ac3d63c69d08c7 -C extra-filename=-29ac3d63c69d08c7 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/libc-29ac3d63c69d08c7 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/target-lexicon-c8f2e6f7e30e46c3/build-script-build`
       Running `rustc --crate-name target_lexicon --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/target-lexicon-0.12.6/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' -C metadata=7b15210a98fcde78 -C extra-filename=-7b15210a98fcde78 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow --cfg 'feature="rust_1_40"'`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/quote-98f1ad977aa03ed7/build-script-build`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/memchr-e8ad66f3cd6d70df/build-script-build`
       Running `rustc --crate-name proc_macro2 --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro2-1.0.54/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="proc-macro"' -C metadata=a4c4e7e2e0e0af06 -C extra-filename=-a4c4e7e2e0e0af06 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern unicode_ident=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libunicode_ident-338235c55ffbb767.rmeta --cap-lints allow --cfg use_proc_macro --cfg wrap_proc_macro`
     Compiling syn v1.0.109
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/syn-1.0.109/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=08d3f1fc82929856 -C extra-filename=-08d3f1fc82929856 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/syn-08d3f1fc82929856 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/libc-29ac3d63c69d08c7/build-script-build`
       Running `rustc --crate-name libc /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/libc-0.2.140/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=10221599ee8e0a06 -C extra-filename=-10221599ee8e0a06 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow --cfg freebsd11 --cfg libc_priv_mod_use --cfg libc_union --cfg libc_const_size_of --cfg libc_align --cfg libc_int128 --cfg libc_core_cvoid --cfg libc_packedN --cfg libc_cfg_target_vendor --cfg libc_non_exhaustive --cfg libc_long_array --cfg libc_ptr_addr_of --cfg libc_underscore_const_names --cfg libc_const_extern_fn`
     Compiling pyo3-build-config v0.17.3
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-build-config-0.17.3/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="extension-module"' --cfg 'feature="resolve-config"' -C metadata=03faa15c8c6d77eb -C extra-filename=-03faa15c8c6d77eb --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/pyo3-build-config-03faa15c8c6d77eb -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern target_lexicon=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libtarget_lexicon-7b15210a98fcde78.rlib --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/syn-08d3f1fc82929856/build-script-build`
       Running `rustc --crate-name quote --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/quote-1.0.26/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=eb5ae6f9b9c3483f -C extra-filename=-eb5ae6f9b9c3483f --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern proc_macro2=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libproc_macro2-a4c4e7e2e0e0af06.rmeta --cap-lints allow`
       Running `rustc --crate-name memchr --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/memchr-2.5.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=2cbe141a73b58ecf -C extra-filename=-2cbe141a73b58ecf --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow --cfg memchr_runtime_simd --cfg memchr_runtime_sse2 --cfg memchr_runtime_sse42 --cfg memchr_runtime_avx`
     Compiling lock_api v0.4.9
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/lock_api-0.4.9/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off -C metadata=3422c64d4702a1b0 -C extra-filename=-3422c64d4702a1b0 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/lock_api-3422c64d4702a1b0 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern autocfg=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libautocfg-b37d6e56950c9d16.rlib --cap-lints allow`
     Compiling parking_lot_core v0.9.7
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot_core-0.9.7/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off -C metadata=1cc0128c102813d5 -C extra-filename=-1cc0128c102813d5 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/parking_lot_core-1cc0128c102813d5 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/lock_api-3422c64d4702a1b0/build-script-build`
       Running `rustc --crate-name syn --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/syn-1.0.109/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=49fe588315e94abd -C extra-filename=-49fe588315e94abd --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern proc_macro2=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libproc_macro2-a4c4e7e2e0e0af06.rmeta --extern quote=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libquote-eb5ae6f9b9c3483f.rmeta --extern unicode_ident=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libunicode_ident-338235c55ffbb767.rmeta --cap-lints allow --cfg syn_disable_nightly_tests`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/pyo3-build-config-03faa15c8c6d77eb/build-script-build`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/parking_lot_core-1cc0128c102813d5/build-script-build`
     Compiling memoffset v0.6.5
       Running `rustc --crate-name build_script_build /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/memoffset-0.6.5/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' -C metadata=69f9f45c1de8383a -C extra-filename=-69f9f45c1de8383a --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/memoffset-69f9f45c1de8383a -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern autocfg=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libautocfg-b37d6e56950c9d16.rlib --cap-lints allow`
     Compiling cfg-if v1.0.0
       Running `rustc --crate-name cfg_if --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/cfg-if-1.0.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=f2340c58ea21a555 -C extra-filename=-f2340c58ea21a555 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `rustc --crate-name pyo3_build_config --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-build-config-0.17.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="extension-module"' --cfg 'feature="resolve-config"' -C metadata=6e3670cdd6d97c18 -C extra-filename=-6e3670cdd6d97c18 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern once_cell=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libonce_cell-53cd5fce86b56e64.rmeta --extern target_lexicon=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libtarget_lexicon-7b15210a98fcde78.rmeta --cap-lints allow`
     Compiling smallvec v1.10.0
       Running `rustc --crate-name smallvec --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/smallvec-1.10.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=cfb5dbf1c59bcbfc -C extra-filename=-cfb5dbf1c59bcbfc --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling scopeguard v1.1.0
       Running `rustc --crate-name scopeguard /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/scopeguard-1.1.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=227eadc7e6168e55 -C extra-filename=-227eadc7e6168e55 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `rustc --crate-name lock_api --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/lock_api-0.4.9/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=81388d0022bba73f -C extra-filename=-81388d0022bba73f --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern scopeguard=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libscopeguard-227eadc7e6168e55.rmeta --cap-lints allow --cfg has_const_fn_trait_bound`
       Running `rustc --crate-name parking_lot_core --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot_core-0.9.7/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=327569d518ef00d4 -C extra-filename=-327569d518ef00d4 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern cfg_if=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libcfg_if-f2340c58ea21a555.rmeta --extern libc=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/liblibc-10221599ee8e0a06.rmeta --extern smallvec=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libsmallvec-cfb5dbf1c59bcbfc.rmeta --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/memoffset-69f9f45c1de8383a/build-script-build`
     Compiling aho-corasick v0.7.20
       Running `rustc --crate-name aho_corasick --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/aho-corasick-0.7.20/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=4433db8dd5f3d5a1 -C extra-filename=-4433db8dd5f3d5a1 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern memchr=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libmemchr-2cbe141a73b58ecf.rmeta --cap-lints allow`
     Compiling pyo3-ffi v0.17.3
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-ffi-0.17.3/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="extension-module"' -C metadata=dab892698f24dcf5 -C extra-filename=-dab892698f24dcf5 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/pyo3-ffi-dab892698f24dcf5 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern pyo3_build_config=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libpyo3_build_config-6e3670cdd6d97c18.rlib --cap-lints allow`
     Compiling pyo3 v0.17.3
       Running `rustc --crate-name build_script_build --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-0.17.3/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="extension-module"' --cfg 'feature="indoc"' --cfg 'feature="macros"' --cfg 'feature="pyo3-macros"' --cfg 'feature="unindent"' -C metadata=7918891e65f03d60 -C extra-filename=-7918891e65f03d60 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/pyo3-7918891e65f03d60 -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern pyo3_build_config=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libpyo3_build_config-6e3670cdd6d97c18.rlib --cap-lints allow`
     Compiling regex-syntax v0.6.29
       Running `rustc --crate-name regex_syntax --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/regex-syntax-0.6.29/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=57c75579a8fceb80 -C extra-filename=-57c75579a8fceb80 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/pyo3-ffi-dab892698f24dcf5/build-script-build`
     Compiling bit-vec v0.6.3
       Running `rustc --crate-name bit_vec /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/bit-vec-0.6.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="std"' -C metadata=4e47ea0df421b6fb -C extra-filename=-4e47ea0df421b6fb --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling bit-set v0.5.3
       Running `rustc --crate-name bit_set /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/bit-set-0.5.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=5b473fd690fd0a8d -C extra-filename=-5b473fd690fd0a8d --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern bit_vec=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libbit_vec-4e47ea0df421b6fb.rmeta --cap-lints allow`
       Running `/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/build/pyo3-7918891e65f03d60/build-script-build`
     Compiling pyo3-macros-backend v0.17.3
       Running `rustc --crate-name pyo3_macros_backend --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-macros-backend-0.17.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=d9078075e362abd4 -C extra-filename=-d9078075e362abd4 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern proc_macro2=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libproc_macro2-a4c4e7e2e0e0af06.rmeta --extern quote=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libquote-eb5ae6f9b9c3483f.rmeta --extern syn=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libsyn-49fe588315e94abd.rmeta --cap-lints allow`
     Compiling regex v1.7.3
       Running `rustc --crate-name regex --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/regex-1.7.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="aho-corasick"' --cfg 'feature="default"' --cfg 'feature="memchr"' --cfg 'feature="perf"' --cfg 'feature="perf-cache"' --cfg 'feature="perf-dfa"' --cfg 'feature="perf-inline"' --cfg 'feature="perf-literal"' --cfg 'feature="std"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=7167774a23191df9 -C extra-filename=-7167774a23191df9 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern aho_corasick=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libaho_corasick-4433db8dd5f3d5a1.rmeta --extern memchr=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libmemchr-2cbe141a73b58ecf.rmeta --extern regex_syntax=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libregex_syntax-57c75579a8fceb80.rmeta --cap-lints allow`
       Running `rustc --crate-name pyo3_ffi --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-ffi-0.17.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="extension-module"' -C metadata=44e288894f537f0f -C extra-filename=-44e288894f537f0f --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern libc=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/liblibc-10221599ee8e0a06.rmeta --cap-lints allow --cfg Py_3_6 --cfg Py_3_7 --cfg Py_3_8 --cfg Py_3_9 --cfg Py_3_10 --cfg min_const_generics --cfg addr_of --cfg option_insert`
     Compiling parking_lot v0.12.1
       Running `rustc --crate-name parking_lot --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot-0.12.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' -C metadata=62bfdf1c6c401ff2 -C extra-filename=-62bfdf1c6c401ff2 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern lock_api=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/liblock_api-81388d0022bba73f.rmeta --extern parking_lot_core=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libparking_lot_core-327569d518ef00d4.rmeta --cap-lints allow`
     Compiling pyo3-macros v0.17.3
       Running `rustc --crate-name pyo3_macros --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-macros-0.17.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=2cbadd792e45006f -C extra-filename=-2cbadd792e45006f --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern proc_macro2=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libproc_macro2-a4c4e7e2e0e0af06.rlib --extern pyo3_macros_backend=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libpyo3_macros_backend-d9078075e362abd4.rlib --extern quote=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libquote-eb5ae6f9b9c3483f.rlib --extern syn=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libsyn-49fe588315e94abd.rlib --extern proc_macro --cap-lints allow`
       Running `rustc --crate-name memoffset /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/memoffset-0.6.5/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' -C metadata=2cc69c807853499f -C extra-filename=-2cc69c807853499f --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow --cfg tuple_ty --cfg allow_clippy --cfg maybe_uninit --cfg doctests --cfg raw_ref_macros`
     Compiling indoc v1.0.9
       Running `rustc --crate-name indoc --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/indoc-1.0.9/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=7d05a571450e759e -C extra-filename=-7d05a571450e759e --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern proc_macro --cap-lints allow`
       Running `rustc --crate-name once_cell --edition=2021 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/once_cell-1.17.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="race"' --cfg 'feature="std"' -C metadata=709e29b0a49a8445 -C extra-filename=-709e29b0a49a8445 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling regex-automata v0.1.10
       Running `rustc --crate-name regex_automata /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/regex-automata-0.1.10/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=44cee800d70d43ee -C extra-filename=-44cee800d70d43ee --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling unindent v0.1.11
     Compiling bstr v1.4.0
       Running `rustc --crate-name bstr --edition=2021 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/bstr-1.4.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="std"' --cfg 'feature="unicode"' -C metadata=c86745ecc4ef3e3f -C extra-filename=-c86745ecc4ef3e3f --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern memchr=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libmemchr-2cbe141a73b58ecf.rmeta --extern once_cell=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libonce_cell-709e29b0a49a8445.rmeta --extern regex_automata=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libregex_automata-44cee800d70d43ee.rmeta --cap-lints allow`
       Running `rustc --crate-name unindent --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/unindent-0.1.11/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=93cb6fe7ca9f88c3 -C extra-filename=-93cb6fe7ca9f88c3 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
       Running `rustc --crate-name pyo3 --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-0.17.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="extension-module"' --cfg 'feature="indoc"' --cfg 'feature="macros"' --cfg 'feature="pyo3-macros"' --cfg 'feature="unindent"' -C metadata=159154f6c04fb37e -C extra-filename=-159154f6c04fb37e --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern cfg_if=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libcfg_if-f2340c58ea21a555.rmeta --extern indoc=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libindoc-7d05a571450e759e.so --extern libc=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/liblibc-10221599ee8e0a06.rmeta --extern memoffset=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libmemoffset-2cc69c807853499f.rmeta --extern parking_lot=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libparking_lot-62bfdf1c6c401ff2.rmeta --extern pyo3_ffi=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libpyo3_ffi-44e288894f537f0f.rmeta --extern pyo3_macros=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libpyo3_macros-2cbadd792e45006f.so --extern unindent=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libunindent-93cb6fe7ca9f88c3.rmeta --cap-lints allow --cfg Py_3_6 --cfg Py_3_7 --cfg Py_3_8 --cfg Py_3_9 --cfg Py_3_10 --cfg min_const_generics --cfg addr_of --cfg option_insert`
     Compiling fancy-regex v0.10.0
       Running `rustc --crate-name fancy_regex --edition=2018 /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/fancy-regex-0.10.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="perf"' --cfg 'feature="unicode"' -C metadata=aaf5bf03c0c4acd3 -C extra-filename=-aaf5bf03c0c4acd3 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern bit_set=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libbit_set-5b473fd690fd0a8d.rmeta --extern regex=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libregex-7167774a23191df9.rmeta --cap-lints allow`
     Compiling rustc-hash v1.1.0
       Running `rustc --crate-name rustc_hash /home/mtw/.cargo/registry/src/github.com-1ecc6299db9ec823/rustc-hash-1.1.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=eb8763e65cb328e9 -C extra-filename=-eb8763e65cb328e9 --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --cap-lints allow`
     Compiling tiktoken v0.3.3 (/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src)
       Running `rustc --crate-name _tiktoken --edition=2021 src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type cdylib --emit=dep-info,link -C opt-level=3 -C embed-bitcode=no --crate-type cdylib -C metadata=3e88276806a1788a --out-dir /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps -C incremental=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/incremental -L dependency=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps --extern bstr=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libbstr-c86745ecc4ef3e3f.rlib --extern fancy_regex=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libfancy_regex-aaf5bf03c0c4acd3.rlib --extern pyo3=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libpyo3-159154f6c04fb37e.rlib --extern regex=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/libregex-7167774a23191df9.rlib --extern rustc_hash=/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/target/release/deps/librustc_hash-eb8763e65cb328e9.rlib`
      Finished release [optimized] target(s) in 41.82s
  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/setup.py", line 4, in <module>
      setup(
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/__init__.py", line 108, in setup
      return distutils.core.setup(**attrs)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
      self.run_command(cmd)
    File "/home/mtw/Schreibtisch/chaquopy-master/server/pypi/env/lib/python/sitecustomize.py", line 28, in run_command_override
      run_command_original(self, command)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/dist.py", line 1221, in run_command
      super().run_command(command)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/mtw/.local/lib/python3.10/site-packages/wheel/bdist_wheel.py", line 192, in run
      self.run_command('build')
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/home/mtw/Schreibtisch/chaquopy-master/server/pypi/env/lib/python/sitecustomize.py", line 28, in run_command_override
      run_command_original(self, command)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/dist.py", line 1221, in run_command
      super().run_command(command)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/command/build.py", line 131, in run
      self.run_command(cmd_name)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/home/mtw/Schreibtisch/chaquopy-master/server/pypi/env/lib/python/sitecustomize.py", line 28, in run_command_override
      run_command_original(self, command)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/dist.py", line 1221, in run_command
      super().run_command(command)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools_rust/setuptools_ext.py", line 156, in run
      build_rust.run()
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools_rust/command.py", line 101, in run
      self.run_for_extension(ext)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools_rust/build.py", line 128, in run_for_extension
      self.install_extension(ext, dylib_paths)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools_rust/build.py", line 344, in install_extension
      ext_path = self.get_dylib_ext_path(ext, module_name)
    File "/home/mtw/.local/lib/python3.10/site-packages/setuptools_rust/build.py", line 403, in get_dylib_ext_path
      host_arch = host_platform.rsplit("-", 1)[1]
  IndexError: list index out of range
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /usr/bin/python3.10 -u -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize
  
  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)
  
  __file__ = %r
  sys.argv[0] = __file__
  
  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"
  
  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'/home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-vujrrhtv
  cwd: /home/mtw/Schreibtisch/chaquopy-master/server/pypi/packages/tiktoken/build/0.3.3/cp310-cp310-android_21_arm64_v8a/src/
  Building wheel for tiktoken (setup.py) ... error
  ERROR: Failed building wheel for tiktoken
  Running setup.py clean for tiktoken
  Running command python setup.py clean
  Chaquopy: clean command disabled
Failed to build tiktoken
ERROR: Failed to build one or more wheels
build-wheel.py: Error: Command returned exit status 1

I really don't know what to do here, maybe you have an idea.

BTW this is how my meta.yaml looks like:

package:
  name: tiktoken
  version: 0.3.3

requirements:
   build:
     - setuptools-rust 1.5.2
     - setuptools 67.6.1

Thank you again for your efforts regarding this issue! I hope you can help me out on this one.

@mhsmith
Copy link
Member Author

mhsmith commented Apr 2, 2023 •
edited
Loading

Unfortunately our package build tool doesn't currently have working support for Rust. The most recent discussion about this is in #1030.

@0cothucluc
Copy link

0cothucluc commented Aug 5, 2023 •
edited by mhsmith
Loading

[Moved to #927]

@mhsmith mhsmith mentioned this issue Jun 23, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
packages
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mhsmith @Matthaeus07 @0cothucluc