Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet test isn't properly failing #88

Open
visch opened this issue Jul 2, 2024 · 0 comments
Open

Parquet test isn't properly failing #88

visch opened this issue Jul 2, 2024 · 0 comments

Comments

@visch
Copy link
Member

visch commented Jul 2, 2024

This should cause the test to fail when at this commit f651c45

meltano lock --update --all 
meltano install
meltano config tap-universal-file set file_type parquet
meltano config tap-universal-file set parquet_type_coercion_strategy envelope
meltano config tap-universal-file set file_type file_regex "^.*racing\\.parquet$"
meltano invoke tap-unviersal-file

I get the error

tap-universal-file-py3.10visch@DESKTOP-9BDPA9T:~/git/tap-universal-file$ meltano invoke tap-universal-file
2024-07-02T16:33:13.485002Z [info     ] Environment 'test' is active  
Need help fixing this problem? Visit http://melta.no/ for troubleshooting steps, or to
join our friendly Slack community.

Catalog discovery failed: command ['/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/bin/tap-universal-file', '--config', '/home/visch/git/tap-universal-file/.meltano/run/tap-universal-file/tap.8127f8c9-7a4d-45cc-991f-21b171619874.config.json', '--discover'] returned 1 with stderr:
 
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last):  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/bin/tap-universal-file", line 5, in <module>
    from tap_universal_file.tap import TapUniversalFile
  File "/home/visch/git/tap-universal-file/tap_universal_file/tap.py", line 19, in <module>
    from tap_universal_file import streams
  File "/home/visch/git/tap-universal-file/tap_universal_file/streams.py", line 15, in <module>
    import pyarrow as pa
  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/lib/python3.10/site-packages/pyarrow/__init__.py", line 65, in <module>
    import pyarrow.lib as _lib
AttributeError: _ARRAY_API not found
Traceback (most recent call last):
  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/bin/tap-universal-file", line 5, in <module>
    from tap_universal_file.tap import TapUniversalFile
  File "/home/visch/git/tap-universal-file/tap_universal_file/tap.py", line 19, in <module>
    from tap_universal_file import streams
  File "/home/visch/git/tap-universal-file/tap_universal_file/streams.py", line 15, in <module>
    import pyarrow as pa
  File "/home/visch/git/tap-universal-file/.meltano/extractors/tap-universal-file/venv/lib/python3.10/site-packages/pyarrow/__init__.py", line 65, in <module>
    import pyarrow.lib as _lib
  File "pyarrow/lib.pyx", line 36, in init pyarrow.lib
ImportError: numpy.core.multiarray failed to import
@visch visch mentioned this issue Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant