You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You could at least tell us what line it's occuring on, and also likely where the origin of the exception is.
(DataStreamer pid=974272) Failed to unpickle serialized exception
(DataStreamer pid=974272) Traceback (most recent call last):
(DataStreamer pid=974272) File "/usr/local/lib/python3.11/site-packages/ray/exceptions.py", line 51, in from_ray_exception
(DataStreamer pid=974272) return pickle.loads(ray_exception.serialized_exception)
(DataStreamer pid=974272) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(DataStreamer pid=974272) File "/usr/local/lib/python3.11/site-packages/jax/_src/errors.py", line 314, in __init__
(DataStreamer pid=974272) f"{tracer._error_repr()}{tracer._origin_msg()}")
(DataStreamer pid=974272) ^^^^^^^^^^^^^^^^^^
(DataStreamer pid=974272) AttributeError: 'str' object has no attribute '_error_repr'
(DataStreamer pid=974272)
(DataStreamer pid=974272) The above exception was the direct cause of the following exception:
(DataStreamer pid=974272)
(DataStreamer pid=974272) Traceback (most recent call last):
(DataStreamer pid=974272) File "/usr/local/lib/python3.11/site-packages/ray/_private/serialization.py", line 460, in deserialize_objects
(DataStreamer pid=974272) obj = self._deserialize_object(data, metadata, object_ref)
(DataStreamer pid=974272) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(DataStreamer pid=974272) File "/usr/local/lib/python3.11/site-packages/ray/_private/serialization.py", line 342, in _deserialize_object
(DataStreamer pid=974272) return RayError.from_bytes(obj)
(DataStreamer pid=974272) ^^^^^^^^^^^^^^^^^^^^^^^^
(DataStreamer pid=974272) File "/usr/local/lib/python3.11/site-packages/ray/exceptions.py", line 45, in from_bytes
(DataStreamer pid=974272) return RayError.from_ray_exception(ray_exception)
(DataStreamer pid=974272) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(DataStreamer pid=974272) File "/usr/local/lib/python3.11/site-packages/ray/exceptions.py", line 54, in from_ray_exception
(DataStreamer pid=974272) raise RuntimeError(msg) from e
(DataStreamer pid=974272) RuntimeError: Failed to unpickle serialized exception
Versions / Dependencies
2.39
Reproduction script
Not possible because the poor exception messages makes it hard to find out where the problem is.
Issue Severity
High: It blocks me from completing my task.
The text was updated successfully, but these errors were encountered:
Joshuaalbert
added
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
labels
Jan 16, 2025
@wingkitlee0 I am able to find the source of the problem after a trial and error search with debug messages since JAX is used in many places. However, I'm loath to discuss the cause of the exception (which is simple to solve once found) because I've been asking Ray to put better messages in the case of unserialisable exceptions for some time, and their engineers like to ignore the request and talk rather about the exception. It's an edge case that an exception is not serialisable, and they should handle it.
What happened + What you expected to happen
You could at least tell us what line it's occuring on, and also likely where the origin of the exception is.
Versions / Dependencies
2.39
Reproduction script
Not possible because the poor exception messages makes it hard to find out where the problem is.
Issue Severity
High: It blocks me from completing my task.
The text was updated successfully, but these errors were encountered: