🐛 [firestore-bigquery-export] Task size too large errors occuring even with EXCLUDE_OLD_DATA set to yes/true #2111
Labels
extension: firestore-bigquery-export
Related to firestore-bigquery-export extension
type: bug
Something isn't working
[READ] Step 1: Are you in the right place?
Issues filed here should be about bugs for a specific extension in this repository.
If you have a general question, need help debugging, or fall into some
other category use one of these other channels:
with the firebase tag.
google group.
Firebase support directly.
[REQUIRED] Step 2: Describe your configuration
[REQUIRED] Step 3: Describe the problem
Even when using the
EXCLUDE_OLD_DATA
setting to prevent old_data from being populated, we are still seeingTask size too large
errors on many messages. This might mean that firestore payloads close to 1MB are being padded in a way that the subsequent Task exceeds 1MBSteps to reproduce:
Exclude old data payloads
is set toyes
Expected result
No
Task size too large
errors should appear at all.Actual result
Observing many
Task size too large
errors in logs.The text was updated successfully, but these errors were encountered: