castTimestampToDate does not work since arrow upgrade to v16

[kaciakmaciak]

What happens?

castTimestampToDate option does not have effect since the arrow has been bumped to v16. The timestamps being returned as number.

To Reproduce

const duckdbInstance = new duckdb.AsyncDuckDB(logger, worker);
await duckdbInstance.open({
  query: {
    castTimestampToDate: true,
  },
});

const connection = await duckdbInstance.connect();
const result = await connection.query(`
  SELECT TIMESTAMP '1992-03-22 01:02:03' as value
`);
const value = result.toArray()[0]?.value; // value should be an instance of Date, but is a number

Browser/Environment:

any

Device:

any

DuckDB-Wasm Version:

1.28.1-dev242.0

DuckDB-Wasm Deployment:

shell.duckdb.org

Full Name:

Katarina Anton

Affiliation:

Individual

[kaciakmaciak]

Please see an example in Codesandbox.

[carlopi]

I defer here to @domoritz, I don't think there has been any relevant change duckdb-wasm side / I am not sure what's preferable here, do you have any recommendations?

[domoritz]

I don't think there was any change in arrow related to this. Iirc duckdb chnages the output type not arrow.

[carlopi]

Thanks for chiming in, let me take a deeper look then

[kaciakmaciak]

If that helps, if I force Arrow 15 to be installed, it works as expected.

[kimmolinna]

I checked the version 1.28.1-dev226.0 is the last one which is working

[kimmolinna]

@domoritz do you have any ideas why this is working with Arrow 15 but not with Arrow 16 according to @kaciakmaciak?