Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Branch 43 downgraded tonic #5

Open
wants to merge 1,524 commits into
base: main
Choose a base branch
from
Open

Conversation

matthewmturner
Copy link

Which issue does this PR close?

Closes #.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

alamb and others added 30 commits October 8, 2024 06:37
…he#12745)

* remove redundant aggregate documentation

* remove redundant window documentation

* remove rudundant scalar functions
* Improve documentation, make DependencyMap / Dependencies a real struct + fix stack overflow

* Update datafusion/physical-expr/src/equivalence/properties.rs

Co-authored-by: Berkay Şahin <[email protected]>

---------

Co-authored-by: Berkay Şahin <[email protected]>
* API to go from `ParquetExec` to `ParquetExecBuilder`

* fix potential regression

* Apply suggestions from code review

Co-authored-by: Nga Tran <[email protected]>

* add note about fields being re-created

---------

Co-authored-by: Nga Tran <[email protected]>
* Minor: add documentation note about `NullState`

* Remove unecessary copy/paste license

* Update datafusion/expr-common/src/groups_accumulator.rs
…zer crate (apache#12783)

* move test from core to optimizer crate

Signed-off-by: jayzhan211 <[email protected]>

* cleanup

Signed-off-by: jayzhan211 <[email protected]>

* upd

Signed-off-by: jayzhan211 <[email protected]>

* clippy

Signed-off-by: jayzhan211 <[email protected]>

* fmt

Signed-off-by: jayzhan211 <[email protected]>

---------

Signed-off-by: jayzhan211 <[email protected]>
…pache#12825)

Bumps [cookie](https://github.com/jshttp/cookie) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `cookie` from 0.6.0 to 0.7.1
- [Release notes](https://github.com/jshttp/cookie/releases)
- [Commits](jshttp/cookie@v0.6.0...v0.7.1)

Updates `express` from 4.21.0 to 4.21.1
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/4.21.1/History.md)
- [Commits](expressjs/express@4.21.0...4.21.1)

---
updated-dependencies:
- dependency-name: cookie
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Remove unused dependencies and features

* Update Cargo.lock

* Remove regex and base64
* impl primitive arrays generator.

* sort out the test record batch generating codes.

* draft for `DataSetsGenerator`.

* tmp

* improve the data generator, and start to impl the session context generator.

* impl context generator.

* tmp

* define the `AggregationFuzzer`.

* add ut for data generator.

* improve comments for `SessionContextGenerator`.

* define `GeneratedSessionContextBuilder` to reduce repeated codes.

* extract the check equality logic for reusing.

* add ut for `SessionContextGenerator`.

* tmp

* finish the main logic of `AggregationFuzzer`.

* try to rewrite some test using the fuzzer.

* fix header.

* expose table name through `AggregationFuzzerBuilder`.

* throw err to aggr fuzzer, and expect them then.

* switch to Arc<str> to slightly improve performance.

* throw more errors to fuzzer.

* print task informantion before panic.

* improve comments.

* support printing generated session context params in error reporting.

* add todo.

* add some new fuzz case based on `AggregationFuzzer`.

* fix lint.

* print more information in error report.

* fix clippy.

* improve comment of `SessionContextGenerator`.

* just use fixed `data_gen_rounds` and `ctx_gen_rounds` currently, because we will hardly set them.

* improve comments for rounds constants.

* small improvements.

* select sql from some candidates ranther than fixed one.

* make `data_gen_rounds` able to set again, and add more tests.

* add no group cases.

* add fuzz test for basic string aggr.

* make `data_gen_rounds` smaller.

* add comments.

* fix typo.

* fix comment.
…pache#12804)

* Patched from `lead-lag` conversion tree

* Fixes unit tests in `row_number` udwf

* Add doc comments

* Updates doc comment

* Updates API to expose `input_exprs` directly

* Updates API to returns data types of input expressions
`Setup rust toolchain` build step was observed to be flaky. Retries may
help.
…int[3]`) (apache#12810)

* add arm to process array def with square bracket as fixedsizelist

* add tests
* Make HashJoinExec::join_schema public

It is needed by physical optimizers that want to replace the HashJoin with a different
type of join, as they need to replace it with an equivalent projection, but
HashJoinExec::projection could not be used to build it because it refers to
indices in HashJoinExec::join_schema.

* Replace it with an accessor
* Fixed NaN Error

* fmt fix

* Added guard

* Remove checks
Fix Bug in Display for ScalarValue::Struct (apache#12856)
… UDWF (apache#12718)

* wip: converting rank builtin function to UDWF

* commented BuiltInWindowFunction in datafusion.proto and fixed issue related to Datafusion window function

* implemented rank.rs, percent_rank.rs and dense_rank.rs in datafusion functions-window

* removed a test from built in window function test for percent_rank and updated pbson fields

* removed unnecessary code

* added window_functions field to the MockSessionState

* updated rank, percent_rank and dense_rank udwf to use macros

* wip: fix rank functionality in sql integration

* fixed rank udwf not found issue in sql_integration.rs

* evaluating rank, percent_rank and dense_rank udwf with evaluate_with_rank function

* fixed rank projection test

* wip: fixing the percent_rank() documentation

* fixed the docs error issue

* fixed data type of the percent_rank udwf

* updated prost.rs file

* updated test and documentation

* Fix logical conflicts

* tweak module documentation

---------

Co-authored-by: jatin <[email protected]>
Co-authored-by: Andrew Lamb <[email protected]>
* Do not optimise regex casts in `UnwrapCastInComparison`

* Mark regex operators are non-comparison ones

* Also remove is distinct from

* Rename method for `supports_propagation` for clarity

* Remove duplicated tests

* Fix doctest

* Revert `supports_propagation` and handle dicts in `binary_string_array_flag_op_scalar`

* Update tabulation

* Minimise code inside `downcast_dictionary_array!` to fix wasm-pack build

* Switch to `as_any_dictionary`

* Use `take_iter`

* Revert `is_comparison_operator` and make it deprecated
* Small changes in datafusion/sql folder

* more small changes
* Update crypto docs

* delete old

* fmt checks
* add duckdb struct n row

Signed-off-by: jayzhan211 <[email protected]>

* fmt

Signed-off-by: jayzhan211 <[email protected]>

---------

Signed-off-by: jayzhan211 <[email protected]>
alamb and others added 13 commits November 2, 2024 06:24
* Derive `Clone` for more ExecutionPlans

* improve docs
* [logical-types] add NativeType and LogicalType

* Add license header

* Add NativeField and derivates

* Support TypeSignatures

* Fix doc

* Add documentation

* Fix doc tests

* Remove dummy test

* From NativeField to LogicalField

* Add default_cast_for

* Add type order with can_cast_types

* Rename NativeType Utf8 to String

* NativeType from &DataType

* Add builtin types

* From LazyLock to OnceLock
* Apply projection to `Statistics` in `FilterExec`

* Use Statistics::project in HashJoin
…er (apache#13130)

* overloaded from ts

* Update docs/source/user-guide/sql/scalar_functions_new.md

Co-authored-by: Bruce Ritchie <[email protected]>

* fixed return type

* added sql example

* optional in ∂oc

* review

---------

Co-authored-by: Bruce Ritchie <[email protected]>
Co-authored-by: Andrew Lamb <[email protected]>
…13174)

* Deprecate invoke and invoke_no_args in favor of invoke_batch

`invoke_batch` covers all needs, so let's deprecate and eventually
remove the redundant variants.

* Migrate test_function to invoke_batch

* Migrate regexpcount tests to invoke_batch

* Migrate log tests to invoke_batch

* Migrate tests to use invoke_batch

* Migrate ToUnixtimeFunc to implement invoke_batch

* Suppress deprecation warnings in tests

To be followed-up on.

* Migrate random benchmark to invoke_batch

* fixup! Suppress deprecation warnings in tests

* Fix docstring
* Remove deprecated transform functions

They were deprecated since 38.0.0, which was released 6 months ago.

* Remove deprecated and unused FileSinkExec type

It was deprecated since 38.0.0, which was released 6 months ago.
@xudong963 xudong963 force-pushed the branch-43-downgraded-tonic branch from e640d67 to 917588c Compare January 22, 2025 04:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.