Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added support for head() and tail() for blink tables #4136

Merged
merged 13 commits into from
Jul 11, 2023

Conversation

malhotrashivam
Copy link
Contributor

@malhotrashivam malhotrashivam commented Jul 5, 2023

Feature request, closes #2411

Change description: Before this change, head/tail operations on blink table would return the head/tail of the rows added to the blink table in the latest update cycle. After this change, head/tail would act the same as they would on an append-only (full history) table derived from the stream. For example, head(10) on a blink table would store the first 10 rows received by the blink table after the operation and then won't change. Similarly, tail(10) would store the latest 10 rows received by the blink table.
Also, after this change, headPct(), taillPct() and slice() will not be supported for blink tables and will return an error.

Documentation change: We need to provide the above description in the documentation pages of blink tables and these operations. These are some places I could find: Blink table, head Python, head Java, tail Python, tail Java

@malhotrashivam malhotrashivam added feature request New feature or request query engine core Core development tasks DocumentationNeeded NoReleaseNotesNeeded No release notes are needed. labels Jul 5, 2023
@malhotrashivam malhotrashivam added this to the July 2023 milestone Jul 5, 2023
@malhotrashivam malhotrashivam self-assigned this Jul 5, 2023
Copy link
Contributor

@lbooker42 lbooker42 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is looking good. Let's ask @rcaudy about disconnecting the listener when the table is full (assuming you haven't).

@malhotrashivam malhotrashivam changed the title (WIP) Added support for head() and tail() for blink tables Added support for head() and tail() for blink tables Jul 7, 2023
@malhotrashivam malhotrashivam merged commit a2db33d into deephaven:main Jul 11, 2023
10 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Jul 11, 2023
@deephaven-internal
Copy link
Contributor

Labels indicate documentation is required. Issues for documentation have been opened:

How-to: https://github.com/deephaven/deephaven.io/issues/2891
Reference: https://github.com/deephaven/deephaven.io/issues/2892

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
core Core development tasks DocumentationNeeded feature request New feature or request NoReleaseNotesNeeded No release notes are needed. query engine
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make head and tail on a blink table act as if they have full history
4 participants