GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | |||||||||||||||||||||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | |||||||||||||||||||||||||||||||||
GeezerVison is showing github.com — [SQL] Dataflow analysis to compute for each stream whether it's a (multi)set by mihaibudiu · Pull Request #7725 · feldera/feldera Conversation
Contributor
Linked IssuePreviously each operator used to carry a bit indicating whether it expects the output (or the integrated output for an incremental circuit) to be a set or a multiset. This is used to remove some unneeded DISTINCT calls. This PR removes the bit from the operator and adds a dataflow analysis which recomputes the value of the bit. This is better because the bit cannot become stale by mistake: it is only valid immediately after the analysis has run. The analysis is a bit more precise now too: it tries to prove that some functions are injective, if they can preserve sets, and recursive circuits insert DISTINCT calls automatically; now we use this information (although I think the compiler should insert the distincts, not the circuit builder). Checklist
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
ryzhyk
approved these changes
…lti)set Signed-off-by: Mihai Budiu <[email protected]>
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. pitfall (medium): persistent ids change on upgrade. This bit is part of the global hash. The more precise analysis flips it for some operators, and the change carries into every downstream id.
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. bug (medium): outputs with a null
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Contributor
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. Uh oh!
There was an error while loading. Please reload this page.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
ReviewersUh oh!
There was an error while loading. Please reload this page. AssigneesNo one assignedLabels
None yet
ProjectsMilestoneNo milestoneDevelopmentSuccessfully merging this pull request may close these issues. [SQL] map_index that drops a table's primary key is marked distinct [SQL] Make the "is multiset" flag the result of a dynamic analysisUh oh!
There was an error while loading. Please reload this page. Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later. | |||||||||||||||||||||||||||||||||
| You are visitor 01402520 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |