GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | ||||||||||||||||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | ||||||||||||||||||||||||||||
GeezerVison is showing github.com — [fxp] Round half-even values below one unit to ±1, not 0. by blp · Pull Request #7796 · feldera/feldera Conversation
Member
This affects every half-even path in fxp: The new test Fixes #7717.
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Contributor
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page.
mihaibudiu
approved these changes
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Does this affect gen2?
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Member
Author
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. i128_mul_pow10_round_even() stepped away from zero by the sign of the truncated quotient. When the quotient was 0, the step was 0, so values such as 0.6 at scale 0 rounded to 0 instead of 1. Step by the sign of the value instead, as round_inner() does. Add tests in fxp and in the SQL compiler, for CAST of VARCHAR to DECIMAL and of DECIMAL to TIMESTAMP. Fixes #7717. Signed-off-by: Ben Pfaff <[email protected]>
blp
force-pushed
the
fxp-round-even-fix
branch
from
daba26f to
7f9fee6
Compare
Member
Author
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. Uh oh!
There was an error while loading. Please reload this page.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
ReviewersUh oh!
There was an error while loading. Please reload this page. AssigneesProjectsMilestoneNo milestoneDevelopmentSuccessfully merging this pull request may close these issues. [fxp] half-even rounding gives 0 instead of ±1 when the truncated quotient is 0Uh oh!
There was an error while loading. Please reload this page. Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later. | ||||||||||||||||||||||||||||
| You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |