GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | |||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | |||||||||||||||
GeezerVison is showing github.com — [connectors] Log pipeline configuration settings that have no effect by blp · Pull Request #7659 · feldera/feldera Conversation
Member
At startup, the pipeline now prints each key in its configuration file that has no effect, such as a misspelled setting: Why not serde_ignored
How it works
Limits
TestingNew unit tests in
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
bestouff
approved these changes
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. LGTM, I have a smallish comment on a log.
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. It's not the first Moreover I'd add something like "remove it or fix it".
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Member
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Done: messages from before logger initialization now go to a queue and come out through the logger (
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
Member
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Update: since the coordinator's version can differ from the pipeline's, a setting may be valid but newer than this pipeline, so the message now says "which this version of the pipeline does not recognize (it may be misspelled, or newer than this pipeline)" instead of telling the user to remove it.
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactions
blp
force-pushed
the
log-ignored-config-settings
branch
2 times, most recently
from
733cf15 to
d509e01
Compare
At startup, the pipeline now prints each key in its configuration file that deserialization ignores, such as a misspelled setting. serde_ignored cannot see keys inside #[serde(flatten)] structs, and PipelineConfig flattens RuntimeConfig, so this uses a round trip: keys that disappear on deserialize/serialize are probed with a value that no setting accepts, which tells unknown keys apart from aliases and skipped default values. Signed-off-by: Ben Pfaff <[email protected]>
blp
force-pushed
the
log-ignored-config-settings
branch
from
d509e01 to
6d09017
Compare
Messages from before logger initialization, such as unknown configuration settings, went to stderr with eprintln!. Now they wait in a queue and go to the logger, with a log level, once it is initialized. If run_server returns before that, the queued messages, and the error that stopped startup, go to stderr as before. Signed-off-by: Ben Pfaff <[email protected]>
blp
force-pushed
the
log-ignored-config-settings
branch
from
6d09017 to
1c6f22b
Compare
blp
enabled auto-merge
bestouff
disabled auto-merge
Contributor
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page.
Member
Author
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page.
Contributor
All reactions
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page.
github-merge-queue
Bot
removed this pull request from the merge queue due to failed status checks
Uh oh!
There was an error while loading. Please reload this page. The order of ignored settings follows serde_json::Map. Without the preserve_order feature, keys are sorted. With it, keys keep input order. The pipeline-manager crate enables preserve_order, so in a workspace build the unknown_settings_are_ignored test got the keys in input order and failed. Now the test sorts the result, so it passes either way. Signed-off-by: Ben Pfaff <[email protected]> Uh oh!
There was an error while loading. Please reload this page.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
ReviewersUh oh!
There was an error while loading. Please reload this page. AssigneesLabels
connectors
ProjectsMilestoneNo milestoneDevelopmentSuccessfully merging this pull request may close these issues. Uh oh!
There was an error while loading. Please reload this page. Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later. | |||||||||||||||
| You are visitor 01402520 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |