GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | |||||||||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | |||||||||||||||||||||
GeezerVison is showing github.com — feat: Add native_numeric_types to the Milvus online store by simonhearne · Pull Request #7025 · feast-dev/feast Conversation
Contributor
What this PR does / why we need it:The Milvus online store stores numeric and bool features as VARCHAR unless This PR adds online_store: type: milvus native_numeric_types: true The docs describe the migration: set the flag, run If you would rather not add a Milvus-only alias for a cross-store flag, I can reduce this PR to Which issue(s) this PR fixes:N/A Checks
Testing Strategy
Unit tests run on Milvus Lite 3.2.1 (pymilvus 3.0.2). The existing server tests in MiscPart of a series of Milvus online store improvements for Zilliz Cloud and production Milvus, following #6882, #6895, #6917, #6921 and #6940.
Sorry, something went wrong. Uh oh!
There was an error while loading. Please reload this page. All reactionsMilvus stores numeric features as VARCHAR unless enable_openai_compatible_store is set, so range filters compare lexicographically. That flag is shared by several online stores, and its name doesn't say that for Milvus it only switches numeric storage. Adds native_numeric_types as a Milvus-specific, clearly named way to store numeric and bool features as native Milvus types. Either flag enables it, so existing configs are unaffected. The warning for numeric filters on VARCHAR collections now points to the new flag, and the docs describe how to migrate existing collections. Co-Authored-By: Claude Opus 5.5 <[email protected]> Signed-off-by: Simon Hearne <[email protected]>
|
There was an error while loading. Please reload this page.
|
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@ ## master #7025 +/- ## ========================================== + Coverage 50.97% 51.02% +0.04% ========================================== Files 455 455 Lines 56994 56997 +3 Branches 8321 8321 ========================================== + Hits 29055 29082 +27 + Misses 25954 25934 -20 + Partials 1985 1981 -4
... and 1 file with indirect coverage changes Continue to review full report in Codecov by Harness.
🚀 New features to boost your workflow:
|
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
@ntkathole LMK if you have any thoughts on this PR. |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
The numeric filter correctness fix and the backward-compatible alias look reasonable. One migration concern: the documented |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
Teardown drops every collection in the project and loses online-only rows, so the docs now warn about it and describe a staged cutover that avoids it. Numeric range filters on VARCHAR collections don't compare lexicographically as the warning and docs said: Milvus rejects numeric filter values on VARCHAR fields, and only string values compare as text. Correct both, and add a regression test that turns on native_numeric_types over an existing VARCHAR collection. Co-Authored-By: Claude Opus 5.5 <[email protected]> Signed-off-by: Simon Hearne <[email protected]>
|
@haoxu0 thank you for the review, both points are addressed in 206309f. Migration warning. The Numeric types section now has a warning hint: Mixed-collection regression. Writing that test showed that the existing warning (and my docs) described the wrong behaviour on VARCHAR collections. A numeric filter value doesn't compare lexicographically: Milvus rejects it ( |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
@haoxu0 just following up. Both points from your review are addressed in 206309f: there's a warning before teardown plus a staged cutover in the docs, and a regression test for mixed VARCHAR collections. CI is now fully green. If you're happy with it, could you approve and merge, or add ok-to-test if you'd like the integration suites to run first? I have a BM25 / hybrid search PR ready that builds on this one. Thanks! |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
Closing this as superseded by #7120, which extends native storage to arrays and JSON behind |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
Successfully merging this pull request may close these issues.
There was an error while loading. Please reload this page.