GeezerVison

The World Wide Web, restored to 800 pixels of glory.

GeezerVison is showing github.com — feat: Optional nameless pre-computed vectors with a schema fingerprint by chandlerok · Pull Request #7077 · feast-dev/feast

Conversation

chandlerok commented Oct 26, 2026 •

edited

Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link

Copy Markdown

Contributor

What this PR does / why we need it:

Adds an opt-in precompute_omit_names on FeatureService. Vectors written for such a service carry values, per-view timestamps, and a fingerprint of the service's ordered <fv>__<feature> names instead of the repeated name list. The fast path validates a nameless vector by fingerprint and takes its names from the service. Vectors with names keep working as before, and a vector whose fingerprint does not match the service falls through to the existing mismatch handling.

Measured on a 90-feature service, Feast 0.67.0, Redis store:

	bytes per entity	bytes read for 500 entities
pre-computed vector, with names (today)	4773 B, 3774 B of it names	2.4 MB
pre-computed vector, `precompute_omit_names=True`	834 B	414 KB
per-view HMGET of the same 90 features (what the vector replaces)	n/a	550 KB

The names are identical for every entity, so today the single-read path moves 4x the bytes of the per-view path it replaces.

Proto changes: FeatureServiceSpec.precompute_omit_names and PrecomputedFeatureVector.schema_fingerprint, both additive. Generated code is from grpcio-tools 1.62.3 (protobuf 4.25) and mypy-protobuf 3.3.0 so the diff against the checked-in files is only the new fields.

Stacked on #7076; the first two commits are that PR.

Which issue(s) this PR fixes:

Fixes #7075

Checks

I've made sure the tests are passing.
My commits are signed off (git commit -s)
My PR title follows conventional commits format

Testing Strategy

Unit tests
Integration tests
Manual tests
Testing is not required for this change

New unit tests: nameless vector matches and reorders by fingerprint, stale fingerprint falls back, nameless vector without a service falls back, flag round-trips through proto, fingerprint follows feature order. test_precomputed_feature_vectors.py and local_feast_tests/test_feature_service.py pass locally.

Misc

@ntkathole

🤖 Generated with Claude Code

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions

chandlerok and others added 3 commits

October 26, 2026 19:16


          feat: Refresh pre-computed vectors for pushed entities only

984def1

precompute_feature_service accepts entity_keys and skips the keyspace scan
when they are given. The push hook now passes the distinct entity keys from
the pushed DataFrame instead of rebuilding every entity in the store.

Signed-off-by: Chandler King <[email protected]>
Co-Authored-By: Claude Fable 5.1 <[email protected]>


          fix: Match pre-computed vector names when full_feature_names is False

5262d64

Stored vectors carry "<fv>__<feature>" names while the default request
expects bare feature names, so the fast path always reported a schema
mismatch unless full_feature_names=True. Compare on the caller's naming and
derive the per-feature view name from the stored names for TTL checks.

Signed-off-by: Chandler King <[email protected]>
Co-Authored-By: Claude Fable 5.1 <[email protected]>


          feat: Optional nameless pre-computed vectors with a schema fingerprint

d39d949

A pre-computed vector stores the full repeated feature name list next to its
values. For a wide service that is most of the blob: 90 features came to
4.8 KB per entity, 3.8 KB of it names that are identical for every entity.

FeatureService gains precompute_omit_names. Vectors written for such a
service carry only values, per-view timestamps, and a fingerprint of the
service's ordered names. The fast path validates a nameless vector by
fingerprint and takes its names from the service. Vectors with names keep
working as before. With the flag on the same blob is 834 bytes, and a
500-entity read moves 414 KB instead of 2.4 MB.

Generated code is from grpcio-tools 1.62.3 (protobuf 4.25) and mypy-protobuf
3.3.0 to match the checked-in files.

Signed-off-by: Chandler King <[email protected]>
Co-Authored-By: Claude Fable 5.1 <[email protected]>

chandlerok requested review from a team as code owners

October 26, 2026 23:19

chandlerok requested review from ejscribner, robhowley and tokoko and removed request for a team

October 26, 2026 23:19

chandlerok mentioned this pull request

Oct 26, 2026

precompute_online: feature names are about 80% of every vector blob #7075

Closed

codecov-commenter commented Oct 26, 2026 •

edited

Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link

Copy Markdown

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 58.20896% with 28 lines in your changes missing coverage. Please review.
✅ Project coverage is 51.03%. Comparing base (bbaca76) to head (92367bd).
⚠️ Report is 22 commits behind head on master.

Files with missing lines	Patch %	Lines
sdk/python/feast/feature_store.py	34.88%	28 Missing ⚠️
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #7077      +/-   ##
==========================================
- Coverage   51.32%   51.03%   -0.29%     
==========================================
  Files         458      455       -3     
  Lines       57441    56906     -535     
  Branches     8421     8287     -134     
==========================================
- Hits        29482    29044     -438     
+ Misses      25950    25895      -55     
+ Partials     2009     1967      -42

Flag	Coverage Δ		*Carryforward flag
go-feature-server	`30.58% <ø> (ø)`
python-unit	`52.50% <58.20%> (-0.30%)`	⬇️	Carriedforward from 644ba3a

*This pull request uses carry forward flags. Click here to find out more.

Files with missing lines	Coverage Δ
sdk/python/feast/feature_service.py	`84.05% <100.00%> (+0.55%)`	⬆️
...k/python/feast/infra/online_stores/online_store.py	`85.14% <100.00%> (+0.66%)`	⬆️
sdk/python/feast/feature_store.py	`47.27% <34.88%> (+0.38%)`	⬆️

... and 12 files with indirect coverage changes

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1396c88...92367bd. Read the comment docs.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

chandlerok commented Oct 27, 2026

Copy link

Copy Markdown

Contributor Author

The one red check is unit-test-python (3.12, macos-14): test_start_script_can_fail_before_docker_when_repo_missing died with SIGTRAP under the gRPC fork handlers, nothing this PR touches. The same job is green on #7076 and the 3.11 macOS job is green here. Could a maintainer rerun it?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

chandlerok and others added 2 commits

October 29, 2026 23:03


          chore: Retrigger CI

644ba3a

Signed-off-by: Chandler King <[email protected]>


          Merge branch 'master' into feat/precompute-nameless-vectors

92367bd

shuchu merged commit 9420fac into feast-dev:master

Nov 10, 2026

14 of 20 checks passed

Uh oh!

There was an error while loading. Please reload this page.

shuchu approved these changes

Nov 10, 2026

View reviewed changes

shuchu left a comment

Copy link

Copy Markdown

Collaborator

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions

patelchaitany mentioned this pull request

Nov 10, 2026

chore: Sync upstream feast-dev/feast master opendatahub-io/feast#288

Merged

franciscojavierarceo pushed a commit that referenced this pull request

Nov 10, 2026


          chore(release): release 0.68.0

fb5e5d5

# [0.68.0](v0.67.0...v0.68.0) (2026-11-10)

### Bug Fixes

* add watch verb on clusterroles and clusterrolebindings for feast-operator ([#7062](#7062)) ([b6bdda4](b6bdda4))
* Apply on demand feature views in SparkRetrievalJob.to_spark_df() ([#6993](#6993)) ([f416309](f416309))
* Break event timestamp ties by created timestamp in Milvus write batches ([#7084](#7084)) ([bbaca76](bbaca76))
* Break event timestamp ties by created timestamp in the Dask offline store ([#6952](#6952)) ([eb93b08](eb93b08))
* Build the Go feature server image in two stages ([1e5e90c](1e5e90c)), closes [#7060](#7060)
* Fall back to the serialized body when UDF source misses globals ([#6816](#6816)) ([f61079f](f61079f))
* Install patched libbrotli1 to address DSA-6582-1 ([#7096](#7096)) ([d458393](d458393))
* Keep description, tags and nested types of ODFV schema fields ([8ef6e75](8ef6e75))
* Keep entity columns out of StreamFeatureView proto features ([#7033](#7033)) ([d520584](d520584))
* Keep the metrics server running when a Gunicorn worker exits ([#7012](#7012)) ([68c5d54](68c5d54)), closes [#7011](#7011)
* Key registry proto caches on the proto, not its id() ([#7085](#7085)) ([147adad](147adad))
* Log ODFV materialization skips instead of printing them ([#7117](#7117)) ([8fdcee7](8fdcee7))
* Pin build dependencies of source builds to the CI lock ([#7104](#7104)) ([dec2f24](dec2f24))
* Populate spec.project in registry REST feature view responses (#… ([#7037](#7037)) ([e304a84](e304a84))
* Preserve colliding source timestamps in Dask retrieval ([#7071](#7071)) ([1396c88](1396c88))
* Preserve Dask historical requests without eligible features ([#7000](#7000)) ([fff09f7](fff09f7))
* Read None elements of UUID and Decimal lists as None ([#7039](#7039)) ([03f30fe](03f30fe))
* Retire the support of Python3.10 ([#7101](#7101)) ([a56766e](a56766e)), closes [#7104](#7104) [#7089](#7089) [#7106](#7106) [#7105](#7105)
* Serialize UUID and TimeUuid entity keys ([#7032](#7032)) ([0c845a1](0c845a1))
* Stop the Ray engine from hiding materialization errors ([#7026](#7026)) ([7903e2e](7903e2e)), closes [#7024](#7024)
* **ui:** stop treating the monitoring baseline as the latest window ([#7056](#7056)) ([0f01802](0f01802)), closes [#7054](#7054)
* Use date-only bounds for partition filters built from string timestamps ([#7116](#7116)) ([b1f2168](b1f2168))
* Validate entity column types in feast dbt import ([#7067](#7067)) ([abca80c](abca80c)), closes [#5876](#5876)
* Warm up the whole DynamoDB connection pool ([#6985](#6985)) ([8ce548c](8ce548c))

### Features

* Add --gc-freeze option to feast serve ([#7089](#7089)) ([aad0c15](aad0c15))
* Add native complex types and scalar index tags to the Milvus online store ([#7120](#7120)) ([f7068d6](f7068d6))
* Add num_partitions and partition_key_isolation to the Milvus online store ([#7083](#7083)) ([68de84e](68de84e)), closes [#6940](#6940)
* Add Pinecone online store integration ([#6585](#6585)) ([7a84f2a](7a84f2a))
* Add PolarisSource and PolarisProvider for Apache Polaris ([#7006](#7006)) ([386759c](386759c))
* Add row deletion to the Milvus online store ([#7082](#7082)) ([d3e2041](d3e2041))
* Add upstream FeatureView lineage support for PushSource ([#6853](#6853)) ([c9b9d72](c9b9d72))
* Optional nameless pre-computed vectors with a schema fingerprint ([#7077](#7077)) ([9420fac](9420fac))

### Performance Improvements

* Scan Lance sources lazily in the DuckDB offline store ([1299e4e](1299e4e))

patelchaitany mentioned this pull request

Nov 11, 2026

chore: Sync upstream feast-dev/feast stable (0.68.0) opendatahub-io/feast#291

Merged

shuchu added a commit to shuchu/feast that referenced this pull request

Nov 11, 2026


          feat: Optional nameless pre-computed vectors with a schema fingerprint (

acc7f47

feast-dev#7077)

* feat: Refresh pre-computed vectors for pushed entities only

precompute_feature_service accepts entity_keys and skips the keyspace scan
when they are given. The push hook now passes the distinct entity keys from
the pushed DataFrame instead of rebuilding every entity in the store.

Signed-off-by: Chandler King <[email protected]>
Co-Authored-By: Claude Fable 5.1 <[email protected]>

* fix: Match pre-computed vector names when full_feature_names is False

Stored vectors carry "<fv>__<feature>" names while the default request
expects bare feature names, so the fast path always reported a schema
mismatch unless full_feature_names=True. Compare on the caller's naming and
derive the per-feature view name from the stored names for TTL checks.

Signed-off-by: Chandler King <[email protected]>
Co-Authored-By: Claude Fable 5.1 <[email protected]>

* feat: Optional nameless pre-computed vectors with a schema fingerprint

A pre-computed vector stores the full repeated feature name list next to its
values. For a wide service that is most of the blob: 90 features came to
4.8 KB per entity, 3.8 KB of it names that are identical for every entity.

FeatureService gains precompute_omit_names. Vectors written for such a
service carry only values, per-view timestamps, and a fingerprint of the
service's ordered names. The fast path validates a nameless vector by
fingerprint and takes its names from the service. Vectors with names keep
working as before. With the flag on the same blob is 834 bytes, and a
500-entity read moves 414 KB instead of 2.4 MB.

Generated code is from grpcio-tools 1.62.3 (protobuf 4.25) and mypy-protobuf
3.3.0 to match the checked-in files.

Signed-off-by: Chandler King <[email protected]>
Co-Authored-By: Claude Fable 5.1 <[email protected]>

* chore: Retrigger CI

Signed-off-by: Chandler King <[email protected]>

---------

Signed-off-by: Chandler King <[email protected]>
Co-authored-by: Claude Fable 5.1 <[email protected]>
Co-authored-by: Shuchu Han <[email protected]>
Signed-off-by: Shuchu Han <[email protected]>

shuchu pushed a commit to shuchu/feast that referenced this pull request

Nov 11, 2026


          chore(release): release 0.68.0

5b94c9e

# [0.68.0](feast-dev/feast@v0.67.0...v0.68.0) (2026-11-10)

### Bug Fixes

* add watch verb on clusterroles and clusterrolebindings for feast-operator ([feast-dev#7062](feast-dev#7062)) ([b6bdda4](feast-dev@b6bdda4))
* Apply on demand feature views in SparkRetrievalJob.to_spark_df() ([feast-dev#6993](feast-dev#6993)) ([f416309](feast-dev@f416309))
* Break event timestamp ties by created timestamp in Milvus write batches ([feast-dev#7084](feast-dev#7084)) ([bbaca76](feast-dev@bbaca76))
* Break event timestamp ties by created timestamp in the Dask offline store ([feast-dev#6952](feast-dev#6952)) ([eb93b08](feast-dev@eb93b08))
* Build the Go feature server image in two stages ([1e5e90c](feast-dev@1e5e90c)), closes [feast-dev#7060](feast-dev#7060)
* Fall back to the serialized body when UDF source misses globals ([feast-dev#6816](feast-dev#6816)) ([f61079f](feast-dev@f61079f))
* Install patched libbrotli1 to address DSA-6582-1 ([feast-dev#7096](feast-dev#7096)) ([d458393](feast-dev@d458393))
* Keep description, tags and nested types of ODFV schema fields ([8ef6e75](feast-dev@8ef6e75))
* Keep entity columns out of StreamFeatureView proto features ([feast-dev#7033](feast-dev#7033)) ([d520584](feast-dev@d520584))
* Keep the metrics server running when a Gunicorn worker exits ([feast-dev#7012](feast-dev#7012)) ([68c5d54](feast-dev@68c5d54)), closes [feast-dev#7011](feast-dev#7011)
* Key registry proto caches on the proto, not its id() ([feast-dev#7085](feast-dev#7085)) ([147adad](feast-dev@147adad))
* Log ODFV materialization skips instead of printing them ([feast-dev#7117](feast-dev#7117)) ([8fdcee7](feast-dev@8fdcee7))
* Pin build dependencies of source builds to the CI lock ([feast-dev#7104](feast-dev#7104)) ([dec2f24](feast-dev@dec2f24))
* Populate spec.project in registry REST feature view responses (#… ([feast-dev#7037](feast-dev#7037)) ([e304a84](feast-dev@e304a84))
* Preserve colliding source timestamps in Dask retrieval ([feast-dev#7071](feast-dev#7071)) ([1396c88](feast-dev@1396c88))
* Preserve Dask historical requests without eligible features ([feast-dev#7000](feast-dev#7000)) ([fff09f7](feast-dev@fff09f7))
* Read None elements of UUID and Decimal lists as None ([feast-dev#7039](feast-dev#7039)) ([03f30fe](feast-dev@03f30fe))
* Retire the support of Python3.10 ([feast-dev#7101](feast-dev#7101)) ([a56766e](feast-dev@a56766e)), closes [feast-dev#7104](feast-dev#7104) [feast-dev#7089](feast-dev#7089) [feast-dev#7106](feast-dev#7106) [feast-dev#7105](feast-dev#7105)
* Serialize UUID and TimeUuid entity keys ([feast-dev#7032](feast-dev#7032)) ([0c845a1](feast-dev@0c845a1))
* Stop the Ray engine from hiding materialization errors ([feast-dev#7026](feast-dev#7026)) ([7903e2e](feast-dev@7903e2e)), closes [feast-dev#7024](feast-dev#7024)
* **ui:** stop treating the monitoring baseline as the latest window ([feast-dev#7056](feast-dev#7056)) ([0f01802](feast-dev@0f01802)), closes [feast-dev#7054](feast-dev#7054)
* Use date-only bounds for partition filters built from string timestamps ([feast-dev#7116](feast-dev#7116)) ([b1f2168](feast-dev@b1f2168))
* Validate entity column types in feast dbt import ([feast-dev#7067](feast-dev#7067)) ([abca80c](feast-dev@abca80c)), closes [feast-dev#5876](feast-dev#5876)
* Warm up the whole DynamoDB connection pool ([feast-dev#6985](feast-dev#6985)) ([8ce548c](feast-dev@8ce548c))

### Features

* Add --gc-freeze option to feast serve ([feast-dev#7089](feast-dev#7089)) ([aad0c15](feast-dev@aad0c15))
* Add native complex types and scalar index tags to the Milvus online store ([feast-dev#7120](feast-dev#7120)) ([f7068d6](feast-dev@f7068d6))
* Add num_partitions and partition_key_isolation to the Milvus online store ([feast-dev#7083](feast-dev#7083)) ([68de84e](feast-dev@68de84e)), closes [feast-dev#6940](feast-dev#6940)
* Add Pinecone online store integration ([feast-dev#6585](feast-dev#6585)) ([7a84f2a](feast-dev@7a84f2a))
* Add PolarisSource and PolarisProvider for Apache Polaris ([feast-dev#7006](feast-dev#7006)) ([386759c](feast-dev@386759c))
* Add row deletion to the Milvus online store ([feast-dev#7082](feast-dev#7082)) ([d3e2041](feast-dev@d3e2041))
* Add upstream FeatureView lineage support for PushSource ([feast-dev#6853](feast-dev#6853)) ([c9b9d72](feast-dev@c9b9d72))
* Optional nameless pre-computed vectors with a schema fingerprint ([feast-dev#7077](feast-dev#7077)) ([9420fac](feast-dev@9420fac))

### Performance Improvements

* Scan Lance sources lazily in the DuckDB offline store ([1299e4e](feast-dev@1299e4e))

Signed-off-by: Shuchu Han <[email protected]>

rhods-devops-app Bot mentioned this pull request

Nov 12, 2026

Automated Sync from main to stable red-hat-data-services/feast#630

Open

Reviewers

shuchu

shuchu approved these changes

ejscribner

Awaiting requested review from ejscribner

ejscribner is a code owner automatically assigned from feast-dev/maintainers

robhowley

Awaiting requested review from robhowley

robhowley is a code owner automatically assigned from feast-dev/maintainers

tokoko

Awaiting requested review from tokoko

tokoko is a code owner automatically assigned from feast-dev/maintainers

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

precompute_online: feature names are about 80% of every vector blob

Uh oh!

There was an error while loading. Please reload this page.

3 participants

Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.

GeezerVison

Conversation

chandlerok commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What this PR does / why we need it:

Which issue(s) this PR fixes:

Checks

Testing Strategy

Misc

Uh oh!

codecov-commenter commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

chandlerok commented Oct 27, 2026

Uh oh!

Uh oh!

shuchu left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

chandlerok commented Oct 26, 2026 •

edited

Loading

Uh oh!

There was an error while loading. Please reload this page.

codecov-commenter commented Oct 26, 2026 •

edited

Loading

Uh oh!

There was an error while loading. Please reload this page.