GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — feat: Adding write capability to online store to on demand feature views by franciscojavierarceo · Pull Request #4585 · feast-dev/feast

Conversation

@franciscojavierarceo

@franciscojavierarceo franciscojavierarceo commented Sep 28, 2024 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

What this PR does / why we need it:

This PR adds the ability to write On Demand Feature Views to the online store. At the moment, On Demand Feature Views are limited to transformations on reads. This allows for transformations to happen on writes using the Feast feature server (i.e., when store.push() or store.write_to_online_store() are called).

On Demand Feature Views are designed to apply transformations over existing features dynamically. However, limiting these transformations to read time can be inefficient, especially for complex computations. Enabling write-time transformations allows for these computations to be done once during data ingestion, reducing read-time latency.

Why do we need this?

  1. Performance Improvement: By performing transformations at write time, we reduce the computational load during reads, leading to faster online inference and improved scalability.
  2. Unified Transformation Workflow: This change is a crucial step toward unifying feature transformations and feature views, streamlining the feature engineering process as discussed in issue #4584.
  3. Flexibility: It provides users with more flexibility in how and when feature transformations are applied, catering to a broader range of use cases.

Summary of changes

Updated the following:

  • DataFrameSerializationError to handle Any input in sdk/python/feast/errors.py
  • Types to include BaseFeatureView in sdk/python/feast/feature_service.py
  • sdk/python/feast/feature_store.py to run update_feature_views_with_inferred_features_and_entities for ODFVs as well
  • apply_diffs in sdk/python/feast/feature_store.py to include ODFVs for all ODFVs with write_to_online_store
    • Also incorporated updating data sources
  • _infer_on_demand_features_and_entities in sdk/python/feast/inference.py to behave as expected
  • Types in:
    • sdk/python/feast/infra/materialization/aws_lambda/lambda_engine.py
    • sdk/python/feast/infra/materialization/batch_materialization_engine.py
    • sdk/python/feast/infra/materialization/contrib/spark/spark_materialization_engine.py
    • sdk/python/feast/infra/materialization/kubernetes/k8s_materialization_engine.py
    • sdk/python/feast/infra/materialization/local_engine.py
    • sdk/python/feast/infra/materialization/snowflake_engine.py
    • sdk/python/feast/infra/online_stores/online_store.py
    • sdk/python/feast/infra/passthrough_provider.py
    • sdk/python/feast/infra/provider.py
  • ingest_df in sdk/python/feast/infra/passthrough_provider.py to incorporate OnDemandFeatureView
  • sdk/python/feast/type_map.py to incorporate List[float] (float = double)
  • sdk/python/feast/types.py to implement _utc_now
  • _convert_arrow_to_proto in sdk/python/feast/utils.py to include BaseFeatureView and OnDemandFeatureView to
    • Implement _convert_arrow_odfv_to_proto
    • Update _prepare_entities_to_read_from_online_store to handle ODFVs
  • sdk/python/tests/integration/materialization/test_snowflake.py to be more explicit about the expected return value
  • sdk/python/tests/unit/local_feast_tests/test_local_feature_store.py to
    • Fix typo in test_apply_dummy_entity_and_feature_view_columns
    • Explicitly test behavior of FeatureView.entity_columns() class instantiation before and after FeatureStore.apply() with and without entities (the behavior is different)
  • sdk/python/tests/unit/online_store/test_online_writes.py to also include test for expected values of FeatureView.entity_columns()
  • sdk/python/tests/unit/test_on_demand_feature_view.py to add test_on_demand_feature_view_writes_protos and test_on_demand_feature_view_stored_writes functions to validate and demonstrate expected behavior
  • sdk/python/tests/unit/test_on_demand_python_transformation.py to add python_stored_writes_feature_view ODFV and test_stored_writes test to verify expected behavior
    • Implemented TestOnDemandTransformationsWithWrites class to further test the behavior end to end

Which issue(s) this PR fixes:

#4376

Misc

Documentation is added in this PR #4607

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
shuchu reacted with thumbs up emoji
All reactions
  • 👍 1 reaction
@franciscojavierarceo
franciscojavierarceo force-pushed the podfv2 branch from 97fc1ec to 082a860 Compare September 29, 2024 19:10
franciscojavierarceo added 29 commits September 29, 2024 22:49
@franciscojavierarceo
merged changes
508bad2 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
saving progress
899f7f4 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merged changes to odfv
5b69c71 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
linted
d107354 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
adding the test needed to show the expected behavior
a34ec4d 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
updated test case
b95d2a2 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
saving progress
47974c2 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merging
ceb75a2 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merged
6688933 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merged
4c28acc 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merging
fd577dc 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
adding the entity keys for now to do retrieval
167fe6c 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
adding entity to odfv
54811d7 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
checking in progress...getting closer
f0d87fc 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
may have to revert some of this...looks like the challenge is getting…
b7091ca 
… the entities correct when storing writes. just checking in progress

Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
moving things around to make it easier to debug
d2a12f8 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
debugging
9d496ba 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merged
58280aa 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merging
c42be75 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
Rebasing and merging changes from other PR
fb3b315 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
Merging changes continued
82f3f8b 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
update the _make_inference to include odfvs with writes in the update…
172693d 
… map

Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
have the table being written now...the create table happens in the Sq…
66c5b57 
…liteOnlineStore.update() method

Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
checking in progress
ea3b98a 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
adding logs
905912b 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
updating permissions
25d42dd 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
going to error out on purpose
03d6116 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
adding unit test and merging changes
9b16615 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
almost got everything working and type validation behaving
adbaeb6 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
linter
0ce93f2 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo franciscojavierarceo changed the title Podfv2 feat: Adding write capability to online store to on demand feature views Oct 3, 2024
@franciscojavierarceo franciscojavierarceo added the ok-to-test label Oct 3, 2024
franciscojavierarceo and others added 2 commits October 3, 2024 23:49
@franciscojavierarceo
updated type map for integration tests
bf31d59 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
Merge branch 'master' into podfv2
9aff889
@franciscojavierarceo
franciscojavierarceo force-pushed the podfv2 branch from eec9419 to 9aff889 Compare October 5, 2024 02:50
franciscojavierarceo and others added 8 commits October 5, 2024 05:41
@franciscojavierarceo
updated local feature store test
acc7b7f 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
fixed local fs test
12d9100 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
chore: Updated snowflake test to be more explicit about post apply en…
3c94614 
…tity_columns return value (#4603)

chore: updated snowflake test to be more explicit about post apply entity_column return value

Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
merging
f01b691 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
fixed test to entity_rows_to_read
c26ae75 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
resolved inf conflicts
c6d55c7 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
lint
52b8c4d 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
Updated tests and lint, think I have everything working
ca0971a 
Signed-off-by: Francisco Javier Arceo <[email protected]>
@franciscojavierarceo
franciscojavierarceo marked this pull request as ready for review October 6, 2024 04:01
@franciscojavierarceo
franciscojavierarceo requested a review from a team as a code owner October 6, 2024 04:01
@franciscojavierarceo
franciscojavierarceo requested review from haoxu0, shuchu and tokoko and removed request for a team October 6, 2024 04:01
This was referenced Oct 6, 2024
feat: Adding write capabability to online store to on demand feature … #4418
Closed
feat: Adding documentation for On Demand Feature Transformations with writes #4607
Merged
emgeee
emgeee approved these changes Oct 7, 2024
View reviewed changes

@emgeee emgeee left a comment

Copy link
Copy Markdown
Contributor

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
All reactions
@franciscojavierarceo franciscojavierarceo mentioned this pull request Oct 9, 2024
OnDemandFeatureViews with RequestSource returns different columns depending on online/offline feature retrieval. #4479
Closed
haoxu0
haoxu0 approved these changes Oct 9, 2024
View reviewed changes

@haoxu0 haoxu0 left a comment

Copy link
Copy Markdown
Collaborator

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
All reactions
@franciscojavierarceo
franciscojavierarceo merged commit ef9e0bb into master Oct 10, 2024
franciscojavierarceo pushed a commit that referenced this pull request Oct 26, 2024
@feast-ci-bot
chore(release): release 0.41.0
e02e8dc 
# [0.41.0](v0.40.0...v0.41.0) (2024-10-26)

* chore!: Update @elastic/eui and @emotion/react in Feast UI ([#4597](#4597)) ([b9ddbf9](b9ddbf9))

### Bug Fixes

* Add --chdir to test_workflow.py ([#4453](#4453)) ([6b2f026](6b2f026))
* Add feast-operator files to semantic-release script ([#4382](#4382)) ([8eceff2](8eceff2))
* Add feast-operator Makefile to semantic-release script ([#4424](#4424)) ([d18d01d](d18d01d))
* Added Offline Store Arrow client errors handler ([#4524](#4524)) ([7535b40](7535b40))
* Added Online Store REST client errors handler ([#4488](#4488)) ([2118719](2118719))
* Added Permission API docs ([#4485](#4485)) ([2bd03fa](2bd03fa))
* Added support for multiple name patterns to Permissions ([#4633](#4633)) ([f05e928](f05e928))
* Adding protobuf<5 as a required dependency due to snowflake limitations ([#4537](#4537)) ([cecca83](cecca83))
* Avoid the python 3.9+ threadpool cleanup bug ([#4627](#4627)) ([ba05893](ba05893))
* Bigquery dataset create table disposition ([#4649](#4649)) ([58e03d1](58e03d1))
* Changes template file path to relative path ([#4624](#4624)) ([3e313b1](3e313b1))
* Check for snowflake functions when setting up materialization engine ([#4456](#4456)) ([c365b4e](c365b4e))
* Correctly handle list values in _python_value_to_proto_value ([#4608](#4608)) ([c0a1026](c0a1026))
* Default to pandas mode if not specified in ODFV proto in database ([#4420](#4420)) ([d235832](d235832))
* Deleting data from feast_metadata when we delete project ([#4550](#4550)) ([351a2d0](351a2d0))
* Disable active_timer When registry_ttl_sec is 0 ([#4499](#4499)) ([c94f32f](c94f32f))
* Escape special characters in the Postgres password ([#4394](#4394)) ([419ca5e](419ca5e))
* FeastExtrasDependencyImportError when using SparkOfflineStore without S3 ([#4594](#4594)) ([1ba94f7](1ba94f7))
* Fix Feast project name test ([#4685](#4685)) ([9f41fd6](9f41fd6))
* Fix for SQL registry initialization fails [#4543](#4543) ([#4544](#4544)) ([4e2eacc](4e2eacc))
* Fix gitignore issue ([#4674](#4674)) ([2807dfa](2807dfa))
* Fix online pg import ([#4581](#4581)) ([1f17caa](1f17caa))
* Fix the mypy type check issue. ([#4498](#4498)) ([7ecc615](7ecc615))
* Fix vector store config ([#4583](#4583)) ([11c00d4](11c00d4))
* Fixes validator field access for 'project_id' in BigQuery offline Store ([#4509](#4509)) ([9a0398e](9a0398e))
* Fixing failure of protos during ODFV transformations for missing entities ([#4667](#4667)) ([41aaeeb](41aaeeb))
* Fixing the master branch build failure. ([#4563](#4563)) ([0192b2e](0192b2e))
* Hao xu request source timestamp_field ([#4495](#4495)) ([96344b2](96344b2))
* Ignore the type check as both functions calls are not belonging to Feast code. ([#4500](#4500)) ([867f532](867f532))
* Import grpc only for type checking in errors.py ([#4533](#4533)) ([f308572](f308572))
* Initial commit targetting grpc registry server ([#4458](#4458)) ([484240c](484240c)), closes [#4465](#4465)
* Links to the RBAC documentation under Concepts and Components ([#4430](#4430)) ([0a48f7b](0a48f7b))
* Locate feature_store.yaml from __file__ ([#4443](#4443)) ([20290ce](20290ce))
* Logger settings for feature servers and updated logger for permission flow ([#4531](#4531)) ([50b8f23](50b8f23))
* Move tslib from devDependencies to dependencies in Feast UI ([#4525](#4525)) ([c5a4d90](c5a4d90))
* Null value compatibility for unit timestamp list value type ([#4378](#4378)) ([8f264b6](8f264b6))
* Patch FAISS online return signature ([#4671](#4671)) ([0d45e95](0d45e95))
* Quickstart documentation changes ([#4618](#4618)) ([7ac0908](7ac0908))
* Refactor auth_client_manager_factory.py in function get_auth_client_m… ([#4505](#4505)) ([def8633](def8633))
* Remote apply using offline store ([#4559](#4559)) ([ac62a32](ac62a32))
* Remove Feast UI TypeScript dependencies from `peerDependencies` and `dependencies` ([#4554](#4554)) ([e781e16](e781e16))
* Remove unnecessary peer dependencies from Feast UI ([#4577](#4577)) ([9ac7f4e](9ac7f4e))
* Removed protobuf as a required dependency ([#4535](#4535)) ([0fb76e9](0fb76e9))
* Removed the k8s dependency from required dependencies ([#4519](#4519)) ([3073ea5](3073ea5))
* Removed usage of pull_request_target as much as possible to prevent security concerns ([#4549](#4549)) ([3198371](3198371))
* Replaced ClusterRoles with local RoleBindings ([#4625](#4625)) ([ca9fb9b](ca9fb9b))
* Retire pytz library ([#4406](#4406)) ([23c6c86](23c6c86))
* Typos related to k8s ([#4442](#4442)) ([dda0088](dda0088))
* Update java testcontainers to use Compose V2 ([#4381](#4381)) ([9a33fce](9a33fce))
* Update min versions for pyarrow and protobuf ([#4646](#4646)) ([c7ddd4b](c7ddd4b))
* Update react-router-dom to 6.3.0 and restrict its version in Feast UI ([#4556](#4556)) ([4293608](4293608)), closes [#3794](#3794) [/github.com/remix-run/react-router/blob/main/CHANGELOG.md#v630](https://github.com//github.com/remix-run/react-router/blob/main/CHANGELOG.md/issues/v630)
* Update the base image for feature-server. ([#4576](#4576)) ([0390d8a](0390d8a))
* Update the base image of materilization engine. ([#4580](#4580)) ([f8592d8](f8592d8))
* Updated README link ([#4669](#4669)) ([35fbdc9](35fbdc9))
* Updating the documentation and adding tests for project length ([#4628](#4628)) ([945b0fa](945b0fa))
* Using get_type_hints instead of inspect signature for udf return annotation  ([#4391](#4391)) ([3a32e8a](3a32e8a))
* Using repo_config parameter in teardown to allow for feature-store-yaml overrides ([#4413](#4413)) ([0baeeb5](0baeeb5))
* Validating permission to update an existing request on both the new and the old instance ([#4449](#4449)) ([635a01b](635a01b))

### Features

* Add boto3 session based auth for dynamodb online store for cross account access ([#4606](#4606)) ([00eaf74](00eaf74))
* Add cli list/describe for SavedDatasets, StreamFeatureViews, & … ([#4487](#4487)) ([7b250e5](7b250e5))
* Add connection_name field to Snowflake config ([#4600](#4600)) ([10ce2aa](10ce2aa))
* Add health check service to registry server ([#4421](#4421)) ([46655f0](46655f0))
* Add more __repr__ methods ([#4676](#4676)) ([e726c09](e726c09))
* Add registry methods for dealing with all FV types ([#4435](#4435)) ([ac381b2](ac381b2))
* Added Project object to Feast Objects ([#4475](#4475)) ([4a6b663](4a6b663))
* Added support for reading from Reader  Endpoints for AWS Aurora use cases ([#4494](#4494)) ([d793c77](d793c77))
* Adding documentation for On Demand Feature Transformations with writes ([#4607](#4607)) ([8e0c1b5](8e0c1b5))
* Adding mode='python' for get_historical_features on ODFVs ([#4653](#4653)) ([c40d539](c40d539))
* Adding registry cache support for get_on_demand_feature_view ([#4572](#4572)) ([354c059](354c059))
* Adding SSL support for online server ([#4677](#4677)) ([80a5b3c](80a5b3c))
* Adding write capability to online store to on demand feature views ([#4585](#4585)) ([ef9e0bb](ef9e0bb)), closes [#4603](#4603)
* Allow feast snowflake to read in byte string for private-key authentication ([#4384](#4384)) ([5215a21](5215a21))
* An action to test operator at PR time ([#4635](#4635)) ([14c1000](14c1000))
* Create ADOPTERS.md ([#4410](#4410)) ([721ec74](721ec74))
* Create initial structure of Feast Go Operator ([#4596](#4596)) ([b5ab6c7](b5ab6c7))
* Faiss and In memory store ([#4464](#4464)) ([a1ff129](a1ff129))
* Feast Security Model (aka RBAC) ([#4380](#4380)) ([1771f66](1771f66)), closes [#36](#36)
* Instrument Feast using Prometheus and OpenTelemetry ([#4366](#4366)) ([a571e08](a571e08))
* Intra server to server communication ([#4433](#4433)) ([729c874](729c874))
* Publish TypeScript types in Feast UI package ([#4551](#4551)) ([334e5d7](334e5d7))
* Refactoring code to get oidc end points from discovery URL. ([#4429](#4429)) ([896360a](896360a))
* Return entity key in the retrieval document api ([#4511](#4511)) ([5f5caf0](5f5caf0))
* Update roadmap.md ([#4445](#4445)) ([34238d2](34238d2))
* Update sqlite-vec package ([#4389](#4389)) ([b734cb1](b734cb1))
* Updated Feast model Inference Architecture ([#4570](#4570)) ([8cd0dcf](8cd0dcf))
* Updating docs to include model inference guidelines ([#4416](#4416)) ([cebbe04](cebbe04))
* Updating FeatureViewProjection and OnDemandFeatureView to add batch_source and entities ([#4530](#4530)) ([0795496](0795496))
* Upgrade React from 17.0.2 to 18.3.1 in Feast UI ([#4620](#4620)) ([d6f3cb8](d6f3cb8))

### Performance Improvements

* Add init and cleanup of long lived resources ([#4642](#4642)) ([47dc04d](47dc04d))
* Added indexes to sql tables to optimize query execution ([#4538](#4538)) ([9688790](9688790))
* Default to async endpoints, use threadpool for sync ([#4647](#4647)) ([c1f1912](c1f1912))
* Implement dynamo write_batch_async ([#4675](#4675)) ([ba4404c](ba4404c))
* Make /push async ([#4650](#4650)) ([61abf89](61abf89))
* Parallelize read calls by table and batch ([#4619](#4619)) ([043eff1](043eff1))

### BREAKING CHANGES

* Consuming apps that use @elastic/eui should update it
to a compatible version. If you use @elastic/eui components that have
been renamed or replaced with others, you'll need to update your code
accordingly.

Signed-off-by: Harri Lehtola <[email protected]>

* chore: Update Node version from 17 to 20 in UI unit tests

Node 17 is not an LTS (long-term support) version and apparently
rejected by the latest versions of Elastic UI:

> error @elastic/[email protected]: The engine "node" is incompatible with
> this module. Expected version "16.x || 18.x || >=20.x". Got "17.9.1"

Let's try with the latest LTS version.

Signed-off-by: Harri Lehtola <[email protected]>
franciscojavierarceo pushed a commit that referenced this pull request Oct 26, 2024
@feast-ci-bot
chore(release): release 0.41.0
a439b93 
# [0.41.0](v0.40.0...v0.41.0) (2024-10-26)

* chore!: Update @elastic/eui and @emotion/react in Feast UI ([#4597](#4597)) ([b9ddbf9](b9ddbf9))

### Bug Fixes

* Add --chdir to test_workflow.py ([#4453](#4453)) ([6b2f026](6b2f026))
* Add feast-operator files to semantic-release script ([#4382](#4382)) ([8eceff2](8eceff2))
* Add feast-operator Makefile to semantic-release script ([#4424](#4424)) ([d18d01d](d18d01d))
* Added Offline Store Arrow client errors handler ([#4524](#4524)) ([7535b40](7535b40))
* Added Online Store REST client errors handler ([#4488](#4488)) ([2118719](2118719))
* Added Permission API docs ([#4485](#4485)) ([2bd03fa](2bd03fa))
* Added support for multiple name patterns to Permissions ([#4633](#4633)) ([f05e928](f05e928))
* Adding protobuf<5 as a required dependency due to snowflake limitations ([#4537](#4537)) ([cecca83](cecca83))
* Avoid the python 3.9+ threadpool cleanup bug ([#4627](#4627)) ([ba05893](ba05893))
* Bigquery dataset create table disposition ([#4649](#4649)) ([58e03d1](58e03d1))
* Changes template file path to relative path ([#4624](#4624)) ([3e313b1](3e313b1))
* Check for snowflake functions when setting up materialization engine ([#4456](#4456)) ([c365b4e](c365b4e))
* Correctly handle list values in _python_value_to_proto_value ([#4608](#4608)) ([c0a1026](c0a1026))
* Default to pandas mode if not specified in ODFV proto in database ([#4420](#4420)) ([d235832](d235832))
* Deleting data from feast_metadata when we delete project ([#4550](#4550)) ([351a2d0](351a2d0))
* Disable active_timer When registry_ttl_sec is 0 ([#4499](#4499)) ([c94f32f](c94f32f))
* Escape special characters in the Postgres password ([#4394](#4394)) ([419ca5e](419ca5e))
* FeastExtrasDependencyImportError when using SparkOfflineStore without S3 ([#4594](#4594)) ([1ba94f7](1ba94f7))
* Fix Feast project name test ([#4685](#4685)) ([9f41fd6](9f41fd6))
* Fix for SQL registry initialization fails [#4543](#4543) ([#4544](#4544)) ([4e2eacc](4e2eacc))
* Fix gitignore issue ([#4674](#4674)) ([2807dfa](2807dfa))
* Fix online pg import ([#4581](#4581)) ([1f17caa](1f17caa))
* Fix the mypy type check issue. ([#4498](#4498)) ([7ecc615](7ecc615))
* Fix vector store config ([#4583](#4583)) ([11c00d4](11c00d4))
* Fixes validator field access for 'project_id' in BigQuery offline Store ([#4509](#4509)) ([9a0398e](9a0398e))
* Fixing failure of protos during ODFV transformations for missing entities ([#4667](#4667)) ([41aaeeb](41aaeeb))
* Fixing the master branch build failure. ([#4563](#4563)) ([0192b2e](0192b2e))
* Hao xu request source timestamp_field ([#4495](#4495)) ([96344b2](96344b2))
* Ignore the type check as both functions calls are not belonging to Feast code. ([#4500](#4500)) ([867f532](867f532))
* Import grpc only for type checking in errors.py ([#4533](#4533)) ([f308572](f308572))
* Initial commit targetting grpc registry server ([#4458](#4458)) ([484240c](484240c)), closes [#4465](#4465)
* Links to the RBAC documentation under Concepts and Components ([#4430](#4430)) ([0a48f7b](0a48f7b))
* Locate feature_store.yaml from __file__ ([#4443](#4443)) ([20290ce](20290ce))
* Logger settings for feature servers and updated logger for permission flow ([#4531](#4531)) ([50b8f23](50b8f23))
* Move tslib from devDependencies to dependencies in Feast UI ([#4525](#4525)) ([c5a4d90](c5a4d90))
* Null value compatibility for unit timestamp list value type ([#4378](#4378)) ([8f264b6](8f264b6))
* Patch FAISS online return signature ([#4671](#4671)) ([0d45e95](0d45e95))
* Quickstart documentation changes ([#4618](#4618)) ([7ac0908](7ac0908))
* Refactor auth_client_manager_factory.py in function get_auth_client_m… ([#4505](#4505)) ([def8633](def8633))
* Remote apply using offline store ([#4559](#4559)) ([ac62a32](ac62a32))
* Remove Feast UI TypeScript dependencies from `peerDependencies` and `dependencies` ([#4554](#4554)) ([e781e16](e781e16))
* Remove unnecessary peer dependencies from Feast UI ([#4577](#4577)) ([9ac7f4e](9ac7f4e))
* Removed protobuf as a required dependency ([#4535](#4535)) ([0fb76e9](0fb76e9))
* Removed the k8s dependency from required dependencies ([#4519](#4519)) ([3073ea5](3073ea5))
* Removed usage of pull_request_target as much as possible to prevent security concerns ([#4549](#4549)) ([3198371](3198371))
* Replaced ClusterRoles with local RoleBindings ([#4625](#4625)) ([ca9fb9b](ca9fb9b))
* Retire pytz library ([#4406](#4406)) ([23c6c86](23c6c86))
* Typos related to k8s ([#4442](#4442)) ([dda0088](dda0088))
* Update java testcontainers to use Compose V2 ([#4381](#4381)) ([9a33fce](9a33fce))
* Update min versions for pyarrow and protobuf ([#4646](#4646)) ([c7ddd4b](c7ddd4b))
* Update react-router-dom to 6.3.0 and restrict its version in Feast UI ([#4556](#4556)) ([4293608](4293608)), closes [#3794](#3794) [/github.com/remix-run/react-router/blob/main/CHANGELOG.md#v630](https://github.com//github.com/remix-run/react-router/blob/main/CHANGELOG.md/issues/v630)
* Update the base image for feature-server. ([#4576](#4576)) ([0390d8a](0390d8a))
* Update the base image of materilization engine. ([#4580](#4580)) ([f8592d8](f8592d8))
* Updated README link ([#4669](#4669)) ([35fbdc9](35fbdc9))
* Updating the documentation and adding tests for project length ([#4628](#4628)) ([945b0fa](945b0fa))
* Using get_type_hints instead of inspect signature for udf return annotation  ([#4391](#4391)) ([3a32e8a](3a32e8a))
* Using repo_config parameter in teardown to allow for feature-store-yaml overrides ([#4413](#4413)) ([0baeeb5](0baeeb5))
* Validating permission to update an existing request on both the new and the old instance ([#4449](#4449)) ([635a01b](635a01b))

### Features

* Add boto3 session based auth for dynamodb online store for cross account access ([#4606](#4606)) ([00eaf74](00eaf74))
* Add cli list/describe for SavedDatasets, StreamFeatureViews, & … ([#4487](#4487)) ([7b250e5](7b250e5))
* Add connection_name field to Snowflake config ([#4600](#4600)) ([10ce2aa](10ce2aa))
* Add health check service to registry server ([#4421](#4421)) ([46655f0](46655f0))
* Add more __repr__ methods ([#4676](#4676)) ([e726c09](e726c09))
* Add registry methods for dealing with all FV types ([#4435](#4435)) ([ac381b2](ac381b2))
* Added Project object to Feast Objects ([#4475](#4475)) ([4a6b663](4a6b663))
* Added support for reading from Reader  Endpoints for AWS Aurora use cases ([#4494](#4494)) ([d793c77](d793c77))
* Adding documentation for On Demand Feature Transformations with writes ([#4607](#4607)) ([8e0c1b5](8e0c1b5))
* Adding mode='python' for get_historical_features on ODFVs ([#4653](#4653)) ([c40d539](c40d539))
* Adding registry cache support for get_on_demand_feature_view ([#4572](#4572)) ([354c059](354c059))
* Adding SSL support for online server ([#4677](#4677)) ([80a5b3c](80a5b3c))
* Adding write capability to online store to on demand feature views ([#4585](#4585)) ([ef9e0bb](ef9e0bb)), closes [#4603](#4603)
* Allow feast snowflake to read in byte string for private-key authentication ([#4384](#4384)) ([5215a21](5215a21))
* An action to test operator at PR time ([#4635](#4635)) ([14c1000](14c1000))
* Create ADOPTERS.md ([#4410](#4410)) ([721ec74](721ec74))
* Create initial structure of Feast Go Operator ([#4596](#4596)) ([b5ab6c7](b5ab6c7))
* Faiss and In memory store ([#4464](#4464)) ([a1ff129](a1ff129))
* Feast Security Model (aka RBAC) ([#4380](#4380)) ([1771f66](1771f66)), closes [#36](#36)
* Instrument Feast using Prometheus and OpenTelemetry ([#4366](#4366)) ([a571e08](a571e08))
* Intra server to server communication ([#4433](#4433)) ([729c874](729c874))
* Publish TypeScript types in Feast UI package ([#4551](#4551)) ([334e5d7](334e5d7))
* Refactoring code to get oidc end points from discovery URL. ([#4429](#4429)) ([896360a](896360a))
* Return entity key in the retrieval document api ([#4511](#4511)) ([5f5caf0](5f5caf0))
* Update roadmap.md ([#4445](#4445)) ([34238d2](34238d2))
* Update sqlite-vec package ([#4389](#4389)) ([b734cb1](b734cb1))
* Updated Feast model Inference Architecture ([#4570](#4570)) ([8cd0dcf](8cd0dcf))
* Updating docs to include model inference guidelines ([#4416](#4416)) ([cebbe04](cebbe04))
* Updating FeatureViewProjection and OnDemandFeatureView to add batch_source and entities ([#4530](#4530)) ([0795496](0795496))
* Upgrade React from 17.0.2 to 18.3.1 in Feast UI ([#4620](#4620)) ([d6f3cb8](d6f3cb8))

### Performance Improvements

* Add init and cleanup of long lived resources ([#4642](#4642)) ([47dc04d](47dc04d))
* Added indexes to sql tables to optimize query execution ([#4538](#4538)) ([9688790](9688790))
* Default to async endpoints, use threadpool for sync ([#4647](#4647)) ([c1f1912](c1f1912))
* Implement dynamo write_batch_async ([#4675](#4675)) ([ba4404c](ba4404c))
* Make /push async ([#4650](#4650)) ([61abf89](61abf89))
* Parallelize read calls by table and batch ([#4619](#4619)) ([043eff1](043eff1))

### BREAKING CHANGES

* Consuming apps that use @elastic/eui should update it
to a compatible version. If you use @elastic/eui components that have
been renamed or replaced with others, you'll need to update your code
accordingly.

Signed-off-by: Harri Lehtola <[email protected]>

* chore: Update Node version from 17 to 20 in UI unit tests

Node 17 is not an LTS (long-term support) version and apparently
rejected by the latest versions of Elastic UI:

> error @elastic/[email protected]: The engine "node" is incompatible with
> this module. Expected version "16.x || 18.x || >=20.x". Got "17.9.1"

Let's try with the latest LTS version.

Signed-off-by: Harri Lehtola <[email protected]>
lokeshrangineni pushed a commit to lokeshrangineni/feast that referenced this pull request Oct 29, 2024
@feast-ci-bot @lokeshrangineni
chore(release): release 0.41.0
4050079 
# [0.41.0](feast-dev/feast@v0.40.0...v0.41.0) (2024-10-26)

* chore!: Update @elastic/eui and @emotion/react in Feast UI ([feast-dev#4597](feast-dev#4597)) ([b9ddbf9](feast-dev@b9ddbf9))

### Bug Fixes

* Add --chdir to test_workflow.py ([feast-dev#4453](feast-dev#4453)) ([6b2f026](feast-dev@6b2f026))
* Add feast-operator files to semantic-release script ([feast-dev#4382](feast-dev#4382)) ([8eceff2](feast-dev@8eceff2))
* Add feast-operator Makefile to semantic-release script ([feast-dev#4424](feast-dev#4424)) ([d18d01d](feast-dev@d18d01d))
* Added Offline Store Arrow client errors handler ([feast-dev#4524](feast-dev#4524)) ([7535b40](feast-dev@7535b40))
* Added Online Store REST client errors handler ([feast-dev#4488](feast-dev#4488)) ([2118719](feast-dev@2118719))
* Added Permission API docs ([feast-dev#4485](feast-dev#4485)) ([2bd03fa](feast-dev@2bd03fa))
* Added support for multiple name patterns to Permissions ([feast-dev#4633](feast-dev#4633)) ([f05e928](feast-dev@f05e928))
* Adding protobuf<5 as a required dependency due to snowflake limitations ([feast-dev#4537](feast-dev#4537)) ([cecca83](feast-dev@cecca83))
* Avoid the python 3.9+ threadpool cleanup bug ([feast-dev#4627](feast-dev#4627)) ([ba05893](feast-dev@ba05893))
* Bigquery dataset create table disposition ([feast-dev#4649](feast-dev#4649)) ([58e03d1](feast-dev@58e03d1))
* Changes template file path to relative path ([feast-dev#4624](feast-dev#4624)) ([3e313b1](feast-dev@3e313b1))
* Check for snowflake functions when setting up materialization engine ([feast-dev#4456](feast-dev#4456)) ([c365b4e](feast-dev@c365b4e))
* Correctly handle list values in _python_value_to_proto_value ([feast-dev#4608](feast-dev#4608)) ([c0a1026](feast-dev@c0a1026))
* Default to pandas mode if not specified in ODFV proto in database ([feast-dev#4420](feast-dev#4420)) ([d235832](feast-dev@d235832))
* Deleting data from feast_metadata when we delete project ([feast-dev#4550](feast-dev#4550)) ([351a2d0](feast-dev@351a2d0))
* Disable active_timer When registry_ttl_sec is 0 ([feast-dev#4499](feast-dev#4499)) ([c94f32f](feast-dev@c94f32f))
* Escape special characters in the Postgres password ([feast-dev#4394](feast-dev#4394)) ([419ca5e](feast-dev@419ca5e))
* FeastExtrasDependencyImportError when using SparkOfflineStore without S3 ([feast-dev#4594](feast-dev#4594)) ([1ba94f7](feast-dev@1ba94f7))
* Fix Feast project name test ([feast-dev#4685](feast-dev#4685)) ([9f41fd6](feast-dev@9f41fd6))
* Fix for SQL registry initialization fails [feast-dev#4543](feast-dev#4543) ([feast-dev#4544](feast-dev#4544)) ([4e2eacc](feast-dev@4e2eacc))
* Fix gitignore issue ([feast-dev#4674](feast-dev#4674)) ([2807dfa](feast-dev@2807dfa))
* Fix online pg import ([feast-dev#4581](feast-dev#4581)) ([1f17caa](feast-dev@1f17caa))
* Fix the mypy type check issue. ([feast-dev#4498](feast-dev#4498)) ([7ecc615](feast-dev@7ecc615))
* Fix vector store config ([feast-dev#4583](feast-dev#4583)) ([11c00d4](feast-dev@11c00d4))
* Fixes validator field access for 'project_id' in BigQuery offline Store ([feast-dev#4509](feast-dev#4509)) ([9a0398e](feast-dev@9a0398e))
* Fixing failure of protos during ODFV transformations for missing entities ([feast-dev#4667](feast-dev#4667)) ([41aaeeb](feast-dev@41aaeeb))
* Fixing the master branch build failure. ([feast-dev#4563](feast-dev#4563)) ([0192b2e](feast-dev@0192b2e))
* Hao xu request source timestamp_field ([feast-dev#4495](feast-dev#4495)) ([96344b2](feast-dev@96344b2))
* Ignore the type check as both functions calls are not belonging to Feast code. ([feast-dev#4500](feast-dev#4500)) ([867f532](feast-dev@867f532))
* Import grpc only for type checking in errors.py ([feast-dev#4533](feast-dev#4533)) ([f308572](feast-dev@f308572))
* Initial commit targetting grpc registry server ([feast-dev#4458](feast-dev#4458)) ([484240c](feast-dev@484240c)), closes [feast-dev#4465](feast-dev#4465)
* Links to the RBAC documentation under Concepts and Components ([feast-dev#4430](feast-dev#4430)) ([0a48f7b](feast-dev@0a48f7b))
* Locate feature_store.yaml from __file__ ([feast-dev#4443](feast-dev#4443)) ([20290ce](feast-dev@20290ce))
* Logger settings for feature servers and updated logger for permission flow ([feast-dev#4531](feast-dev#4531)) ([50b8f23](feast-dev@50b8f23))
* Move tslib from devDependencies to dependencies in Feast UI ([feast-dev#4525](feast-dev#4525)) ([c5a4d90](feast-dev@c5a4d90))
* Null value compatibility for unit timestamp list value type ([feast-dev#4378](feast-dev#4378)) ([8f264b6](feast-dev@8f264b6))
* Patch FAISS online return signature ([feast-dev#4671](feast-dev#4671)) ([0d45e95](feast-dev@0d45e95))
* Quickstart documentation changes ([feast-dev#4618](feast-dev#4618)) ([7ac0908](feast-dev@7ac0908))
* Refactor auth_client_manager_factory.py in function get_auth_client_m… ([feast-dev#4505](feast-dev#4505)) ([def8633](feast-dev@def8633))
* Remote apply using offline store ([feast-dev#4559](feast-dev#4559)) ([ac62a32](feast-dev@ac62a32))
* Remove Feast UI TypeScript dependencies from `peerDependencies` and `dependencies` ([feast-dev#4554](feast-dev#4554)) ([e781e16](feast-dev@e781e16))
* Remove unnecessary peer dependencies from Feast UI ([feast-dev#4577](feast-dev#4577)) ([9ac7f4e](feast-dev@9ac7f4e))
* Removed protobuf as a required dependency ([feast-dev#4535](feast-dev#4535)) ([0fb76e9](feast-dev@0fb76e9))
* Removed the k8s dependency from required dependencies ([feast-dev#4519](feast-dev#4519)) ([3073ea5](feast-dev@3073ea5))
* Removed usage of pull_request_target as much as possible to prevent security concerns ([feast-dev#4549](feast-dev#4549)) ([3198371](feast-dev@3198371))
* Replaced ClusterRoles with local RoleBindings ([feast-dev#4625](feast-dev#4625)) ([ca9fb9b](feast-dev@ca9fb9b))
* Retire pytz library ([feast-dev#4406](feast-dev#4406)) ([23c6c86](feast-dev@23c6c86))
* Typos related to k8s ([feast-dev#4442](feast-dev#4442)) ([dda0088](feast-dev@dda0088))
* Update java testcontainers to use Compose V2 ([feast-dev#4381](feast-dev#4381)) ([9a33fce](feast-dev@9a33fce))
* Update min versions for pyarrow and protobuf ([feast-dev#4646](feast-dev#4646)) ([c7ddd4b](feast-dev@c7ddd4b))
* Update react-router-dom to 6.3.0 and restrict its version in Feast UI ([feast-dev#4556](feast-dev#4556)) ([4293608](feast-dev@4293608)), closes [feast-dev#3794](feast-dev#3794) [/github.com/remix-run/react-router/blob/main/CHANGELOG.md#v630](https://github.com//github.com/remix-run/react-router/blob/main/CHANGELOG.md/issues/v630)
* Update the base image for feature-server. ([feast-dev#4576](feast-dev#4576)) ([0390d8a](feast-dev@0390d8a))
* Update the base image of materilization engine. ([feast-dev#4580](feast-dev#4580)) ([f8592d8](feast-dev@f8592d8))
* Updated README link ([feast-dev#4669](feast-dev#4669)) ([35fbdc9](feast-dev@35fbdc9))
* Updating the documentation and adding tests for project length ([feast-dev#4628](feast-dev#4628)) ([945b0fa](feast-dev@945b0fa))
* Using get_type_hints instead of inspect signature for udf return annotation  ([feast-dev#4391](feast-dev#4391)) ([3a32e8a](feast-dev@3a32e8a))
* Using repo_config parameter in teardown to allow for feature-store-yaml overrides ([feast-dev#4413](feast-dev#4413)) ([0baeeb5](feast-dev@0baeeb5))
* Validating permission to update an existing request on both the new and the old instance ([feast-dev#4449](feast-dev#4449)) ([635a01b](feast-dev@635a01b))

### Features

* Add boto3 session based auth for dynamodb online store for cross account access ([feast-dev#4606](feast-dev#4606)) ([00eaf74](feast-dev@00eaf74))
* Add cli list/describe for SavedDatasets, StreamFeatureViews, & … ([feast-dev#4487](feast-dev#4487)) ([7b250e5](feast-dev@7b250e5))
* Add connection_name field to Snowflake config ([feast-dev#4600](feast-dev#4600)) ([10ce2aa](feast-dev@10ce2aa))
* Add health check service to registry server ([feast-dev#4421](feast-dev#4421)) ([46655f0](feast-dev@46655f0))
* Add more __repr__ methods ([feast-dev#4676](feast-dev#4676)) ([e726c09](feast-dev@e726c09))
* Add registry methods for dealing with all FV types ([feast-dev#4435](feast-dev#4435)) ([ac381b2](feast-dev@ac381b2))
* Added Project object to Feast Objects ([feast-dev#4475](feast-dev#4475)) ([4a6b663](feast-dev@4a6b663))
* Added support for reading from Reader  Endpoints for AWS Aurora use cases ([feast-dev#4494](feast-dev#4494)) ([d793c77](feast-dev@d793c77))
* Adding documentation for On Demand Feature Transformations with writes ([feast-dev#4607](feast-dev#4607)) ([8e0c1b5](feast-dev@8e0c1b5))
* Adding mode='python' for get_historical_features on ODFVs ([feast-dev#4653](feast-dev#4653)) ([c40d539](feast-dev@c40d539))
* Adding registry cache support for get_on_demand_feature_view ([feast-dev#4572](feast-dev#4572)) ([354c059](feast-dev@354c059))
* Adding SSL support for online server ([feast-dev#4677](feast-dev#4677)) ([80a5b3c](feast-dev@80a5b3c))
* Adding write capability to online store to on demand feature views ([feast-dev#4585](feast-dev#4585)) ([ef9e0bb](feast-dev@ef9e0bb)), closes [feast-dev#4603](feast-dev#4603)
* Allow feast snowflake to read in byte string for private-key authentication ([feast-dev#4384](feast-dev#4384)) ([5215a21](feast-dev@5215a21))
* An action to test operator at PR time ([feast-dev#4635](feast-dev#4635)) ([14c1000](feast-dev@14c1000))
* Create ADOPTERS.md ([feast-dev#4410](feast-dev#4410)) ([721ec74](feast-dev@721ec74))
* Create initial structure of Feast Go Operator ([feast-dev#4596](feast-dev#4596)) ([b5ab6c7](feast-dev@b5ab6c7))
* Faiss and In memory store ([feast-dev#4464](feast-dev#4464)) ([a1ff129](feast-dev@a1ff129))
* Feast Security Model (aka RBAC) ([feast-dev#4380](feast-dev#4380)) ([1771f66](feast-dev@1771f66)), closes [feast-dev#36](feast-dev#36)
* Instrument Feast using Prometheus and OpenTelemetry ([feast-dev#4366](feast-dev#4366)) ([a571e08](feast-dev@a571e08))
* Intra server to server communication ([feast-dev#4433](feast-dev#4433)) ([729c874](feast-dev@729c874))
* Publish TypeScript types in Feast UI package ([feast-dev#4551](feast-dev#4551)) ([334e5d7](feast-dev@334e5d7))
* Refactoring code to get oidc end points from discovery URL. ([feast-dev#4429](feast-dev#4429)) ([896360a](feast-dev@896360a))
* Return entity key in the retrieval document api ([feast-dev#4511](feast-dev#4511)) ([5f5caf0](feast-dev@5f5caf0))
* Update roadmap.md ([feast-dev#4445](feast-dev#4445)) ([34238d2](feast-dev@34238d2))
* Update sqlite-vec package ([feast-dev#4389](feast-dev#4389)) ([b734cb1](feast-dev@b734cb1))
* Updated Feast model Inference Architecture ([feast-dev#4570](feast-dev#4570)) ([8cd0dcf](feast-dev@8cd0dcf))
* Updating docs to include model inference guidelines ([feast-dev#4416](feast-dev#4416)) ([cebbe04](feast-dev@cebbe04))
* Updating FeatureViewProjection and OnDemandFeatureView to add batch_source and entities ([feast-dev#4530](feast-dev#4530)) ([0795496](feast-dev@0795496))
* Upgrade React from 17.0.2 to 18.3.1 in Feast UI ([feast-dev#4620](feast-dev#4620)) ([d6f3cb8](feast-dev@d6f3cb8))

### Performance Improvements

* Add init and cleanup of long lived resources ([feast-dev#4642](feast-dev#4642)) ([47dc04d](feast-dev@47dc04d))
* Added indexes to sql tables to optimize query execution ([feast-dev#4538](feast-dev#4538)) ([9688790](feast-dev@9688790))
* Default to async endpoints, use threadpool for sync ([feast-dev#4647](feast-dev#4647)) ([c1f1912](feast-dev@c1f1912))
* Implement dynamo write_batch_async ([feast-dev#4675](feast-dev#4675)) ([ba4404c](feast-dev@ba4404c))
* Make /push async ([feast-dev#4650](feast-dev#4650)) ([61abf89](feast-dev@61abf89))
* Parallelize read calls by table and batch ([feast-dev#4619](feast-dev#4619)) ([043eff1](feast-dev@043eff1))

### BREAKING CHANGES

* Consuming apps that use @elastic/eui should update it
to a compatible version. If you use @elastic/eui components that have
been renamed or replaced with others, you'll need to update your code
accordingly.

Signed-off-by: Harri Lehtola <[email protected]>

* chore: Update Node version from 17 to 20 in UI unit tests

Node 17 is not an LTS (long-term support) version and apparently
rejected by the latest versions of Elastic UI:

> error @elastic/[email protected]: The engine "node" is incompatible with
> this module. Expected version "16.x || 18.x || >=20.x". Got "17.9.1"

Let's try with the latest LTS version.

Signed-off-by: Harri Lehtola <[email protected]>
lokeshrangineni pushed a commit to lokeshrangineni/feast that referenced this pull request Oct 29, 2024
@feast-ci-bot @lokeshrangineni
chore(release): release 0.41.0
be0d067 
# [0.41.0](feast-dev/feast@v0.40.0...v0.41.0) (2024-10-26)

* chore!: Update @elastic/eui and @emotion/react in Feast UI ([feast-dev#4597](feast-dev#4597)) ([b9ddbf9](feast-dev@b9ddbf9))

### Bug Fixes

* Add --chdir to test_workflow.py ([feast-dev#4453](feast-dev#4453)) ([6b2f026](feast-dev@6b2f026))
* Add feast-operator files to semantic-release script ([feast-dev#4382](feast-dev#4382)) ([8eceff2](feast-dev@8eceff2))
* Add feast-operator Makefile to semantic-release script ([feast-dev#4424](feast-dev#4424)) ([d18d01d](feast-dev@d18d01d))
* Added Offline Store Arrow client errors handler ([feast-dev#4524](feast-dev#4524)) ([7535b40](feast-dev@7535b40))
* Added Online Store REST client errors handler ([feast-dev#4488](feast-dev#4488)) ([2118719](feast-dev@2118719))
* Added Permission API docs ([feast-dev#4485](feast-dev#4485)) ([2bd03fa](feast-dev@2bd03fa))
* Added support for multiple name patterns to Permissions ([feast-dev#4633](feast-dev#4633)) ([f05e928](feast-dev@f05e928))
* Adding protobuf<5 as a required dependency due to snowflake limitations ([feast-dev#4537](feast-dev#4537)) ([cecca83](feast-dev@cecca83))
* Avoid the python 3.9+ threadpool cleanup bug ([feast-dev#4627](feast-dev#4627)) ([ba05893](feast-dev@ba05893))
* Bigquery dataset create table disposition ([feast-dev#4649](feast-dev#4649)) ([58e03d1](feast-dev@58e03d1))
* Changes template file path to relative path ([feast-dev#4624](feast-dev#4624)) ([3e313b1](feast-dev@3e313b1))
* Check for snowflake functions when setting up materialization engine ([feast-dev#4456](feast-dev#4456)) ([c365b4e](feast-dev@c365b4e))
* Correctly handle list values in _python_value_to_proto_value ([feast-dev#4608](feast-dev#4608)) ([c0a1026](feast-dev@c0a1026))
* Default to pandas mode if not specified in ODFV proto in database ([feast-dev#4420](feast-dev#4420)) ([d235832](feast-dev@d235832))
* Deleting data from feast_metadata when we delete project ([feast-dev#4550](feast-dev#4550)) ([351a2d0](feast-dev@351a2d0))
* Disable active_timer When registry_ttl_sec is 0 ([feast-dev#4499](feast-dev#4499)) ([c94f32f](feast-dev@c94f32f))
* Escape special characters in the Postgres password ([feast-dev#4394](feast-dev#4394)) ([419ca5e](feast-dev@419ca5e))
* FeastExtrasDependencyImportError when using SparkOfflineStore without S3 ([feast-dev#4594](feast-dev#4594)) ([1ba94f7](feast-dev@1ba94f7))
* Fix Feast project name test ([feast-dev#4685](feast-dev#4685)) ([9f41fd6](feast-dev@9f41fd6))
* Fix for SQL registry initialization fails [feast-dev#4543](feast-dev#4543) ([feast-dev#4544](feast-dev#4544)) ([4e2eacc](feast-dev@4e2eacc))
* Fix gitignore issue ([feast-dev#4674](feast-dev#4674)) ([2807dfa](feast-dev@2807dfa))
* Fix online pg import ([feast-dev#4581](feast-dev#4581)) ([1f17caa](feast-dev@1f17caa))
* Fix the mypy type check issue. ([feast-dev#4498](feast-dev#4498)) ([7ecc615](feast-dev@7ecc615))
* Fix vector store config ([feast-dev#4583](feast-dev#4583)) ([11c00d4](feast-dev@11c00d4))
* Fixes validator field access for 'project_id' in BigQuery offline Store ([feast-dev#4509](feast-dev#4509)) ([9a0398e](feast-dev@9a0398e))
* Fixing failure of protos during ODFV transformations for missing entities ([feast-dev#4667](feast-dev#4667)) ([41aaeeb](feast-dev@41aaeeb))
* Fixing the master branch build failure. ([feast-dev#4563](feast-dev#4563)) ([0192b2e](feast-dev@0192b2e))
* Hao xu request source timestamp_field ([feast-dev#4495](feast-dev#4495)) ([96344b2](feast-dev@96344b2))
* Ignore the type check as both functions calls are not belonging to Feast code. ([feast-dev#4500](feast-dev#4500)) ([867f532](feast-dev@867f532))
* Import grpc only for type checking in errors.py ([feast-dev#4533](feast-dev#4533)) ([f308572](feast-dev@f308572))
* Initial commit targetting grpc registry server ([feast-dev#4458](feast-dev#4458)) ([484240c](feast-dev@484240c)), closes [feast-dev#4465](feast-dev#4465)
* Links to the RBAC documentation under Concepts and Components ([feast-dev#4430](feast-dev#4430)) ([0a48f7b](feast-dev@0a48f7b))
* Locate feature_store.yaml from __file__ ([feast-dev#4443](feast-dev#4443)) ([20290ce](feast-dev@20290ce))
* Logger settings for feature servers and updated logger for permission flow ([feast-dev#4531](feast-dev#4531)) ([50b8f23](feast-dev@50b8f23))
* Move tslib from devDependencies to dependencies in Feast UI ([feast-dev#4525](feast-dev#4525)) ([c5a4d90](feast-dev@c5a4d90))
* Null value compatibility for unit timestamp list value type ([feast-dev#4378](feast-dev#4378)) ([8f264b6](feast-dev@8f264b6))
* Patch FAISS online return signature ([feast-dev#4671](feast-dev#4671)) ([0d45e95](feast-dev@0d45e95))
* Quickstart documentation changes ([feast-dev#4618](feast-dev#4618)) ([7ac0908](feast-dev@7ac0908))
* Refactor auth_client_manager_factory.py in function get_auth_client_m… ([feast-dev#4505](feast-dev#4505)) ([def8633](feast-dev@def8633))
* Remote apply using offline store ([feast-dev#4559](feast-dev#4559)) ([ac62a32](feast-dev@ac62a32))
* Remove Feast UI TypeScript dependencies from `peerDependencies` and `dependencies` ([feast-dev#4554](feast-dev#4554)) ([e781e16](feast-dev@e781e16))
* Remove unnecessary peer dependencies from Feast UI ([feast-dev#4577](feast-dev#4577)) ([9ac7f4e](feast-dev@9ac7f4e))
* Removed protobuf as a required dependency ([feast-dev#4535](feast-dev#4535)) ([0fb76e9](feast-dev@0fb76e9))
* Removed the k8s dependency from required dependencies ([feast-dev#4519](feast-dev#4519)) ([3073ea5](feast-dev@3073ea5))
* Removed usage of pull_request_target as much as possible to prevent security concerns ([feast-dev#4549](feast-dev#4549)) ([3198371](feast-dev@3198371))
* Replaced ClusterRoles with local RoleBindings ([feast-dev#4625](feast-dev#4625)) ([ca9fb9b](feast-dev@ca9fb9b))
* Retire pytz library ([feast-dev#4406](feast-dev#4406)) ([23c6c86](feast-dev@23c6c86))
* Typos related to k8s ([feast-dev#4442](feast-dev#4442)) ([dda0088](feast-dev@dda0088))
* Update java testcontainers to use Compose V2 ([feast-dev#4381](feast-dev#4381)) ([9a33fce](feast-dev@9a33fce))
* Update min versions for pyarrow and protobuf ([feast-dev#4646](feast-dev#4646)) ([c7ddd4b](feast-dev@c7ddd4b))
* Update react-router-dom to 6.3.0 and restrict its version in Feast UI ([feast-dev#4556](feast-dev#4556)) ([4293608](feast-dev@4293608)), closes [feast-dev#3794](feast-dev#3794) [/github.com/remix-run/react-router/blob/main/CHANGELOG.md#v630](https://github.com//github.com/remix-run/react-router/blob/main/CHANGELOG.md/issues/v630)
* Update the base image for feature-server. ([feast-dev#4576](feast-dev#4576)) ([0390d8a](feast-dev@0390d8a))
* Update the base image of materilization engine. ([feast-dev#4580](feast-dev#4580)) ([f8592d8](feast-dev@f8592d8))
* Updated README link ([feast-dev#4669](feast-dev#4669)) ([35fbdc9](feast-dev@35fbdc9))
* Updating the documentation and adding tests for project length ([feast-dev#4628](feast-dev#4628)) ([945b0fa](feast-dev@945b0fa))
* Using get_type_hints instead of inspect signature for udf return annotation  ([feast-dev#4391](feast-dev#4391)) ([3a32e8a](feast-dev@3a32e8a))
* Using repo_config parameter in teardown to allow for feature-store-yaml overrides ([feast-dev#4413](feast-dev#4413)) ([0baeeb5](feast-dev@0baeeb5))
* Validating permission to update an existing request on both the new and the old instance ([feast-dev#4449](feast-dev#4449)) ([635a01b](feast-dev@635a01b))

### Features

* Add boto3 session based auth for dynamodb online store for cross account access ([feast-dev#4606](feast-dev#4606)) ([00eaf74](feast-dev@00eaf74))
* Add cli list/describe for SavedDatasets, StreamFeatureViews, & … ([feast-dev#4487](feast-dev#4487)) ([7b250e5](feast-dev@7b250e5))
* Add connection_name field to Snowflake config ([feast-dev#4600](feast-dev#4600)) ([10ce2aa](feast-dev@10ce2aa))
* Add health check service to registry server ([feast-dev#4421](feast-dev#4421)) ([46655f0](feast-dev@46655f0))
* Add more __repr__ methods ([feast-dev#4676](feast-dev#4676)) ([e726c09](feast-dev@e726c09))
* Add registry methods for dealing with all FV types ([feast-dev#4435](feast-dev#4435)) ([ac381b2](feast-dev@ac381b2))
* Added Project object to Feast Objects ([feast-dev#4475](feast-dev#4475)) ([4a6b663](feast-dev@4a6b663))
* Added support for reading from Reader  Endpoints for AWS Aurora use cases ([feast-dev#4494](feast-dev#4494)) ([d793c77](feast-dev@d793c77))
* Adding documentation for On Demand Feature Transformations with writes ([feast-dev#4607](feast-dev#4607)) ([8e0c1b5](feast-dev@8e0c1b5))
* Adding mode='python' for get_historical_features on ODFVs ([feast-dev#4653](feast-dev#4653)) ([c40d539](feast-dev@c40d539))
* Adding registry cache support for get_on_demand_feature_view ([feast-dev#4572](feast-dev#4572)) ([354c059](feast-dev@354c059))
* Adding SSL support for online server ([feast-dev#4677](feast-dev#4677)) ([80a5b3c](feast-dev@80a5b3c))
* Adding write capability to online store to on demand feature views ([feast-dev#4585](feast-dev#4585)) ([ef9e0bb](feast-dev@ef9e0bb)), closes [feast-dev#4603](feast-dev#4603)
* Allow feast snowflake to read in byte string for private-key authentication ([feast-dev#4384](feast-dev#4384)) ([5215a21](feast-dev@5215a21))
* An action to test operator at PR time ([feast-dev#4635](feast-dev#4635)) ([14c1000](feast-dev@14c1000))
* Create ADOPTERS.md ([feast-dev#4410](feast-dev#4410)) ([721ec74](feast-dev@721ec74))
* Create initial structure of Feast Go Operator ([feast-dev#4596](feast-dev#4596)) ([b5ab6c7](feast-dev@b5ab6c7))
* Faiss and In memory store ([feast-dev#4464](feast-dev#4464)) ([a1ff129](feast-dev@a1ff129))
* Feast Security Model (aka RBAC) ([feast-dev#4380](feast-dev#4380)) ([1771f66](feast-dev@1771f66)), closes [feast-dev#36](feast-dev#36)
* Instrument Feast using Prometheus and OpenTelemetry ([feast-dev#4366](feast-dev#4366)) ([a571e08](feast-dev@a571e08))
* Intra server to server communication ([feast-dev#4433](feast-dev#4433)) ([729c874](feast-dev@729c874))
* Publish TypeScript types in Feast UI package ([feast-dev#4551](feast-dev#4551)) ([334e5d7](feast-dev@334e5d7))
* Refactoring code to get oidc end points from discovery URL. ([feast-dev#4429](feast-dev#4429)) ([896360a](feast-dev@896360a))
* Return entity key in the retrieval document api ([feast-dev#4511](feast-dev#4511)) ([5f5caf0](feast-dev@5f5caf0))
* Update roadmap.md ([feast-dev#4445](feast-dev#4445)) ([34238d2](feast-dev@34238d2))
* Update sqlite-vec package ([feast-dev#4389](feast-dev#4389)) ([b734cb1](feast-dev@b734cb1))
* Updated Feast model Inference Architecture ([feast-dev#4570](feast-dev#4570)) ([8cd0dcf](feast-dev@8cd0dcf))
* Updating docs to include model inference guidelines ([feast-dev#4416](feast-dev#4416)) ([cebbe04](feast-dev@cebbe04))
* Updating FeatureViewProjection and OnDemandFeatureView to add batch_source and entities ([feast-dev#4530](feast-dev#4530)) ([0795496](feast-dev@0795496))
* Upgrade React from 17.0.2 to 18.3.1 in Feast UI ([feast-dev#4620](feast-dev#4620)) ([d6f3cb8](feast-dev@d6f3cb8))

### Performance Improvements

* Add init and cleanup of long lived resources ([feast-dev#4642](feast-dev#4642)) ([47dc04d](feast-dev@47dc04d))
* Added indexes to sql tables to optimize query execution ([feast-dev#4538](feast-dev#4538)) ([9688790](feast-dev@9688790))
* Default to async endpoints, use threadpool for sync ([feast-dev#4647](feast-dev#4647)) ([c1f1912](feast-dev@c1f1912))
* Implement dynamo write_batch_async ([feast-dev#4675](feast-dev#4675)) ([ba4404c](feast-dev@ba4404c))
* Make /push async ([feast-dev#4650](feast-dev#4650)) ([61abf89](feast-dev@61abf89))
* Parallelize read calls by table and batch ([feast-dev#4619](feast-dev#4619)) ([043eff1](feast-dev@043eff1))

### BREAKING CHANGES

* Consuming apps that use @elastic/eui should update it
to a compatible version. If you use @elastic/eui components that have
been renamed or replaced with others, you'll need to update your code
accordingly.

Signed-off-by: Harri Lehtola <[email protected]>

* chore: Update Node version from 17 to 20 in UI unit tests

Node 17 is not an LTS (long-term support) version and apparently
rejected by the latest versions of Elastic UI:

> error @elastic/[email protected]: The engine "node" is incompatible with
> this module. Expected version "16.x || 18.x || >=20.x". Got "17.9.1"

Let's try with the latest LTS version.

Signed-off-by: Harri Lehtola <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@haoxu0 haoxu0 haoxu0 approved these changes
@shuchu shuchu Awaiting requested review from shuchu shuchu is a code owner automatically assigned from feast-dev/maintainers
@tokoko tokoko Awaiting requested review from tokoko tokoko is a code owner automatically assigned from feast-dev/maintainers
+1 more reviewer
@emgeee emgeee emgeee approved these changes
Reviewers whose approvals may not affect merge requirements

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

ok-to-test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

3 participants

@franciscojavierarceo @emgeee @haoxu0
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.