Full Changelog

Breaking changes:

• Add .proto to packages of Protobuf generated Java classes #700 (woop)
• Add support for feature set updates and remove versions #676 (zhilingc)
• Feast configuration files refactored #611 (woop)

See Feast 0.5 Release Issue for more details.

Implemented enhancements:

• Add general storage API and refactor existing store implementations #567 (zhilingc)
• Add support for feature set updates and remove versions #676 (zhilingc)
• Add unique ingestion id for all batch ingestions #656 (zhilingc)
• Add storage interfaces #529 (zhilingc)
• Add BigQuery storage implementation #546 (zhilingc)
• Add Redis storage implementation #547 (zhilingc)
• Add Support for Redis Cluster #502 (lavkesh)
• Add Ingestion Job management API for Feast Core #548 (mrzzy)
• Add feature and feature set labels for metadata #536 (imjuanleonard)
• Update Python SDK so FeatureSet can import Schema from Tensorflow metadata #450 (davidheryanto)

Fixed bugs:

• Add feature set status JOB_STARTING to denote feature sets waiting for job to get to RUNNING state #714 (zhilingc)
• Remove feature set status check for job update requirement #708 (khorshuheng)
• Fix Feast Core docker image #703 (khorshuheng)
• Include server port config on the generated application.yml #696 (khorshuheng)
• Fix typo in all types parquet yml file (e2e test) #683 (khorshuheng)
• Add grpc health probe implementation to core #680 (zhilingc)
• Ensure that generated python code are considered as module #679 (khorshuheng)
• Fix DataflowJobManager to update existing job instance instead of creating new one #678 (zhilingc)
• Fix config validation for feast.jobs.metrics.host #662 (davidheryanto)
• Docker compose bug fix #661 (woop)
• Swap join columns #647 (zhilingc)
• Fix Feast Serving not registering its store in Feast Core #641 (mrzzy)
• Kafka producer should raise an exception when it fails to connect to broker #636 (junhui096)

Merged pull requests:

• Change organization from gojek to feast-dev #712 (woop)
• Extract feature set update tests so CI doesn't run it #709 (zhilingc)
• Ensure that batch retrieval tests clean up after themselves #704 (zhilingc)
• Apply default project to rows without project during ingestion #701 (zhilingc)
• Update tests to correct compute region #699 (terryyylim)
• Make Projects optional & Update Feature References #693 (mrzzy)
• Add Java code coverage reporting #686 (ches)
• Update e2e tests to allow non-SNAPSHOT testing #672 (woop)
• Move TFDV stats to higher-numbered protobuf fields #669 (ches)
• Clean up Docker Compose and add test #668 (woop)
• Enable Prow e2e tests by default #666 (woop)
• Add label checking to Prow #665 (woop)
• Upgrade Github Checkout action to v2 #660 (khorshuheng)
• Fix Redis cluster e2e #659 (terryyylim)
• Split Field model into distinct Feature and Entity objects #655 (zhilingc)
• Use Runner enum type instead of string for Job model #651 (ches)
• JobUpdateTask cleanups #650 (ches)
• Update approvers list #648 (khorshuheng)
• Update end-to-end test config #645 (zhilingc)
• Fix bigquery config for serving store #644 (zhilingc)
• Fix Dataflow translator bug #643 (zhilingc)
• Fix subscription config and doctests #634 (woop)
• Correct links to why-feast and concepts doc site #627 (anderseriksson)
• Make error on retrieval of nonexistent feature humanly readable #625 (mrzzy)
• Generate golang code for non-serving protos #618 (zhilingc)
• Regenerate golang code, fix proto comparisons #616 (zhilingc)
• Fix doc building #603 (woop)
• Pin Jupyter Notebook version #597 (imjuanleonard)
• Create project if not exists on applyFeatureSet #596 (Joostrothweiler)
• Apply a fixed window before writing row metrics #590 (davidheryanto)
• Allow tests to run on non-master branches #588 (woop)

Full Changelog

Merged pull requests:

• Add log4j-web jar to core and serving. #498 (Yanson)
• Clear all the futures when sync is called. #501 (lavkesh)
• Encode feature row before storing in Redis #530 (khorshuheng)
• Remove transaction when listing projects #522 (davidheryanto)
• Remove unused ingestion deps #520 (ches)
• Parameterize end to end test scripts. #433 (Yanson)
• Replacing Jedis With Lettuce in ingestion and serving #485 (lavkesh)

Full Changelog

Merged pull requests:

• Rename metric name for request latency in feast serving #488 (davidheryanto)
• Allow use of secure gRPC in Feast Python client #459 (Yanson)
• Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD #486 (davidheryanto)
• Remove transaction from Ingestion #480 (imjuanleonard)
• Fix fastavro version used in Feast to avoid Timestamp delta error #490 (davidheryanto)
• Fail Spotless formatting check before tests execute #487 (ches)
• Reduce refresh rate of specification refresh in Serving to 10 seconds #481 (woop)

Full Changelog

Merged pull requests:

• Use bzip2 compressed feature set json as pipeline option #466 (khorshuheng)
• Make redis key creation more determinisitic #471 (zhilingc)
• Helm Chart Upgrades #458 (Yanson)
• Exclude version from grouping #441 (khorshuheng)
• Use concrete class for AvroCoder compatibility #465 (zhilingc)
• Fix typo in split string length check #464 (zhilingc)
• Update README.md and remove versions from Helm Charts #457 (woop)
• Deduplicate example notebooks #456 (woop)
• Allow users not to set max age for batch retrieval #446 (zhilingc)

Full Changelog

Merged pull requests:

• Change RedisBackedJobService to use a connection pool #439 (zhilingc)
• Update GKE installation and chart values to work with 0.4.3 #434 (lgvital)
• Remove "resource" concept and the need to specify a kind in feature sets #432 (woop)
• Add retry options to BigQuery #431 (Yanson)
• Fix logging #430 (Yanson)
• Add documentation for bigquery batch retrieval #428 (zhilingc)
• Publish datatypes/java along with sdk/java #426 (ches)
• Update basic Feast example to Feast 0.4 #424 (woop)
• Introduce datatypes/java module for proto generation #391 (ches)

Full Changelog

Fixed bugs:

• Bugfix for redis ingestion retries throwing NullPointerException on remote runners #417 (khorshuheng)

Full Changelog

Fixed bugs:

• Missing argument in error string in ValidateFeatureRowDoFn #401

Merged pull requests:

• Define maven revision property when packaging jars in Dockerfile so the images are built successfully #410 (davidheryanto)
• Deduplicate rows in subquery #409 (zhilingc)
• Filter out extra fields, deduplicate fields in ingestion #404 (zhilingc)
• Automatic documentation generation for gRPC API #403 (woop)
• Update feast core default values to include hibernate merge strategy #400 (zhilingc)
• Move cli into feast package #398 (zhilingc)
• Use Nexus staging plugin for deployment #394 (khorshuheng)
• Handle retry for redis io flow #274 (khorshuheng)

Full Changelog

Merged pull requests:

• Add project-related commands to CLI #397 (zhilingc)

Full Changelog

Implemented enhancements:

• Edit description in feature specification to also reflect in BigQuery schema description. #239
• Allow for disabling of metrics pushing #57

Merged pull requests:

• Java SDK release script #406 (davidheryanto)
• Use fixed 'dev' revision for test-e2e-batch #395 (davidheryanto)
• Project Namespacing #393 (woop)
• <docs>(concepts): change data types to upper case because lower case … #389 (david30907d)
• Remove alpha v1 from java package name #387 (khorshuheng)
• Minor bug fixes for Python SDK #383 (voonhous)
• Allow user to override job options #377 (khorshuheng)
• Add documentation to default values.yaml in Feast chart #376 (davidheryanto)
• Add support for file paths for providing entity rows during batch retrieval #375 (voonhous)
• Update sync helm chart script to ensure requirements.lock in in sync with requirements.yaml #373 (davidheryanto)
• Catch errors thrown by BQ during entity table loading #371 (zhilingc)
• Async job management #361 (zhilingc)
• Infer schema of PyArrow table directly #355 (voonhous)
• Add readiness checks for Feast services in end to end test #337 (davidheryanto)
• Create CHANGELOG.md #321 (woop)

Full Changelog

Merged pull requests:

• Moved end-to-end test scripts from .prow to infra #657 (khorshuheng)
• Backported #566 & #647 to v0.3 #654 (ches)

Merged pull requests:

Full Changelog

• Add support for file paths for providing entity rows during batch retrieval #375 (voonhous)

Full Changelog

Merged pull requests:

• Always set destination table in BigQuery query config in Feast Batch Serving so it can handle large results #392 (davidheryanto)

Full Changelog

Merged pull requests:

• Make redis key creation more determinisitic #380 (zhilingc)

Full Changelog

Implemented enhancements:

• Added Docker Compose for Feast #272
• Added ability to check import job status and cancel job through Python SDK #194
• Added basic customer transactions example #354 (woop)

Merged pull requests:

• Added Prow jobs to automate the release of Docker images and Python SDK #369 (davidheryanto)
• Fixed installation link in README.md #368 (Jeffwan)
• Fixed Java SDK tests not actually running (missing dependencies) #366 (woop)
• Added more batch retrieval tests #357 (zhilingc)
• Python SDK and Feast Core Bug Fixes #353 (woop)
• Updated buildFeatureSets method in Golang SDK #351 (davidheryanto)
• Python SDK cleanup #348 (woop)
• Broke up queries for point in time correctness joins #347 (zhilingc)
• Exports gRPC call metrics and Feast resource metrics in Core #345 (davidheryanto)
• Fixed broken Google Group link on Community page #343 (ches)
• Ensured ImportJobTest is not flaky by checking WriteToStore metric and requesting adequate resources for testing #332 (davidheryanto)
• Added docker-compose file with Jupyter notebook #328 (khorshuheng)
• Added minimal implementation of ingesting Parquet and CSV files #327 (voonhous)

Full Changelog

Merged pull requests:

• Fixed incorrect BigQuery schema creation from FeatureSetSpec #340 (davidheryanto)
• Filtered out feature sets that dont share the same source #339 (zhilingc)
• Changed latency calculation method to not use Timer #338 (zhilingc)
• Moved Prometheus annotations to pod template for serving #336 (zhilingc)
• Removed metrics windowing, cleaned up step names for metrics writing #334 (zhilingc)
• Set BigQuery table time partition inside get table function #333 (zhilingc)
• Added unit test in Redis to return values with no max age set #329 (smadarasmi)
• Consolidated jobs into single steps instead of branching out #326 (zhilingc)
• Pinned Python SDK to minor versions for dependencies #322 (woop)
• Added Auto format to Google style with Spotless #317 (ches)

Full Changelog

Merged pull requests:

• Added Prometheus metrics to serving #316 (zhilingc)
• Changed default job metrics sink to Statsd #315 (zhilingc)
• Fixed module import error in Feast CLI #314 (davidheryanto)

Full Changelog

Summary:

• Introduced "Feature Sets" as a concept with a new Feast Core API, Feast Serving API
• Upgraded Python SDK to support new Feast API. Allows for management of Feast as a library or through the command line.
• Implemented a Golang SDK and Java SDK to support the new Feast Core and Feast Serving APIs.
• Added support for multi-feature set retrieval and joins.
• Added point-in-time correct retrieval for both batch and online serving.
• Added support for an external source in Kafka.
• Added job management to Feast Core to manage ingestion/population jobs to remote Feast deployments
• Added metric support through Prometheus

Merged pull requests:

• Regenerate go protos #313 (zhilingc)
• Bump chart version to 0.3.0 #311 (zhilingc)
• Refactored Core API: ListFeatureSets, ListStore, and GetFeatureSet #309 (woop)
• Use Maven's --also-make by default #308 (ches)
• Python SDK Ingestion and schema inference updates #307 (woop)
• Batch ingestion fix #299 (zhilingc)
• Update values-demo.yaml to make Minikube installation simpler #298 (woop)
• Fix bug in core not setting default Kafka source #297 (woop)
• Replace Prometheus logging in ingestion with StatsD logging #293 (woop)
• Feast Core: Stage files manually when launching Dataflow jobs #291 (davidheryanto)
• Database tweaks #290 (smadarasmi)
• Feast Helm charts and build script #289 (davidheryanto)
• Fix max_age changes not updating specs and add TQDM silencing flag #292 (woop)
• Ingestion fixes #286 (zhilingc)
• Consolidate jobs #279 (zhilingc)
• Import Spring Boot's dependency BOM, fix spring-boot:run at parent project level #276 (ches)
• Feast 0.3 Continuous Integration (CI) Update #271 (davidheryanto)
• Add batch feature retrieval to Python SDK #268 (woop)
• Set Maven build requirements and some project POM metadata #267 (ches)
• Python SDK enhancements #264 (woop)
• Use a symlink for Java SDK's protos #263 (ches)
• Clean up the Maven build #262 (ches)
• Add golang SDK #261 (zhilingc)
• Move storage configuration to serving #254 (zhilingc)
• Serving API changes for 0.3 #253 (zhilingc)

Full Changelog

Implemented enhancements:

• Feast cli config file should be settable by an env var #149
• Helm chart for deploying feast using Flink as runner #64
• Get ingestion metrics when running on Flink runner #63
• Move source types into their own package and discover them using java.util.ServiceLoader #61
• Change config to yaml #51
• Ability to pass runner option during ingestion job submission #50

Fixed bugs:

• Fix Print Method in Feast CLI #211
• Dataflow monitoring by core is failing with incorrect job id #153
• Feast core crashes without logger set #150

Merged pull requests:

• Remove redis transaction #280 (pradithya)
• Fix tracing to continue from existing trace created by grpc client #245 (pradithya)

Full Changelog

Fixed bugs:

• Batch Import, feature with datetime format issue #203
• Serving not correctly reporting readiness check if there is no activity #190
• Serving stop periodically reloading feature specification after a while #188

Merged pull requests:

• Add romanwozniak to prow owners config #216 (romanwozniak)
• Implement filter for create dataset api #215 (pradithya)
• expand raw column to accomodate more features ingested in one go #213 (budi)
• update feast installation docs #210 (budi)
• Add Prow job for unit testing Python SDK #209 (davidheryanto)
• fix create_dataset #208 (budi)
• Update Feast installation doc #207 (davidheryanto)
• Fix unit test cli in prow script not returning correct exit code #206 (davidheryanto)
• Fix pytests and make TS conversion conditional #205 (zhilingc)
• Use full prow build id as dataset name during test #200 (davidheryanto)
• Add Feast CLI / python SDK documentation #199 (romanwozniak)
• Update library version to fix security vulnerabilities in dependencies #198 (davidheryanto)
• Update Prow configuration for Feast CI #197 (davidheryanto)
• [budi] update python sdk quickstart #196 (budi)
• Readiness probe #191 (pradithya)
• Fix periodic feature spec reload #189 (pradithya)
• Fixed a typo in environment variable in installation #187 (gauravkumar37)
• Revert "Update Quickstart" #185 (zhilingc)
• Update Quickstart #184 (pradithya)
• Continuous integration and deployment (CI/CD) update #183 (davidheryanto)
• Remove feature specs being able to declare their serving or warehouse stores #159 (tims)

Full Changelog

Fixed bugs:

• Fix BigQuery query template to retrieve training data #182 (davidheryanto)

Merged pull requests:

• Add python init files #176 (zhilingc)
• Change pypi package from Feast to feast #173 (zhilingc)

Full Changelog

Implemented enhancements:

• Removal of storing historical value of feature in serving storage #53
• Remove feature "granularity" and relegate to metadata #17

Closed issues:

• Add ability to name an import job #167
• Ingestion retrying an invalid FeatureRow endlessly #163
• Ability to associate data ingested in Warehouse store to its ingestion job #145
• Missing (Fixing) unit test for FeatureRowKafkaIO #132

Merged pull requests:

• Catch all kind of exception to avoid retrying #171 (pradithya)
• Integration test #170 (zhilingc)
• Proto error #169 (pradithya)
• Add --name flag to submit job #168 (pradithya)
• Prevent throwing RuntimeException when invalid proto is received #166 (pradithya)
• Add davidheryanto to OWNER file #165 (pradithya)
• Check validity of event timestamp in ValidateFeatureRowDoFn #164 (pradithya)
• Remove granularity #162 (pradithya)
• Better Kafka test #160 (tims)
• Simplify and document CLI building steps #158 (thirteen37)
• Fix link typo in README.md #156 (pradithya)
• Add Feast admin quickstart guide #155 (thirteen37)
• Pass all specs to ingestion by file #154 (tims)
• Preload spec in serving cache #152 (pradithya)
• Add job identifier to FeatureRow #147 (mansiib)
• Fix unit tests #146 (mansiib)
• Add thirteen37 to OWNERS #144 (thirteen37)
• Fix import spec created from Importer.from_csv #143 (pradithya)
• Regenerate go #142 (zhilingc)
• Flat JSON for pubsub and text files #141 (tims)
• Add wait flag for jobs, fix go proto path for dataset service #138 (zhilingc)
• Fix Python SDK importer's ability to apply features #135 (woop)
• Refactor stores #110 (tims)
• Coalesce rows #89 (tims)
• Remove historical feature in serving store #87 (pradithya)

Full Changelog

Implemented enhancements:

• Coalesce FeatureRows for improved "latest" value consistency in serving stores #88
• Kafka source #22

Closed issues:

• Preload Feast's spec in serving cache #151
• Feast csv data upload job #137
• Blocking call to start feast ingestion job #136
• Python SDK fails to apply feature when submitting job #134
• Default dump format should be changed for Python SDK #133
• Listing resources and finding out system state #131
• Reorganise ingestion store classes to match architecture #109

Full Changelog

Implemented enhancements:

• Spring boot CLI logs show up as JSON #104
• Allow for registering feature that doesn't have warehouse store #5

Fixed bugs:

• Error when submitting large import spec #125
• Ingestion is not ignoring unknown feature in streaming source #99
• Vulnerability in dependency (core - jackson-databind ) #92
• TF file for cloud build trigger broken #72
• Job Execution Failure with NullPointerException #46
• Runtime Dependency Error After Upgrade to Beam 2.9.0 #44
• [FlinkRunner] Core should not follow remote flink runner job to completion #21
• Go packages in protos use incorrect repo #16

Merged pull requests:

• Disable test during docker image creation #129 (pradithya)
• Repackage helm chart #127 (pradithya)
• Increase the column size for storing raw import spec #126 (pradithya)
• Update Helm Charts (Redis, Logging) #123 (woop)
• Added LOG_TYPE environmental variable #120 (woop)
• Fix missing Redis write #119 (pradithya)
• add logging when error on request feature #117 (pradithya)
• run yarn run build during generate-resource #115 (pradithya)
• Add loadBalancerSourceRanges option for both serving and core #114 (zhilingc)
• Build master #112 (pradithya)
• Cleanup warning while building proto files #108 (pradithya)
• Embed ui build & packaging into core's build #106 (pradithya)
• Add build badge to README #103 (woop)
• Ignore features in FeatureRow if it's not requested in import spec #101 (pradithya)
• Add override for serving service static ip #100 (zhilingc)
• Fix go test #97 (zhilingc)
• add missing copyright headers and fix test fail due to previous merge #95 (tims)
• Allow submission of kafka jobs #94 (zhilingc)
• upgrade jackson databind for security vulnerability #93 (tims)
• Version revert #91 (zhilingc)
• Fix validating feature row when the associated feature spec has no warehouse store #90 (pradithya)
• Add get command #85 (zhilingc)
• Avoid error thrown when no storage for warehouse/serving is registered #83 (pradithya)
• Fix jackson dependency issue #82 (zhilingc)
• Allow registration of feature without warehouse store #80 (pradithya)
• Remove branch from cloud build trigger #79 (woop)
• move read transforms into "source" package as FeatureSources #74 (tims)
• Fix tag regex in tf file #73 (zhilingc)
• Update charts #71 (mansiib)
• Deduplicate storage ids before we fetch them #68 (tims)
• Check the size of result against deduplicated request #67 (pradithya)
• Add ability to submit ingestion job using Flink #62 (pradithya)
• Fix vulnerabilities for webpack-dev #59 (budi)
• Build push #56 (zhilingc)
• Fix github vulnerability issue with webpack #54 (budi)
• Only lookup storage specs that we actually need #52 (tims)
• Link Python SDK RFC to PR and Issue #49 (woop)
• Python SDK #47 (zhilingc)
• Update com.google.httpclient to be same as Beam's dependency #45 (pradithya)
• Bump Beam SDK to 2.9.0 #43 (pradithya)
• Add fix for tests failing in docker image #40 (zhilingc)
• Change error store to be part of configuration instead #39 (zhilingc)
• Fix location of Prow's Tide configuration #35 (woop)
• Add testing folder for deploying test infrastructure and running tests #34 (woop)
• skeleton contributing guide #33 (tims)
• allow empty string to select a NoOp write transform #30 (tims)
• Remove packaging ingestion as separate profile (fix #28) #29 (pradithya)
• Change gopath to point to feast-dev repo #26 (zhilingc)
• Fixes #31 - errors during kafka deserializer (passing) test execution #25 (baskaranz)
• Kafka IO fixes #23 (tims)
• KafkaIO implementation for feast #19 (baskaranz)
• Return same type string for warehouse and serving NoOp stores #18 (tims)
• #12: prefetch specs and validate on job expansion #15 (tims)
• Added RFC for Feast Python SDK #14 (woop)
• Add more validation in feature spec registration #11 (pradithya)
• Added rfcs/ folder with readme and template #10 (woop)
• Expose ui service rpc #9 (pradithya)
• Add Feast overview to README #8 (woop)
• Directory structure changes #7 (zhilingc)
• Change register to apply #4 (zhilingc)
• Empty response handling in serving api #3 (pradithya)
• Proto file fixes #1 (pradithya)