GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — Feast will attempt to create a BigQuery dataset regardless of `table_create_disposition` · Issue #4648 · feast-dev/feast

Feast will attempt to create a BigQuery dataset regardless of table_create_disposition #4648

New issue
Copy link
New issue
Copy link
Closed
#4649
Closed
Feast will attempt to create a BigQuery dataset regardless of table_create_disposition#4648
#4649
Copy link
Labels
kind/bugpriority/p2

Description

@danbaron63
danbaron63
opened on Oct 18, 2024
Issue body actions

Expected Behavior

When table_create_disposition is set to CREATE_NEVER, a BigQuery dataset should not be created.

Current Behavior

table_create_disposition is ignored and feast will attempt to create the dataset regardless. This can be a problem for orgs who require to manage warehouse infrastructure outside of Feast.

Steps to reproduce

Run get_historical_features on any BigQuery offline store. Example code:

from feast import FeatureStore
from pathlib import Path
from datetime import datetime
import pandas as pd

config = Path("feature_store.yaml")
store = FeatureStore(fs_yaml_file=config)
training_df = store.get_historical_features(
    entity_df=pd.DataFrame.from_dict(
        {
            "id": ["<uid>"],
            "feature_timestamp": [datetime(2020, 1, 1)]
        }
    ),
    features=[
        "<feature_view>:<feature>"
    ]
)

print(training_df.to_df())

Specifications

  • Version: feast[gcp,aws]==0.40.1
  • Platform: python 3.10.14
  • Subsystem: Debian GNU/Linux 11 (bullseye)

Possible Solution

table_create_disposition should be checked in this method. If the dataset does not exist and exception should be thrown when table_create_disposition is CREATE_NEVER.

Activity

  1. danbaron63
    added
    kind/bug
    priority/p2
    on Oct 18, 2024
  2. danbaron63 commented on Oct 18, 2024

    @danbaron63
    danbaron63
    on Oct 18, 2024
    ContributorAuthor
    More actions

    Draft PR here https://github.com/feast-dev/feast/pull/4649/files

    Still WIP as some tests are failing locally (possibly due to my environment setup though). Will see if I can get them working next week some time!

  3. tokoko
    closed this as completedin #4649on Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugpriority/p2

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      You are visitor 01402503 — GeezerVison does not store the pages you look up.
      Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.