GeezerVison

Original file line number	Diff line number	Diff line change
Expand Up		@@ -325,11 +325,7 @@ def _to_df_internal(self) -> pd.DataFrame:

		def _to_arrow_internal(self) -> pyarrow.Table:
		"""Return dataset as pyarrow Table synchronously"""

		# write to temp parquet and then load it as pyarrow table from disk
		with tempfile.TemporaryDirectory() as temp_dir:
		self.to_spark_df().write.parquet(temp_dir, mode="overwrite")
		return pq.read_table(temp_dir)
		return pyarrow.Table.from_pandas(self._to_df_internal())

		def persist(self, storage: SavedDatasetStorage, allow_overwrite: bool = False):
		"""
Expand Down

Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.