Skip to content

Commit

Permalink
fix: Fixed SparkSource docstrings so it wouldn't used inhereted class…
Browse files Browse the repository at this point in the history
… docstrings (#4722)

Fixed docstrings so it wouldn't used inhereted class docstrings

Signed-off-by: dandawg <12484302+dandawg@users.noreply.github.com>
  • Loading branch information
dandawg authored Nov 5, 2024
1 parent 1a165c7 commit 32e6aa1
Showing 1 changed file with 21 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,8 @@ class SparkSourceFormat(Enum):


class SparkSource(DataSource):
"""A SparkSource object defines a data source that a Spark offline store can use"""

def __init__(
self,
*,
Expand All @@ -44,6 +46,25 @@ def __init__(
owner: Optional[str] = "",
timestamp_field: Optional[str] = None,
):
"""Creates a SparkSource object.
Args:
name: The name of the data source, which should be unique within a project.
table: The name of a Spark table.
query: The query to be executed in Spark.
path: The path to file data.
file_format: The format of the file data.
created_timestamp_column: Timestamp column indicating when the row
was created, used for deduplicating rows.
field_mapping: A dictionary mapping of column names in this data
source to feature names in a feature table or view.
description: A human-readable description.
tags: A dictionary of key-value pairs to store arbitrary metadata.
owner: The owner of the DataSource, typically the email of the primary
maintainer.
timestamp_field: Event timestamp field used for point-in-time joins of
feature values.
"""
# If no name, use the table as the default name.
if name is None and table is None:
raise DataSourceNoNameException()
Expand Down

0 comments on commit 32e6aa1

Please sign in to comment.