Skip to content

Commit 688b9e5

Browse files
committed
add myself to author list and update readme
1 parent d9ad461 commit 688b9e5

File tree

2 files changed

+13
-1
lines changed

2 files changed

+13
-1
lines changed

README.md

Lines changed: 12 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ Save to Hugging Face:
4343
df.write.format("huggingface").save("username/my_dataset")
4444
# Or pass a token manually
4545
df.write.format("huggingface").option("token", "hf_xxx").save("username/my_dataset")
46-
```
46+
```
4747

4848
## Advanced
4949

@@ -91,3 +91,14 @@ huggingface datasource enabled for pyspark 3.x.x (backport from pyspark 4)
9191

9292
The import is only necessary on Spark 3.x to enable the backport.
9393
Spark 4 automatically imports `pyspark_huggingface` as soon as it is installed, and registers the "huggingface" data source.
94+
95+
96+
## Development
97+
98+
[Install uv](https://docs.astral.sh/uv/getting-started/installation/) if not already done.
99+
100+
Then, from the project root directory, sync dependencies and run tests.
101+
```
102+
uv sync
103+
uv run pytest
104+
```

pyproject.toml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@ description = "A DataSource for reading and writing HuggingFace Datasets in Spar
55
authors = [
66
{name = "allisonwang-db", email = "allison.wang@databricks.com"},
77
{name = "lhoestq", email = "quentin@huggingface.co"},
8+
{name = "wengh", email = "wenghy02@gmail.com"},
89
]
910
license = {text = "Apache License 2.0"}
1011
readme = "README.md"

0 commit comments

Comments
 (0)