Skip to content

Commit 8e3925c

Browse files
jdye64charlesbluca
andauthored
Do not persist data to memory by default when creating tables (dask-contrib#245)
* Add GPU tests, pytest `gpu` marker (#1) * Add dask-cudf tests with GPU marker * Change --gpu option to --rungpu * xfail GPU table creation from memory * Do not persist data to memory by default when creating tables * Revert "Add GPU tests, pytest `gpu` marker (#1)" This reverts commit efa492f. * update persist doc Co-authored-by: Charles Blackmon-Luca <[email protected]>
1 parent e7ae26d commit 8e3925c

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

dask_sql/context.py

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -123,7 +123,7 @@ def create_table(
123123
table_name: str,
124124
input_table: InputType,
125125
format: str = None,
126-
persist: bool = True,
126+
persist: bool = False,
127127
schema_name: str = None,
128128
gpu: bool = False,
129129
**kwargs,
@@ -144,8 +144,9 @@ def create_table(
144144
Typical file formats are csv or parquet.
145145
Any additional parameters will get passed on to the read method.
146146
Please note that some file formats require additional libraries.
147-
By default, the data will be loaded directly into the memory
148-
of the nodes. If you do not want that, set persist to False.
147+
By default, the data will be lazily loaded. If you would like to
148+
load the data directly into memory you can do so by setting
149+
persist=True.
149150
150151
See :ref:`data_input` for more information.
151152
@@ -185,7 +186,7 @@ def create_table(
185186
Specify the file format directly here if it can not be deduced from the extension.
186187
If set to "memory", load the data from a published dataset in the dask cluster.
187188
persist (:obj:`bool`): Only used when passing a string into the ``input`` parameter.
188-
Set to false to turn off loading the file data directly into memory.
189+
Set to true to turn on loading the file data directly into memory.
189190
**kwargs: Additional arguments for specific formats. See :ref:`data_input` for more information.
190191
191192
"""

0 commit comments

Comments
 (0)