Miscellaneous#

LazyFrame.cache()

Cache the result once the execution of the physical plan hits this node.

LazyFrame.collect(*[, type_coercion, ...])

Collect into a DataFrame.

LazyFrame.fetch([n_rows, type_coercion, ...])

Collect a small number of rows for debugging purposes.

LazyFrame.lazy()

Return lazy representation, i.e. itself.

LazyFrame.map(function, *[, ...])

Apply a custom function.

LazyFrame.pipe(func, *args, **kwargs)

Offers a structured way to apply a sequence of user-defined functions (UDFs).

LazyFrame.profile(*[, type_coercion, ...])

Profile a LazyFrame.

LazyFrame.sink_ipc(path, *[, compression, ...])

Persists a LazyFrame at the provided path.

LazyFrame.sink_parquet(path, *[, ...])

Persists a LazyFrame at the provided path.

Read/write logical plan#

LazyFrame.from_json(json)

Read a logical plan from a JSON string to construct a LazyFrame.

LazyFrame.read_json(file)

Read a logical plan from a JSON file to construct a LazyFrame.

LazyFrame.write_json()

Write the logical plan of this LazyFrame to a file or string in JSON format.