nodejs-polars
    Preparing search index...

    Function readJSONStream

    • Read a newline delimited JSON stream into a DataFrame.

      Parameters

      • stream: Readable

        readable stream containing json data

      • Optionaloptions: Partial<ReadJsonOptions>
        • inferSchemaLength

          Maximum number of lines to read to infer schema. If set to 0, all columns will be read as pl.Utf8. If set to null, a full table scan will be done (slow). Note: this is done per batch

        • batchSize

          Number of lines to read into the buffer at once. Modify this to change performance.

      Returns Promise<pl.DataFrame<any>>

      >>> const readStream = new Stream.Readable({read(){}});
      >>> readStream.push(`${JSON.stringify({a: 1, b: 2})} \n`);
      >>> readStream.push(`${JSON.stringify({a: 2, b: 2})} \n`);
      >>> readStream.push(`${JSON.stringify({a: 3, b: 2})} \n`);
      >>> readStream.push(`${JSON.stringify({a: 4, b: 2})} \n`);
      >>> readStream.push(null);

      >>> pl.readJSONStream(readStream, { format: "lines" }).then(df => console.log(df));
      shape: (4, 2)
      ┌─────┬─────┐
      ab
      │ --- ┆ --- │
      i64i64
      ╞═════╪═════╡
      12
      ├╌╌╌╌╌┼╌╌╌╌╌┤
      22
      ├╌╌╌╌╌┼╌╌╌╌╌┤
      32
      ├╌╌╌╌╌┼╌╌╌╌╌┤
      42
      └─────┴─────┘