rust-data-processing documentation

Browse API reference for the Rust crate (rustdoc) and the Python bindings (pdoc). This site is generated on every push to main.

Rust API (rustdoc)
Ingestion, pipelines, SQL, profiling, validation, and processing helpers.
Python API (pdoc)
PyO3 bindings: ingest_from_path, DataFrame, validation, profiling, and more. Python examples (same content as the examples module page).

Minimal examples

Rust

use rust_data_processing::ingestion::{ingest_from_path, IngestionOptions};
use rust_data_processing::types::{DataType, Field, Schema};

let schema = Schema::new(vec![
    Field::new("id", DataType::Int64),
    Field::new("name", DataType::Utf8),
]);
let ds = ingest_from_path("tests/fixtures/people.csv", &schema, &IngestionOptions::default())?;
println!("rows={}", ds.row_count());

Python

import rust_data_processing as rdp

schema = [
    {"name": "id", "data_type": "int64"},
    {"name": "name", "data_type": "utf8"},
]
ds = rdp.ingest_from_path("path/to/data.csv", schema, {"format": "csv"})
print("rows", ds.row_count())