Struct ExecutionEngine 

pub struct ExecutionEngine { /* private fields */ }

A configurable execution engine for in-memory DataSet pipelines.

Implementations

impl ExecutionEngine

pub fn new(opts: ExecutionOptions) -> Self

Create a new engine with the given options.

Panics

Panics if chunk_size == 0, max_in_flight_chunks == 0, or num_threads == Some(0).

pub fn with_observer(self, observer: Arc<dyn ExecutionObserver>) -> Self

Attach an observer for execution events (metrics/logging).

pub fn metrics(&self) -> Arc<ExecutionMetrics>

Get a handle to real-time execution metrics.

pub fn filter_parallel<F>(&self, dataset: &DataSet, predicate: F) -> DataSet

where F: Fn(&[Value]) -> bool + Send + Sync,

Execute a parallel filter over the dataset.

pub fn map_parallel<F>(&self, dataset: &DataSet, mapper: F) -> DataSet

where F: Fn(&[Value]) -> Vec<Value> + Send + Sync,

Execute a parallel map over the dataset.

Panics

Panics if mapper returns rows with a different length than the schema field count.

pub fn reduce( &self, dataset: &DataSet, column: &str, op: ReduceOp, ) -> Option<Value>

Reduce a column using the existing built-in reduce operation.

This is currently sequential, but is tracked via the observer/metrics hooks.