About Fleak ZephFlow
ZephFlow is a lightweight data processing engine that runs DAG-based transformation pipelines in Docker containers.
Quick Start Guide
Get started with ZephFlow by running it as a standalone Docker container with the CLI starter.
ZephFlow Nodes
3 items
Understanding Data Flows in ZephFlow
ZephFlow uses Directed Acyclic Graphs to define data processing logic, with support for branching, merging, and complex multi-step transformations from source to sink.
Fleak Eval Expression Language (FEEL) Reference
FEEL is a flexible expression language for ZephFlow data transformations, supporting rich data manipulation, path selection, and extensive functions for filtering, mapping, and validation.
Decoding and Encoding
Sources read bytes with a `decoding` configuration and sinks write bytes with an `encoding` configuration. Both have the same shape: a `format` and an optional `compression`.
Error Handling
ZephFlow provides robust error handling with Dead Letter Queue support (S3 and GCS) for capturing and analyzing failed records, ensuring data integrity throughout transformation pipelines.
Tutorials
1 item