HTTP Source Node
Quick Reference
Port
TCP port the HTTP server listens on.
ex: 8080
Path
HTTP path that accepts POST requests. Default: /.
ex: /records
Bind Address
IP address to bind the server to. Default: 0.0.0.0.
Encoding Type The format used to decode each request body. Note: Parquet is not supported.
Max Body Size (bytes)
Maximum allowed request body size in bytes. Requests exceeding this limit are rejected with HTTP 413. Default: 1048576 (1 MB).
Queue Capacity
Internal buffer size between the HTTP server and the pipeline. Default: 10000.
Include Request Metadata When enabled, each emitted record includes HTTP metadata (headers, remote address, timestamp) under the metadata field name. Default: disabled.
Metadata Field Name
The field name used to attach request metadata when Include Request Metadata is enabled. Default: __http__.
Server Instances
Number of Vert.x server instances (record-loop threads). Increase for higher throughput under concurrent load. Default: 2.
Shutdown Grace Period (ms)
Time in milliseconds to wait for in-flight requests to complete during shutdown. Default: 5000.
Overview
The HTTP Source node embeds a lightweight HTTP server that accepts POST requests and emits each request body as a pipeline record.
Configuration
| Field | Description | Required | Default |
|---|---|---|---|
| Port | TCP port the HTTP server listens on. | Yes | — |
| Path | HTTP path that accepts POST requests. | No | / |
| Bind Address | IP address to bind the server to. | No | 0.0.0.0 |
| Encoding Type | The format used to decode each request body. Options: CSV, JSON Object, JSON Array, JSON Lines, String Line, Text, XML. More info here. Note: Parquet is not supported. | Yes | — |
| Max Body Size (bytes) | Maximum allowed request body size in bytes. Requests exceeding this limit are rejected with HTTP 413. | No | 1048576 |
| Queue Capacity | Internal buffer size between the HTTP server and the pipeline. | No | 10000 |
| Include Request Metadata | When enabled, each emitted record includes HTTP metadata (headers, remote address, timestamp) under the metadata field name. | No | false |
| Metadata Field Name | The field name used to attach request metadata when Include Request Metadata is enabled. | No | __http__ |
| Server Instances | Number of Vert.x server instances (record-loop threads). Increase for higher throughput under concurrent load. | No | 2 |
| Shutdown Grace Period (ms) | Time in milliseconds to wait for in-flight requests to complete during shutdown. | No | 5000 |
Related Nodes
- Kafka Source: Consume streaming data from Kafka
- SQS Source: Read messages from an Amazon SQS queue