Skip to main content

Data streaming

Data streaming is powered by Redpanda and enables continuous movement of operational events across the platform.

data-streaming

Redpanda capabilities​

Users can work with streaming ingestion by:

  • Publishing individual events via POST /api/v1/ingest.
  • Publishing message batches via POST /api/v1/ingest/batch.
  • Checking stream connectivity/readiness via GET /api/v1/connectivity.
  • Operating topic-based pipelines for AIS, weather, and Copernicus event flows.

What users can do​

  • Feed near-real-time maritime data into event topics.
  • Validate ingestion health and broker readiness.
  • Support downstream consumers and Spark structured streaming jobs.
  • Enable faster reaction to operational changes through live event flow.

For non-technical users, Data streaming means decisions can use fresher information instead of waiting for delayed batch updates. It supports more responsive operations and better situational awareness.

Its role is to keep data continuously moving from source systems to analytics and operational tools.

Official reference​