Learn about Pipelines limits.
Overview
BetaIngest and load real time data streams to R2, using Cloudflare Pipelines.
Available on Paid plans
Pipelines lets you ingest and load real time data streams into R2, without managing any infrastructure. You can send data to a Pipeline via HTTP, or from a Worker. Your Pipeline will handle batching the data, generating compressed JSON files, and delivering the files to an R2 bucket.
Refer to the get started guide to start building with Pipelines.
Build your first Pipeline
Create your first Pipeline, and send data to it.
HTTP as a source
Each Pipeline generates an HTTP endpoint to use for ingestion
Batch and deliver records to R2
Pipelines buffer records, before creating JSON files and delivering them to R2.
Follow @CloudflareDev on Twitter to learn about product announcements, and what is new in Cloudflare Workers.
Connect with the Workers community on Discord to ask questions, show what you are building, and discuss the platform with other developers.