v1.1.3

Major Changes

• Enhanced autoscaling peeking logic [#1432]
• Fixed Kafka source duplicate message issue [#1438]
• Fixed a bug of cycle topology pipeline (#1447)

Pull Requests

v1.1.2...v1.1.3

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.1.3/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.1.3/validating-webhook-install.yaml

v1.1.2

Major Changes

• Fix numaflow-ux server secret query permission issue.

Pull Requests

v1.1.1...v1.1.2

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.1.2/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.1.2/validating-webhook-install.yaml

v1.1.1

Major Changes

• Source idle watermark support
• UI access with local user authentication

🚨 Breaking Change 🚨

• User Defined Source interface requires to implement Partitions() function.
• MessageToDrop function in Source Transformer needs to give event time.

Pull Requests

v1.1.0...v1.1.1

Contributors

@KeranYang
@vigith
@yhl25
@jy4096
@dpadhiar
@veds-g
@whynowy
@kohlisid
@mshakira
@darshansimha

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.1.1/install.yaml

v1.1.0

Major Changes

• Source idle watermark support
• UI access with local user authentication

🚨 Breaking Change 🚨

• User Defined Source interface requires to implement Partitions() function.
• MessageToDrop function in Source Transformer needs to give event time.

Pull Requests

v1.0.0...v1.1.0

Contributors

@KeranYang
@vigith
@yhl25
@jy4096
@dpadhiar
@veds-g
@whynowy
@kohlisid
@mshakira
@darshansimha

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.1.0/install.yaml

v1.0.0

Major Features

• Kubernetes native streaming data processing platform.
• Built-in sources, sinks and UDFs.
• User defined sources, sinks and functions.
• Language agnostic, SDKs in Go, Python, Java, Rust.
• Autoscaling from 0 - N.
• Map Reduce operations.
• Conditional forwarding.
• Side Inputs support.
• Out-of-box watermark support.
• Pipeline topologies in Line, Tree, Join and Cycle.
• Pipeline operations such as pause and resume.
• Built-in observability.
• UX with AuthN/AuthZ.

Check the v1.0 release blog.

What's New in v1.0

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)
• Unified metrics names [#1290]

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0/validating-webhook-install.yaml

Check more installation options here.

Contributors

@alexanghh
@amitkalamkar
@aruwanip
@ashwinidulams
@bbehnke
@bpcarey01
@cdikibo
@chandankumar4
@darshansimha
@dpadhiar
@dratler
@dseapy
@dsosa17
@edlee2121
@jasonzeshengchen
@joelcomp1
@Jorvaulx
@juliev0
@jy4096
@kbaumzie
@KeranYang
@kohlisid
@Krithika3
@mshakira
@muregii
@qhuai
@RohanAshar
@sandangel
@sarabala1979
@saradhis
@shashank10456
@shubhamdixit863
@si3nloong
@tasneemkoushar
@tczhao
@testwill
@veds-g
@vigith
@VishalSoni07
@whynowy
@xdevxy
@yhl25

v1.0.0-rc4

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc4

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc4/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc4/validating-webhook-install.yaml

Check more installation options here.

v1.0.0-rc3

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc3

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc3/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc3/validating-webhook-install.yaml

Check more installation options here.

v1.0.0-rc2

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc2

Installation

kubectl create namespace numaflow-system

# Install numaflow controller
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc2/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc2/validating-webhook-install.yaml

Check more installation options here.

v1.0.0-rc1

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc1

Installation

kubectl create namespace numaflow-system

# Install numaflow controller
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc1/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc1/validating-webhook-install.yaml

Check more installation options here.

v0.11.0

Major Changes

• User-Defined Source Support
  Support using the latest Numaflow SDKs(numaflow-go 0.5.2, numaflow-java 0.5.4 and numaflow-python 0.5.3) to craft your own User-Defined Source.

• UX Improvements
  Improved the overall look and feel of the user interface, making it more visually appealing and user-friendly.

Other enhancements

• Enhanced Pipeline Validations to cover more edge cases.
• Optimized Back Pressure Measurement to always treat dropOnFull buffer as not having back pressure.
• Single-Pod JetStream Inter-Step Buffer Service to support the case when availability is not as important as saving cost.
• Simplified Java UDSink SDK.

Pull Requests

v0.10.0...v0.11.0

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.11.0/install.yaml