Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks
Databricks introduces on-demand state repartitioning for Apache Spark Structured Streaming.
Databricks has announced a new feature for Apache Spark Structured Streaming that allows on-demand state repartitioning. This capability will enhance query performance and efficiency for users running stateful streaming applications in production.