Introducing Runtime Filtering

Author: jaceklaskowski

docs/bloom-filter-join/index.md

@@ -1,6 +1,9 @@
 # Bloom Filter Join
 
-**Bloom Filter Join** is an optimization of join queries by pre-filtering one side of a join using [BloomFilter](BloomFilter.md) or `InSubquery` predicate based on the values from the other side of the join.
+**Bloom Filter Join** is an optimization of join queries by pre-filtering one side of a join using [BloomFilter](BloomFilter.md) based on the values from the other side of the join.
+
+!!! note "Runtime Filtering"
+    Bloom Filter Join is one of the two optimizations in [Runtime Filtering](../runtime-filtering/index.md) optimization.
 
 Bloom Filter Join uses [BloomFilter](BloomFilter.md)s as runtime filters when [spark.sql.optimizer.runtime.bloomFilter.enabled](../configuration-properties.md#spark.sql.optimizer.runtime.bloomFilter.enabled) configuration property is enabled.
 

docs/runtime-filtering/.pages

@@ -0,0 +1,4 @@
+title: Runtime Filtering
+nav:
+    - index.md
+    - ...

docs/runtime-filtering/index.md

@@ -0,0 +1,5 @@
+# Runtime Filtering
+
+**Runtime Filtering** is an optimization of join queries by pre-filtering one side of a join using [Bloom Filter](../bloom-filter-join/index.md) or `InSubquery` predicate based on the values from the other side of the join.
+
+Runtime Filtering uses [InjectRuntimeFilter](../logical-optimizations/InjectRuntimeFilter.md) logical optimization to inject either [Bloom Filter](../bloom-filter-join/index.md) or `InSubquery` predicate based on [spark.sql.optimizer.runtime.bloomFilter.enabled](../configuration-properties.md#spark.sql.optimizer.runtime.bloomFilter.enabled) configuration property.

mkdocs.yml

@@ -223,7 +223,9 @@ nav:
     - ... | metadata-columns/**.md
     - Partition File Metadata Caching:
       - partition-file-metadata-caching/index.md
+    # spark-connect
     - ... | connect/**.md
+    - ... | runtime-filtering/**.md
     - ... | thrift-server/**.md
     - Statistics: new-and-noteworthy/statistics.md
     - ... | subqueries/**.md