You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/logical-operators/AddColumns.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: AddColumns
3
+
---
4
+
1
5
# AddColumns Logical Operator
2
6
3
7
`AddColumns` is an `AlterTableCommand` logical operator that represents [ALTER TABLE ADD COLUMNS](../sql/AstBuilder.md#visitAddTableColumns) SQL statement (in a logical query plan).
Copy file name to clipboardExpand all lines: docs/logical-operators/Aggregate.md
+5-1Lines changed: 5 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: Aggregate
3
+
---
4
+
1
5
# Aggregate Logical Operator
2
6
3
7
`Aggregate` is a [unary logical operator](LogicalPlan.md#UnaryNode) for [Aggregation Queries](../aggregations/index.md) and can represent the following high-level operators in a [logical query plan](LogicalPlan.md):
@@ -94,7 +98,7 @@ In the end, `supportsHashAggregate` [isAggregateBufferMutable](#isAggregateBuffe
94
98
*`AggUtils` is requested to [create a physical operator for aggregation](../aggregations/AggUtils.md#createAggregate)
95
99
*`HashAggregateExec` physical operator is created (to assert that the [aggregateBufferAttributes](../physical-operators/HashAggregateExec.md#aggregateBufferAttributes) are supported)
Copy file name to clipboardExpand all lines: docs/logical-operators/AnalyzeColumnCommand.md
+17-11Lines changed: 17 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: AnalyzeColumnCommand
3
+
---
4
+
1
5
# AnalyzeColumnCommand Logical Command
2
6
3
7
`AnalyzeColumnCommand` is a [logical command](RunnableCommand.md) to represent [AnalyzeColumn](AnalyzeColumn.md) logical operator.
@@ -16,21 +20,23 @@
16
20
17
21
*[ResolveSessionCatalog](../logical-analysis-rules/ResolveSessionCatalog.md) logical resolution rule is executed (to resolve an [AnalyzeColumn](AnalyzeColumn.md))
18
22
19
-
## <spanid="run"> Executing Logical Command
23
+
## Executing Command { #run }
20
24
21
-
```scala
22
-
run(
23
-
sparkSession: SparkSession):Seq[Row]
24
-
```
25
+
??? note "RunnableCommand"
26
+
27
+
```scala
28
+
run(
29
+
sparkSession: SparkSession): Seq[Row]
30
+
```
25
31
26
-
`run` is part of [RunnableCommand](RunnableCommand.md#run) abstraction.
32
+
`run` is part of [RunnableCommand](RunnableCommand.md#run) abstraction.
27
33
28
34
`run` calculates the following statistics:
29
35
30
-
* sizeInBytes
36
+
*`sizeInBytes`
31
37
* stats for each column
32
38
33
-
### <spanid="computeColumnStats"> Computing Statistics for Specified Columns
39
+
### Computing Statistics for Specified Columns { #computeColumnStats }
In the end, `analyzeColumnInCatalog` requests the [SessionCatalog](../SessionState.md#catalog) to [alter](../SessionCatalog.md#alterTableStats) the [table](#tableIdent) with the new [CatalogStatistics](../CatalogStatistics.md).
Copy file name to clipboardExpand all lines: docs/logical-operators/AnalyzePartitionCommand.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: AnalyzePartitionCommand
3
+
---
4
+
1
5
# AnalyzePartitionCommand Logical Command
2
6
3
7
`AnalyzePartitionCommand` is a [LeafRunnableCommand](LeafRunnableCommand.md) that represents [ANALYZE TABLE PARTITION COMPUTE STATISTICS](../sql/AstBuilder.md#visitAnalyze) ([AnalyzeTable](AnalyzeTable.md) logical command with [partition specification](#partitionSpec)) at analysis.
Copy file name to clipboardExpand all lines: docs/logical-operators/AnalyzeTableCommand.md
+13-7Lines changed: 13 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: AnalyzeTableCommand
3
+
---
4
+
1
5
# AnalyzeTableCommand Logical Command
2
6
3
7
`AnalyzeTableCommand` is a [LeafRunnableCommand](LeafRunnableCommand.md) that [computes statistics](#run) (and stores them in a metastore).
@@ -13,19 +17,21 @@
13
17
14
18
*[ResolveSessionCatalog](../logical-analysis-rules/ResolveSessionCatalog.md) logical resolution rule is executed (and resolves an [AnalyzeTable](AnalyzeTable.md) logical operator with no `PARTITION`s)
15
19
16
-
## <spanid="run"> run
20
+
## Executing Command { #run }
17
21
18
-
```scala
19
-
run(
20
-
sparkSession: SparkSession):Seq[Row]
21
-
```
22
+
??? note "RunnableCommand"
23
+
24
+
```scala
25
+
run(
26
+
sparkSession: SparkSession): Seq[Row]
27
+
```
28
+
29
+
`run` is part of the [RunnableCommand](RunnableCommand.md#run) abstraction.
22
30
23
31
`run`[analyzes](../CommandUtils.md#analyzeTable) the given [table](#tableIdent).
24
32
25
33
`run` returns an empty collection.
26
34
27
-
`run` is part of the [RunnableCommand](RunnableCommand.md#run) abstraction.
Copy file name to clipboardExpand all lines: docs/logical-operators/AnalyzeTablesCommand.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: AnalyzeTablesCommand
3
+
---
4
+
1
5
# AnalyzeTablesCommand Logical Command
2
6
3
7
`AnalyzeTablesCommand` is a [LeafRunnableCommand](LeafRunnableCommand.md) that represents `ANALYZE TABLES COMPUTE STATISTICS` SQL statement (`AnalyzeTables` logical command) at query execution.
Copy file name to clipboardExpand all lines: docs/logical-operators/AppendData.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,7 @@
1
+
---
2
+
title: AppendData
3
+
---
4
+
1
5
# AppendData Logical Command
2
6
3
7
`AppendData` is a [V2WriteCommand](V2WriteCommand.md) that represents appending data (the result of executing a [structured query](#query)) to a [table](#table) (with the [columns matching](#isByName) by [name](#byName) or [position](#byPosition)).
0 commit comments