Modifier and Type | Method and Description |
---|---|
Table |
addColumns(Expression... fields)
Adds additional columns.
|
Table |
addColumns(String fields)
Adds additional columns.
|
Table |
addOrReplaceColumns(Expression... fields)
Adds additional columns.
|
Table |
addOrReplaceColumns(String fields)
Adds additional columns.
|
AggregatedTable |
aggregate(Expression aggregateFunction)
Performs a global aggregate operation with an aggregate function.
|
AggregatedTable |
aggregate(String aggregateFunction)
Performs a global aggregate operation with an aggregate function.
|
Table |
as(Expression... fields)
Renames the fields of the expression result.
|
Table |
as(String field,
String... fields)
Renames the fields of the expression result.
|
static TableImpl |
createTable(TableEnvironmentInternal tableEnvironment,
QueryOperation operationTree,
OperationTreeBuilder operationTreeBuilder,
FunctionLookup functionLookup) |
TemporalTableFunction |
createTemporalTableFunction(Expression timeAttribute,
Expression primaryKey)
Creates
TemporalTableFunction backed up by this table as a history table. |
TemporalTableFunction |
createTemporalTableFunction(String timeAttribute,
String primaryKey)
Creates
TemporalTableFunction backed up by this table as a history table. |
Table |
distinct()
Removes duplicate values and returns only distinct (different) values.
|
Table |
dropColumns(Expression... fields)
Drops existing columns.
|
Table |
dropColumns(String fields)
Drops existing columns.
|
TableResult |
execute()
Collects the contents of the current table local client.
|
TableResult |
executeInsert(String tablePath)
|
TableResult |
executeInsert(String tablePath,
boolean overwrite)
|
String |
explain(ExplainDetail... extraDetails)
Returns the AST of this table and the execution plan to compute the result of this table.
|
Table |
fetch(int fetch)
Limits a (possibly sorted) result to the first n rows.
|
Table |
filter(Expression predicate)
Filters out elements that don't pass the filter predicate.
|
Table |
filter(String predicate)
Filters out elements that don't pass the filter predicate.
|
FlatAggregateTable |
flatAggregate(Expression tableAggregateFunction)
Perform a global flatAggregate without groupBy.
|
FlatAggregateTable |
flatAggregate(String tableAggregateFunction)
Perform a global flatAggregate without groupBy.
|
Table |
flatMap(Expression tableFunction)
Performs a flatMap operation with an user-defined table function or built-in table function.
|
Table |
flatMap(String tableFunction)
Performs a flatMap operation with an user-defined table function or built-in table function.
|
Table |
fullOuterJoin(Table right,
Expression joinPredicate)
Joins two
Table s. |
Table |
fullOuterJoin(Table right,
String joinPredicate)
Joins two
Table s. |
QueryOperation |
getQueryOperation()
Returns underlying logical representation of this table.
|
TableSchema |
getSchema()
Returns the schema of this table.
|
TableEnvironment |
getTableEnvironment() |
GroupedTable |
groupBy(Expression... fields)
Groups the elements on some grouping keys.
|
GroupedTable |
groupBy(String fields)
Groups the elements on some grouping keys.
|
void |
insertInto(String tablePath)
|
Table |
intersect(Table right)
Intersects two
Table s with duplicate records removed. |
Table |
intersectAll(Table right)
Intersects two
Table s. |
Table |
join(Table right)
Joins two
Table s. |
Table |
join(Table right,
Expression joinPredicate)
Joins two
Table s. |
Table |
join(Table right,
String joinPredicate)
Joins two
Table s. |
Table |
joinLateral(Expression tableFunctionCall)
Joins this
Table with an user-defined TableFunction . |
Table |
joinLateral(Expression tableFunctionCall,
Expression joinPredicate)
Joins this
Table with an user-defined TableFunction . |
Table |
joinLateral(String tableFunctionCall)
Joins this
Table with an user-defined TableFunction . |
Table |
joinLateral(String tableFunctionCall,
String joinPredicate)
Joins this
Table with an user-defined TableFunction . |
Table |
leftOuterJoin(Table right)
Joins two
Table s. |
Table |
leftOuterJoin(Table right,
Expression joinPredicate)
Joins two
Table s. |
Table |
leftOuterJoin(Table right,
String joinPredicate)
Joins two
Table s. |
Table |
leftOuterJoinLateral(Expression tableFunctionCall)
Joins this
Table with an user-defined TableFunction . |
Table |
leftOuterJoinLateral(Expression tableFunctionCall,
Expression joinPredicate)
Joins this
Table with an user-defined TableFunction . |
Table |
leftOuterJoinLateral(String tableFunctionCall)
Joins this
Table with an user-defined TableFunction . |
Table |
leftOuterJoinLateral(String tableFunctionCall,
String joinPredicate)
Joins this
Table with an user-defined TableFunction . |
Table |
map(Expression mapFunction)
Performs a map operation with an user-defined scalar function or built-in scalar function.
|
Table |
map(String mapFunction)
Performs a map operation with an user-defined scalar function or a built-in scalar function.
|
Table |
minus(Table right)
Minus of two
Table s with duplicate records removed. |
Table |
minusAll(Table right)
Minus of two
Table s. |
Table |
offset(int offset)
Limits a (possibly sorted) result from an offset position.
|
Table |
orderBy(Expression... fields)
Sorts the given
Table . |
Table |
orderBy(String fields)
Sorts the given
Table . |
void |
printSchema()
Prints the schema of this table to the console in a tree format.
|
Table |
renameColumns(Expression... fields)
Renames existing columns.
|
Table |
renameColumns(String fields)
Renames existing columns.
|
Table |
rightOuterJoin(Table right,
Expression joinPredicate)
Joins two
Table s. |
Table |
rightOuterJoin(Table right,
String joinPredicate)
Joins two
Table s. |
Table |
select(Expression... fields)
Performs a selection operation.
|
Table |
select(String fields)
Performs a selection operation.
|
String |
toString() |
Table |
union(Table right)
Unions two
Table s with duplicate records removed. |
Table |
unionAll(Table right)
Unions two
Table s. |
Table |
where(Expression predicate)
Filters out elements that don't pass the filter predicate.
|
Table |
where(String predicate)
Filters out elements that don't pass the filter predicate.
|
GroupWindowedTable |
window(GroupWindow groupWindow)
Groups the records of a table by assigning them to windows defined by a time or row interval.
|
OverWindowedTable |
window(OverWindow... overWindows)
Defines over-windows on the records of a table.
|
public TableEnvironment getTableEnvironment()
public static TableImpl createTable(TableEnvironmentInternal tableEnvironment, QueryOperation operationTree, OperationTreeBuilder operationTreeBuilder, FunctionLookup functionLookup)
public TableSchema getSchema()
Table
public void printSchema()
Table
printSchema
in interface Table
public QueryOperation getQueryOperation()
Table
getQueryOperation
in interface Table
public Table select(String fields)
Table
Example:
tab.select("key, value.avg + ' The average' as average")
public Table select(Expression... fields)
Table
Scala Example:
tab.select($("key"), $("value").avg().plus(" The average").as("average"));
Scala Example:
tab.select($"key", $"value".avg + " The average" as "average")
public TemporalTableFunction createTemporalTableFunction(String timeAttribute, String primaryKey)
Table
TemporalTableFunction
backed up by this table as a history table. Temporal
Tables represent a concept of a table that changes over time and for which Flink keeps track
of those changes. TemporalTableFunction
provides a way how to access those data.
For more information please check Flink's documentation on Temporal Tables.
Currently TemporalTableFunction
s are only supported in streaming.
createTemporalTableFunction
in interface Table
timeAttribute
- Must points to a time attribute. Provides a way to compare which records
are a newer or older version.primaryKey
- Defines the primary key. With primary key it is possible to update a row or
to delete it.TemporalTableFunction
which is an instance of TableFunction
. It takes
one single argument, the timeAttribute
, for which it returns matching version of
the Table
, from which TemporalTableFunction
was created.public TemporalTableFunction createTemporalTableFunction(Expression timeAttribute, Expression primaryKey)
Table
TemporalTableFunction
backed up by this table as a history table. Temporal
Tables represent a concept of a table that changes over time and for which Flink keeps track
of those changes. TemporalTableFunction
provides a way how to access those data.
For more information please check Flink's documentation on Temporal Tables.
Currently TemporalTableFunction
s are only supported in streaming.
createTemporalTableFunction
in interface Table
timeAttribute
- Must points to a time indicator. Provides a way to compare which records
are a newer or older version.primaryKey
- Defines the primary key. With primary key it is possible to update a row or
to delete it.TemporalTableFunction
which is an instance of TableFunction
. It takes
one single argument, the timeAttribute
, for which it returns matching version of
the Table
, from which TemporalTableFunction
was created.public Table as(String field, String... fields)
Table
Example:
tab.as("a", "b")
public Table as(Expression... fields)
Table
Example:
tab.as($("a"), $("b"))
Scala Example:
tab.as($"a", $"b")
public Table filter(String predicate)
Table
Example:
tab.filter("name = 'Fred'")
public Table filter(Expression predicate)
Table
Example:
tab.filter($("name").isEqual("Fred"));
Scala Example:
tab.filter($"name" === "Fred")
public Table where(String predicate)
Table
Example:
tab.where("name = 'Fred'")
public Table where(Expression predicate)
Table
Example:
tab.where($("name").isEqual("Fred"));
Scala Example:
tab.where($"name" === "Fred")
public GroupedTable groupBy(String fields)
Table
Example:
tab.groupBy("key").select("key, value.avg")
public GroupedTable groupBy(Expression... fields)
Table
Scala Example:
tab.groupBy($("key")).select($("key"), $("value").avg());
Scala Example:
tab.groupBy($"key").select($"key", $"value".avg)
public Table distinct()
Table
Example:
tab.select($("key"), $("value")).distinct();
public Table join(Table right)
Table
Table
s. Similar to a SQL join. The fields of the two joined operations must
not overlap, use as
to rename fields if necessary. You can use where and select
clauses after a join to further specify the behaviour of the join.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.join(right)
.where($("a").isEqual($("b")).and($("c").isGreater(3))
.select($("a"), $("b"), $("d"));
public Table join(Table right, String joinPredicate)
Table
Table
s. Similar to a SQL join. The fields of the two joined operations must
not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.join(right, "a = b")
public Table join(Table right, Expression joinPredicate)
Table
Table
s. Similar to a SQL join. The fields of the two joined operations must
not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.join(right, $("a").isEqual($("b")))
.select($("a"), $("b"), $("d"));
Scala Example:
left.join(right, $"a" === $"b")
.select($"a", $"b", $"d")
public Table leftOuterJoin(Table right)
Table
Table
s. Similar to a SQL left outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.leftOuterJoin(right)
.select($("a"), $("b"), $("d"));
leftOuterJoin
in interface Table
public Table leftOuterJoin(Table right, String joinPredicate)
Table
Table
s. Similar to a SQL left outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.leftOuterJoin(right, "a = b").select("a, b, d")
leftOuterJoin
in interface Table
public Table leftOuterJoin(Table right, Expression joinPredicate)
Table
Table
s. Similar to a SQL left outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.leftOuterJoin(right, $("a").isEqual($("b")))
.select($("a"), $("b"), $("d"));
Scala Example:
left.leftOuterJoin(right, $"a" === $"b")
.select($"a", $"b", $"d")
leftOuterJoin
in interface Table
public Table rightOuterJoin(Table right, String joinPredicate)
Table
Table
s. Similar to a SQL right outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.rightOuterJoin(right, "a = b").select("a, b, d")
rightOuterJoin
in interface Table
public Table rightOuterJoin(Table right, Expression joinPredicate)
Table
Table
s. Similar to a SQL right outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.rightOuterJoin(right, $("a").isEqual($("b")))
.select($("a"), $("b"), $("d"));
Scala Example:
left.rightOuterJoin(right, $"a" === $"b")
.select($"a", $"b", $"d")
rightOuterJoin
in interface Table
public Table fullOuterJoin(Table right, String joinPredicate)
Table
Table
s. Similar to a SQL full outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.fullOuterJoin(right, "a = b").select("a, b, d")
fullOuterJoin
in interface Table
public Table fullOuterJoin(Table right, Expression joinPredicate)
Table
Table
s. Similar to a SQL full outer join. The fields of the two joined
operations must not overlap, use as
to rename fields if necessary.
Note: Both tables must be bound to the same TableEnvironment
and its TableConfig
must have null check enabled (default).
Example:
left.fullOuterJoin(right, $("a").isEqual($("b")))
.select($("a"), $("b"), $("d"));
Scala Example:
left.fullOuterJoin(right, $"a" === $"b")
.select($"a", $"b", $"d")
fullOuterJoin
in interface Table
public Table joinLateral(String tableFunctionCall)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL inner join with ON TRUE predicate but works with a table function. Each row of the
table is joined with all rows produced by the table function.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
TableFunction<String> split = new MySplitUDTF();
tableEnv.registerFunction("split", split);
table.joinLateral("split(c) as (s)").select("a, b, c, s");
joinLateral
in interface Table
public Table joinLateral(Expression tableFunctionCall)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL inner join with ON TRUE predicate but works with a table function. Each row of the
table is joined with all rows produced by the table function.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
table.joinLateral(call(MySplitUDTF.class, $("c")).as("s"))
.select($("a"), $("b"), $("c"), $("s"));
Scala Example:
class MySplitUDTF extends TableFunction[String] {
def eval(str: String): Unit = {
str.split("#").foreach(collect)
}
}
val split = new MySplitUDTF()
table.joinLateral(split($"c") as "s")
.select($"a", $"b", $"c", $"s")
joinLateral
in interface Table
public Table joinLateral(String tableFunctionCall, String joinPredicate)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL inner join but works with a table function. Each row of the table is joined with all
rows produced by the table function.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
TableFunction<String> split = new MySplitUDTF();
tableEnv.registerFunction("split", split);
table.joinLateral("split(c) as (s)", "a = s").select("a, b, c, s");
joinLateral
in interface Table
public Table joinLateral(Expression tableFunctionCall, Expression joinPredicate)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL inner join but works with a table function. Each row of the table is joined with all
rows produced by the table function.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
table.joinLateral(call(MySplitUDTF.class, $("c")).as("s"), $("a").isEqual($("s")))
.select($("a"), $("b"), $("c"), $("s"));
Scala Example:
class MySplitUDTF extends TableFunction[String] {
def eval(str: String): Unit = {
str.split("#").foreach(collect)
}
}
val split = new MySplitUDTF()
table.joinLateral(split($"c") as "s", $"a" === $"s")
.select($"a", $"b", $"c", $"s")
joinLateral
in interface Table
public Table leftOuterJoinLateral(String tableFunctionCall)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL left outer join with ON TRUE predicate but works with a table function. Each row of the
table is joined with all rows produced by the table function. If the table function does not
produce any row, the outer row is padded with nulls.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
TableFunction<String> split = new MySplitUDTF();
tableEnv.registerFunction("split", split);
table.leftOuterJoinLateral("split(c) as (s)").select("a, b, c, s");
leftOuterJoinLateral
in interface Table
public Table leftOuterJoinLateral(Expression tableFunctionCall)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL left outer join with ON TRUE predicate but works with a table function. Each row of the
table is joined with all rows produced by the table function. If the table function does not
produce any row, the outer row is padded with nulls.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
table.leftOuterJoinLateral(call(MySplitUDTF.class, $("c")).as("s"))
.select($("a"), $("b"), $("c"), $("s"));
Scala Example:
class MySplitUDTF extends TableFunction[String] {
def eval(str: String): Unit = {
str.split("#").foreach(collect)
}
}
val split = new MySplitUDTF()
table.leftOuterJoinLateral(split($"c") as "s")
.select($"a", $"b", $"c", $"s")
leftOuterJoinLateral
in interface Table
public Table leftOuterJoinLateral(String tableFunctionCall, String joinPredicate)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL left outer join with ON TRUE predicate but works with a table function. Each row of the
table is joined with all rows produced by the table function. If the table function does not
produce any row, the outer row is padded with nulls.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
TableFunction<String> split = new MySplitUDTF();
tableEnv.registerFunction("split", split);
table.leftOuterJoinLateral("split(c) as (s)", "a = s").select("a, b, c, s");
leftOuterJoinLateral
in interface Table
public Table leftOuterJoinLateral(Expression tableFunctionCall, Expression joinPredicate)
Table
Table
with an user-defined TableFunction
. This join is similar to
a SQL left outer join with ON TRUE predicate but works with a table function. Each row of the
table is joined with all rows produced by the table function. If the table function does not
produce any row, the outer row is padded with nulls.
Example:
class MySplitUDTF extends TableFunction<String> {
public void eval(String str) {
str.split("#").forEach(this::collect);
}
}
table.leftOuterJoinLateral(call(MySplitUDTF.class, $("c")).as("s"), $("a").isEqual($("s")))
.select($("a"), $("b"), $("c"), $("s"));
Scala Example:
class MySplitUDTF extends TableFunction[String] {
def eval(str: String): Unit = {
str.split("#").foreach(collect)
}
}
val split = new MySplitUDTF()
table.leftOuterJoinLateral(split($"c") as "s", $"a" === $"s")
.select($"a", $"b", $"c", $"s")
leftOuterJoinLateral
in interface Table
public Table minus(Table right)
Table
Table
s with duplicate records removed. Similar to a SQL EXCEPT clause.
Minus returns records from the left table that do not exist in the right table. Duplicate
records in the left table are returned exactly once, i.e., duplicates are removed. Both
tables must have identical field types.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.minus(right);
public Table minusAll(Table right)
Table
Table
s. Similar to a SQL EXCEPT ALL. Similar to a SQL EXCEPT ALL clause.
MinusAll returns the records that do not exist in the right table. A record that is present n
times in the left table and m times in the right table is returned (n - m) times, i.e., as
many duplicates as are present in the right table are removed. Both tables must have
identical field types.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.minusAll(right);
public Table union(Table right)
Table
Table
s with duplicate records removed. Similar to a SQL UNION. The fields
of the two union operations must fully overlap.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.union(right);
public Table unionAll(Table right)
Table
Table
s. Similar to a SQL UNION ALL. The fields of the two union operations
must fully overlap.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.unionAll(right);
public Table intersect(Table right)
Table
Table
s with duplicate records removed. Intersect returns records that
exist in both tables. If a record is present in one or both tables more than once, it is
returned just once, i.e., the resulting table has no duplicate records. Similar to a SQL
INTERSECT. The fields of the two intersect operations must fully overlap.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.intersect(right);
public Table intersectAll(Table right)
Table
Table
s. IntersectAll returns records that exist in both tables. If a
record is present in both tables more than once, it is returned as many times as it is
present in both tables, i.e., the resulting table might have duplicate records. Similar to an
SQL INTERSECT ALL. The fields of the two intersect operations must fully overlap.
Note: Both tables must be bound to the same TableEnvironment
.
Example:
left.intersectAll(right);
intersectAll
in interface Table
public Table orderBy(String fields)
Table
Table
. Similar to SQL ORDER BY. The resulting Table is sorted
globally sorted across all parallel partitions.
Example:
tab.orderBy("name.desc")
public Table orderBy(Expression... fields)
Table
Table
. Similar to SQL ORDER BY
.
The resulting Table is globally sorted across all parallel partitions.
Java Example:
tab.orderBy($("name").desc());
Scala Example:
tab.orderBy($"name".desc)
For unbounded tables, this operation requires a sorting on a time attribute or a subsequent fetch operation.
public Table offset(int offset)
Table
This method can be combined with a preceding Table.orderBy(Expression...)
call for a
deterministic order and a subsequent Table.fetch(int)
call to return n rows after skipping
the first o rows.
// skips the first 3 rows and returns all following rows.
tab.orderBy($("name").desc()).offset(3);
// skips the first 10 rows and returns the next 5 rows.
tab.orderBy($("name").desc()).offset(10).fetch(5);
For unbounded tables, this operation requires a subsequent fetch operation.
public Table fetch(int fetch)
Table
This method can be combined with a preceding Table.orderBy(Expression...)
call for a
deterministic order and Table.offset(int)
call to return n rows after skipping the first o
rows.
// returns the first 3 records.
tab.orderBy($("name").desc()).fetch(3);
// skips the first 10 rows and returns the next 5 rows.
tab.orderBy($("name").desc()).offset(10).fetch(5);
public void insertInto(String tablePath)
Table
Table
to a TableSink
that was registered under the specified path.
For the path resolution algorithm see TableEnvironment.useDatabase(String)
.
A batch Table
can only be written to a org.apache.flink.table.sinks.BatchTableSink
, a streaming Table
requires a org.apache.flink.table.sinks.AppendStreamTableSink
, a org.apache.flink.table.sinks.RetractStreamTableSink
, or an org.apache.flink.table.sinks.UpsertStreamTableSink
.
insertInto
in interface Table
tablePath
- The path of the registered TableSink
to which the Table
is
written.public GroupWindowedTable window(GroupWindow groupWindow)
Table
For streaming tables of infinite size, grouping into windows is required to define finite groups on which group-based aggregates can be computed.
For batch tables of finite size, windowing essentially provides shortcuts for time-based groupBy.
Note: Computing windowed aggregates on a streaming table is only a parallel
operation if additional grouping attributes are added to the groupBy(...)
clause. If
the groupBy(...)
only references a GroupWindow alias, the streamed table will be
processed by a single task, i.e., with parallelism 1.
public OverWindowedTable window(OverWindow... overWindows)
Table
An over-window defines for each record an interval of records over which aggregation functions can be computed.
Example:
table
.window(Over.partitionBy($("c")).orderBy($("rowTime")).preceding(lit(10).seconds()).as("ow")
.select($("c"), $("b").count().over($("ow")), $("e").sum().over($("ow")));
Scala Example:
table
.window(Over partitionBy $"c" orderBy $"rowTime" preceding 10.seconds as "ow")
.select($"c", $"b".count over $"ow", $"e".sum over $"ow")
Note: Computing over window aggregates on a streaming table is only a parallel operation if the window is partitioned. Otherwise, the whole stream will be processed by a single task, i.e., with parallelism 1.
Note: Over-windows for batch tables are currently not supported.
public Table addColumns(String fields)
Table
Example:
tab.addColumns("a + 1 as a1, concat(b, 'sunny') as b1")
addColumns
in interface Table
public Table addColumns(Expression... fields)
Table
Example:
tab.addColumns(
$("a").plus(1).as("a1"),
concat($("b"), "sunny").as("b1")
);
Scala Example:
tab.addColumns(
$"a" + 1 as "a1",
concat($"b", "sunny") as "b1"
)
addColumns
in interface Table
public Table addOrReplaceColumns(String fields)
Table
Example:
tab.addOrReplaceColumns("a + 1 as a1, concat(b, 'sunny') as b1")
addOrReplaceColumns
in interface Table
public Table addOrReplaceColumns(Expression... fields)
Table
Example:
tab.addOrReplaceColumns(
$("a").plus(1).as("a1"),
concat($("b"), "sunny").as("b1")
);
Scala Example:
tab.addOrReplaceColumns(
$"a" + 1 as "a1",
concat($"b", "sunny") as "b1"
)
addOrReplaceColumns
in interface Table
public Table renameColumns(String fields)
Table
Example:
tab.renameColumns("a as a1, b as b1")
renameColumns
in interface Table
public Table renameColumns(Expression... fields)
Table
Example:
tab.renameColumns(
$("a").as("a1"),
$("b").as("b1")
);
Scala Example:
tab.renameColumns(
$"a" as "a1",
$"b" as "b1"
)
renameColumns
in interface Table
public Table dropColumns(String fields)
Table
Example:
tab.dropColumns("a, b")
dropColumns
in interface Table
public Table dropColumns(Expression... fields)
Table
Example:
tab.dropColumns($("a"), $("b"));
Scala Example:
tab.dropColumns($"a", $"b")
dropColumns
in interface Table
public Table map(String mapFunction)
Table
Example:
ScalarFunction func = new MyMapFunction();
tableEnv.registerFunction("func", func);
tab.map("func(c)");
public Table map(Expression mapFunction)
Table
Example:
tab.map(call(MyMapFunction.class, $("c")))
Scala Example:
val func = new MyMapFunction()
tab.map(func($"c"))
public Table flatMap(String tableFunction)
Table
Example:
TableFunction func = new MyFlatMapFunction();
tableEnv.registerFunction("func", func);
table.flatMap("func(c)");
public Table flatMap(Expression tableFunction)
Table
Example:
tab.flatMap(call(MyFlatMapFunction.class, $("c")))
Scala Example:
val func = new MyFlatMapFunction()
tab.flatMap(func($"c"))
public AggregatedTable aggregate(String aggregateFunction)
Table
Table.aggregate(String)
with a select statement. The output will be flattened if the
output type is a composite type.
Example:
AggregateFunction aggFunc = new MyAggregateFunction()
tableEnv.registerFunction("aggFunc", aggFunc);
table.aggregate("aggFunc(a, b) as (f0, f1, f2)")
.select("f0, f1")
public AggregatedTable aggregate(Expression aggregateFunction)
Table
Table.aggregate(Expression)
with a select statement. The output will be flattened if the
output type is a composite type.
Example:
tab.aggregate(call(MyAggregateFunction.class, $("a"), $("b")).as("f0", "f1", "f2"))
.select($("f0"), $("f1"));
Scala Example:
val aggFunc = new MyAggregateFunction
table.aggregate(aggFunc($"a", $"b") as ("f0", "f1", "f2"))
.select($"f0", $"f1")
public FlatAggregateTable flatAggregate(String tableAggregateFunction)
Table
Example:
TableAggregateFunction tableAggFunc = new MyTableAggregateFunction();
tableEnv.registerFunction("tableAggFunc", tableAggFunc);
tab.flatAggregate("tableAggFunc(a, b) as (x, y, z)")
.select("x, y, z")
flatAggregate
in interface Table
public FlatAggregateTable flatAggregate(Expression tableAggregateFunction)
Table
Example:
tab.flatAggregate(call(MyTableAggregateFunction.class, $("a"), $("b")).as("x", "y", "z"))
.select($("x"), $("y"), $("z"));
Scala Example:
val tableAggFunc: TableAggregateFunction = new MyTableAggregateFunction
tab.flatAggregate(tableAggFunc($"a", $"b") as ("x", "y", "z"))
.select($"x", $"y", $"z")
flatAggregate
in interface Table
public TableResult executeInsert(String tablePath)
Table
Table
to a TableSink
that was registered under the specified path,
and then execute the insert operation.
See the documentation of TableEnvironment.useDatabase(String)
or TableEnvironment.useCatalog(String)
for the rules on the path resolution.
A batch Table
can only be written to a org.apache.flink.table.sinks.BatchTableSink
, a streaming Table
requires a org.apache.flink.table.sinks.AppendStreamTableSink
, a org.apache.flink.table.sinks.RetractStreamTableSink
, or an org.apache.flink.table.sinks.UpsertStreamTableSink
.
Example:
Table table = tableEnv.fromQuery("select * from MyTable");
TableResult tableResult = table.executeInsert("MySink");
tableResult...
executeInsert
in interface Table
tablePath
- The path of the registered TableSink to which the Table is written.public TableResult executeInsert(String tablePath, boolean overwrite)
Table
Table
to a TableSink
that was registered under the specified path,
and then execute the insert operation.
See the documentation of TableEnvironment.useDatabase(String)
or TableEnvironment.useCatalog(String)
for the rules on the path resolution.
A batch Table
can only be written to a org.apache.flink.table.sinks.BatchTableSink
, a streaming Table
requires a org.apache.flink.table.sinks.AppendStreamTableSink
, a org.apache.flink.table.sinks.RetractStreamTableSink
, or an org.apache.flink.table.sinks.UpsertStreamTableSink
.
Example:
Table table = tableEnv.fromQuery("select * from MyTable");
TableResult tableResult = table.executeInsert("MySink", true);
tableResult...
executeInsert
in interface Table
tablePath
- The path of the registered TableSink to which the Table is written.overwrite
- The flag that indicates whether the insert should overwrite existing data or
not.public TableResult execute()
Table
Table table = tableEnv.fromQuery("select * from MyTable");
TableResult tableResult = table.execute();
tableResult...
public String explain(ExplainDetail... extraDetails)
Table
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.