Release 0.243¶
Warning
There is a bug in LambdaDefinitionExpression canonicalization introduced since 0.238. For more details, go to #15424.
Warning
There is a bug that results in columns in the USING
clause of a query to not be checked properly for column-level access control (#15333).
Warning
There is a bug that causes a failure in reading ORC files having MAP columns with MAP_FLAT encoding where all the entries in the column are empty maps (#15468).
Warning
There is a bug causing failure at startup if function namespace manager is enabled and Thrift is not configured (#15501).
Highlights¶
Add
approx_most_frequent()
aggregation function.Add support to
truncate()
function for specifying the number of digits to the right of the decimal point in the truncated result.Add support for ignoring access checks on columns that are referenced in the query, but are not required to compute the query results. This can be enabled with the
check_access_control_on_utilized_columns_only
session property.Add support in verifier to verify
CREATE VIEW
andCREATE TABLE
queries.
Details¶
General Changes¶
Fix query failure when using
EXPLAIN
with aUSE
statement.Add
approx_most_frequent()
aggregation function.Add support to
truncate()
function for specifying the number of digits to the right of the decimal point in the truncated result.Remove configuration property
optimizer.optimize-full-outer-join-with-coalesce
and the corresponding session propertyoptimize_full_outer_join_with_coalesce
. The feature will always be enabled.Remove deprecated configuration properties
grouped-execution-for-aggregation-enabled
andgrouped-execution-for-join-enabled
and their corresponding session propertiesgrouped_execution_for_aggregation
andgrouped_execution_for_join
. These have been replaced by a single configuration propertygrouped-execution-enabled
and session propertygrouped_execution
.Remove deprecated configuration property
dynamic-schedule-for-grouped-execution
and session propertydynamic_schedule_for_grouped_execution
.
Security Changes¶
Add support for ignoring access checks on columns that are referenced in the query, but are not required to compute the query results. This can be enabled with the
check_access_control_on_utilized_columns_only
session property.
Geospatial Changes¶
Add support to allow geometries outside of the spatial partitioning to match in a partitioned spatial join.
Hive Changes¶
Improve metadata query optimizer.
Add support for Parquet file metadata caching.
Pinot Changes¶
Add support for pushing down aggregation function
approx_distinct(x, e)
.Add support for pushing down array functions
array_sum
,array_min
,array_max
,array_average
andcontains
.
Verifier Changes¶
Add support for removing explicitly set broadcast memory limits.
Add support to verify
CREATE VIEW
andCREATE TABLE
queries.
Contributors¶
Ajay George, Andrii Rosa, Ariel Weisberg, Ashish Tadose, Bin Fan, Daniel Ohayon, George Wang, James A. Gill, James Sun, Ke, Leiqing Cai, Maria Basmanova, Mayank Garg, Nikhil Collooru, Rebecca Schlussel, Rongrong Zhong, Shixuan Fan, Timothy Meehan, Vivek, Wenlei Xie, Xiang Fu, Ying Su, Zhenxiao Luo, Zhenyuan Zhao, ankit0811, leonpanokarren, prithvip