Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
290 commits
Select commit Hold shift + click to select a range
5464bfc
Throw OpensearchSecurityException incase of datasource authorization …
vamsimanohar Apr 22, 2024
2c97be7
Bump bwc version (#2616)
vamsimanohar Apr 22, 2024
e578a57
Use EMR serverless bundled iceberg JAR. (#2632)
asuresh8 Apr 24, 2024
ea08c8f
Add option to use LakeFormation in S3Glue data source. (#2624)
asuresh8 Apr 29, 2024
de7b367
Delete Spark datasource (#2638)
ykmr1224 Apr 30, 2024
d32cf94
Refactor SparkQueryDispatcher (#2636)
ykmr1224 Apr 30, 2024
0f4e1c0
Fix test failure in SparkQueryDispatcherTest due to merge (#2645)
ykmr1224 May 1, 2024
b454a2c
release notes for 2.14.0.0 (#2647)
vamsimanohar May 2, 2024
45122ec
Refactor IndexDMLHandler and related classes (#2644)
ykmr1224 May 6, 2024
cfd222c
Update maintainers list (#2663)
seankao31 May 9, 2024
df1c04a
Introduce FlintIndexStateModelService (#2658)
ykmr1224 May 9, 2024
05a2f66
Add comments to async query handlers (#2657)
ykmr1224 May 10, 2024
58c55e7
Updating security reachout email (#2671)
varun-lodaya May 14, 2024
8f06b6f
Bump bwc version to 2.15 (#2662)
derek-ho May 14, 2024
1985459
Extract SessionStorageService and StatementStorageService (#2665)
ykmr1224 May 15, 2024
afec315
Make models free of XContent
ykmr1224 Apr 16, 2024
2c849f7
Add comments
ykmr1224 May 17, 2024
a64fcb1
Remove unneeded datasourceName parameters (#2683)
ykmr1224 May 20, 2024
3a28d2a
Refactor data models to be generic to data storage (#2687)
ykmr1224 May 22, 2024
5a2c199
Provide a way to modify spark parameters (#2691)
ykmr1224 May 24, 2024
3dd1729
Change JobExecutionResponseReader to an interface (#2693)
ykmr1224 May 29, 2024
03a5e4d
Abstract queryId generation (#2695)
ykmr1224 Jun 4, 2024
65e88c2
Introduce SessionConfigSupplier to abstract settings (#2707)
ykmr1224 Jun 4, 2024
c90cf00
Upgrade python 3.8 (#2711)
penghuo Jun 5, 2024
ffc48fa
Add accountId to data models (#2709)
ykmr1224 Jun 5, 2024
60c4d50
Revert "Delete Spark datasource (#2638)" (#2692)
ykmr1224 Jun 6, 2024
3f1e3bd
penghuo@gmail.com
fddattal Jun 6, 2024
d767868
Support Percentile in PPL
LantaoJin Jun 6, 2024
c0a5123
Pass down request context to data accessors (#2715)
ykmr1224 Jun 7, 2024
3ab7851
Add timeout StatementState (#2724)
ykmr1224 Jun 7, 2024
2aab43d
Add v2.15.0 release notes (#2732)
rupal-bq Jun 11, 2024
cd95130
Abstract sessionId generation (#2726)
ykmr1224 Jun 11, 2024
46015d4
Scaffold async-query-core and async-query module (#2733)
ykmr1224 Jun 11, 2024
b959039
Handle create index with batch FlintJob (#2734)
seankao31 Jun 11, 2024
1d703e8
Change DataSourceType from enum to class (#2730)
ykmr1224 Jun 12, 2024
00d5c4e
Fix code style issue (#2745)
ykmr1224 Jun 12, 2024
d5c2fed
Move classes from spark to async-query-core and async-query
ykmr1224 Jun 11, 2024
61091c1
Fix build.gradle
ykmr1224 Jun 12, 2024
ebb07ef
Adjust build.gradle
ykmr1224 Jun 12, 2024
084a3c8
Fix copyrights
ykmr1224 Jun 12, 2024
7b40c2c
Separate build and validateAndBuild method in DataSourceMetadata (#2744)
ykmr1224 Jun 13, 2024
07e52d9
Exclude integ-test, doctest and download task when built offline (#2760)
ykmr1224 Jun 19, 2024
ef2cef3
Abstract metrics to reduce dependency to legacy (#2747)
ykmr1224 Jun 21, 2024
9ad4e02
Remove AsyncQueryId (#2754)
ykmr1224 Jun 21, 2024
fbff4a3
Add README to async-query-core (#2766)
ykmr1224 Jun 21, 2024
b2403ca
Abstract FlintIndex client (#2755)
ykmr1224 Jun 24, 2024
b9f544b
Fix statement to store requested langType (#2777)
ykmr1224 Jun 26, 2024
8eae36f
Push down OpenSearch specific exception handling (#2778)
ykmr1224 Jun 27, 2024
49e2e0e
Implement integration test for async-query-core (#2773)
ykmr1224 Jun 27, 2024
883cc7e
Fix SQLQueryUtils to extract multiple tables (#2784)
ykmr1224 Jun 28, 2024
00f82f5
Eliminate dependency from async-query-core to legacy (#2786)
ykmr1224 Jun 28, 2024
e24b51f
Pass accountId to EMRServerlessClientFactory.getClient (#2783)
ykmr1224 Jun 28, 2024
4326396
Fix build failure (#2794)
ykmr1224 Jun 29, 2024
81ae699
Set baseline JDK version to JDK-21 (#2787)
manasvinibs Jul 2, 2024
f241f34
Fix checkout action failure (#2807)
rupal-bq Jul 8, 2024
c063d5e
Span in PPL statsByClause could be specified after fields (#2720)
LantaoJin Jul 9, 2024
aec4825
Well format the raw response when query parameter "pretty" enabled (#…
LantaoJin Jul 9, 2024
d639796
Added Setting to Toggle Data Source Management Code Paths (#2723)
fddattal Jul 9, 2024
8243414
Temp use of older nodejs version before moving to Almalinux8 (#2815)
peterzhuamazon Jul 10, 2024
d3ecb2d
Register system index descriptors through SystemIndexPlugin.getSystem…
cwperks Jul 10, 2024
a151a7d
Introduce SparkParameterComposerCollection (#2774)
ykmr1224 Jul 12, 2024
eb5c824
Fix yaml errors causing checks not to be run (#2820)
derek-ho Jul 12, 2024
dea459e
Welcome new maintainer LantaoJin (#2818)
penghuo Jul 15, 2024
0c2e1da
SQL pagination should work with the `pretty` parameter (#2759)
LantaoJin Jul 15, 2024
2c29a1a
Add MacOS workflow back and fix the artifact not found issue (#2831)
LantaoJin Jul 17, 2024
a6394cd
Update to Gradle 8.9 (#2835)
LantaoJin Jul 17, 2024
607354c
Fix SparkSubmitParameterModifier issue (#2837)
ykmr1224 Jul 17, 2024
956ec15
Boolean function in PPL should be case insensitive (#2758)
LantaoJin Jul 18, 2024
0fad56d
Add support for custom date format and openSearch date format for dat…
manasvinibs Jul 19, 2024
db2bd66
Restrict UDF functions (#2790)
vamsimanohar Jul 19, 2024
2117650
Fix SparkExecutionEngineConfigClusterSetting deserialize issue (#2838)
ykmr1224 Jul 23, 2024
593ffab
IF function should support complex predicates in PPL (#2756)
LantaoJin Jul 24, 2024
a5ede64
Add release notes for v2.16.0 (#2854)
dai-chen Jul 25, 2024
41100be
Fix Integ test for datasource enabled setting with security plugin (#…
vamsimanohar Jul 29, 2024
6b8ee3d
Update PULL_REQUEST_TEMPLATE to include an API spec change in the che…
dblock Jul 29, 2024
ba82e12
Add RequestContext parameter to verifyDataSourceAccessAndGetRawMetada…
ykmr1224 Jul 30, 2024
103c416
Fixed 2.16 integ test failures (#2871)
vamsimanohar Jul 30, 2024
aa7a690
Change the default value of plugins.query.size_limit to MAX_RESULT_WI…
LantaoJin Jul 31, 2024
53bfeba
Add AsyncQueryRequestContext to QueryIdProvider parameter (#2870)
ykmr1224 Jul 31, 2024
1b17520
Fixed integ test delete myindex issue and wipe All indices with secur…
vamsimanohar Jul 31, 2024
3daf64f
[Feature] Flint query scheduler part1 - integrate job scheduler plugi…
noCharger Jul 31, 2024
82ef68e
Support common format geo point (#2801)
bugmakerrrrrr Aug 1, 2024
14a80a9
Add AsyncQueryRequestContext to FlintIndexMetadataService/FlintIndexS…
ykmr1224 Aug 1, 2024
0e70a50
add TakeOrderedOperator (#2863)
qianheng-aws Aug 5, 2024
7e73f12
Test utils update to fix IT tests for serverless (#2869)
manasvinibs Aug 5, 2024
7022a09
Correct regular expression range (#2836)
LantaoJin Aug 7, 2024
4a735ea
Push down limit through eval (#2876)
qianheng-aws Aug 9, 2024
6972487
[Tests] IT tests and test utils update to fix failing tests for serve…
manasvinibs Aug 13, 2024
05c961e
Add flags for Iceberg and Lake Formation and Security Lake as a data …
asuresh8 Aug 13, 2024
7815c96
Merge feature/pit branch to main (#2936)
manasvinibs Aug 15, 2024
69853fe
Add pit for pagination query (#2940)
manasvinibs Aug 23, 2024
83bc3d2
Add mvQuery attribute in IndexQueryDetails (#2946)
ykmr1224 Aug 29, 2024
e1ee3b1
Add AsyncQueryRequestContext to update/get in StatementStorageService…
ykmr1224 Aug 29, 2024
d260e0e
Extract validation logic from FlintIndexMetadataServiceImpl (#2944)
ykmr1224 Aug 30, 2024
c13f770
Fix jobType for Batch and IndexDML query (#2955)
ykmr1224 Sep 4, 2024
a83ab20
Add queryId Spark parameter to batch query (#2952)
ykmr1224 Sep 4, 2024
b4a6c60
Fix SparkExecutionEngineConfigClusterSetting deserialize issue (#2966)
ykmr1224 Sep 4, 2024
729bb13
Flint query scheduler part 2 (#2961)
noCharger Sep 4, 2024
6c5c685
Adds validation to allow only flint queries and sql SELECT queries to…
eirsep Sep 4, 2024
b14a8cb
Fix handler for existing query (#2968)
ykmr1224 Sep 4, 2024
da622eb
Add feature flag for async query scheduler (#2973)
noCharger Sep 5, 2024
06c56e7
Fix type mismatch (#2990)
noCharger Sep 5, 2024
83e89fb
Delegate Flint index vacuum operation to Spark (#2985)
dai-chen Sep 6, 2024
cb2c452
Add release notes for v2.17.0 (#2992)
seankao31 Sep 6, 2024
b76aa65
Populate indexName for BatchQuery (#2956)
ykmr1224 Sep 6, 2024
1b1a1b5
Add query, langType, status, error in AsyncQueryJobMetadata (#2958)
ykmr1224 Sep 9, 2024
2c878fb
Throw exception for RECOVER INDEX JOB query (#2988)
ykmr1224 Sep 9, 2024
c22929b
Throw IllegalArgumentException when cancelJob failed with ValidationE…
ykmr1224 Sep 9, 2024
4303a2a
Bump BWC version to 2.17 (#3007)
penghuo Sep 10, 2024
2506468
Upgrade org.bouncycastle:bcprov-jdk18on to 1.78.1 (#3004)
penghuo Sep 13, 2024
37188bd
Extend scheduler interface for Multitenancy (#3014)
noCharger Sep 16, 2024
a87893a
Implement SQL validation based on grammar element (#3039)
ykmr1224 Sep 23, 2024
ce17d0a
Add missing refactoring of Scroll to PIT API calls for Joins and Pagi…
manasvinibs Sep 23, 2024
ec5c3b7
Fix minor issues with SQL pIT refactor (#3045)
manasvinibs Sep 26, 2024
ef5d14a
Add new maintiner @noCharger (#3046)
vamsimanohar Sep 26, 2024
c1e623d
Add job scheduler plugin to test cluster (#2957)
noCharger Sep 27, 2024
d7710d0
Refer Antlr file using specific branch (#2893)
ykmr1224 Oct 4, 2024
564ab60
Resolve Alias Issues in Legacy SQL with Filters (#2960)
aparajita31pandey Oct 8, 2024
ac8678c
Disable join types in validators (#3056)
ykmr1224 Oct 8, 2024
063015c
CVE-2024-6345 fix (#2931)
qianheng-aws Oct 10, 2024
7477fd8
Improve error handling for malformed query cursors (#3066)
Swiddis Oct 10, 2024
cf1564b
Update doctest code for more consistent runs (#3053)
Swiddis Oct 11, 2024
4c44f56
Unify internal OpenSearch exceptions with returned status code (#3068)
Swiddis Oct 12, 2024
e838e46
Fix record skipping when querying paginated data across shards (#3061)
Swiddis Oct 13, 2024
7666a44
Updating JobExecutionResponseReader interface to add RequestContext (…
amityadav005 Oct 16, 2024
a87061d
Optimize scheduler interval conf (#3049)
noCharger Oct 18, 2024
0e3e57c
Fix grammar in log warnings. (#2928)
dblock Oct 21, 2024
f4def31
Refactor test workflow to separate bwc tests (#3070)
Swiddis Oct 21, 2024
0710134
bump commons-io to 2.14.0 (#3083)
seankao31 Oct 21, 2024
366d165
Remove scheduler index from SystemIndexDescriptor (#3092)
noCharger Oct 23, 2024
5852ce3
Improve error handling for some more edge cases (#3080)
Swiddis Oct 23, 2024
e109417
Array values are preserved (#1300) (#3095)
normanj-bitquill Oct 24, 2024
f00244e
Add release notes for v2.18.0 (#3125)
dai-chen Oct 25, 2024
3b86612
Add validation method for Flint extension queries and wire it into th…
engechas Oct 28, 2024
5716cab
Call updateState when query is cancelled (#3139)
ykmr1224 Oct 30, 2024
9bb4c08
Added documentation for the plugins.query.field_type_tolerance settin…
normanj-bitquill Oct 31, 2024
4ff1fe3
Fix a regression issue of parsing datetime string with custom time fo…
LantaoJin Nov 1, 2024
cfe38d7
Fix: CSV and Raw output, escape quotes (#3063)
Michael-S Nov 6, 2024
95a1643
Fix coverage issue for #3063 (#3155)
ykmr1224 Nov 14, 2024
5b3cdd8
Call LeaseManager for BatchQuery (#3153)
ykmr1224 Nov 14, 2024
380dd34
Make GrammarElement public (#3161)
ykmr1224 Nov 20, 2024
8b2d01e
Update grammar validation settings (#3165)
ykmr1224 Nov 21, 2024
40b5b79
Doc fixs (#3163)
andy-k-improving Nov 26, 2024
871d9f2
Add grammar validation for PPL (#3167)
ykmr1224 Nov 27, 2024
eb88e3c
Fix: Date field format parsing for legacy query engine (#3160)
andy-k-improving Dec 2, 2024
9d9730b
Fix: CI Github Action (#3177)
andy-k-improving Dec 2, 2024
6712526
Add CIDR function to PPL (#3036) (#3110)
currantw Dec 3, 2024
b6846ce
Add FILLNULL command in PPL (#3032) (#3075)
normanj-bitquill Dec 5, 2024
e9af11f
Remove unused imports (#3192)
currantw Dec 6, 2024
bc2fd58
Add `final` to constant fields (#3191)
currantw Dec 6, 2024
3e2cb1d
Fix FilterOperator to cache next element and avoid repeated consumpti…
penghuo Dec 9, 2024
ed0ca8d
Add trendline PPL command (#3071)
jduo Dec 12, 2024
6911faf
Fix broken linkchecker pipeline job (#3202)
currantw Dec 13, 2024
8bfa2e9
Add validation for unsupported type/identifier/commands (#3195)
ykmr1224 Dec 16, 2024
3430deb
#3145 Add IP Address Data Type (#3175)
currantw Dec 19, 2024
44250d0
Add stalled PRs workflow (#3221)
Swiddis Dec 27, 2024
696d421
Remove spark-sql-application (#1916)
rupal-bq Dec 27, 2024
4224f31
Function str_to_date should work with two-digits year (#2841)
LantaoJin Dec 30, 2024
2f43bb8
Incorporated vamsimanohar username change. (#3231)
vamsimanohar Jan 6, 2025
7554e59
Doc: Proposed RFC Github issue template (#3164)
andy-k-improving Jan 7, 2025
44a92c5
Build subprojects in parallel (#3223)
LantaoJin Jan 8, 2025
0e4acd3
Fix the flaky test testExtractDatePartWithTimeType() (#3225)
LantaoJin Jan 8, 2025
79ffb14
Dedup running workflows on push action with auto-backport (#2843)
LantaoJin Jan 9, 2025
0e61d20
Revert "Build subprojects in parallel (#3223)" (#3234)
LantaoJin Jan 9, 2025
e415325
Allow metadata fields in PPL query (#2789)
LantaoJin Jan 10, 2025
aa0857d
[Followup] Fix the doctest failure (#3241)
LantaoJin Jan 14, 2025
e7be8ca
Fixed DateTimeFunctionTest.testWeekOfYearWithTimeType and YearWeekTes…
kenrickyap Jan 15, 2025
4b93d60
Framework of Calcite Engine: Parser, Catalog Binding and Plan Convert…
LantaoJin Jan 17, 2025
1314a31
[POC] Make PPL execute successfully on Calcite engine (#3258)
qianheng-aws Feb 7, 2025
e7188da
Make basic aggregation working (part 1) (#3318)
LantaoJin Feb 13, 2025
cb103d7
[Calcite Engine] Push down project and filter operator into index sca…
qianheng-aws Feb 21, 2025
7f1eba4
add condition and string func
xinyual Feb 21, 2025
86f1b9c
add atan
xinyual Feb 24, 2025
7d46cbc
[WIP] map opensearch math functions to calcite implementations
yuancu Feb 24, 2025
ce264dd
add transfer for log
xinyual Feb 24, 2025
06a7b65
Merge branch 'mapToCalciteBuiltIn' into map2calcite
xinyual Feb 24, 2025
25d7d51
Merge pull request #1 from yaunchun/map2calcite
xinyual Feb 24, 2025
6cc2452
fix log and atan
xinyual Feb 24, 2025
7ff8a1c
add udf and udaf percentile and Mod
xinyual Feb 24, 2025
19e11d6
add condition udf and take agg
xinyual Feb 25, 2025
25867df
add unified test framework
xinyual Feb 25, 2025
4ba78d3
[Calcite] Build integration test framework (#3342)
LantaoJin Feb 26, 2025
65fd487
Merge remote-tracking branch 'origin/feature/calcite-engine' into add…
xinyual Feb 26, 2025
db22f1c
Followup: Register OpenSearchTypeSystem to OpenSearchTypeFactory (#3349)
LantaoJin Feb 26, 2025
c2fe0ad
Make basic aggregation working (part 2) : adding tests (#3355)
LantaoJin Feb 27, 2025
7274a05
fix UT/IT
xinyual Feb 27, 2025
6ccfd97
merge
xinyual Feb 27, 2025
f6120dc
fix UT/IT
xinyual Feb 27, 2025
4fa915d
remove useless code change
xinyual Feb 27, 2025
99b33cd
apply spotless
xinyual Feb 27, 2025
2971eae
Fix execution errors caused by plan gap (#3350)
qianheng-aws Feb 27, 2025
f18c187
Implement ppl join command with Calcite (#3364)
LantaoJin Feb 28, 2025
0b28fab
add license and move it
xinyual Feb 28, 2025
651db98
remove useless change
xinyual Feb 28, 2025
37df1bf
Enable push down optimization by default (#3366)
qianheng-aws Feb 28, 2025
706f9b0
add time functions
xinyual Mar 3, 2025
8c0dd3b
fix date/utc_data/timestamp
xinyual Mar 3, 2025
e2d7333
Fix CalcitePPLJoinIT (#3369)
qianheng-aws Mar 3, 2025
a62d87d
Implement ppl `IN` subquery command with Calcite (#3371)
LantaoJin Mar 4, 2025
d0f4f38
add unix_timestamp(half)
xinyual Mar 4, 2025
2f29ab7
continue to fix unixtimestamp
xinyual Mar 4, 2025
fa63b23
[BugFix] support push down text field correctly. (#3376)
qianheng-aws Mar 4, 2025
8fc4b39
fix unixtimestamp
xinyual Mar 4, 2025
6668aa8
Add udf interface (#3374)
xinyual Mar 4, 2025
2591b15
[BugFix] Fix the join condition resolving bug introduced by IN subque…
LantaoJin Mar 5, 2025
92cb8ab
Implement ppl relation subquery command with Calcite (#3378)
LantaoJin Mar 6, 2025
22375df
Implement ppl exists subquery command with Calcite (#3388)
LantaoJin Mar 7, 2025
a07c2cd
Implement ppl scalar subquery command with Calcite (#3392)
LantaoJin Mar 7, 2025
dcf2057
Calcite enable pushdown aggregation (#3389)
qianheng-aws Mar 7, 2025
b7f6cf7
Add string builtin functions (#3393)
xinyual Mar 10, 2025
9ff34e2
Keep aggregation in Calcite consistent with current PPL behavior (#3405)
LantaoJin Mar 11, 2025
d10e9ab
Support multiple table and index pattern (#3409)
qianheng-aws Mar 11, 2025
1fa0fc4
Separate with/without pushdown ITs (#3413)
LantaoJin Mar 12, 2025
6eb9204
add timestamp
xinyual Mar 13, 2025
869ced9
Add condition UDFs (#3412)
xinyual Mar 13, 2025
211d3cf
Fix IT and CI, revert alias change (#3423)
penghuo Mar 14, 2025
5b75398
fix timestamp
xinyual Mar 14, 2025
61deedf
Implement DATEADD function
yuancu Mar 6, 2025
60a2807
Implement DATE_SUB function
yuancu Mar 6, 2025
85798af
WIP: Implement TIMEADD
yuancu Mar 12, 2025
f4c08cf
Implement ADDTIME
yuancu Mar 12, 2025
02be4c4
Implement DAY_OF_WEEK and DAY_OF_YEAR
yuancu Mar 12, 2025
6ca160d
Implement DATEDIFF
yuancu Mar 13, 2025
a359112
Leverage org.opensearch.sql.utils.DateTimeFormatters for datetime par…
yuancu Mar 13, 2025
0e8e5be
Make datetime utils interface
yuancu Mar 13, 2025
8338a58
Implement DATE_FORMAT (can't handle nanoseconds yet)
yuancu Mar 14, 2025
c82a2ed
Revert result ordering of `stats-by` (#3427)
LantaoJin Mar 14, 2025
6849035
Merge pull request #4 from yuancu/addTimeFunctions
xinyual Mar 14, 2025
cbd95d6
Fix rebase
yuancu Mar 14, 2025
345de93
Fix TIME function
yuancu Mar 14, 2025
e5a347d
Merge remote-tracking branch 'xinyuan/addTimeFunctions' into addTimeF…
yuancu Mar 14, 2025
03e0726
Merge pull request #5 from yuancu/addTimeFunctions
xinyual Mar 14, 2025
b8a8667
Implement EXTRACT by reusing OS PPL
yuancu Mar 14, 2025
c78f6ca
Implement CONVERT_TZ. Cannot handle null return at the moment.
yuancu Mar 14, 2025
d8201da
merge from main
xinyual Mar 14, 2025
5f72f21
apply spotless
xinyual Mar 14, 2025
40d4caa
Merge branch 'addTimeFunctions' into cleanDateTime
yuancu Mar 14, 2025
2962942
Implement DATETIME
yuancu Mar 14, 2025
c94657c
Implement FROM_DAYS
yuancu Mar 14, 2025
6711b82
Implement GET_FORMAT
yuancu Mar 14, 2025
b8509d2
Implement MAKETIME
yuancu Mar 14, 2025
c3eb8ff
Fix null returns for CONVERT_TZ and DATETIME by manually casting retu…
yuancu Mar 17, 2025
ee9f704
Implement PERIOD_ADD and PERIOD_DIFF
yuancu Mar 17, 2025
7a8674d
Implement STR_TO_DATE
yuancu Mar 17, 2025
40b166c
Add license information to datetime UDFs
yuancu Mar 17, 2025
6f3545a
Implement SUBTIME
yuancu Mar 17, 2025
ae42653
Reimplement WEEK and WEEK_OF_YEAR
yuancu Mar 17, 2025
8e04bde
Map CURRENT_TIME to SqlStdOperatorTable.CURRENT_TIME
yuancu Mar 17, 2025
8a45c36
Implement MINUTE_OF_DAY
yuancu Mar 17, 2025
9db5a08
Fix String.format locale to US for exprMakeTime
yuancu Mar 17, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .github/CODEOWNERS
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
# This should match the owning team set up in https://github.com/orgs/opensearch-project/teams
* @pjfitzgibbons @ps48 @kavithacm @derek-ho @joshuali925 @dai-chen @YANG-DB @rupal-bq @mengweieric @vamsi-amazon @swiddis @penghuo @seankao-az @MaxKsyunz @Yury-Fridlyand @anirudha @forestmvey @acarbonetto @GumpacG
* @pjfitzgibbons @ps48 @kavithacm @derek-ho @joshuali925 @dai-chen @YANG-DB @rupal-bq @mengweieric @vamsi-amazon @swiddis @penghuo @seankao-az @MaxKsyunz @Yury-Fridlyand @anirudha @forestmvey @acarbonetto @GumpacG @ykmr1224 @LantaoJin @noCharger
32 changes: 32 additions & 0 deletions .github/ISSUE_TEMPLATE/request_of_comments.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
---
name: 📄 Request of comments
about: Create a request of comments to initiate an discussion on feature implementation / design.
title: '[RFC]'
labels: 'rfc, untriaged'
assignees: ''
---

**Problem Statement**
Describes the issue or challenge that needs to be addressed.

**Current State**
Explains the existing setup or context and its shortcomings.

**Long-Term Goals**
* Describe the ideal outcome or future state you aim to achieve.
* What are the primary objectives of this solution should fulfill in the long run?
* How will this solution ensure sustainability or scalability over time?
* Consider whether the solution addresses the root problem and aligns with the overall goals.
* How confident are we that this solution solves the problem?

**Proposal**
Summarizes the suggested solution or improvement.

**Approach**
Details the steps or strategy to implement the proposal.

**Alternative**
Alternative that can serve as workarounds to partially or temporarily solve the problem.

**Implementation Discussion**
Outlines point the discussion regarding the proposed implementation.
20 changes: 11 additions & 9 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,18 @@
### Description
[Describe what this change achieves]

### Issues Resolved
[List any issues this PR will resolve]


### Related Issues
Resolves #[Issue number to be closed when this PR is merged]
<!-- List any other related issues here -->

### Check List
- [ ] New functionality includes testing.
- [ ] All tests pass, including unit test, integration test and doctest
- [ ] New functionality has been documented.
- [ ] New functionality has javadoc added
- [ ] New functionality has user manual doc added
- [ ] Commits are signed per the DCO using --signoff
- [ ] New functionality has javadoc added.
- [ ] New functionality has a user manual doc added.
- [ ] API changes companion pull request [created](https://github.com/opensearch-project/opensearch-api-specification/blob/main/DEVELOPER_GUIDE.md).
- [ ] Commits are signed per the DCO using `--signoff`.
- [ ] Public documentation issue/PR [created](https://github.com/opensearch-project/documentation-website/issues/new/choose).

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/OpenSearch/blob/main/CONTRIBUTING.md#developer-certificate-of-origin).
For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/sql/blob/main/CONTRIBUTING.md#developer-certificate-of-origin).
7 changes: 6 additions & 1 deletion .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ on:
- '[1-9]+.[0-9x]+'
push:
branches-ignore:
- 'backport/**'
- 'dependabot/**'
paths:
- '**/*.java'
Expand All @@ -27,7 +28,11 @@ jobs:
steps:
- name: Checkout repository
uses: actions/checkout@v3

- name: Set up JDK 21
uses: actions/setup-java@v3
with:
distribution: temurin
java-version: 21
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
with:
Expand Down
26 changes: 14 additions & 12 deletions .github/workflows/integ-tests-with-security.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ on:
pull_request:
push:
branches-ignore:
- 'backport/**'
- 'dependabot/**'
paths:
- 'integ-test/**'
Expand All @@ -20,21 +21,22 @@ jobs:
strategy:
fail-fast: false
matrix:
java: [ 11, 17 ]

java: [21]
runs-on: ubuntu-latest
container:
# using the same image which is used by opensearch-build team to build the OpenSearch Distribution
# this image tag is subject to change as more dependencies and updates will arrive over time
image: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-version-linux }}
# need to switch to root so that github actions can install runner binary on container without permission issues.
options: --user root
options: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-options }}

steps:
- uses: actions/checkout@v3
- name: Run start commands
run: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-command }}

- uses: actions/checkout@v4

- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@v3
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: ${{ matrix.java }}
Expand All @@ -46,7 +48,7 @@ jobs:

- name: Upload test reports
if: ${{ always() }}
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: test-reports-${{ matrix.os }}-${{ matrix.java }}
Expand All @@ -59,16 +61,16 @@ jobs:
strategy:
fail-fast: false
matrix:
os: [ windows-latest, macos-latest ]
java: [ 11, 17 ]
os: [ windows-latest, macos-13 ]
java: [21]

runs-on: ${{ matrix.os }}

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4

- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@v3
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: ${{ matrix.java }}
Expand All @@ -78,7 +80,7 @@ jobs:

- name: Upload test reports
if: ${{ always() }}
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: test-reports-${{ matrix.os }}-${{ matrix.java }}
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/maven-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ jobs:
- uses: actions/setup-java@v3
with:
distribution: temurin # Temurin is a distribution of adoptium
java-version: 11
java-version: 21
- uses: actions/checkout@v3
- uses: aws-actions/configure-aws-credentials@v1.7.0
with:
Expand Down
16 changes: 9 additions & 7 deletions .github/workflows/sql-pitest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,21 +21,23 @@ jobs:
strategy:
matrix:
java:
- 11
- 17
- 21
runs-on: ubuntu-latest
container:
# using the same image which is used by opensearch-build team to build the OpenSearch Distribution
# this image tag is subject to change as more dependencies and updates will arrive over time
image: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-version-linux }}
# need to switch to root so that github actions can install runner binary on container without permission issues.
options: --user root
options: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-options }}


steps:
- uses: actions/checkout@v3
- name: Run start commands
run: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-command }}

- uses: actions/checkout@v4

- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@v3
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: ${{ matrix.java }}
Expand All @@ -47,7 +49,7 @@ jobs:

- name: Upload test reports
if: always()
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
with:
name: test-reports-${{ matrix.entry.java }}
path: |
Expand Down
88 changes: 64 additions & 24 deletions .github/workflows/sql-test-and-build-workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ on:
pull_request:
push:
branches-ignore:
- 'backport/**'
- 'dependabot/**'
paths:
- '**/*.java'
Expand All @@ -28,22 +29,22 @@ jobs:
# Run all jobs
fail-fast: false
matrix:
java:
- 11
- 17
java: [21]
runs-on: ubuntu-latest
container:
# using the same image which is used by opensearch-build team to build the OpenSearch Distribution
# this image tag is subject to change as more dependencies and updates will arrive over time
image: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-version-linux }}
# need to switch to root so that github actions can install runner binary on container without permission issues.
options: --user root
options: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-options }}

steps:
- uses: actions/checkout@v3
- name: Run start commands
run: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-command }}

- uses: actions/checkout@v4

- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@v3
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: ${{ matrix.java }}
Expand All @@ -53,11 +54,6 @@ jobs:
chown -R 1000:1000 `pwd`
su `id -un 1000` -c "./gradlew --continue build"

- name: Run backward compatibility tests
run: |
chown -R 1000:1000 `pwd`
su `id -un 1000` -c "./scripts/bwctest.sh"

- name: Create Artifact Path
run: |
mkdir -p opensearch-sql-builds
Expand All @@ -66,22 +62,22 @@ jobs:
# This step uses the codecov-action Github action: https://github.com/codecov/codecov-action
- name: Upload SQL Coverage Report
if: ${{ always() }}
uses: codecov/codecov-action@v3
uses: codecov/codecov-action@v4
continue-on-error: true
with:
flags: sql-engine
token: ${{ secrets.CODECOV_TOKEN }}

- name: Upload Artifacts
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: opensearch-sql-ubuntu-latest-${{ matrix.java }}
path: opensearch-sql-builds

- name: Upload test reports
if: ${{ always() }}
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: test-reports-ubuntu-latest-${{ matrix.java }}
Expand All @@ -104,17 +100,15 @@ jobs:
fail-fast: false
matrix:
entry:
- { os: windows-latest, java: 11, os_build_args: -x doctest -PbuildPlatform=windows }
- { os: macos-latest, java: 11}
- { os: windows-latest, java: 17, os_build_args: -x doctest -PbuildPlatform=windows }
- { os: macos-latest, java: 17 }
- { os: windows-latest, java: 21, os_build_args: -x doctest -PbuildPlatform=windows }
- { os: macos-13, java: 21 }
runs-on: ${{ matrix.entry.os }}

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4

- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@v3
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: ${{ matrix.entry.java }}
Expand All @@ -130,22 +124,22 @@ jobs:
# This step uses the codecov-action Github action: https://github.com/codecov/codecov-action
- name: Upload SQL Coverage Report
if: ${{ always() && matrix.entry.os == 'ubuntu-latest' }}
uses: codecov/codecov-action@v3
uses: codecov/codecov-action@v4
continue-on-error: true
with:
flags: sql-engine
token: ${{ secrets.CODECOV_TOKEN }}

- name: Upload Artifacts
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: opensearch-sql-${{ matrix.entry.os }}-${{ matrix.entry.java }}
path: opensearch-sql-builds

- name: Upload test reports
if: ${{ always() && matrix.entry.os == 'ubuntu-latest' }}
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: test-reports-${{ matrix.entry.os }}-${{ matrix.entry.java }}
Expand All @@ -161,3 +155,49 @@ jobs:
plugin/build/reports/**
doctest/build/testclusters/docTestCluster-0/logs/*
integ-test/build/testclusters/*/logs/*

bwc-tests:
needs: Get-CI-Image-Tag
runs-on: ubuntu-latest
strategy:
matrix:
java: [21]
container:
image: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-version-linux }}
options: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-options }}

steps:
- name: Run start commands
run: ${{ needs.Get-CI-Image-Tag.outputs.ci-image-start-command }}

- uses: actions/checkout@v4

- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: ${{ matrix.java }}

- name: Run backward compatibility tests
run: |
chown -R 1000:1000 `pwd`
su `id -un 1000` -c "./scripts/bwctest.sh"

- name: Upload test reports
if: ${{ always() }}
uses: actions/upload-artifact@v4
continue-on-error: true
with:
name: test-reports-ubuntu-latest-${{ matrix.java }}-bwc
path: |
sql/build/reports/**
ppl/build/reports/**
core/build/reports/**
common/build/reports/**
opensearch/build/reports/**
integ-test/build/reports/**
protocol/build/reports/**
legacy/build/reports/**
plugin/build/reports/**
doctest/build/testclusters/docTestCluster-0/logs/*
integ-test/build/testclusters/*/logs/*
Loading
Loading