Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MultiDataSource feature merge #2334

Merged
merged 54 commits into from
Sep 19, 2022
Merged

MultiDataSource feature merge #2334

merged 54 commits into from
Sep 19, 2022

Commits on Sep 15, 2022

  1. Instantiate credential management plugin code structure (opensearch-p… 

    …roject#1996)

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    9171a5d View commit details
    Browse the repository at this point in the history

  2. Data source inside stack management setup (opensearch-project#2017) (o… 

    …pensearch-project#2030)

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    b2ca14f View commit details
    Browse the repository at this point in the history

  3. enable CI for feature branch (opensearch-project#2010) 

    Signed-off-by: Zhongnan Su <szhongna@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zhongnansu @kristenTian
    zhongnansu authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    addbb10 View commit details
    Browse the repository at this point in the history

  4. Add empty data source plugin (opensearch-project#2052) 

    Adds empty data source plugin.

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zengyan-amazon @kristenTian
    zengyan-amazon authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    4737ba4 View commit details
    Browse the repository at this point in the history

  5. [MD] Add initial credential management CRUD pages (opensearch-project… 

    …#2040)

* Add credential management CRUD pages

1. List all credentials
2. Create your saved credential
3. Edit your credential
4. Delete credentials

Signed-off-by: Louis Chu <clingzhi@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    1762412 View commit details
    Browse the repository at this point in the history

  6. Register Data source to savedObject & Update license header (opensear… 

    …ch-project#2037)

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0f12808 View commit details
    Browse the repository at this point in the history

  7. Move credential saved object to data source plugin (opensearch-projec… 

    …t#2062)

Signed-off-by: Louis Chu <clingzhi@amazon.com>

Move credential saved object to data source plugin
Resolve follow up comments on UI

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    3870b7d View commit details
    Browse the repository at this point in the history

  8. breadcrumbfix for datasource management (opensearch-project#2066) 

    * breadcrumbfix for datasource management

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* breadcrumbfix for datasource management - refactoring code

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* using services to update breadcrumb on data sources management page

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* Changing the license header on breadcrumbs.ts datasource management

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    85906d9 View commit details
    Browse the repository at this point in the history

  9. Fix breadcrumb on listing page and update saved object mapping (opens… 

    …earch-project#2069)

Signed-off-by: Louis Chu <clingzhi@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    420c118 View commit details
    Browse the repository at this point in the history

  10. Add data source step into IndexPattern with Mock switch (opensearch-p… 

    …roject#2064) (opensearch-project#2086)

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    03fa1c5 View commit details
    Browse the repository at this point in the history

  11. Add delete button for credential detailed page (opensearch-project#2067) 

    Signed-off-by: Yibo Wang <yibow@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @yibow98 @kristenTian
    yibow98 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    2faa379 View commit details
    Browse the repository at this point in the history

  12. Link datasource to indexpattern (opensearch-project#2118) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0019d2d View commit details
    Browse the repository at this point in the history

  13. Add encrypt/decrypt module on data source plugin (opensearch-project#… 

    …2120)

Signed-off-by: Louis Chu <clingzhi@amazon.com>

1. Add encrypt/decrypt module with UT
2. Add client factory wrapper for encrypt credential
3. Add encryption config support
4. Bugfix on Jest interpret Buffer

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    72d9b1a View commit details
    Browse the repository at this point in the history

  14. Integrate index pattern with new data client (opensearch-project#2146) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0a34341 View commit details
    Browse the repository at this point in the history

  15. Add noAuth to dataSource attributes (opensearch-project#2154) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    f6b9de6 View commit details
    Browse the repository at this point in the history

  16. [MD] Datasource Management - creation & listing - UI only (opensearch… 

    …-project#2128)

* data source management - creation & Listing UI only

* data source management - creation & Listing UI only

* Create/edit data source feature

* toggling default value

* refactoring code as per review comments

* toggling server flag to false

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    9f7c9b6 View commit details
    Browse the repository at this point in the history

  17. Apply dataSource plugin as dependent for cm and dsm plugins (opensear… 

    …ch-project#2150)

Signed-off-by: Louis Chu <clingzhi@amazon.com>

Apply dataSource plugin as dependent for cm and dsm plugins (opensearch-project#2150)

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    71014a2 View commit details
    Browse the repository at this point in the history

  18. Leverage datasource enablement in index pattern management 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    9ddb250 View commit details
    Browse the repository at this point in the history

  19. [MD] Add client management module and register getClient() to route… 

    … handler context (opensearch-project#2121)

* Add client management module and register `getClient()` interface to route handler context
Signed-off-by: Zhongnan Su <szhongna@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zhongnansu @kristenTian
    zhongnansu authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    6f64642 View commit details
    Browse the repository at this point in the history

  20. Make step info in index pattern creation dynamic (opensearch-project#… 

    …2164)

Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    d41cf71 View commit details
    Browse the repository at this point in the history

  21. Refactor for credential listing page & add loading effect (opensearch… 

    …-project#2142)

Signed-off-by: Yibo Wang <yibow@amazon.com>

Signed-off-by: Yibo Wang <yibow@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @yibow98 @kristenTian
    yibow98 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    c7cd702 View commit details
    Browse the repository at this point in the history

  22. Integration sequal - replace data client placeholders (opensearch-pro… 

    …ject#2167)

Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    5d4134e View commit details
    Browse the repository at this point in the history

  23. Integrate with crypto module to decrpt password (opensearch-project#2170 

    )

Signed-off-by: Zhongnan Su <szhongna@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zhongnansu @kristenTian
    zhongnansu authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0ca5bb1 View commit details
    Browse the repository at this point in the history

  24. [MD] noAuth integration, credential & endpoint validation (opensearch… 

    …-project#2165)

* noAuth integration, credential & endpoint validation

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* Refactoring validation message

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* Adding back accidentally deleted file home/tutorials/haproxy_metrics/index.ts

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    5c1b3fd View commit details
    Browse the repository at this point in the history

  25. [MD] Refactor search strategy to conditionally user datasource client (… 

    …opensearch-project#2171)

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zhongnansu @kristenTian
    zhongnansu authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    a058cc4 View commit details
    Browse the repository at this point in the history

  26. adding relation between credential selection and no auth checkbox (op… 

    …ensearch-project#2175)

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    a38f5d3 View commit details
    Browse the repository at this point in the history

  27. Update getIndicesViaSearch with datasource (opensearch-project#2176) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    ce6f8fc View commit details
    Browse the repository at this point in the history

  28. Add null header to child client spawn (opensearch-project#2188) 

    Signed-off-by: Su <szhongna@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zhongnansu @kristenTian
    zhongnansu authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    278d1d7 View commit details
    Browse the repository at this point in the history

  29. [MD][IP]Update button position & Add UT & Add skip option (opensearch… 

    …-project#2195)

* Add UT - index pattern related

Signed-off-by: Kristen Tian <tyarong@amazon.com>

* Update button position

Signed-off-by: Kristen Tian <tyarong@amazon.com>

* Add skip option to allow use default os data source

Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    bfb8ab1 View commit details
    Browse the repository at this point in the history

  30. [MD]Refactor layout and validate input fields for listing and create … 

    …pages (opensearch-project#2202)

Signed-off-by: Louis Chu <clingzhi@amazon.com>

Signed-off-by: Louis Chu <clingzhi@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    63959d8 View commit details
    Browse the repository at this point in the history

  31. Enable datasource link in saveObjectManagement (opensearch-project#2209) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    72a1066 View commit details
    Browse the repository at this point in the history

  32. Update configure data source per UX input (opensearch-project#2235) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    868e606 View commit details
    Browse the repository at this point in the history

  33. Enable data source audit log to file (opensearch-project#2215) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    144649d View commit details
    Browse the repository at this point in the history

  34. [MD] Refactor of credential editing page layout & refactor backend fi… 

    …eld validation method (opensearch-project#2222)

* Refactor of credential editing page layout & refactor backend field validation method

* Resolved the comments & fix the multiple call for one operation

Signed-off-by: Yibo Wang <yibow@amazon.com>

Signed-off-by: Yibo Wang <yibow@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @yibow98 @kristenTian
    yibow98 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    7af0631 View commit details
    Browse the repository at this point in the history

  35. Tweak fetch data back to original (opensearch-project#2238) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    b7c0b56 View commit details
    Browse the repository at this point in the history

  36. [MD] Revamped UX for data source management (opensearch-project#2239) 

    * revamped UX for data source management

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* refactored datasource screens as per PR comments

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    2e585f9 View commit details
    Browse the repository at this point in the history

  37. [MD] Credentials security redesign (opensearch-project#2253) 

    1. Data model changes for data source saved object
2. Server side changes for data source saved object
  a. Implement data_source_saved_objects_client_wrapper to integrate with CryptographyClient for password
  encryption / decryption.
  b. Change data_source_service to fetch credentials directly from data source (still decrypt via CryptographyClient)
  c. Fix unit tests accordingly

Signed-off-by: Louis Chu <clingzhi@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @noCharger @kristenTian
    noCharger authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    847e4c6 View commit details
    Browse the repository at this point in the history

  38. Add step data source UI test (opensearch-project#2264) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    ea0ee82 View commit details
    Browse the repository at this point in the history

  39. [MD]Improve datasource server side error handling (opensearch-project… 

    …#2236)

Signed-off-by: Su <szhongna@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @zhongnansu @kristenTian
    zhongnansu authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    6490e8c View commit details
    Browse the repository at this point in the history

  40. [MD] Datasource management new API change integrations (opensearch-pr… 

    …oject#2282)

* changing datasource management design to integrate with new API changes

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* Update edit_data_source_form.tsx

moving masked password to constants

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    bf990b0 View commit details
    Browse the repository at this point in the history

  41. Update stream test to bypass CI env generate domain attribute 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    384eae6 View commit details
    Browse the repository at this point in the history

  42. Delete credential management 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    08f2e4c View commit details
    Browse the repository at this point in the history

  43. Address comments 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    8a8c3e5 View commit details
    Browse the repository at this point in the history

  44. [MD] Datasource Management - Create data source - Unit tests (opensea… 

    …rch-project#2341)

* Unit test cases for data source management - create

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

* adding tests to utils.ts & changing it to test

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    442111d View commit details
    Browse the repository at this point in the history

  45. Fix update data source & block update endpint (opensearch-project#2364) 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>

Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    efb7c27 View commit details
    Browse the repository at this point in the history

  46. MD datasource management-datasource table-UTs (opensearch-project#2350) 

    Signed-off-by: Yibo Wang <yibow@amazon.com>

Signed-off-by: Yibo Wang <yibow@amazon.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @yibow98 @kristenTian
    yibow98 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    bd8cf04 View commit details
    Browse the repository at this point in the history

  47. reafctor based on PR 2334 comments to merge to main (opensearch-proje… 

    …ct#2375)

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    98fa63e View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. removing invalid urls as CI fails on link checker for inavlid urls in… 

    … git (opensearch-project#2376)

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>

Signed-off-by: mpabba3003 <amazonmanideep@gmail.com>
Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @mpabba3003 @kristenTian
    mpabba3003 authored and kristenTian committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    70beb18 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2022

  1. Address comments 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    fabc1c2 View commit details
    Browse the repository at this point in the history

  2. Fix DS snapshot test 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    954d747 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2022

  1. Add https://test.com/ to lychee exclude 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    2939054 View commit details
    Browse the repository at this point in the history

  2. Address comments 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    58e055e View commit details
    Browse the repository at this point in the history

  3. Remove unnessacry check 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    3b55e4f View commit details
    Browse the repository at this point in the history

  4. Remove not needed check 

    Signed-off-by: Kristen Tian <tyarong@amazon.com>
    @kristenTian
    kristenTian committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    3fad470 View commit details
    Browse the repository at this point in the history