Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix: change max chunk limit exception #717

Merged
merged 16 commits into from
Apr 30, 2024
Merged

Fix: change max chunk limit exception #717

merged 16 commits into from
Apr 30, 2024

Commits on Apr 30, 2024

  1. change max chunk limit exception 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    bcb1c79 View commit details
    Browse the repository at this point in the history

  2. fix integration tests for two chunking algorithm 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    97ad445 View commit details
    Browse the repository at this point in the history

  3. update changelog 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    df89605 View commit details
    Browse the repository at this point in the history

  4. add run time parameter string_tobe_chunked_count 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    da90fc2 View commit details
    Browse the repository at this point in the history

  5. fix unit test for fixed token length and delimiter algorithm 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    b66e358 View commit details
    Browse the repository at this point in the history

  6. implement unit test for string to be chunked in fixed token length an… 

    …d delimiter algorithm

Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    5f73a18 View commit details
    Browse the repository at this point in the history

  7. update definition for string to be chunked parameter 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    d18e793 View commit details
    Browse the repository at this point in the history

  8. fix text chunking processor ut 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    18d6fed View commit details
    Browse the repository at this point in the history

  9. add string to be chunked count in text chunking processor 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    c0b5b25 View commit details
    Browse the repository at this point in the history

  10. add string to be chunked count in text chunking processor 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    1fdf596 View commit details
    Browse the repository at this point in the history

  11. add more test cases for text chunking processor 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    416f33b View commit details
    Browse the repository at this point in the history

  12. remove chunker util 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    3490a92 View commit details
    Browse the repository at this point in the history

  13. change chunk limit check in boht algorithms 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    84cd362 View commit details
    Browse the repository at this point in the history

  14. update ut for text chunking processor 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    65f8cf7 View commit details
    Browse the repository at this point in the history

  15. update parameter name to chunk_string_count 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    18b7936 View commit details
    Browse the repository at this point in the history

  16. run spot less apply 

    Signed-off-by: yuye-aws <yuyezhu@amazon.com>
    @yuye-aws
    yuye-aws committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    489acc9 View commit details
    Browse the repository at this point in the history