Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Python Client API support for shared memory #570

Merged
merged 26 commits into from
Aug 29, 2019
Merged

Python Client API support for shared memory #570

merged 26 commits into from
Aug 29, 2019

Commits on Aug 29, 2019

  1. Add Shared Memory Python client support

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    0d25464 View commit details
    Browse the repository at this point in the history

  2. keep shared memory wrapper separate for now - will merge in future 

    - currently creating new so locally
    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    62188c1 View commit details
    Browse the repository at this point in the history

  3. add shared memory helper functions to python API

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    1d347a6 View commit details
    Browse the repository at this point in the history

  4. fix docs

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    c4a13dd View commit details
    Browse the repository at this point in the history

  5. move shared memory back out of regular client

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    ac9a5e6 View commit details
    Browse the repository at this point in the history

  6. modify shared memory python client with new API

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    4802dba View commit details
    Browse the repository at this point in the history

  7. WIP - read output_values into list of numpy arrays

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    68061e6 View commit details
    Browse the repository at this point in the history

  8. Python client integration

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    538b0fa View commit details
    Browse the repository at this point in the history

  9. fix set input shared memory

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    28fd76b View commit details
    Browse the repository at this point in the history

  10. support read output from shared memory

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    6f3f426 View commit details
    Browse the repository at this point in the history

  11. - fix typos 

    - avoid extra mmap while setting input
- avoid extra memcpy for reading output
    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    41cc60c View commit details
    Browse the repository at this point in the history

  12. return result for shared memory like regular results

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    c0a772c View commit details
    Browse the repository at this point in the history

  13. migrate to using shared memory handle instead of base address

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    146543b View commit details
    Browse the repository at this point in the history

  14. Add python client to simple shared_memory test

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    c3bd8ac View commit details
    Browse the repository at this point in the history

  15. move shared memory helpers to tensorrtserver.shared_memory

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    65d7819 View commit details
    Browse the repository at this point in the history

  16. fix segfault during shared memory handle creation

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    fbcb727 View commit details
    Browse the repository at this point in the history

  17. move shared memory handle struct to a different header file

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    ef46c11 View commit details
    Browse the repository at this point in the history

  18. review edits

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    71a2d8a View commit details
    Browse the repository at this point in the history

  19. - use handle when possible - fix import for shared_memory (remove unn… 

    …ecessary class)
    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    9c3aef7 View commit details
    Browse the repository at this point in the history

  20. fix segfault due to empty handle

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    f820b19 View commit details
    Browse the repository at this point in the history

  21. fix for windows build

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    4f84563 View commit details
    Browse the repository at this point in the history

  22. use only handle to denote shared memory region - one shared memory re… 

    …gion per input with libchm
    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    1ed4da3 View commit details
    Browse the repository at this point in the history

  23. fix for batch_size != 1

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    98fc877 View commit details
    Browse the repository at this point in the history

  24. remove dependency of shared_memory on request

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    13919c0 View commit details
    Browse the repository at this point in the history

  25. review edits

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    7a41f1a View commit details
    Browse the repository at this point in the history

  26. fix raising exception

    @CoderHam
    CoderHam committed Aug 29, 2019
    Configuration menu
    Copy the full SHA
    5d04920 View commit details
    Browse the repository at this point in the history