Closed
Description
openedon Jun 6, 2023
Version
23.07
Which installation method(s) does this occur on?
Conda, Source
Describe the bug.
Serialization monitor seems to miscount messages, rendering a higher count than the previous stages. This cascades to later monitor stages like for ToFile. However, final line count in the output file is correct.
Believed to be a missing override of the C++ count method in SlicedMessageMeta.
Minimum reproducible example
morpheus --log_level=DEBUG run --use_cpp=True --num_threads=4 --pipeline_batch_size=8192 --model_max_batch_size=32 --edge_buffer_size=32 pipeline-nlp --labels_file=data/labels_nlp.txt --model_seq_length=256 from-file --filename=examples/data/pcap_dump.jsonlines monitor --description='FromFile rate' deserialize monitor --description='Deserialization rate' preprocess --vocab_hash_file=morpheus/data/bert-base-uncased-hash.txt --truncation=True --do_lower_case=True --add_special_tokens=False monitor --description='Preprocessing rate' inf-triton --force_convert_inputs=True --model_name=sid-minibert-onnx --server_url=localhost:8000 --use_shared_memory monitor --description='Inference rate' --unit inf add-class monitor --description='Classification rate' serialize --exclude '^ts_' monitor --description='Serialization rate' to-file --filename=./sid-minibert-onnx-output.jsonlines --overwrite monitor --description='ToFile rate'
Relevant log output
====Building Segment Complete!====
FromFile rate[Complete]: 93085 messages [00:00, 104817.96 messages/s]
Deserialization rate[Complete]: 93085 messages [00:00, 104531.29 messages/s]
Preprocessing rate[Complete]: 93085 messages [00:01, 81892.28 messages/s]
Inference rate[Complete]: 93085 inf [00:19, 4852.97 inf/s]
Classification rate[Complete]: 93085 messages [00:19, 4852.35 messages/s]
Serialization rate[Complete]: 1117020 messages [00:19, 58230.33 messages/s]
ToFile rate[Complete]: 1117020 messages [00:19, 58183.08 messages/s]
====Pipeline Complete====
Full env printout
No response
Other/Misc.
workaround is to disable C++ stages
Code of Conduct
- I agree to follow Morpheus' Code of Conduct
- I have searched the open bugs and have found no duplicates for this bug report
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Metadata
Assignees
Type
Projects
Status
Done