Skip to content

[BUG]: SlicedMessageMeta needs to override count method, throws off monitor stage #970

Closed

Description

Version

23.07

Which installation method(s) does this occur on?

Conda, Source

Describe the bug.

Serialization monitor seems to miscount messages, rendering a higher count than the previous stages. This cascades to later monitor stages like for ToFile. However, final line count in the output file is correct.

Believed to be a missing override of the C++ count method in SlicedMessageMeta.

Minimum reproducible example

morpheus --log_level=DEBUG run --use_cpp=True --num_threads=4 --pipeline_batch_size=8192 --model_max_batch_size=32 --edge_buffer_size=32  pipeline-nlp --labels_file=data/labels_nlp.txt --model_seq_length=256 from-file --filename=examples/data/pcap_dump.jsonlines monitor --description='FromFile rate'  deserialize monitor --description='Deserialization rate' preprocess --vocab_hash_file=morpheus/data/bert-base-uncased-hash.txt --truncation=True --do_lower_case=True --add_special_tokens=False monitor --description='Preprocessing rate' inf-triton --force_convert_inputs=True --model_name=sid-minibert-onnx --server_url=localhost:8000 --use_shared_memory monitor --description='Inference rate' --unit inf add-class monitor --description='Classification rate' serialize --exclude '^ts_' monitor --description='Serialization rate' to-file --filename=./sid-minibert-onnx-output.jsonlines --overwrite monitor --description='ToFile rate'

Relevant log output

====Building Segment Complete!====
FromFile rate[Complete]: 93085 messages [00:00, 104817.96 messages/s]
Deserialization rate[Complete]: 93085 messages [00:00, 104531.29 messages/s]
Preprocessing rate[Complete]: 93085 messages [00:01, 81892.28 messages/s]
Inference rate[Complete]: 93085 inf [00:19, 4852.97 inf/s]
Classification rate[Complete]: 93085 messages [00:19, 4852.35 messages/s]
Serialization rate[Complete]: 1117020 messages [00:19, 58230.33 messages/s]
ToFile rate[Complete]: 1117020 messages [00:19, 58183.08 messages/s]
====Pipeline Complete====

Full env printout

No response

Other/Misc.

workaround is to disable C++ stages

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

bugSomething isn't workingimprovementImprovement to existing functionalitynon-breakingNon-breaking change

Type

No type

Projects

  • Status

    Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions