Skip to content

Commit 334ed89

Browse files
authored
Remove 4MB limit for gRPC message payloads (#49)
Currently our logic chunks data to send over gRPC according to numbers of rows of data, this led to large streamsets in the multivalue api erroring out while trying to recv this data. This PR sets the limit for the client to receive from the server to be unlimited for the time being. This will allow arbitrarly-sized streamsets to have successful multivalue queries. In the future we should update our logic to better handle these size limits when sending from the server, but this is a patch fix for now.
1 parent be0b757 commit 334ed89

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

btrdb/conn.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,10 @@ def __init__(self, addrportstr, apikey=None):
6060
6161
"""
6262
addrport = addrportstr.split(":", 2)
63-
chan_ops = []
63+
# 100MB size limit ~ 2500 streams for 5000 points with each point being 64bit
64+
# 500MB size limit ~ 13K streams for 5000 points
65+
# -1 size limit = no limit of size to send
66+
chan_ops = [("grpc.max_receive_message_length", -1)]
6467

6568
if len(addrport) != 2:
6669
raise ValueError("expecting address:port")

0 commit comments

Comments
 (0)