Skip to content

Commit

Permalink
Add query parts to lamp (#2736)
Browse files Browse the repository at this point in the history
### What problem does this PR solve?


### Type of change

- [x] New Feature (non-breaking change which adds functionality)
  • Loading branch information
KevinHuSh authored Oct 8, 2024
1 parent a3ab5ba commit b3b5468
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions api/db/services/dialog_service.py
Original file line number Diff line number Diff line change
Expand Up @@ -189,6 +189,7 @@ def chat(dialog, messages, stream=True, **kwargs):
used_token_count, msg = message_fit_in(msg, int(max_tokens * 0.97))
assert len(msg) >= 2, f"message_fit_in has bug: {msg}"
prompt = msg[0]["content"]
prompt += "\n\n### Query:\n%s" % " ".join(questions)

if "max_tokens" in gen_conf:
gen_conf["max_tokens"] = min(
Expand Down

0 comments on commit b3b5468

Please sign in to comment.