Skip to content

Commit

Permalink
Update Vertex AI embedding to allow a batch size of 250 (langchain4j#556
Browse files Browse the repository at this point in the history
)
  • Loading branch information
glaforge authored Jan 26, 2024
1 parent eb4b6f2 commit ccee079
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@
*/
public class VertexAiEmbeddingModel implements EmbeddingModel {

private static final int BATCH_SIZE = 5; // Vertex AI has a limit of up to 5 input texts per request
private static final int BATCH_SIZE = 250; // Vertex AI has a limit of up to 250 input texts per request

private final PredictionServiceSettings settings;
private final EndpointName endpointName;
Expand Down

0 comments on commit ccee079

Please sign in to comment.