Skip to content

Commit

Permalink
Expose ggml_get_accelerator via llm
Browse files Browse the repository at this point in the history
This allows consuming applications to simply check the available accelerator at runtime.
  • Loading branch information
LLukas22 committed Jul 18, 2023
1 parent 08329b9 commit 645093e
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion crates/llm/src/lib.rs
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,9 @@ use std::{
// Try not to expose too many GGML details here.
// This is the "user-facing" API, and GGML may not always be our backend.
pub use llm_base::{
conversation_inference_callback, feed_prompt_callback, ggml::format as ggml_format, load,
conversation_inference_callback, feed_prompt_callback,
ggml::accelerator::get_accelerator as ggml_get_accelerator,
ggml::accelerator::Accelerator as GgmlAccelerator, ggml::format as ggml_format, load,
load_progress_callback_stdout, quantize, samplers, ElementType, FileType, FileTypeFormat,
FormatMagic, Hyperparameters, InferenceError, InferenceFeedback, InferenceParameters,
InferenceRequest, InferenceResponse, InferenceSession, InferenceSessionConfig,
Expand Down

0 comments on commit 645093e

Please sign in to comment.