Search results

ggml : spread compute across threads in chunks

demoDemonstrate some concept or idea, not intended to be mergedDemonstrate some concept or idea, not intended to be merged

threadingParallel processing and thread managementParallel processing and thread management

Status: Open (in progress).

ggml-org/llama.cppnumber 1507

#1507 In ggml-org/llama.cpp;

· ggerganov opened on May 17, 2023

Use Threadpool to schedule the work

threadingParallel processing and thread managementParallel processing and thread management

Status: Draft (not ready).

ggml-org/llama.cppnumber 851

#851 In ggml-org/llama.cpp;

· howard0su opened on Apr 8, 2023

Run several single thread operators parellel

threadingParallel processing and thread managementParallel processing and thread management

Status: Open (in progress).

ggml-org/llama.cppnumber 850

#850 In ggml-org/llama.cpp;

· howard0su opened on Apr 8, 2023

Optimize locking behavior

threadingParallel processing and thread managementParallel processing and thread management

Status: Open (in progress).

ggml-org/llama.cppnumber 813

#813 In ggml-org/llama.cpp;

· janekb04 opened on Apr 6, 2023

Add "-e"/"--eval-threads" to distinguish thread counts for single-token eval and prompt eval

threadingParallel processing and thread managementParallel processing and thread management

Status: Draft (not ready).

ggml-org/llama.cppnumber 744

#744 In ggml-org/llama.cpp;

· MagisterLuddite opened on Apr 3, 2023