Skip to content

Navigation Menu

Appearance settings

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

ggml-org / llama.cpp Public

Notifications You must be signed in to change notification settings
Fork 12.7k
Star 85.1k

Code
Issues 329
Pull requests 510
Discussions
Actions
Projects 10
Wiki
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Wiki
Security
Insights

llama : refactor graph build code#3837

Merged

ggerganov merged 21 commits intomasterggml-org/llama.cpp:masterfrom

llama-refactorggml-org/llama.cpp:llama-refactorCopy head branch name to clipboard

Nov 1, 2023

Conversation Commits21 (21)Checks Files changed

Merged

llama : refactor graph build code#3837
ggerganov merged 21 commits intomasterfrom
llama-refactor

Commits

Commits on Oct 28, 2023

llama : factor out ggml-alloc from graph graph build functions
ggerganov
committed
metal : disable kernel load log
ggerganov
committed
llama : factor out tensor offloading outside the build call (wip)
ggerganov
committed
llama : offload rest of the models
ggerganov
committed
llama : update offload log messages to print node index
ggerganov
committed
llama : comments
ggerganov
committed

Commits on Oct 29, 2023

llama : support offloading result_norm + comments
ggerganov
committed
llama : factor graph input into a function
ggerganov
committed
llama : do tensor offload only with CUDA
ggerganov
committed
llama : fix res_norm offloading
ggerganov
committed
llama : try to optimize offloading code
ggerganov
committed
llama : fix non-CUDA build
ggerganov
committed
llama : try to fix build
ggerganov
committed
llama : move refact in correct place + optimize graph input
ggerganov
committed
llama : refactor tensor offloading as callback
ggerganov
committed
llama : add layer index to all tensor names
ggerganov
committed
llama : add functional header
ggerganov
committed
llama : comment
ggerganov
committed
llama : remove obsolete map for layer counting
ggerganov
committed

Commits on Oct 31, 2023

llama : add llm_build helper functions (#3848)
ggerganov
authored
Merge branch 'master' into llama-refactor
ggerganov
committed

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.