Skip to content

ci: bundle libggml-cuda.so/ggml-cuda.dll in CUDA release artifacts#10

Merged
kenvandine merged 1 commit into
lemonade-sdk:lemonadefrom
Phqen1x:bundle-ggml-cuda
Jun 4, 2026
Merged

ci: bundle libggml-cuda.so/ggml-cuda.dll in CUDA release artifacts#10
kenvandine merged 1 commit into
lemonade-sdk:lemonadefrom
Phqen1x:bundle-ggml-cuda

Conversation

@Phqen1x
Copy link
Copy Markdown

@Phqen1x Phqen1x commented Jun 4, 2026

Summary

  • When SD_BUILD_SHARED_LIBS=ON and CUDA is enabled, ggml builds the CUDA backend as a shared library plugin (libggml-cuda.so / ggml-cuda.dll) rather than linking it statically into the main library
  • Without this plugin present at runtime, CUDA inference fails even if the CUDA runtime libs are bundled
  • Adds a find (Linux) / Get-ChildItem (Windows) step to copy the plugin into the artifact directory before packaging, in case cmake placed it outside build/bin/ (e.g. build/ggml/src/); no-op if it is already there

Test plan

  • Trigger a manual workflow run with create_release: true and verify libggml-cuda.so appears in a ubuntu-cuda-* tar.xz
  • Verify ggml-cuda.dll appears in a windows-cuda-* zip
  • Confirm CUDA inference works with the bundled artifact on a GPU host

🤖 Generated with Claude Code

The ggml CUDA backend is built as a shared library plugin when
SD_BUILD_SHARED_LIBS=ON. Bundle it alongside the CUDA runtime libs so
that CUDA inference works out of the box without the plugin being
missing at runtime.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Copy link
Copy Markdown
Member

@kenvandine kenvandine left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kenvandine kenvandine merged commit c2cc188 into lemonade-sdk:lemonade Jun 4, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants