Skip to content

Commit d1e2b6e

Browse files
kunnisteleprint-me
authored andcommitted
ggml : use dynamic thread scheduling for matrix multiplication (ggml-org#6915)
* Just reordering some structs. * Adding in the calls to mm_pause * Passing around the state * Renaming and moving a bunch of variables around. * Extracting the logic to it's own function. * Moving some variable definitions into the chunk function. * Moving some variables around * moving src1_cont inside * Moving row_size * adding the current_chunk * Reorg the code. * Formatting to match the orig patch * starting to setup the chunking variables * Starting the buildup of the loop * The yield shouldn't be necessary. * adding the looping structure based on the chunk configuration. * Add in the re-chunking code. * Making it much more likely to rechunk. * disable resizing if numa is enabled. * Updating comments with what we've learned. * Fix formatting * Couple more formatting fixes. * More style fixes. * Fix Warnings * Going with unused because there's conditional logic that needs it. * Update ggml.c * Update ggml.c ---------
1 parent dda1347 commit d1e2b6e

File tree

1 file changed

+237
-144
lines changed

1 file changed

+237
-144
lines changed

0 commit comments

Comments
 (0)