Commit b7dce49
committed
Document Eagle3 auxiliary layer default selection in Llama
Add documentation explaining that get_eagle3_aux_hidden_state_layers()
provides default layer selection and that the GPU model runner can
override this with values from speculative config for dynamic
configuration.1 parent 69862ba commit b7dce49
1 file changed
+5
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
578 | 578 | | |
579 | 579 | | |
580 | 580 | | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
581 | 586 | | |
582 | 587 | | |
583 | 588 | | |
| |||
0 commit comments