Skip to content

Commit 6a16a79

Browse files
authored
add models in deepspeed support table (#2989)
1 parent 2a692c4 commit 6a16a79

File tree

2 files changed

+17
-3
lines changed

2 files changed

+17
-3
lines changed

docs/_static/htmls/tbl_deepspeed.html

Lines changed: 15 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -123,29 +123,41 @@
123123
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
124124
</tr>
125125
<tr class="row-odd">
126+
<td><p>Mistral</p></td>
127+
<td><p>mistralai/Mixtral-8x7B-v0.1</p></td>
128+
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
129+
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
130+
</tr>
131+
<tr class="row-even">
126132
<td><p>MPT</p></td>
127133
<td><p>mosaicml/mpt-7b</p></td>
128134
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
129135
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
130136
</tr>
131-
<tr class="row-even">
137+
<tr class="row-odd">
132138
<td><p>Stablelm</p></td>
133139
<td><p>stabilityai/stablelm-2-1_6b</p></td>
134140
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
135141
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
136142
</tr>
137-
<tr class="row-odd">
143+
<tr class="row-even">
138144
<td><p>Qwen</p></td>
139145
<td><p>Qwen/Qwen-7B-Chat</p></td>
140146
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
141147
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
142148
</tr>
143-
<tr class="row-even">
149+
<tr class="row-odd">
144150
<td><p>GIT</p></td>
145151
<td><p>microsoft/git-base</p></td>
146152
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
147153
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
148154
</tr>
155+
<tr class="row-even">
156+
<td><p>Phi</p></td>
157+
<td><p>microsoft/phi-2</p></td>
158+
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
159+
<td><p style="text-align: center; vertical-align: middle;">🟩</p></td>
160+
</tr>
149161
<tr class="row-odd">
150162
<td><p>Phi</p></td>
151163
<td><p>microsoft/Phi-3-mini-4k-instruct</p></td>

examples/cpu/inference/python/llm/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -69,10 +69,12 @@ And a set of data types are supported for various scenarios, including FP32, BF1
6969
|GPTBigCode| bigcode/starcoder | 🟩 | 🟩 |
7070
|T5| google/flan-t5-xl | 🟩 | 🟩 |
7171
|Mistral| mistralai/Mistral-7B-v0.1 | 🟩 | 🟩 |
72+
|Mistral| mistralai/Mixtral-8x7B-v0.1 | 🟩 | 🟩 |
7273
|MPT| mosaicml/mpt-7b | 🟩 | 🟩 |
7374
|Stablelm| stabilityai/stablelm-2-1_6b | 🟩 | 🟩 |
7475
|Qwen| Qwen/Qwen-7B-Chat | 🟩 | 🟩 |
7576
|GIT| microsoft/git-base | 🟩 | 🟩 |
77+
|Phi| microsoft/phi-2 | 🟩 | 🟩 |
7678
|Phi| microsoft/Phi-3-mini-4k-instruct | 🟩 | 🟩 |
7779
|Phi| microsoft/Phi-3-mini-128k-instruct | 🟩 | 🟩 |
7880
|Phi| microsoft/Phi-3-medium-4k-instruct | 🟩 | 🟩 |

0 commit comments

Comments
 (0)