Skip to content
Merged
Show file tree
Hide file tree
Changes from 8 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
1. See [pull_request_template.md](./pull_request_template.md) for pull request (PR) requirements.
2. See [BUILD.md](../src/docs/BUILD.md) for instructions on how to build `OpenVINO™ GenAI`.
1. See [pull_request_template.md](/.github/pull_request_template.md) for pull request (PR) requirements.
2. See [BUILD.md](/src/docs/BUILD.md) for instructions on how to build `OpenVINO™ GenAI`.
3. Code style is determined by the file the change is made in. If ambiguous, look into the neighboring files of the same type. In case of contradiction, pick any of the options but stay consistent in your choice.
4. Don't push branches directly to the upstream repository. Once a branch is pushed to upstream, non-admins lose push access to it, preventing you from updating your changes. Instead, push to your fork and open PRs from there.
5. Your PR will be tested after one of the developers approves the tests run.
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
![Python](https://img.shields.io/badge/python-3.10+-green)
![OS](https://img.shields.io/badge/OS-Linux_|_Windows_|_MacOS-blue)

![](src/docs/openvino_genai.svg)
![](site/static/img/openvino-genai-workflow.svg)

</div>

Expand Down
10 changes: 10 additions & 0 deletions site/docs/guides/debug-logging.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -76,3 +76,13 @@ Accepted token rate, %: 51
===============================
Request_id: 0 ||| 40 0 40 20 0 0 40 40 0 20 20 20 0 40 0 0 20 80 0 80 20 0 0 0 40 80 0 40 60 40 80 0 0 0 0 40 20 20 0 40 20 40 0 20 0 0 0
```

When GGUF model passed to pipeline, the details debug info will be also printed.

```sh title="Output:"
[GGUF Reader]: Loading and unpacking model from: gguf_models/qwen2.5-0.5b-instruct-q4_0.gguf
[GGUF Reader]: Loading and unpacking model done. Time: 196ms
[GGUF Reader]: Start generating OpenVINO model...
[GGUF Reader]: Save generated OpenVINO model to: gguf_models/openvino_model.xml done. Time: 466 ms
[GGUF Reader]: Model generation done. Time: 757ms
```
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@ type SpeechGenerationModelType = {
architecture: string;
models: Array<{
name: string;
loraSupport: boolean;
links: string[];
}>;
};
Expand All @@ -13,7 +12,6 @@ export const SPEECH_GENERATION_MODELS: SpeechGenerationModelType[] = [
models: [
{
name: 'SpeechT5 TTS',
loraSupport: false,
links: ['https://huggingface.co/microsoft/speecht5_tts'],
},
],
Expand Down
14 changes: 0 additions & 14 deletions site/docs/supported-models/_components/vlm-models-table/models.ts
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@ type VLMModelType = {
architecture: string;
models: Array<{
name: string;
loraSupport: boolean;
links: string[];
notesLink?: string;
}>;
Expand All @@ -14,7 +13,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'InternVLChatModel',
loraSupport: false,
links: [
'https://huggingface.co/OpenGVLab/InternVL2-1B',
'https://huggingface.co/OpenGVLab/InternVL2-2B',
Expand All @@ -39,7 +37,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'LLaVA-v1.5',
loraSupport: false,
links: ['https://huggingface.co/llava-hf/llava-1.5-7b-hf'],
},
],
Expand All @@ -49,12 +46,10 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'nanoLLaVA',
loraSupport: false,
links: ['https://huggingface.co/qnguyen3/nanoLLaVA'],
},
{
name: 'nanoLLaVA-1.5',
loraSupport: false,
links: ['https://huggingface.co/qnguyen3/nanoLLaVA-1.5'],
},
],
Expand All @@ -64,7 +59,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'LLaVA-v1.6',
loraSupport: false,
links: [
'https://huggingface.co/llava-hf/llava-v1.6-mistral-7b-hf',
'https://huggingface.co/llava-hf/llava-v1.6-vicuna-7b-hf',
Expand All @@ -78,7 +72,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'LLaVA-Next-Video',
loraSupport: false,
links: [
'https://huggingface.co/llava-hf/LLaVA-NeXT-Video-7B-hf',
],
Expand All @@ -90,7 +83,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'MiniCPM-o-2_6',
loraSupport: false,
links: ['https://huggingface.co/openbmb/MiniCPM-o-2_6'],
notesLink: '#minicpm-o-notes',
},
Expand All @@ -101,7 +93,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'MiniCPM-V-2_6',
loraSupport: false,
links: ['https://huggingface.co/openbmb/MiniCPM-V-2_6'],
},
],
Expand All @@ -111,7 +102,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'phi3_v',
loraSupport: false,
links: [
'https://huggingface.co/microsoft/Phi-3-vision-128k-instruct',
'https://huggingface.co/microsoft/Phi-3.5-vision-instruct',
Expand All @@ -125,7 +115,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'phi4mm',
loraSupport: false,
links: [
'https://huggingface.co/microsoft/Phi-4-multimodal-instruct',
],
Expand All @@ -138,7 +127,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'Qwen2-VL',
loraSupport: false,
links: [
'https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct',
'https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct',
Expand All @@ -153,7 +141,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'Qwen2.5-VL',
loraSupport: false,
links: [
'https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct',
'https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct',
Expand All @@ -166,7 +153,6 @@ export const VLM_MODELS: VLMModelType[] = [
models: [
{
name: 'gemma3',
loraSupport: false,
links: [
'https://huggingface.co/google/gemma-3-4b-it',
'https://huggingface.co/google/gemma-3-12b-it',
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@ type WhisperModelType = {
architecture: string;
models: Array<{
name: string;
loraSupport: boolean;
links: string[];
}>;
};
Expand All @@ -13,7 +12,6 @@ export const WHISPER_MODELS: WhisperModelType[] = [
models: [
{
name: 'Whisper',
loraSupport: false,
links: [
'https://huggingface.co/openai/whisper-tiny',
'https://huggingface.co/openai/whisper-tiny.en',
Expand All @@ -28,7 +26,6 @@ export const WHISPER_MODELS: WhisperModelType[] = [
},
{
name: 'Distil-Whisper',
loraSupport: false,
links: [
'https://huggingface.co/distil-whisper/distil-small.en',
'https://huggingface.co/distil-whisper/distil-medium.en',
Expand Down
4 changes: 2 additions & 2 deletions src/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -539,12 +539,12 @@ print(tokens.input_ids.shape)

## How It Works

For information on how OpenVINO™ GenAI works, refer to the [How It Works Section](./docs/HOW_IT_WORKS.md).
For information on how OpenVINO™ GenAI works, refer to the [How It Works](https://openvinotoolkit.github.io/openvino.genai/docs/concepts/how-it-works) page.

## Supported Models

For a list of supported models, refer to the [Supported Models](https://openvinotoolkit.github.io/openvino.genai/docs/supported-models/) page.

## Debug Log

For using debug log, refer to [DEBUG Log](./doc/DEBUG_LOG.md).
For using debug log, refer to the [Debug Logging](https://openvinotoolkit.github.io/openvino.genai/docs/guides/debug-logging) page.
79 changes: 0 additions & 79 deletions src/docs/DEBUG_LOG.md

This file was deleted.

88 changes: 0 additions & 88 deletions src/docs/DOCKER.md

This file was deleted.

25 changes: 0 additions & 25 deletions src/docs/HOW_IT_WORKS.md

This file was deleted.

3 changes: 0 additions & 3 deletions src/docs/beam_idx-drop.gif

This file was deleted.

3 changes: 0 additions & 3 deletions src/docs/beam_idx-fork.gif

This file was deleted.

Loading
Loading