From 30ad79e238748ee8acb4604aa40fa01c8253572b Mon Sep 17 00:00:00 2001 From: Svetlana Karslioglu Date: Wed, 16 Oct 2024 14:12:36 -0700 Subject: [PATCH] Fix formatting --- recipes_source/regional_compilation.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/recipes_source/regional_compilation.py b/recipes_source/regional_compilation.py index f0f0e7f3e3d..8b51d3ef516 100644 --- a/recipes_source/regional_compilation.py +++ b/recipes_source/regional_compilation.py @@ -3,6 +3,7 @@ ============================================================================ **Author:** `Animesh Jain `_ + As deep learning models get larger, the compilation time of these models also increases. This extended compilation time can result in a large startup time in inference services or wasted resources in large-scale training. This recipe @@ -23,7 +24,7 @@ pip install torch -.. note:: +.. note:: This feature is available starting with the 2.5 release. If you are using version 2.4, you can enable the configuration flag ``torch._dynamo.config.inline_inbuilt_nn_modules=True`` to prevent recompilations during regional compilation. In version 2.5, this flag is enabled by default.