integrate librosa for faster and more efficient audio loading #14984
+32
−2
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ading perf(audio): use librosa for faster and more efficient audio loading Added librosa as an alternative audio loading method to improve performance and reduce load times compared to the current implementation. Signed-off-by: S Abolfazl Mortazavi <112397868+SAMortazavi@users.noreply.github.com>
SAMortazavi
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Description
In the current implementation,
.opusfiles are not included in the list of supported audio formats, even thoughsoundfile (sf)can successfully load them. Additionally, usingpydubfor segment extraction is inefficient for long audio files, as it first loads the entire file into memory before clipping segments.This PR addresses the issue by adding
.opusto the supported formats and improving loading efficiency by introducinglibrosafor audio loading. Iflibrosaandsoundfilefail to load the audio, the fallback mechanism usespydubas a backup loader.Relevant Code
View on GitHub
Summary of Changes
.opusto supported audio formats.librosafor efficient audio loading to improve performance on long audio files.librosaandsoundfilefail, the loader falls back topydub.librosa-loaded data efficiently.