[Patch release] Make sure we install correct PEFT version

Small patch release to make sure the correct PEFT version is installed.

All commits

• Improve setup.py and add dependency check by @patrickvonplaten in #5826