retry on 429 for plugin ProxyPool

[fayland]

Hello

thanks for the software. and I'm wondering if it's possible to add a retry on 429 Too many requests on ProxyPool plugin.

my situation is using ProxyPool with 2-3 proxies servers. and some proxy may return 429 too many requests due to overload. and I want to pick the next pool proxy to retry the request. or even retry the request on the same proxy if that's easier (b/c 429 is a temp status, it might be ok on the next request)

is it possible? or if we need to implement the plugin myself, which function would be a good place to start? handle_client_data or handle_upstream_chunk or what?

Thanks

[abhinavsingh]

Sorry for late reply. I think currently upstream proxies are hardcoded, but it's easy to make them dynamic. What you want to do is:

1. Detect 429 within your response handlers
2. Upon 429, update your upstream proxies e.g. remove a certain proxy
3. FWIW, you can also read upstream proxies from some file on disk, cache/db where you can keep updating proxies asynchronously.

Please let me know if this helps. Thank you