Serious Discussion Cloudflare Gateway Free Plan

[rashmi]

I started getting rate limited all of a sudden.

I'm also seeing the rate limit issue and error patching, including in the last update just an hour ago.

 

[Marko :)]

I'm also seeing the rate limit issue and error patching, including in the last update just an hour ago.

I haven't found time to contact support yet, but considering you are also getting errors, I think the problem is Cloudflare reduced limits. There isn't any other explanation considering list once grew over 300.000 domains and we never got rate limited, just domain limited.

I'm still on ControlD and it seems they kind of somehow sped it up at least on my location. Also, my workplace changed ISP so now there's normal routing towards their server. I may consider staying on it.

 

[SeriousHoax]

I also received rate limit warnings today. Only increasing the API delay might be enough. I'll try to experiment with different API delays to find an acceptable value.

 

[Marko :)]

API delay set to 1 with 25 concurrent requests still hits rate limit.

 

[SeriousHoax]

API delay set to 1 with 25 concurrent requests still hits rate limit.

I just came here to write that I found the solution.
Both max concurrent request and api delay have to be lowered.
Setting Max concurrent to 5 and API delay to 0.5 a.k.a. 500 ms works fine.
The updating process still completes under 1 minute.

 

[Marko :)]

I just came here to write that I found the solution.
Both max concurrent request and api delay have to be lowered.
Setting Max concurrent to 5 and API delay to 0.5 a.k.a. 500 ms works fine.
The updating process still completes under 1 minute.

I will try this. Though I'm tired of checking GitHub often just to see if everything works correctly.

 

[SeriousHoax]

I will try this. Though I'm tired of checking GitHub often just to see if everything works correctly.

It's great that you check because I usually don't and without you saying it, I wouldn't realize what's going on.

 

[rashmi]

I just came here to write that I found the solution.
Both max concurrent request and api delay have to be lowered.
Setting Max concurrent to 5 and API delay to 0.5 a.k.a. 500 ms works fine.
The updating process still completes under 1 minute.

The solution appears to have fixed the rate-limiting and error-patching issues.