You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Instead of blocking scraping, can't we just put a limit on it? #19
The allow_scrape_if_limited_to requires a limit to be specified, but we'll never get clients to adhere to such requirements.
Instead why not have an option to impose a hard limit on scraping queries (or on all queries even) So if someone requests all our events we can just return the last 50 or something.
Activity
mikedilger commentedon Mar 14, 2024
Interesting. I'm torn though.
I don't want to return results that I know are incorrect (incomplete), I'd rather return an error saying we can't fulfill the request.
mikedilger commentedon Apr 10, 2024
Maybe we could have a config that specifies a max age, and then allow scrapes (backwards in time) up to the max age.