Skip to content

Instead of blocking scraping, can't we just put a limit on it? #19

Open

Description

@fiatjaf

The allow_scrape_if_limited_to requires a limit to be specified, but we'll never get clients to adhere to such requirements.

Instead why not have an option to impose a hard limit on scraping queries (or on all queries even) So if someone requests all our events we can just return the last 50 or something.

Activity

  1. mikedilger commented on Mar 14, 2024

    @mikedilger
    Owner

    Interesting. I'm torn though.

    I don't want to return results that I know are incorrect (incomplete), I'd rather return an error saying we can't fulfill the request.

  2. mikedilger commented on Apr 10, 2024

    @mikedilger
    Owner

    Maybe we could have a config that specifies a max age, and then allow scrapes (backwards in time) up to the max age.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions