Do you want to help support HBC? You can contribute through e-transfer to marc@huntingbc.ca or via PayPal

Results 1 to 3 of 3

Thread: More bots and AI things blocked

  1. #1
    Join Date
    Aug 2010
    Location
    Langley
    Posts
    6,379

    More bots and AI things blocked

    tri777 reached out to me with the below image and observation that there were many "Guests" viewing old threads (like 9 years old in this example)

    I checked the logs and found in this case it was AmazonBot, which is basically for Alexa and AI training.

    It got me to thinking... AI training does not benefit HBC in any way. They are basically using our resources to improve their own products and make money. We get nothing in return for that. Further to AI training, they essentially use our content/posts for their own gain.

    Think for example someone asks ChatGPT a question "Tell me some good blacktail hunting tactics in BC" and ChatGPT responds basically with information it has learned from our site as its "own knowledge" without any referral, reference or credit. It's not like a search engine (which are mutually beneficial) where it crawls our site and sends visitors (potential new members) to our site. It's a parasitic relationship, using our resources to benefit themselves by turning it into their product and making money off it.

    Below is a list of what has been blocked so far. This is in addition to other abusive hosts/organizations that were blocked previously at a firewall level for flooding our site. I see the number of "Guests" on the site is much lower now and that we are using less bandwidth and other resources. This list will probably grow. I don't expect any impact, but if you notice anything ("hey caddis my Alexa won't read me HBC posts anymore" -- doubt that was ever a thing) let me know.

    And thanks to tri777 for noticing this.

    Bytespider
    spider-feedback
    bytedance
    GPTBot
    AhrefsBot
    amazonbot
    ChatGPT-User
    meta-externalagent
    OAI-SearchBot
    anthropic-ai
    ClaudeBot
    YouBot
    AI2Bot
    cohere-ai
    Timpibot
    diffbot


    Last edited by caddisguy; 04-12-2025 at 06:41 PM.

  2. Site Sponsor

  3. #2
    Join Date
    Aug 2010
    Location
    Langley
    Posts
    6,379

    Re: More bots and AI things blocked

    To put it into perspective, these AI training robots have made 61744 requests (essentially "page loads") from our website just today:

    # grep -E 'Bytespider|spider-feedback|bytedance|GPTBot|AhrefsBot|amazonbot|Chat GPT-User|OAI-SearchBot|anthropic-ai|ClaudeBot|YouBot|AI2Bot|cohere-ai|Timpibot|diffbot|meta-externalagent' huntingbc.ca-ssl_log | wc -l
    61744

    In April (so far and excluding today) it was 1,322,553

    In March, the total was 3,350,650

    Not cool.

    Websites have plans similar to cell phone plans. You get X amount of data per month. If you exceed it, it either shuts off or you have to pay more money. There is no reason for us to allow these companies to drive up our data usage to build their products. We don't get anything in return and in a way they are somewhat competitive of web forums in general.
    Last edited by caddisguy; 04-12-2025 at 06:54 PM.

  4. #3
    Join Date
    Jun 2022
    Posts
    3,770

    Re: More bots and AI things blocked

    Big shout out to you Caddis for you are HBC site whisperer !

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •