1. Forum
  2. DOVE-Net
  3. General

  • Google loves 90's tracker music

    From Deepthaw@VERT/DS94 to All on Thu Jul 6 13:48:27 2017
    My BBS has been running for about a month now, and I got all excited because guests were accessing the ftp site and downloading files!

    Turns out it was the Google web crawler. I'm not sure why it has a taste for mid 90's Amiga format music, but it is an AI after all.

    At least I know this means I'm probably showing up in search results for "crap from the 90's only deepthaw cares about anymore."

    ---
    þ Synchronet þ Deep Space '94 - deepspace94.com - The Best 1994 Had to Offer
  • From Denn Gray@VERT/OUTWEST to Deepthaw on Thu Jul 6 13:41:45 2017
    Re: Google loves 90's tracker music
    By: Deepthaw to All on Thu Jul 06 2017 01:48 pm

    My BBS has been running for about a month now, and I got all excited because guests were accessing the ftp site and downloading files!

    Turns out it was the Google web crawler. I'm not sure why it has a taste for mid 90's Amiga format music, but it is an AI after all.

    You can add directiries to your robots.txt to keep google from going through all you folders, below is how mine is set up.
    User-agent: *
    Disallow: /msgs/
    Disallow: /dirs/
    Disallow: /logs/
    Disallow: /text/
    Disallow: /subs/
    Disallow: /user/
    Disallow: /data/
    Disallow: /docs/
    Disallow: /ctrl/
    Disallow: /exec/
    Disallow: /web/
    Disallow: /user/
    Disallow: /mods/

    "... Chuck Norris can hear sign language and speak Braille."

    ---
    þ Synchronet þ the Outwest BBS - outwestbbs.com Telnet - outwestbbs.com:23
  • From KK4QBN@VERT/KK4QBN to Deepthaw on Thu Jul 6 16:49:36 2017
    Re: Google loves 90's tracker music
    By: Deepthaw to All on Thu Jul 06 2017 13:48:27

    My BBS has been running for about a month now, and I got all excited because guests were accessing the ftp site and downloading files!

    Turns out it was the Google web crawler. I'm not sure why it has a taste for mid 90's Amiga format music, but it is an AI after all.

    At least I know this means I'm probably showing up in search results for "crap from the 90's only deepthaw cares about anymore."
    [0m


    I let google search my filebase, but I don't allow it to download from it.. sucking up my bandwidth all day lomg.

    --

    Tim Smith (KK4QBN)
    KK4QBN BBS

    ---
    * Synchronet * KK4QBN - kk4qbn.synchro.net - 7064229538 - Chatsworth GA USA
  • From Daryl Stout@VERT/TBOLT to DEEPTHAW on Thu Jul 6 19:00:00 2017
    At least I know this means I'm probably showing up in search results for "cra D>from the 90's only deepthaw cares about anymore."

    Most of my files are for Windows XP and before...although I have some
    for the 32-bit and 64-bit systems.

    If they want to leech files over here, go for it. Anonymous FTP and
    Guest Accounts can't upload.

    Daryl

    ---
    þ OLX 1.53 þ I like stuffed animals; oven baked with bread crumbs.
    þ Synchronet þ The Thunderbolt BBS - wx1der.dyndns.org
  • From Vk3jed@VERT/FREEWAY to Daryl Stout on Fri Jul 7 13:11:00 2017
    Daryl Stout wrote to DEEPTHAW <=-

    If they want to leech files over here, go for it. Anonymous FTP and Guest Accounts can't upload.

    Same here. :)


    ... OS/2 VirusScan - "Windows found: Remove it? [Y/y]"
    --- MultiMail/Win32 v0.49
    þ Synchronet þ Freeway BBS in Bendigo, Australia.
  • From Daryl Stout@VERT/TBOLT to DENN GRAY on Fri Jul 7 01:12:00 2017
    You can add directiries to your robots.txt to keep google from going through DG>all you folders, below is how mine is set up.

    Interesting. I've seen references to it in the SBBS Control Panel, but
    wasn't sure where it was.

    Daryl

    ---
    þ OLX 1.53 þ I was told "Have emergency # on vacation". I wrote "911".
    þ Synchronet þ The Thunderbolt BBS - wx1der.dyndns.org