Facebook  Twitter 

SMFHacks.com

+-

SMFHacks.com

+- User Information

Welcome, Guest.
Please login or register.
 
 
 
Forgot your password?

+- Forum Stats

Members
Total Members: 4257
Latest: Alex998.
New This Month: 1
New This Week: 0
New Today: 0
Stats
Total Posts: 43293
Total Topics: 7522
Most Online Today: 118
Most Online Ever: 2482
(April 09, 2011, 07:02:45 pm)
Users Online
Members: 0
Guests: 103
Total: 103

Author Topic: Blocking spiders and search engines from downloading our service manuals files?  (Read 6329 times)

0 Members and 1 Guest are viewing this topic.

Offline ApplianceJunk

  • Sr. Member
  • ****
  • Posts: 432
    • View Profile
    • ApplianceJunk.com
When I open up our download section for guest to use I take it that spiders and such are also able to click the download button and I'm concerned that will increase our monthly band width usage. Is that correct?

I have put a daily limit of three downloads for guest and a wait time of two minutes between downloads, but is there anything I can do to keep spiders and such from downloading our files?

I want google and such to be able to view the download page yet, but just not download the .pdf files we have on them.

What do you think?

Thanks,

Offline ApplianceJunk

  • Sr. Member
  • ****
  • Posts: 432
    • View Profile
    • ApplianceJunk.com
Any thoughts on this?

Even though spiders can click on the download button do they really download a file to anyplace after that?

Is there any reason to even be concerned about spiders increasing our band width usage by them downloading our .pdf files?

If spiders can download our .pdf files from our download section how about adding a recaptcha or spam verification question that has to be filled in before the download works for guest?


Offline SMFHacks

  • Administrator
  • Hero Member
  • *****
  • Posts: 16451
    • View Profile
I wouldn't be worried about the bandwidth usage they should only hit the files one time to index them.

I could add some code from blocking to access that page as an option though.
Get your Forum Ranked! at https://www.forumrankings.net - find out how your forum compares with others!

Like What I do? Support me at https://www.patreon.com/vbgamer45/

Offline ApplianceJunk

  • Sr. Member
  • ****
  • Posts: 432
    • View Profile
    • ApplianceJunk.com
I don't want to block them all together from viewing the download page, so I will just keep a eye on it and see how it goes.
If they only hit it once I guess it could be a good thing for use if we end up getting a few more URL's indexed by it.

Having to purchase more bandwidth would not be the worst thing in the world either. ;)

One of our affiliates we work with wanted us to open our downloads so you did not have to register to download a single service manual or two so I'm giving it a try.

We did not have as many new members register yesterday for our site and I believe this is because we opened up our downloads to guest like our affiliate wanted, but we had a great day for selling parts.

Thanks for the reply.

Offline SMFHacks

  • Administrator
  • Hero Member
  • *****
  • Posts: 16451
    • View Profile
Made an update that may help
2.1.1
+Added setting to deny access to search engines to download file to prevent indexing/resource usage.
+Added setting for basic hotlink protection
Get your Forum Ranked! at https://www.forumrankings.net - find out how your forum compares with others!

Like What I do? Support me at https://www.patreon.com/vbgamer45/

Offline ApplianceJunk

  • Sr. Member
  • ****
  • Posts: 432
    • View Profile
    • ApplianceJunk.com
Made an update that may help
2.1.1
+Added setting to deny access to search engines to download file to prevent indexing/resource usage.
+Added setting for basic hotlink protection


Awesome, Thanks!
I'm currently using 2.0.4.
Do I need to uninstall it first?

Offline SMFHacks

  • Administrator
  • Hero Member
  • *****
  • Posts: 16451
    • View Profile
I suggest an uninstall  if possible when going to 2.1 since a new tab is added in the Admin.php file
Get your Forum Ranked! at https://www.forumrankings.net - find out how your forum compares with others!

Like What I do? Support me at https://www.patreon.com/vbgamer45/

Offline ApplianceJunk

  • Sr. Member
  • ****
  • Posts: 432
    • View Profile
    • ApplianceJunk.com
I suggest an uninstall  if possible when going to 2.1 since a new tab is added in the Admin.php file

Ok, I just tried to but was shown all these failed.

Hope I don't have to do a lot of manual editing...

Offline SMFHacks

  • Administrator
  • Hero Member
  • *****
  • Posts: 16451
    • View Profile
I would skip that part then just install over the top and make the changes to Admin.php if they are not down yet.
Get your Forum Ranked! at https://www.forumrankings.net - find out how your forum compares with others!

Like What I do? Support me at https://www.patreon.com/vbgamer45/

Offline ApplianceJunk

  • Sr. Member
  • ****
  • Posts: 432
    • View Profile
    • ApplianceJunk.com
I would skip that part then just install over the top and make the changes to Admin.php if they are not down yet.

Ok, so when you say 'skip that part' you mean do not uninstall 2.0.4, just upload and install 2.1.1

Thanks,

Offline SMFHacks

  • Administrator
  • Hero Member
  • *****
  • Posts: 16451
    • View Profile
Yes just install the latest version.
Get your Forum Ranked! at https://www.forumrankings.net - find out how your forum compares with others!

Like What I do? Support me at https://www.patreon.com/vbgamer45/

 

Related Topics

  Subject / Started by Replies Last post
0 Replies
4356 Views
Last post August 08, 2007, 06:08:01 pm
by karlbenson
0 Replies
3053 Views
Last post December 02, 2008, 12:31:01 am
by Dwayne
1 Replies
7810 Views
Last post January 27, 2009, 07:28:28 pm
by SMFHacks
0 Replies
3705 Views
Last post January 24, 2010, 04:53:25 pm
by SMFHacks
8 Replies
1630 Views
Last post May 26, 2022, 10:28:02 pm
by Shades

+- Recent Topics

Rate own images by fvlog19
April 11, 2024, 10:56:53 am

Tidy Child Boards on 2.1.4 by SMFHacks
April 04, 2024, 03:54:12 pm

Problems SMF 2.0.19 > 2.1.4 SMF Gallery Pro - Recents Images to overall header by Michel68
March 30, 2024, 12:41:08 pm

Can't DROP 'id_member'; check that column/key exists Datei: by SMFHacks
March 30, 2024, 11:58:20 am

No thumbnails on new uploads by Tonyvic
March 29, 2024, 06:26:18 am

Display the Contact Page for guests by SMFHacks
March 27, 2024, 10:55:43 am

is it possible to add support for odysee.com by fvlog19
March 21, 2024, 08:47:51 am

Request for admin notification by davejo
March 10, 2024, 01:31:59 am

I need help with torrent upload by Ineedsmfhelp
March 09, 2024, 10:01:13 pm

an idea for new mod (( content type with different display )) by SMFHacks
February 27, 2024, 01:36:27 pm

Powered by EzPortal