Good to see site back up ..

[new_moonshiner]

Good to site the place back up and going ... thanks UJ.

[trthskr4]

Whoo hoo, back up and running. What the crap was up with that computer glitch? There were several sites down at the same time.

[Husker]

Yup, good to see it back.

H.

[Ayay]

Couldn't help thinking the gubmint cencor had kicked in beginning the new year. Here in ozland the big nanny says it is for the protection of children from all the nasties, but there will be a secret list of sites banned for everybody. Those sites will simply disappear in oz with no explanation.

Is there a way to download the whole site to store on a DVD? Or a mirror somewhere? You know, just in case, until the smoke settles.

[trthskr4]

Tastelime has a mirror on it, go to the home page and download the homesite and save the mirror site to your favorites.

[HookLine]

Does that download include the forum, or just the mother site?

[Hawke]

That is just the Mother site. There isn't a mirror for the forums.

[radio11]

Yup great to see everything back up.had no were to go today.

[Ayay]

Re downloading the whole site, I googled the question and after searching around found a free program that does it; BackStreet Browser 3.1

It's chugging away as I speak, done about 1800 files and 50mb in 45 mins. Will keep going and see what happens.

[HookLine]

Nice find, Ayay. Unfortunately it is only for Windows, which I do not have. But still interested to see how it works out for you.

[rad14701]

Many Linux distros include wget as part of the default code base... Works great for leeching an entire site as long as it was coded using relative resource path referencing...

[Ayay]

I have downloaded 28,000 files (800Mb) and the program has over 40,000 queued up and rising... with 90,000+ posts on the forum there is a long way to go.

Not sure if my computer will handle so much data, it takes 15mins for the program to initialize I guess in order to extract the queue. I'll do a defrag and see how it goes tomorrow.

[Husker]

People,

NOTE it is VERY tough on the site for people to be site sucking. Not only that, but the way phpBB puts things together, it will be millions of files downloaded.

Certain spiders have been CAREFULLY designed to download sites, looking for keywords (googlespider, yahoospider, etc). Usage of tools like teleport, or other http suckers, can really cause this site to slow down

Now, for people who want a mirror, I think that someone with a server host should contact UJ. That way, the files, and SQL db records can be exported weekly (or monthly), and easily mirrored. Also, it may be possible to do daily updates.

I am not able to do this. However, others might have the expertise (and server space).

But individuals (and possibly MANY individuals), should cease and desist, or at least make sure that you are downloading files at a reasonable rate.

I have noticed many times the last couple days when the site has been very non-responsive, up to the point of NOT updating requests. I am pretty sure this is due to ppl leaching, or trying to leach the forum using the http interface. I know that UJ has not made a plea for people to stop leaching like this, and he may not. However, I would suggest people stop, UNLESS UJ specifically says it is OK, and does not impact the server.

H.

[Uncle Jesse]

Dude was downloading the entire forums at 40 hits/second and slowing things down so much nobody could use the forums, so I firewalled the IP off and added Backstreet to the list of denied agents.

[Husker]

Dude was downloading the entire forums at 40 hits/second and slowing things down so much nobody could use the forums, so I firewalled the IP off and added Backstreet to the list of denied agents.

Listen up folks. Sounds to me like a GOOD way to get your IP locked out, is to do things like trying to leach the whole forum (it is HELL on it, hitting through http). Like I stated, and UJ has confirmed, people doing this WILL impact other users, and make the board seem really slow.

So, please, do NOT be doing this. This thread is being locked, with this post as the last post.


H.