Downloading the whole wiki

For discussion directly related to LifeWiki.
Post Reply
yurich
Posts: 2
Joined: June 26th, 2025, 4:04 am

Downloading the whole wiki

Post by yurich »

I tried scraping some data from pages and Cloudflare didnt let me do that. Is there a dump of the whole wiki I can download?
User avatar
rabbit
Posts: 245
Joined: March 4th, 2024, 6:00 am
Location: Stuck inside a magician's hat. it hurts so bad

Re: Downloading the whole wiki

Post by rabbit »

For what reason do you need to scrape the whole wiki? There's a .zip containing all of the patterns on the wiki's main page if that's what you're looking for.
That's the bunny.
Check out my OCA exploration script, crule.lua!
User avatar
b-engine
Posts: 3762
Joined: October 26th, 2023, 4:11 am
Location: Somewhere on where Earth At
Contact:

Re: Downloading the whole wiki

Post by b-engine »

rabbit wrote: June 26th, 2025, 11:06 am For what reason do you need to scrape the whole wiki? There's a .zip containing all of the patterns on the wiki's main page if that's what you're looking for.
But that's not all - the wiki includes contents outside patterns.
yurich
Posts: 2
Joined: June 26th, 2025, 4:04 am

Re: Downloading the whole wiki

Post by yurich »

I'm creating a personal "internet" on my computer. I wanted to index the thing and be able to search it on my machine. So, I can't, is that right?
User avatar
dvgrn
Moderator
Posts: 12034
Joined: May 17th, 2009, 11:00 pm
Location: Madison, WI
Contact:

Re: Downloading the whole wiki

Post by dvgrn »

yurich wrote: June 30th, 2025, 4:34 am I'm creating a personal "internet" on my computer. I wanted to index the thing and be able to search it on my machine. So, I can't, is that right?
Well... you certainly _could_ still do that, in various ways -- it's a fair amount of work to bypass CloudFlare, but you'd only have to do the work once (unless you want to keep your local copy up-to-date, anyway).

So far there haven't been a lot of people looking for an offline package containing the current state of the LifeWiki. A scraper tool that automatically dodges CloudFlare has some potential for causing over-use of the conwaylife.com server ... so at the moment it isn't high on my priority list to help enable anything along those lines.
User avatar
otismo
Posts: 1593
Joined: August 18th, 2010, 1:41 pm
Location: Florida
Contact:

Re: Downloading the whole wiki

Post by otismo »

we should have a LifeWiki TarBall developers can download

if the OP is going to make some kind of "app"

I would want one for my own

Intranet

Thank You !
"One picture is worth 1000 words; but one thousand words, carefully crafted, can paint an infinite number of pictures."
- autonomic writing
forFUN : http://gol.jct.onl
ArtGallery : http://cgolart.onfav.net
VideoWS : http://conway.life
User avatar
Mimila99
Posts: 20
Joined: September 22nd, 2025, 12:07 am

Re: Downloading the whole wiki

Post by Mimila99 »

If the wiki gets hacked and shut down or crashes for whatever reason, use the wayback machine

Wayback machine

https://web.archive.org

Conway life webite
https://web.archive.org/web/20250201000 ... aylife.com
My abbreviated username:

Code: Select all

#CXRLE Pos=7,7
x = 15, y = 15, rule = B37/S1234
15o$o13bo$ob5ob5obo$obobobobobobobo$obobobobobobobo$obobobobobobobo$ob
obobobobobobo$o13bo$ob5ob5obo$obo3bobo3bobo$ob5ob5obo$o5bo5bobo$ob5ob
5obo$o13bo$15o!
User avatar
hth3
Posts: 362
Joined: February 15th, 2025, 10:04 am
Location: The Sun

Re: Downloading the whole wiki

Post by hth3 »

There absolutely needs to be some way to do this, since the pattern archives are just not enough, descriptions are needed too, and some patterns are either classes of patterns (of which there are many members, so it doesn't refer to just one pattern) or patterns huge enough they are description-only and not the entire pattern (like RCT) (so it would be very useful especially for context and understanding).
As otismo wrote,
otismo wrote: August 28th, 2025, 1:54 pm we should have a LifeWiki TarBall developers can download
if the OP is going to make some kind of "app"
it would also be useful for developers of CGoL apps.
Can't trust someone who misspells typset as typeset.
Contribute to CheckerLife!
Oppose KOSA now, save the internet!
The Sandboxer Sandbox (Discord server)
RIP Unname New Web
User avatar
otismo
Posts: 1593
Joined: August 18th, 2010, 1:41 pm
Location: Florida
Contact:

Re: Downloading the whole wiki

Post by otismo »

just thought I would pop in to post a link to that TrilloByteTarBall

http://tbtb.conway.life

now remember how to put 8cells [a Boat and a BananaSpark] in a 5X5box to get a Glider in 102gens

Merry Christmas !
just had to ani-gif it
just had to ani-gif it
8cells-5X5-Boat-and-Banana-Spark-102gens-Glider-Predecessor-TigerCub414-IO.gif (7.49 KiB) Viewed 1196 times
<3
"One picture is worth 1000 words; but one thousand words, carefully crafted, can paint an infinite number of pictures."
- autonomic writing
forFUN : http://gol.jct.onl
ArtGallery : http://cgolart.onfav.net
VideoWS : http://conway.life
Post Reply