Github Archive

From: Zachary Vance Date: Fri, 20 Nov 2015 06:21:09 +0000 (-0800) Subject: Make page clearer, correct command X-Git-Url: https://git.za3k.com/?a=commitdiff_plain;h=15c3d73e2932f988cdeadac22e8c5d031cc76a32;p=za3k.git Make page clearer, correct command --- diff --git a/github.html b/github.html index 67d7f94..e345255 100644 --- a/github.html +++ b/github.html @@ -1,22 +1,25 @@ Github Archive -Currently no one has archived github.com. +Currently no one has archived github.com. This webpage is about progress toward that. -I host the metadata for the repositories. Metadata for gists is currently unavailable from github, but I'm working with them to make it public. +I host the metadata for the repositories:

Full repository metadata is available in batches of 10,000 at

http://za3k.com/github/repos-<X>0000-<X+1>0000.json
 http://za3k.com/github/repos-<X>0000-<X+1>0000.json.gz

To download all files, run

 
 for x in {0..100}; do \
-  wget "http://za3k.com/github/repos-$((x*10000))-$(((x+1)*10000)).json.gz"\
+  wget "http://za3k.com/github/repos-$((x*10000))-$(((x+1)*10000)).json.gz"; \
 done

+ The files are around 10G compressed, 100G uncompressed.

You can grab greatly abbreviated metadata (recommended) as JSON.
Finally, you can get a txt file of just the repo names: txt.

+ + +Metadata for gists is currently unavailable from github, but I'm working with them to make it public. Additional information: