Github Archive

From 15c3d73e2932f988cdeadac22e8c5d031cc76a32 Mon Sep 17 00:00:00 2001 From: Zachary Vance Date: Thu, 19 Nov 2015 22:21:09 -0800 Subject: [PATCH] Make page clearer, correct command --- github.html | 11 +++++++---- 1 file changed, 7 insertions(+), 4 deletions(-) diff --git a/github.html b/github.html index 67d7f94..e345255 100644 --- a/github.html +++ b/github.html @@ -1,22 +1,25 @@ Github Archive -Currently no one has archived github.com. +Currently no one has archived github.com. This webpage is about progress toward that. -I host the metadata for the repositories. Metadata for gists is currently unavailable from github, but I'm working with them to make it public. +I host the metadata for the repositories:

Full repository metadata is available in batches of 10,000 at

http://za3k.com/github/repos-<X>0000-<X+1>0000.json
 http://za3k.com/github/repos-<X>0000-<X+1>0000.json.gz

To download all files, run

 
 for x in {0..100}; do \
-  wget "http://za3k.com/github/repos-$((x*10000))-$(((x+1)*10000)).json.gz"\
+  wget "http://za3k.com/github/repos-$((x*10000))-$(((x+1)*10000)).json.gz"; \
 done

+ The files are around 10G compressed, 100G uncompressed.

You can grab greatly abbreviated metadata (recommended) as JSON.
Finally, you can get a txt file of just the repo names: txt.

+ + +Metadata for gists is currently unavailable from github, but I'm working with them to make it public. Additional information:

-- 2.47.3