Recent Activity
Note: This update might be based on outdated information.
nice work on the additions! I've made a few updates just now.
Thanks guys! Also - James, I did get that email re: civicaccess discussion on open data catalogs. Wondering how I can best be of service/help standardize the dataset ...
NASA has a really wide database of national, international, private, and consortium datasources here: If anyone wants to help me go through it...
http://gcmd.nasa.gov/KeywordSearch/Keywords.do?Portal=GCMD&KeywordPath=DataCenters&MetadataType=0&homepg=dif
Hi I would be interested, Any initial thoughts how you would like to go ahead.
I was thinking about scraping the full list so there would be some kind of checklist to work off of. I also think there should be a "database name" column...
It's actually a little more frustrating than I had previously thought. The NASA page itself _is_ a both a datahub, and a meta datahub. Often the data listed once you drill down are individual datafiles for data projects, many of them have FGDC metadata (official US government metadata format). Other times they are links to an academic department with no data at all. Gah.
It's actually a little more frustrating than I had previously thought. The NASA page itself _is_ a both a datahub, and a meta datahub. Often the data listed once you drill down are individual datafiles for data projects, many of them have FGDC metadata (official US government metadata format). Other times they are links to an academic department with no data at all. Gah.
It's actually a little more frustrating than I had previously thought. The NASA page itself _is_ a both a datahub, and a meta datahub. Often the data listed once you drill down are individual datafiles for data projects, many of them have FGDC metadata (official US government metadata format). Other times they are links to an academic department with no data at all. Gah.
damnit
hahaha ... seriously makes you realize how inaccessible existing data hubs often are. Sometimes I really wish they'd just keep it simple and think about what people want to know.
Good lord, I just tried subscribing to their Dataset RSS feed to see if it would be something we could have dump straight into BuzzData and it is a navigational nightmare! Just give us the data file and the readme for ****'s sake!!!
I setup a needlebase to pull just the "datacenters" information and not the actual datasets; it's running now, but it should be much more parse-able.
https://pub.needlebase.com/actions/visualizer/V2Visualizer.do?domain=NASA-Data-Centers-List&query=ID
Once it finishes running it still needs to be gone through to throw out the chuff (webpages that don't actually publish data)
OK I accessed the scrape that I made last week. It won't upload to Attachments, but just the here's a link to the flat CSV. A decent proportion of the links are academic departments, but there should be some good stuff in there regardless...
http://dl.dropbox.com/u/233002/WebUploads/BuzzData/NASA-Data-Centers-List.csv
After thinking about it for a second; it may be easier to crowd-source the work, by having a publicly editable google doc of the NASA datalist.
If you want to help work on verifying and adding Hubs to our list, (ie check to see if there's actual data being hosted or linked to other hubs on the list), "Check-out" the page or pages on the list, and then mark completed when when you've updated and uploaded the version to BuzzData (*cough* git-like pull requests sure would be nice here *cough*)
https://docs.google.com/spreadsheet/ccc?key=0ApBOz4yyls8YdEc2ZWctTDJTU0R3MlJiNzBqOGJHQmc&hl=en_US
Oh yes, you have no idea how I long the commits and pull requests. But we only have so many hands. Just you wait, though ... I just asked one @evil_trout (one of our devs) and he says it's definitely coming up!
Ok neat, I had an idea that it must have been on the todo list...
Some links for international hubs (a lot of extra stuff exists for Latin America and Africa)
http://www.delicious.com/azad/statistical.office
http://www.bls.gov/bls/other.htm
http://www.census.gov/aboutus/stat_int.html
Nice, thanks!
Hey there! Sorry it's taken me so long to respond - I was away in Vancouver for the last week. Can I invite you as a collaborator and you can add these great links to the dataset?
No problem... also have you seen this? Put together by real librarians and the like? :p http://logd.tw.rpi.edu/demo/international_dataset_catalog_search
For people interested in Development data be sure to check out the DEVECONDATA blog. Really we should upload all of the data he links to so its accessible here.
http://devecondata.blogspot.com/
Added Headers!
V12 Added International sources from Census Bureau's resource page.
Note: This update might be based on outdated information.
Interactive Map: The United States of Venture Capital
this version is slightly older. (got uploaded by admins) but I can't delete it from the history...