• azad2002 (Azad Amir-Ghassemi)

    azad2002
  • Follow
  • Recent Activity

  • Post new:
  • Comment
  • azad2002 azad2002
    started following the Parking Topic
    x
    x
    x
    azad2002 azad2002
    posted a visualization on NCAA Basketball Spending:

    College basketball $$

    College basketball $$

    x
    x
    azad2002 azad2002
    updated the Open Data Hubs Worldwide Dataroom

    Note: This update might be based on outdated information.

    x
    azad2002 azad2002

    this version is slightly older. (got uploaded by admins) but I can't delete it from the history...

    x
    jpmckinney jpmckinney

    nice work on the additions! I've made a few updates just now.

    x
    momoko momoko

    Thanks guys! Also - James, I did get that email re: civicaccess discussion on open data catalogs. Wondering how I can best be of service/help standardize the dataset ...

    x
    x
    azad2002 azad2002
    commented on Open Data Hubs Worldwide

    NASA has a really wide database of national, international, private, and consortium datasources here: If anyone wants to help me go through it...

    http://gcmd.nasa.gov/KeywordSearch/Keywords.do?Portal=GCMD&KeywordPath=DataCenters&MetadataType=0&homepg=dif

    x
    sorabh sorabh

    Hi I would be interested, Any initial thoughts how you would like to go ahead.

    x
    azad2002 azad2002

    I was thinking about scraping the full list so there would be some kind of checklist to work off of. I also think there should be a "database name" column...

    x
    azad2002 azad2002

    It's actually a little more frustrating than I had previously thought. The NASA page itself _is_ a both a datahub, and a meta datahub. Often the data listed once you drill down are individual datafiles for data projects, many of them have FGDC metadata (official US government metadata format). Other times they are links to an academic department with no data at all. Gah.

    x
    azad2002 azad2002

    It's actually a little more frustrating than I had previously thought. The NASA page itself _is_ a both a datahub, and a meta datahub. Often the data listed once you drill down are individual datafiles for data projects, many of them have FGDC metadata (official US government metadata format). Other times they are links to an academic department with no data at all. Gah.

    x
    azad2002 azad2002

    It's actually a little more frustrating than I had previously thought. The NASA page itself _is_ a both a datahub, and a meta datahub. Often the data listed once you drill down are individual datafiles for data projects, many of them have FGDC metadata (official US government metadata format). Other times they are links to an academic department with no data at all. Gah.

    x
    azad2002 azad2002

    damnit

    x
    momoko momoko

    hahaha ... seriously makes you realize how inaccessible existing data hubs often are. Sometimes I really wish they'd just keep it simple and think about what people want to know.

    x
    momoko momoko

    Good lord, I just tried subscribing to their Dataset RSS feed to see if it would be something we could have dump straight into BuzzData and it is a navigational nightmare! Just give us the data file and the readme for ****'s sake!!!

    x
    azad2002 azad2002

    I setup a needlebase to pull just the "datacenters" information and not the actual datasets; it's running now, but it should be much more parse-able.

    x
    azad2002 azad2002

    https://pub.needlebase.com/actions/visualizer/V2Visualizer.do?domain=NASA-Data-Centers-List&query=ID

    Once it finishes running it still needs to be gone through to throw out the chuff (webpages that don't actually publish data)

    x
    azad2002 azad2002

    OK I accessed the scrape that I made last week. It won't upload to Attachments, but just the here's a link to the flat CSV. A decent proportion of the links are academic departments, but there should be some good stuff in there regardless...
    http://dl.dropbox.com/u/233002/WebUploads/BuzzData/NASA-Data-Centers-List.csv

    x
    azad2002 azad2002

    After thinking about it for a second; it may be easier to crowd-source the work, by having a publicly editable google doc of the NASA datalist.

    If you want to help work on verifying and adding Hubs to our list, (ie check to see if there's actual data being hosted or linked to other hubs on the list), "Check-out" the page or pages on the list, and then mark completed when when you've updated and uploaded the version to BuzzData (*cough* git-like pull requests sure would be nice here *cough*)

    https://docs.google.com/spreadsheet/ccc?key=0ApBOz4yyls8YdEc2ZWctTDJTU0R3MlJiNzBqOGJHQmc&hl=en_US

    x
    momoko momoko

    Oh yes, you have no idea how I long the commits and pull requests. But we only have so many hands. Just you wait, though ... I just asked one @evil_trout (one of our devs) and he says it's definitely coming up!

    x
    azad2002 azad2002

    Ok neat, I had an idea that it must have been on the todo list...

    x
    x
    azad2002 azad2002
    commented on Open Data Hubs Worldwide

    Some links for international hubs (a lot of extra stuff exists for Latin America and Africa)

    x
    azad2002 azad2002

    http://www.delicious.com/azad/statistical.office

    x
    azad2002 azad2002

    http://www.bls.gov/bls/other.htm

    x
    azad2002 azad2002

    http://www.census.gov/aboutus/stat_int.html

    x
    momoko momoko

    Nice, thanks!

    x
    momoko momoko

    Hey there! Sorry it's taken me so long to respond - I was away in Vancouver for the last week. Can I invite you as a collaborator and you can add these great links to the dataset?

    x
    azad2002 azad2002

    No problem... also have you seen this? Put together by real librarians and the like? :p http://logd.tw.rpi.edu/demo/international_dataset_catalog_search

    x
    x
    azad2002 azad2002
    commented on International Development

    For people interested in Development data be sure to check out the DEVECONDATA blog. Really we should upload all of the data he links to so its accessible here.

    x
    azad2002 azad2002

    http://devecondata.blogspot.com/

    x
    x
    azad2002 azad2002
    updated the City Inequality Dataset Dataroom
    x
    azad2002 azad2002

    Added Headers!

    x
    x
    azad2002 azad2002
    started following gaba
    x
    x
    azad2002 azad2002
    started following the EIU Exchange Rate Forecasts Dataroom
    x
    x
    x
    x
    x
    x
    azad2002 azad2002
    started following darrylleewood
    x
    x
    azad2002 azad2002
    commented on Open Data Hubs Worldwide

    V12 Added International sources from Census Bureau's resource page.

    x
    x
    azad2002 azad2002
    updated the Open Data Hubs Worldwide Dataroom

    Note: This update might be based on outdated information.

    x
    x
    azad2002 azad2002
    started following znmeb
    x
    x
    azad2002 azad2002
    posted a visualization on The United States of Venture Capital - 2011:

    Ob-pa641_vcus_a_20110803205010

    Interactive Map: The United States of Venture Capital

    x
    x
    azad2002 azad2002
    updated the Open Data Hubs Worldwide Dataroom
    x
    x
    azad2002 azad2002
    posted a visualization on Chicago School Days:

    4%20%20attendance_hoursinstr_boxplot

    x
    x
    azad2002 azad2002
    posted a visualization on Chicago School Days:

    http://dl.dropbox.com/u/233002/WebUploads...

    x
    x
    + Load more items