Public datasets

• Browse data bots

Directories and general data sets¶

You can also retrieve various data via web APIs.

Language¶

Geographical and location data¶

Space¶

• openNASA: 30k+ data sets from NASA
• Open Exoplanet Catalogue: a database of all discovered extra-solar planets
• Apollo11GuidanceComputerVertAndNounList.txt: a list of “nouns” and “verbs” to control the Apollo 11 guidance computer

Biology¶

• Catalogue of Life: online database of the world’s known species of animals, plants, fungi and micro-organisms, available as an API and downloadable data set

Health¶

• HealthData.gov: making high value health data more accessible to entrepreneurs, researchers, and policy makers in the hopes of better health outcomes for all (healthdata.gov)
• OpenFDA: Open-source APIs for FDA drug, device, and food data
• Medical Data for Machine Learning
• Open Payments Dataset: payments made by healthcare manufacturers (pharmaceutical companies, medical device manufacturers) to any doctor they work with
• Open Food Facts: a food products database

General science¶

• Yelp’s Academic Dataset
• Academic Torrents: datasets from scientific papers
• CERN Open Data Portal

Politics¶

Film, TV, literature¶

• Cornell Movie-Dialogs Corpus: a large metadata-rich collection of fictional conversations extracted from raw movie scripts
• Movielens Data by GroupLens: rating data sets from the MovieLens web site
• UC Irvine Machine Learning Lab’s Movie Data Set: a list of over 10000 films including many older, odd, and cult films
• Hadley Wickham’s Normalized IMDB Movie Data
• AM Stat Movie Data Set: weekend and daily per theater box office receipt data as well as total U.S. gross receipts
• LinkedMDB: open semantic web database for movies, including a large number of interlinks to several datasets on the open data cloud and references to related web pages
• Open Movie Database: a free web service to obtain movie information
• Cornell University Movie Review Data
• Jonathan Koren Movies Data Set: faceted metadata describing contemporary American films, along with relevant judgements by actual human users
• markriedl/WikiPlots: a dataset containing story plots from Wikipedia (books, movies, etc.) and the code for the extractor
• corpusmusic/liederCorpusAnalysis: a collection of IPA (International Phonetic Alphabet) transcriptions of German poems from prominent 19th-c. art songs

Art and images¶

• Open Images Dataset by Google: dataset consisting of ~9 million URLs to images that have been annotated with labels spanning over 6000 categories (related blog post)
• The Museum of Modern Art (MoMA) Collection: basic metadata for more than 120,000 records (no images, but some include URLs)
• The Metropolitan Museum of Art Open Access: select datasets of information on more than 420,000 artworks in its Collection for unrestricted commercial and noncommercial use
• The Tate Collection: snapshot of the Tate collection as of October 2014 (no longer actively maintained)
• The collection data of the Carnegie Museum of Art: data on approximately 28,269 objects across all departments of the museum; fine arts, decorative arts, photography, contemporary art, and the Heinz Architectural Center
• National Museum Sweden Wikidata Collection: the collection of the Nationalmuseum in Stockholm
• Museum für Kunst und Gewerbe Hamburg: more than 20,000 artworks and artifacts
• Yale Center for British Art – Collections Department: high-resolution images of Yale University’s collection objects
• VisualGenome: dataset, a knowledge base, an ongoing effort to connect structured image concepts to language

Other¶

Latest from the blog

Cheap Bots, Done Quick suspended, this time for good

So long, and thanks for all the bots.

Twitter shutting down free access to their API on February 9

I keep saying it's an end of an era quite often these days.

How do folks get into creative botmaking?

Sharing the stories of our early botmaking days.

What kind of bots are posting in the fediverse?

Exploring the bots people make and follow in the fediverse.

Visit the blog