Computer Science
7,622 items in 38 lists
-
TREC Collections trec.nist.gov
TREC is the benchmark dataset used by most IR and Web search algorithms. It has several tracks, each of which consists of dataset to test for a specific task. The tracks along with suggested use-case are:
-
TREC trec.nist.gov
.
-
Can Deep Learning help solve Deep Learning theverge.com
Information Retrieval from Lip Reading.
-
The next web ted.com
Tim Berners-Lee (Ted Talk) [Tim Berners-Lee invented the World Wide Web. He leads the World Wide Web Consortium (W3C), overseeing the Web's standards and development].
-
Is Pivot a turning point for web exploration? ted.com
Gary Flake, Technical Fellow at Microsoft (TED Talks).
-
Beware online "filter bubbles" ted.com
Eli Pariser (Author of the Filter Bubble, TED Talk).
-
The case for anonymity online ted.com
Christopher "moot" Poole" (Ted Talks) [Christopher "moot" Poole is founder of 4chan, an online imageboard whose anonymous denizens have spawned the web's most bewildering and influential subculture].
-
Think your email's private? Think again ted.com
Andy Yen (CERN, TED Talk) [This talk talks about privacy, which Search Engines intrude into, and how can people protect it].
-
The moral bias behind your search results ted.com
Andreas Ekström (Swedish Author & Journalist, TED Talk).
-
Neural Network Learns to Identify Criminals by Their Faces technologyreview.com
Information Extraction.
-
Deep Neural Network Learns to Judge Books by Their Covers technologyreview.com
Information Extraction.
-
Language Modeling for Information Retrieval springer.com
W.B. Croft, J. Lafferty. Springer, 2003. (Handles Language Modeling aspect of Information Retrieval. It also extensively details probabilistic perspective in this domain, which is interesting).
-
SIGIR sigir.org
.
-
Information Retrieval in Practice search-engines-book.com
B. Croft, D. Metzler, T. Strohman. Pearson Education, 2009.
-
Advanced Cross Linugal Information Retrieval and Question Answering (ACLIA) research.nii.ac.jp
The dataset is used for the task of cross-lingual question answering but the complexity of the task is higher than CLQA dataset.
-
Cross Language Q&A (CLQA) dataset collection research.nii.ac.jp
It supports following bi-lingua and mono-lingua:
-
CLIR Test Collections research.nii.ac.jp
This dataset can be used for cross lingual IR between CJKE (Chinese-Japanese-Korean-English) languages. It is suitable for the following tasks:
-
NTCIR research.nii.ac.jp
.
-
NTCIR Test Collection research.nii.ac.jp
This is collection of wide variety of dataset ranging from Ad-hoc collection, Chinese IR collection, mobile clickthrough collections to medical collections. The focus of this collection is mostly on east asian languages and cross language information retrieval.
-
Information Retrieval and the Web research.google.com
Google Research.
-
Modern Information Retrieval people.ischool.berkeley.edu
R. Baeza-Yates, B. Ribeiro-Neto. Addison-Wesley, 1999.
-
Stanford List nlp.stanford.edu
-
Information Retrieval and Data Mining mpi-inf.mpg.de
Dr. Jilles Vreeken , Prof. Dr. Gerhard Weikum (MPI).
-
Apache Lucene lucene.apache.org
Open Source Search Engine that can be used to test Information Retrieval Algorithm. Twitter uses this core for its real-time search.
-
Lemur Toolkit lemurproject.org
Open Source Toolkit for research in Language Modeling, filtering and categorization.
-
Indri Search Engine lemurproject.org
Another Open Source Search Engine competitor of Apache Lucene.
-
The Lemur Project lemurproject.org
The Lemur Project develops search engines, browser toolbars, text analysis tools, and data resources that support research and development of information retrieval and text mining software.
-
20 Newsgroup dataset kdd.ics.uci.edu
This data set consists of 20000 newsgroup messages.posts taken from 20 newsgroup topics.
-
WWW iw3c2.org
.
-
IR Thoughts irthoughts.wordpress.com
Dr. Edel Garcia.
-
ECIR irsg.bcs.org
.
-
GOV2 Test Collection ir.dcs.gla.ac.uk
This is one of the largest Web collection of documents obtained from crawl of government websites by Charlie Clarke and Ian Soboroff, using NIST hardware and network, then formatted by Nick Craswel.
-
Cranfield Collections ir.dcs.gla.ac.uk
This is one of the first collections in IR domain, however the dataset is too small for any statistical significance analysis, but is nevertheless suitable for pilot runs.
-
FIRE fire.irsi.res.in
.
-
To reduce biases in machine learning start with openly discussing the problem enterprisersproject.com
Bias in Relevance.
-
Information Retrieval: A Survey csee.umbc.edu
Ed Greengrass, 2000. (Comprehensive survey of Conventional Information Retrieval, before Deep Learning era).
-
Mining the Web: Analysis of Hypertext and Semi Structured Data cse.iitb.ac.in
S. Chakrabarti. Morgan Kaufmann, 2002.
-
CS 371R: Information Retrieval and Web Search cs.utexas.edu
Raymond J. Mooney (University of Texas at Austin).
-
CS 172: Introduction to Information Retrieval cs.ucr.edu
Vagelis Hristidis (University of California - Riverside).
-
CS 435: Information Retrieval, Discovery, and Delivery cs.princeton.edu
Andrea LaPaugh (Princeton University).
-
600.466: Information Retrieval and Web Agents cs.jhu.edu
David Yarowsky (John Hopkins University).
-
INF384H / CS395T / INF350E: Concepts of Information Retrieval (and Web Search) courses.ischool.utexas.edu
Matthew Lease (University of Texas at Austin).
-
Coursera - Text Retrieval and Search Engines coursera.org
Prof. ChengXiang Zhai (University of Illinois at Urbana-Champaign).
-
Conference and Labs of the Evaluation Forum (CLEF) dataset clef-initiative.eu
It contains a multi-lingual document collection. The test suite includes:
-
CLEF clef-initiative.eu
.
-
CIKM cikmconference.org
.
-
Search Engines: Information Retrieval in Practice ciir.cs.umass.edu
Bruce Croft, Don Metzler, and Trevor Strohman. 2009. (Great book for readers interested in knowing how Search Engines work. The book is very detailed).
-
English Gigaword Fifth Edition catalog.ldc.upenn.edu
This data set is a comprehensive archive of English newswire text data including headlines, datelines and articles.
-
11-442 / 11-642: Search Engines boston.lti.cs.cmu.edu
Jamie Callan (CMU).
-
CMU List boston.lti.cs.cmu.edu
- next page of items loading…
