INF384H/CS395T: Concepts of Information Retrieval (and Web Search)
The 
University of Texas at Austin

INF384H / CS395T: Concepts of Information Retrieval (and Web Search) -- Fall 2013

THIS COURSE IS CROSS-LISTED; IF ONE SECTION IS FULL, PLEASE ENROLL IN ONE OF THE OTHER SECTIONS. All students will receive the same credit toward graduation requirements regardless of which section they enroll in.

  • Computer Science students: If the CS listing is full, enroll in the INF listing and email csadmis@cs.utexas.edu to request the CS major credit.

Instructor: Matt Lease
Day and Time: Thursdays 12-3pm
Location: UTA 1.208 (at the iSchool)
Unique IDs: 28570 (INF) and 54167 (CS)

Syllabus
Course Schedule
Course Blog

Previous offerings: Fall 2012 · Fall 2011 · Fall 2010 · Spring 2010

Prerequisites: No prior knowledge of IR or programming expertise is required; all interested and motivated students are invited to attend. This course typically attracts significant student participation across a wide variety of disciplines: information science, computer science, linguistics, electrical engineering, and design studies. Course activities are intended to serve the needs of both (1) those studying to work professionally on search engines or conduct research in IR, and (2) non-specialists interested in gaining broader exposure and understanding of IR methods and systems.

Textbook: none required, all readings online
Graduate-level course: undergraduate seniors may enroll only with instructor permission.

The course culminates in a public poster session where students present their course projects

Want to publish original research?

In every previous offering of the course, several of the best, most innovative course projects have been extended beyond the semester until the work was in publishable form. If you have a great idea and are willing to work hard to get it published, the course project provides a great opportunity to refine the idea and get started developing the project with regular feedback and advising from the instructor. Examples of previous course projects which led to published papers include:

  • Ramona Broussard, Yongyi Zhou, and Matthew Lease. Mobile Phone Search for Library Catalogs. In Proceedings of the 73rd Annual Meeting of the American Society for Information Science and Technology (ASIS&T), 2010.
  • Ramona Broussard, Yongyi Zhou, and Matthew Lease. University of Texas Mobile Library Search. In Proceedings of the 73rd Annual Meeting of the American Society for Information Science and Technology (ASIS&T), 2010.
  • Lu Guo and Matthew Lease. Personalizing Local Search with Twitter. In Workshop on Enriching Information Retrieval (ENIR) at the 34th Annual ACM SIGIR Conference, 2011.
  • Adriana Kovashka and Matthew Lease. Human and Machine Detection of Stylistic Similarity in Art. In Proceedings of the 1st Annual Conference on the Future of Distributed Work (CrowdConf), San Francisco, September 2010.
  • Abhimanu Kumar and Matthew Lease. Learning to Rank From a Noisy Crowd. In Proceedings of the 34th Annual ACM SIGIR Conference, 2011.
  • Abhimanu Kumar and Matthew Lease. Modeling Annotator Accuracies for Supervised Learning. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 19-22, Hong Kong, China, February 2011.
  • Ripon Saha, Matthew Lease, Sarfraz Khurshid, and Dewayne Perry. Improving Bug Localization using Structured Information Retrieval. In Proceedings of the 28th IEEE/ACM International Conference on Automated Software Engineering (ASE), 2013.
  • Elben Shira and Matthew Lease. Expert Search on Code Repositories. Technical Report TR-11-42, Department of Computer Science, University of Texas at Austin, December 2011.
  • Shilpa Shukla, Matthew Lease, and Ambuj Tewari. Parallelizing ListNet Training using Spark. In Proceedings of the 35th international ACM SIGIR conference on Research and Development in Information Retrieval, 2012.
  • Aibo Tian and Matthew Lease. Active Learning to Maximize Accuracy vs. Effort in Interactive Information Retrieval. In Proceedings of the 34th international ACM SIGIR conference on Research and Development in Information Retrieval, pages 145-154, 2011.
  • Yongyi Zhou, Ramona Broussard, and Matthew Lease. Mobile options for online public access catalogs. In Proceedings of the iConference, pages 598-605. ACM, 2011.

Looking for a funded Research Assistant (RA) position? I typically do not offer RA positions until a student has taken a course with me and demonstrated their abilities and drive to succeed. While the availability of an RA position depends on available funding, I am often looking for new RAs to help me build the next generation of search engines.

Course project resources


Overview

In an Information Age promising instant access to seemingly limitless digital information, search has become the dominant paradigm for enabling information access.

Creating an effective search engine, however, requires addressing many important challenges:

  • Characterizing the nature of search relevance (both topical and user-oriented)
  • Defining operational models for ranking based on relevance
  • Developing search algorithms which are accurate, scalable, and efficient
  • Designing interfaces, interaction mechanisms, and graphical visualizations providing an engaging and user-friendly search experience (human-computer interaction and visualization)
  • Understanding trade-offs between system-oriented and user-oriented methods for search evaluation
Information Retrieval (IR) studies both human information needs and the systems built to meet those needs. As such, IR has lain squarely at the intersection of Information Science and Computer Science since its inception. IR studies methods for capturing, representing, storing, organizing, and retrieving unstructured or loosely structured digital information, as well as designing interface, interaction, and visualization methods for creating an effective and compelling search experience. While digital information was once restricted to electronic documents, today's landscape of digital content is incredibly rich and diverse, including Web pages, news articles, books, transcribed speech, email, blogs (and micro-blogs), images, and video. The rise of the Web as a massive, global repository and distribution network has earned Web search engines and other Web technologies particular importance in organizing and finding information today.

The course will culminate in an end-of-semester paper and presentation of the final course project to disseminate and showcase the work. Meta-ideas for course projects

  • Term paper: write a survey on state-of-the-art practice in a specialized area of IR (review and synthesis of published scientific literature)
  • Algorithm: implement and evaluate a new search algorithm
  • Analysis: Present a novel analysis of one or more existing IR systems
  • User-centered evaluation: evaluate IR system effectiveness via user-oriented qualitative and/or quantitative methods (e.g. interactive IR, task-completion accuracy and/or times, usability issues, affective perceptions, etc.)
  • Human-computer interaction: design a new search interface, implement/mock-up, and evaluate
  • Visualization: design a new graphical visualization method for conveying search results or managing information overload
  • Crowdsourced evaluation: explore crowdsourcing methods for informing or evaluating search engines
  • Mobile IR: Develop a mobile IR application using our pool of Google Android phones
  • Develop an interesting IR application using our pool of GoogleTV devices


Related courses: UT Austin
  • Undergraduate: CS 371R: Information Retrieval and Web Search
  • Graduate: EE380L: Data mining

Related courses: other universities

Reference Textbooks

[1] R. Baeza-yates and B. Ribeiro-Neto. Modern Information Retrieval (2nd ed.). 2011. Four chapters available online. [ http ]
[1] R. Baeza-yates and B. Ribeiro-Neto. Modern Information Retrieval (1st ed.). 1999. Two chapters available online. [ http ]
[2] Stefan Buttcher, Charles L. A. Clarke, and Gordon V. Cormack. Information Retrieval: Implementing and Evaluating Search Engines. MIT Press, 2010. Five chapters available online. [ http ]
[3] H. Chu. Information representation and retrieval in the digital age, volume 2. Information Today, Inc., 2010. First chapter available online. [ .pdf ]
[4] B. Croft, D. Metzler, and T. Strohman. Search Engines: Information Retrieval in Practice. Addison-Wesley Publishing Company, USA, 2009. Two chapters available online. [ http ]
[5] Marti Hearst. Search User Interfaces. Cambridge Univ Press, 2009. HTML chapters. [ http ]
[6] C.D. Manning, P. Raghavan, and H. Schutze. Introduction to information retrieval. Cambridge Univ Press, 2008. HTML and PDF chapters. [ .html ]
[7] CJ Van Rijsbergen. Information retrieval, volume 2. Butterworths, London, 1979. HTML and PDF chapters. [ .html ]

Other References

[1] A. Moffat, J. Zobel, and D. Hawking. Recommended reading for IR research students. In ACM SIGIR Forum, volume 39, pages 3-14. ACM New York, NY, USA, 2005. [ .pdf ]