Competency E
Design, query, and evaluate information retrieval systems
Introduction
The rate at which information is becoming available is at an all time high, increasing at a rate never imagined. Currently, the world produces between 1 and 2 Exabytes of unique information per year. The challenge facing information professionals is to assist people to be able to sort through the vast amount of information available and obtain the specific information that they desire and need to enhance their work and personal lives. As a result one of the most important skills that information professionals must acquire is the ability to query information. Most positions in the information field interact with Information Retrieval Systems. Understanding the design, the way it queries, and evaluating Information Retrieval Systems is an essential part of many information professionals’ skill set. If a query is too broad too many results will appear, if the query is too narrow there is a chance you would miss your desired results altogether.
An Information Retrieval System has two functions 1) to deal with various sources of information and 2) satisfy users’ requirements. In response to user queries it must analyze content of sources of information, match those to queries’ specifications, and retrieve those items that are most relevant. Three areas that make up an Information Retrieval System include: the document subsystem, the user subsystem and the searching/retrieval subsystem. In LIBR 202 I was introduced to Information Retrieval Systems from theory to application. An Information Retrieval System stores, maintains, sorts and allows access to information. These systems are a very important aspect of every library environment, from databases to Open Public Access Catalogs. An Open Public Access Catalog is an online database of materials held by a library or group of libraries. They hold and store information about a library’s collections, both digital and physical. They allow users to access information from a library collection, accessing digital full text links and gaining the locations and call numbers to search for physical materials. It also shows bibliographic information for users to find what years of the publication the library has available, full text links, and basic bibliographic information about the item. Information Retrieval Systems not only hold library collections, they store individual user records for charging and discharging, holding and recalling items, and fine capabilities. The library itself can be viewed as one type of Information Retrieval System containing a database that is organized in a way to produce effective access to content.
Design
The library itself can be viewed as one type of Information Retrieval System containing a database that is organized in a way to produce effective access to content. Any Information Retrieval System has at least two parts: a database and a system for retrieval. The design of an Information Retrieval System is very important. Its user interface and they way it queries information determines how powerful and valuable it becomes to the information field. An Information Retrieval System is designed to retrieve documents or information required by the searcher accurately and efficiently. The Information Retrieval System database must be organized in such a manner that the content is easily and quickly accessible. The data in an Information Retrieval System is stored in a series of databases called files. Data is arranged in tables in a series of columns and rows. The design of these files is crucial since the presence or absence of a specific data field or fields will determines what functionality it has. The fields are accessed through application software and each file will have one or more indexes. It is fundamentally important that information professionals understand the inter-relationships to these files to understand and anticipate the capabilities and limitations of an Information Retrieval System. The library itself can be viewed as one type of Information Retrieval System containing a database that is organized in a way to produce effective access to content. Any Information Retrieval System
Query
A query is a form of questioning, in a line of inquiry. An information retrieval process begins when a user enters a query into the system. Queries are formal statements of information needs. User queries are matched against the database information, depending on the application, the data objects retrieved may be, text documents, images, audio, mind maps or videos. Often the documents themselves are not kept or stored directly in the Information Retrieval system, but are instead represented in the system by document surrogates or metadata. Most Information Retrieval Systems compute a numeric score on how well each object in the database match the query, and rank the objects according to this value. The top ranking objects are then shown to the user. This process may then be reiterated if the user wishes to refine the query.
Evaluate
Evaluation studies investigate the degree to which the stated goals and expectations have been reached. Evaluations of Information Retrieval Systems can be done from a managerial and a user-oriented point of view. There are two basic parameters for measuring the performance of a system: effectiveness and efficiency. Evaluating effectiveness is measure by how far the system can retrieve relevant information while withholding non-relevant information. Efficiency can be measured by elements like, response time, user effort and financial expenditure.
Libraries always expect the best possible performance for the least cost, identifying performance and cost as the most important criteria when evaluating Information Retrieval Systems. To evaluate an Information Retrieval System properly they must ask the following questions: Does the system meet user needs and the needs of the community or academic goals? What are the reasons for the failure of the system if it is not meeting user needs? What is the cost effectiveness of the searches made by users themselves versus those made my information professionals? What basic changes are required to improve? Can cost be reduced while maintaining the same level of performance? What would be the possible effect if some new services were introduced or the existing one was discontinued?
Experience
My first piece of evidence is a group project assigned in LIBR 285, Research Methods in Libraries. We evaluated Lane Medical Library's OPAC. The Lane Medical Library serves a diverse group of users who want reliable information in a convenient manner. Research indicates that library professionals must make changes to improve library catalogs to better meet users’ needs. Using a number of qualitative and quantitative evaluation methods, the Lane Medical Library staff studied the usability of the current catalog from the user’s perspective. In LIBR 202 I created a database using inmagicDB software. Using the software I designed a database with records numbers, authors, chapter-article titles, book-journal titles, publication dates, place of publications, abstracts, chapter-volumes, issues, page numbers, precoordinate and postcoordinate fields, a search by any filed. My second piece of evidenceis the user guide that I created to accompany the database that I designed in LIBR 202. It explains how to use the database, the rules that need to be followed and precoordinate and postcoordinate indexes.
Conclusion
Today's information professionals should know about the traditional tools and techniques of Information Retrieval Systems for two reasons: 1) they show the process of the evolution of information retrieve from shelf to web; and 2) many recent developments in information retrieval that we and digital library environments use, have their roots in traditional bibliographic tools and techniques. Understanding how Information Retrieval Systems work allows information professionals to design search strategies and queries to recall the most valuable accurate search results. Knowing this will allow information professionals to build on this fundamental groundwork, and provide essential input to design, inquiry processes and evaluation tools to make Information Retrieval Systems successful in their information environments
Introduction
The rate at which information is becoming available is at an all time high, increasing at a rate never imagined. Currently, the world produces between 1 and 2 Exabytes of unique information per year. The challenge facing information professionals is to assist people to be able to sort through the vast amount of information available and obtain the specific information that they desire and need to enhance their work and personal lives. As a result one of the most important skills that information professionals must acquire is the ability to query information. Most positions in the information field interact with Information Retrieval Systems. Understanding the design, the way it queries, and evaluating Information Retrieval Systems is an essential part of many information professionals’ skill set. If a query is too broad too many results will appear, if the query is too narrow there is a chance you would miss your desired results altogether.
An Information Retrieval System has two functions 1) to deal with various sources of information and 2) satisfy users’ requirements. In response to user queries it must analyze content of sources of information, match those to queries’ specifications, and retrieve those items that are most relevant. Three areas that make up an Information Retrieval System include: the document subsystem, the user subsystem and the searching/retrieval subsystem. In LIBR 202 I was introduced to Information Retrieval Systems from theory to application. An Information Retrieval System stores, maintains, sorts and allows access to information. These systems are a very important aspect of every library environment, from databases to Open Public Access Catalogs. An Open Public Access Catalog is an online database of materials held by a library or group of libraries. They hold and store information about a library’s collections, both digital and physical. They allow users to access information from a library collection, accessing digital full text links and gaining the locations and call numbers to search for physical materials. It also shows bibliographic information for users to find what years of the publication the library has available, full text links, and basic bibliographic information about the item. Information Retrieval Systems not only hold library collections, they store individual user records for charging and discharging, holding and recalling items, and fine capabilities. The library itself can be viewed as one type of Information Retrieval System containing a database that is organized in a way to produce effective access to content.
Design
The library itself can be viewed as one type of Information Retrieval System containing a database that is organized in a way to produce effective access to content. Any Information Retrieval System has at least two parts: a database and a system for retrieval. The design of an Information Retrieval System is very important. Its user interface and they way it queries information determines how powerful and valuable it becomes to the information field. An Information Retrieval System is designed to retrieve documents or information required by the searcher accurately and efficiently. The Information Retrieval System database must be organized in such a manner that the content is easily and quickly accessible. The data in an Information Retrieval System is stored in a series of databases called files. Data is arranged in tables in a series of columns and rows. The design of these files is crucial since the presence or absence of a specific data field or fields will determines what functionality it has. The fields are accessed through application software and each file will have one or more indexes. It is fundamentally important that information professionals understand the inter-relationships to these files to understand and anticipate the capabilities and limitations of an Information Retrieval System. The library itself can be viewed as one type of Information Retrieval System containing a database that is organized in a way to produce effective access to content. Any Information Retrieval System
Query
A query is a form of questioning, in a line of inquiry. An information retrieval process begins when a user enters a query into the system. Queries are formal statements of information needs. User queries are matched against the database information, depending on the application, the data objects retrieved may be, text documents, images, audio, mind maps or videos. Often the documents themselves are not kept or stored directly in the Information Retrieval system, but are instead represented in the system by document surrogates or metadata. Most Information Retrieval Systems compute a numeric score on how well each object in the database match the query, and rank the objects according to this value. The top ranking objects are then shown to the user. This process may then be reiterated if the user wishes to refine the query.
Evaluate
Evaluation studies investigate the degree to which the stated goals and expectations have been reached. Evaluations of Information Retrieval Systems can be done from a managerial and a user-oriented point of view. There are two basic parameters for measuring the performance of a system: effectiveness and efficiency. Evaluating effectiveness is measure by how far the system can retrieve relevant information while withholding non-relevant information. Efficiency can be measured by elements like, response time, user effort and financial expenditure.
Libraries always expect the best possible performance for the least cost, identifying performance and cost as the most important criteria when evaluating Information Retrieval Systems. To evaluate an Information Retrieval System properly they must ask the following questions: Does the system meet user needs and the needs of the community or academic goals? What are the reasons for the failure of the system if it is not meeting user needs? What is the cost effectiveness of the searches made by users themselves versus those made my information professionals? What basic changes are required to improve? Can cost be reduced while maintaining the same level of performance? What would be the possible effect if some new services were introduced or the existing one was discontinued?
Experience
My first piece of evidence is a group project assigned in LIBR 285, Research Methods in Libraries. We evaluated Lane Medical Library's OPAC. The Lane Medical Library serves a diverse group of users who want reliable information in a convenient manner. Research indicates that library professionals must make changes to improve library catalogs to better meet users’ needs. Using a number of qualitative and quantitative evaluation methods, the Lane Medical Library staff studied the usability of the current catalog from the user’s perspective. In LIBR 202 I created a database using inmagicDB software. Using the software I designed a database with records numbers, authors, chapter-article titles, book-journal titles, publication dates, place of publications, abstracts, chapter-volumes, issues, page numbers, precoordinate and postcoordinate fields, a search by any filed. My second piece of evidenceis the user guide that I created to accompany the database that I designed in LIBR 202. It explains how to use the database, the rules that need to be followed and precoordinate and postcoordinate indexes.
Conclusion
Today's information professionals should know about the traditional tools and techniques of Information Retrieval Systems for two reasons: 1) they show the process of the evolution of information retrieve from shelf to web; and 2) many recent developments in information retrieval that we and digital library environments use, have their roots in traditional bibliographic tools and techniques. Understanding how Information Retrieval Systems work allows information professionals to design search strategies and queries to recall the most valuable accurate search results. Knowing this will allow information professionals to build on this fundamental groundwork, and provide essential input to design, inquiry processes and evaluation tools to make Information Retrieval Systems successful in their information environments
Evidence Summary and Artifacts
#1 LIBR 285 OPAC Evaluation
Lane Medical Library OPAC: User-friendly or User-foe? Team IR System evaluation.The Lane Management Committee analyzed the data and is still making recommendations for improving the usability of the Lane library catalog.
Lane Medical Library OPAC: User-friendly or User-foe? Team IR System evaluation.The Lane Management Committee analyzed the data and is still making recommendations for improving the usability of the Lane library catalog.
team2_assign1_serviceeval_lane_opac.docx | |
File Size: | 396 kb |
File Type: | docx |
#2 LIBR 202 The user guide for my database
The purpose of my datastruture is to retrieve article information that were assigned as supplemental reading for LIBR 202. Each record has a number, author, chapter-article title, book-journal title, publication date, place of publication, abstract, chapter-volume, issue, page number, precoordinate and postcoordinate fields, you may search by any filed. Searching any of these fields will allow you to find articles pertaining to the subject matter you would like to retrieve. There are pre-set validation rules for searching from the precoordinate or postcoordinate fields.
The purpose of my datastruture is to retrieve article information that were assigned as supplemental reading for LIBR 202. Each record has a number, author, chapter-article title, book-journal title, publication date, place of publication, abstract, chapter-volume, issue, page number, precoordinate and postcoordinate fields, you may search by any filed. Searching any of these fields will allow you to find articles pertaining to the subject matter you would like to retrieve. There are pre-set validation rules for searching from the precoordinate or postcoordinate fields.
meaney_shannon_userguide_for_database.rtf | |
File Size: | 56 kb |
File Type: | rtf |
References
Chowdhury, G. (2004). Introduction to Modern Information Retrieval. London: Facet.