manifestation_id original_title title_alternative title_transcription statement_of_responsibility manifestation_identifier creator contributor publisher date_of_publication pub_date year_of_publication publication_place manifestation_created_at manifestation_updated_at carrier_type content_type frequency language isbn issn doi jpno ncid lccn iss_itemno volume_number volume_number_string edition edition_string issue_number issue_number_string serial_number extent start_page end_page dimensions height width depth manifestation_price access_address manifestation_required_role abstract description identifier:unknown identifier:nbn identifier:isbn10 identifier:iss_itemno identifier:online_isbn identifier:print_isbn identifier:print_issn identifier:online_issn identifier:escidoc identifier:nims series_statement_id series_statement_original_title series_statement_title_subseries series_statement_title_subseries_transcription series_statement_title_transcription series_statement_creator series_statement_volume_number series_statement_series_master series_statement_root_manifestation_id series_statement_manifestation_id series_statement_position series_statement_note series_statement_created_at series_statement_updated_at subject:ndlsh subject:unknown subject:bsh classification:ndc8 classification:ndc9 classification:udc item_id item_identifier binding_item_identifier call_number library shelf item_note accepted_at acquired_at item_created_at item_updated_at 105410 An Application of the NTCIR-WEB Raw-data Archive Dataset for User Experiments "" "" "" 2007-05-15 00:00:00 +0900 2007-05-15 2007 2015-12-15 21:30:30 +0900 2025-07-14 15:47:29 +0900 online_resource text unknown English "" "" https://hdl.handle.net/20.500.11932/28303 Guest "This paper presents a simple approach to utilize past test collections as a material for user experiments. We have built a Web-based user interface for NTCIR-5 WEB run results, and conducted a user experiment with 29 subjects to investigate whether performance evaluation metrics of information retrieval systems used in test collections such as TREC and NTCIR comparable to user performance. In this experiment, we selected three types of systems from among systems that participated in NTCIR-5 WEB, and then selected three topics with roughly the same values from among several search topics. The results of the experiment showed no significant differences among these systems and topics in the time for search. While, in general, the user experiment itself have been successfully conducted and shown similar trends with prior study, the approach seems to have some limitations mainly on interactivity and cached page display." "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" "" Evaluation//User experiments//User interface//Rawdata archive//Web information retrieval//Evaluation//User experiments//User interface//Rawdata archive//Web information retrieval//Evaluation//User experiments//User interface//Rawdata archive//Web information retrieval "" "" "" "" 104443 web web 2025-07-14 15:02:31 +0900 2025-07-14 15:47:29 +0900