User talk:TREC EVAL Programm

TREC_EVAL is a program to evaluate TREC[TREC conference] results using the standard, NIST evaluation procedures. You can download it from TREC conference main page. Most contents in this page can be found from an external website.[TRECEVAL notes]

Installation
Compilation should be reasonably system independent. In most cases, typing "make" in the unpacked directory should work. If the binary should be installed elsewhere, change "Makefile" accordingly.

Usage
The format for the command line is:   trec_eval [-q] [-a] trec_rel_file trec_top_file Where trec_eval is the executable name for the code, -q is a parameter specifying detail for all queries, -a is a parameter specifying summary output only (-a and –q are mutually exclusive), trec_rel_file is the query relevance file, trec_top_file is the results file.

File Format

 * trec_rel_file is the query relevence file. It has the format: query_id iter docno rel delimited by spaces. query_id is the three digit query number(an integer). The iter constant 0, is required but ignored by trec_eval. The docno is string value. The rel boolean value between 0 and 1, indicates whether the document is relevant or not. An exmaple of a line from the query relevance file: 351 0 FR940104-0-00001 1.
 * trec_top_file is the result file from an IR system with format: query_id iter docno rank sim runid delimited by spaces. query_id is the three digit query number(an integer). The iter constant 0, is required but ignored by trec_eval. The sim a float value, stands for similarity. rank is an integer from 0 to 1000, which is required but ignored by the program. runid is a string which gets printed out with the output.  An example of a line from the results file: 351 0 FR940104-0-00001 1 42.38 run-name

An Running Example
The following lists some sample results when you ran trec_eval program in Linux on the test dataset.
 * num_q         all          3
 * num_ret       all          1500
 * num_rel       all          561
 * num_rel_ret   all          131
 * map           all          0.1785
 * gm_ap         all          0.1051
 * R-prec        all          0.2174
 * bpref         all          0.1981
 * recip_rank    all          0.4064
 * num_nonrel_judged_ret     all      607
 * exact_prec    all          0.0873
 * exact_recall  all          0.5997
 * 11-pt_avg     all          0.1947
 * 3-pt_avg      all          0.1894
 * avg_doc_prec  all          0.0862
 * map_at_R      all          0.2948
 * int_map       all          0.1895

December 2010
Welcome to Wikipedia. Everyone is welcome to contribute constructively to the encyclopedia. However, the username you have chosen (TREC EVAL Programm) seems to imply that you are editing on behalf of a group, company or website.

There are two issues with this :
 * 1) It is possible that you have a conflict of interest. In keeping with Wikipedia's neutral point of view policy, you must exercise great caution when editing on topics related to your organization.
 * 2) Your account cannot represent a group of people. You may wish to create a new account with a username that represents only you. Alternatively, you may consider changing your username to avoid giving the impression that your personal account is being used for promotional purposes.

Regardless of whether you change your name or create a new account, you are not exempted from the guideline to avoid editing where you have a conflict of interest. For information on how to contribute to Wikipedia when you have a conflict of interest, please see our frequently asked questions for organizations. Thank you. The Bushranger One ping only 04:43, 11 December 2010 (UTC)

Your account has been blocked indefinitely from editing Wikipedia because it appears to be mainly intended or used for publicity and/or promotional purposes. Please read the following carefully.

Why can't I edit Wikipedia?

Your account's edits and/or username indicate that it is being used on behalf of a company, group, celebrity or other well-known individual, or organization for purposes of promotion and/or publicity. The edits may have violated one or more of our rules on spamming, which include: adding inappropriate external links, posting advertisements, and using Wikipedia for promotion. Wikipedia has many articles on companies, groups, and organizations, but it is considered inappropriate for such groups to use Wikipedia to write about themselves. In addition, usernames like yours are disallowed under our username policy.

Probably not. See WP:FAQ/Organizations for a helpful list of frequently asked questions by people in your position. Also, review the conflict of interest guidance to see the kinds of limitations you would have to obey if you did want to continue editing about your company, group, or organization. If this does not fit in with your goals, then you will not be allowed to edit again. Consider using one of the many websites that allow this instead.
 * Am I allowed to make these edits if I change my username?

You are still welcome to write about something other than your company or organization. If you do intend to make useful contributions on some other topic, you must convince a Wikipedia administrator that you mean it. To that end, please do the following:
 * What can I do now?


 * Add the text on your user talk page.
 * Replace the text "Your proposed new username" with a new username you are willing to use. See Special:Listusers to search for available usernames. Your new username will need to meet our username policy.
 * Replace the text "Your reason here" with your reason to be unblocked. In this reason, you must:
 * Convince us that you understand the reason for your block and that you will not repeat the edits for which you were blocked.
 * Describe in general terms the contributions that you intend to make if you are unblocked.

If you believe this block was made in error, please see how to appeal a block. -- Cirt (talk) 07:22, 14 December 2010 (UTC)