BLEU Archives - MultiMedia

BLEU Performance

Nicolae Sfetcu — Mon, 03 Jan 2011 21:18:14 +0000

BLEU has frequently been reported as correlating well with human judgement,[1][2][3] and remains a benchmark for the assessment of any new evaluation metric. There are however a number of criticisms that have been voiced. It has been noted that although … Read More

The post BLEU Performance appeared first on MultiMedia.

BLEU

Nicolae Sfetcu — Fri, 14 May 2010 23:48:56 +0000

BLEU (Bilingual Evaluation Understudy) is an algorithm for evaluating the quality of text which has been machine-translated from one natural language to another. Quality is considered to be the correspondence between a machine’s output and that of a human: “the … Read More

The post BLEU appeared first on MultiMedia.

METEOR

Nicolae Sfetcu — Mon, 16 Nov 2009 12:52:02 +0000

The METEOR metric is designed to address some of the deficiencies inherent in the BLEU metric. The metric is based on the weighted harmonic mean of unigram precision and unigram recall. The metric was designed after research by Lavie (2004) … Read More

The post METEOR appeared first on MultiMedia.

NIST

Nicolae Sfetcu — Tue, 28 Apr 2009 13:51:55 +0000

The NIST metric is based on the BLEU metric, but with some alterations. Where BLEU simply calculates n-gram precision adding equal weight to each one, NIST also calculates how informative a particular n-gram is. That is to say when a … Read More

The post NIST appeared first on MultiMedia.

BLEU

Nicolae Sfetcu — Sun, 29 Mar 2009 23:16:07 +0000

BLEU was one of the first metrics to report high correlation with human judgements of quality. The metric is currently one of the most popular in the field. The central idea behind the metric is that “the closer a machine … Read More

The post BLEU appeared first on MultiMedia.