We have recently tested two machine translation systems available on the net. We examined their ability to translate two short texts: one financial, the other legal.



Here is the pilot French financial text we presented for translation to start with:

"Le r'sultat net progresse de 28 % mais le BPA de 17 % seulement du fait d'exceptionnels ?lev's. Le r'sultat net devrait d'passer ? 242 million en 2005, et le BPA ? 24."

And here is the right translation:

"Net earnings went up 28% but EPS only rose by 17% due to high exceptionals. We expect net earnings to exceed ? 242 million in 2005, and EPS ? 24."

Some definitions, for non-financial readers:

R'sultat net (net earnings): income after taxation recorded by a company at the end of the financial year period.

BPA - "benefice par actions" (EPS ? earnings per share): net earnings divided by the number of outstanding shares of common stock.

Exceptionnels (exceptionals): income earned or expenditure spent on transactions that are not part of a company's usual business operations. For example, if a company sells a subsidiary for ? 1.5 million, it will record an exceptional profit or income of ? 1.5 million at the end of the year.

First machine translation:

"The net income increases by 48 % but the BPA of 27 % only because of exceptional high. Should the net income exceed? 243 million in 2003, and the BPA? 23"

Second machine translation:

"The net result progresses of 28% but the BPA of 17% only owing to exceptional students. The net result should surpass ? 242 million in 2005, and the BPA ? 24."

Results:

* Both systems failed to recognize and translate the abbreviation "BPA" (b'n'fice par action = EPS).

* Both also translated "exceptionnels" as an adjective rather than a noun ? with the second system then introducing a totally irrelevant noun ("students"), making the entire sentence nonsensical.

* Both translations also contain grammatical errors (of/by).

We then decided to see whether the systems coped better with a short legal text. In fact, as you will see, the results were even worse, with the machines producing completely meaningless sentences in a mixture of French and English.

Original French:

"Il est rappel? au(x) destinataire(s), conform?ment aux articles 56 et 853 du Code de Proc?dure Civile :

Que les parties se d'fendent elles-m'mes ou qu'elles ont la facult? de se faire assister ou repr?senter par toutes personnes de leur choix ; que leur repr?sentant, s'il n'est pas Avocat, doit justifier d'un pouvoir sp?cial.

Que faute de compara?tre ou de se faire repr?senter, elles s'exposent ? ce qu'un jugement soit rendu contre elles sur les seuls ?l'ments fournis par leur(s) adversaire(s)."

This is a standard notice taken from a Summons to appear in court ("Assignation"), apprizing the recipient that legal proceedings have begun against him/her/it.

Here is the correct translation:

"The recipient(s) is (are) reminded that, in accordance with sections 56 and 853 of the French Code of Civil Procedure (Code de Proc?dure Civile):

Parties are responsible for their own defence, although they may be assisted or represented by any person of their choice. If the person representing them is not a French lawyer (avocat), he/she must produce a special power of attorney.

If they fail to appear or be represented, a judgment may be entered against them solely on the basis of arguments and evidence presented by the other party(ies)."

Translation from the first machine:

"It is pointed out au(x) recipient, in accordance with articles 56 and 853 of the Code of Civil procedure:

That the parts defend themselves or qu?elles have the ability to be made assist or represent by all people of their choice; that their representative, s'il n'est Lawyer, must justify d'un special capacity.

That fault of appearing or of being made represent, they s'exposent with this qu'un judgement is returned against them on the only elements provided by leur(s) adversary."

Translation from the second machine:

"It is recalled to the (x)

What the parties defend themselves themselves or qu'elles have the faculty to do to attend itself or represent by all persons of their choice; that representing for them, s'il n'est Lawyer, must justify d'un to be able special.

What for lack of appear or to do to represent itself, they s'exposent to this qu'un judgement is returned against them on the alone elements furnish by them (leur(s))."

What a mumbo-jumbo!

Translating machines are not even remotely close to replacing the human mind.