Ideas for Google Summer of Code/Weighted transfer rules
< Ideas for Google Summer of Code
Jump to navigation
Jump to search
Revision as of 14:07, 9 February 2015 by Francis Tyers (talk | contribs) (Created page with " ==Example== Transfer rules: {|class=wikitable |- ! ID !! Rule !! Input !! Output |- | 1 || <math>x</math> de <math>y</math> → <math>x</math> <math>y</math> || memoria de...")
Example
Transfer rules:
| ID | Rule | Input | Output |
|---|---|---|---|
| 1 | Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} de Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y} → Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y} | memoria de traducción | translation memory |
| 2 | Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} de Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y} → Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y} 's Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} | la hermana de mi novia | my girlfriend's sister |
| 3 | Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} de Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y} → Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y} | el estado de la cuestión | the state of the art |
Training
- Take a big corpus
- For each sentence:
- Apply transfer rules
- For each possible combination of transfer rules
- Translate the sentence and score on language model
- Each sentence gets a count 1. This count is shared between the transfer rules.
| La canciller se reúne hoy con el presidente de EE UU para limar asperezas y preparar la cumbre del miércoles con Putin. | ||
| 1 1 | The chancellor gathers today with [the U.S. president] for mend fences and prepare [the Wednesday summit] with Putin. | |
| 2 1 | The chancellor gathers today with [the U.S.'s president] for mend fences and prepare [the Wednesday summit] with Putin. | |
| 3 1 | The chancellor gathers today with [the president of the U.S.] for mend fences and prepare [the Wednesday summit] with Putin. | |
| 1 2 | The chancellor gathers today with [the U.S. president] for mend fences and prepare [the Wednesday's summit] with Putin. | |
| 2 2 | The chancellor gathers today with [the U.S.'s president] for mend fences and prepare [the Wednesday's summit] with Putin. | |
| 3 2 | The chancellor gathers today with [the president of the U.S.] for mend fences and prepare [the Wednesday's summit] with Putin. | |
| 1 3 | The chancellor gathers today with [the U.S. president] for mend fences and prepare [the summit of the Wednesday] with Putin. | |
| 2 3 | The chancellor gathers today with [the U.S.'s president] for mend fences and prepare [the summit of the Wednesday] with Putin. | |
| 3 3 | The chancellor gathers today with [the president of the U.S.] for mend fences and prepare [the summit of the Wednesday] with Putin. |