** Test Accuracy: 0.578571428571429 DiffSum: 0 Thresh: 0.6 ** *************************** Id: 2161 Correct:RIGHT Value: FALSE Text: city official fire the captain of the crashed staten_island ferry . Hyp: staten_island ferry captain have refuse to talk with investigator . Map ----------- captain-3 => captain-5 (Word Cost: 0 Reln Cost: 0.25) ferry-2 => ferry-10 (Word Cost: 0 Reln Cost: 0) have-4 => fire-3 (Word Cost: 0.8 Reln Cost: 0) investigator-9 => official-2 (Word Cost: 0.8 Reln Cost: 0) refuse-5 => No Match! staten_island-1 => staten_island-9 (Word Cost: 0 Reln Cost: 0) talk-7 => No Match! to-6 => No Match! WordCost: 0.587878787878788 RelationCost: 0.75 Function: Graph Match Cost: 0.652727272727273 Final Cost: 0.652727272727273 Thresh: 0.6 *************************** Id: 702 Correct:RIGHT Value: TRUE Text: budapest again become the focus of national political drama in the late 1980 , when hungary lead the reform_movement in eastern europe that break the communist monopoly on political power and usher in the possibility of multiparty politics . Hyp: in the late 1980 budapest become the center of the reform_movement . Map ----------- 1980-4 => 1980-13 (Word Cost: 0 Reln Cost: 0) become-6 => become-3 (Word Cost: 0 Reln Cost: 0) budapest-5 => budapest-1 (Word Cost: 0 Reln Cost: 0) center-8 => focus-5 (Word Cost: 0.4 Reln Cost: 1) late-3 => late-12 (Word Cost: 0 Reln Cost: 0) reform_movement-11 => reform_movement-19 (Word Cost: 0 Reln Cost: 0) WordCost: 0.064 RelationCost: 0.0909090909090909 Function: Graph Match Cost: 0.0747636363636364 Final Cost: 0.0747636363636364 Thresh: 0.6 *************************** Id: 2166 Correct:RIGHT Value: FALSE Text: in wednesday 's filing , google say it plan to complete the ipo `` as soon as practicable . '' Hyp: it be unclear whether wednesday 's twist will affect the timing of google 's initial_public_offering . Map ----------- affect-9 => complete-11 (Word Cost: 0.8 Reln Cost: 1) be-2 => plan-9 (Word Cost: 0.8 Reln Cost: 0.25) google-13 => google-6 (Word Cost: 0 Reln Cost: 0) initial_public_offering-15 => ipo-13 (Word Cost: 0.4 Reln Cost: 1) it-1 => it-8 (Word Cost: 0 Reln Cost: 0) timing-11 => filing-4 (Word Cost: 0.8 Reln Cost: 1) twist-7 => No Match! unclear-3 => No Match! wednesday-5 => wednesday-2 (Word Cost: 0 Reln Cost: 0) will-8 => No Match! WordCost: 0.518518518518518 RelationCost: 0.785714285714286 Function: Graph Match Cost: 0.625396825396825 Final Cost: 0.625396825396825 Thresh: 0.6 *************************** Id: 2174 Correct:RIGHT Value: FALSE Text: al jazeera broadcast to million of arab viewer from headquarters in doha , qatar . Hyp: al jazeera have occasionally run into problem with authority in other arab country . Map ----------- al-1 => al-1 (Word Cost: 0 Reln Cost: 0) arab-12 => arab-7 (Word Cost: 0 Reln Cost: 0) authority-9 => headquarters-10 (Word Cost: 0.8 Reln Cost: 0.5) country-13 => doha-12 (Word Cost: 0.8 Reln Cost: 1) have-3 => broadcast-3 (Word Cost: 0.8 Reln Cost: 0) jazeera-2 => jazeera-2 (Word Cost: 0 Reln Cost: 0.571428571428571) occasionally-4 => No Match! other-11 => No Match! problem-7 => No Match! run-5 => No Match! WordCost: 0.674285714285714 RelationCost: 0.846153846153846 Function: Graph Match Cost: 0.743032967032967 Final Cost: 0.743032967032967 Thresh: 0.6 *************************** Id: 818 Correct:RIGHT Value: TRUE Text: the new study refute earlier finding by researcher at the university of california , los_angeles , who conclude that the odds of get head and neck cancer rise in tandem with the frequency and duration of marijuana use . Hyp: the latest finding contradict a california study that implicate regular pot smoking as have markedly higher risk for head and neck cancer . Map ----------- california-6 => california-13 (Word Cost: 0 Reln Cost: 0) cancer-22 => cancer-27 (Word Cost: 0 Reln Cost: 1) contradict-4 => refute-4 (Word Cost: 0.4 Reln Cost: 0) finding-3 => finding-6 (Word Cost: 0 Reln Cost: 0.666666666666667) have-14 => get-23 (Word Cost: 0.4 Reln Cost: 0) head-19 => head-24 (Word Cost: 0 Reln Cost: 0) higher-16 => No Match! implicate-9 => rise-28 (Word Cost: 0.8 Reln Cost: 0.666666666666667) latest-2 => earlier-5 (Word Cost: 0.4 Reln Cost: 0) markedly-15 => No Match! neck-21 => neck-26 (Word Cost: 0 Reln Cost: 0) pot-11 => duration-35 (Word Cost: 0.8 Reln Cost: 0) regular-10 => No Match! risk-17 => conclude-18 (Word Cost: 0.8 Reln Cost: 0.714285714285714) smoking-12 => use-38 (Word Cost: 0.8 Reln Cost: 1) study-7 => study-3 (Word Cost: 0 Reln Cost: 1) that-8 => No Match! WordCost: 0.385964912280702 RelationCost: 0.702127659574468 Function: Graph Match Cost: 0.512430011198208 Final Cost: 0.512430011198208 Thresh: 0.6 *************************** Id: 820 Correct:RIGHT Value: TRUE Text: kessler 's team conduct 60,643 face to face interview with adult in 14 country . Hyp: kessler 's team interview more_than 60,000 adult in 14 country . Map ----------- 14-9 => 14-13 (Word Cost: 0 Reln Cost: 0) 60 => 60 (Word Cost: 0 Reln Cost: 0) adult-7 => adult-11 (Word Cost: 0 Reln Cost: 1) country-10 => country-14 (Word Cost: 0 Reln Cost: 0) interview-4 => interview-9 (Word Cost: 0 Reln Cost: 1) kessler-1 => kessler-1 (Word Cost: 0 Reln Cost: 0) more_than-5 => No Match! team-3 => team-3 (Word Cost: 0 Reln Cost: 0.8) WordCost: 0.037037037037037 RelationCost: 0.821428571428571 Function: Graph Match Cost: 0.350793650793651 Final Cost: 0.350793650793651 Thresh: 0.6 *************************** Id: 806 Correct:RIGHT Value: TRUE Text: investigators describe the gunman as white , about 30 year old , of medium build with shoulder length , wavy blond hair and as have a `` scruffy '' or `` grunge '' appearance . Hyp: the gunman be describe as a white male in his 30 with a medium build , shoulder length blonde hair and an unkempt appearance . Map ----------- 30-11 => 30-9 (Word Cost: 0 Reln Cost: 1) appearance-24 => appearance-34 (Word Cost: 0 Reln Cost: 1) be-3 => have-25 (Word Cost: 0.8 Reln Cost: 0) blonde-19 => blond-21 (Word Cost: 0.2 Reln Cost: 0) build-15 => build-15 (Word Cost: 0 Reln Cost: 0.666666666666667) describe-4 => describe-2 (Word Cost: 0 Reln Cost: 0.5) gunman-2 => gunman-4 (Word Cost: 0 Reln Cost: 0) hair-20 => hair-22 (Word Cost: 0 Reln Cost: 0.5) his-10 => No Match! length-18 => length-18 (Word Cost: 0 Reln Cost: 0) male-8 => investigators-1 (Word Cost: 0.8 Reln Cost: 1) medium-14 => medium-14 (Word Cost: 0 Reln Cost: 0) shoulder-17 => shoulder-17 (Word Cost: 0 Reln Cost: 0) unkempt-23 => No Match! white-7 => white-6 (Word Cost: 0 Reln Cost: 0) WordCost: 0.1125 RelationCost: 0.606060606060606 Function: Graph Match Cost: 0.309924242424242 Final Cost: 0.309924242424242 Thresh: 0.6 *************************** Id: 823 Correct:RIGHT Value: TRUE Text: the body of satomi mitarai be find by a teacher after she attacker return to class in bloody clothes . Hyp: mitarai 's body be find by a teacher after she killer return to their classroom cover in blood . Map ----------- be-4 => be-6 (Word Cost: 0 Reln Cost: 0) blood-18 => bloody-18 (Word Cost: 0.2 Reln Cost: 0) body-3 => body-2 (Word Cost: 0 Reln Cost: 0) classroom-15 => class-16 (Word Cost: 0.2 Reln Cost: 1) cover-16 => No Match! find-5 => find-7 (Word Cost: 0 Reln Cost: 0) killer-11 => attacker-13 (Word Cost: 0.8 Reln Cost: 0) mitarai-1 => mitarai-5 (Word Cost: 0 Reln Cost: 0) return-12 => return-14 (Word Cost: 0 Reln Cost: 0) she-10 => she-12 (Word Cost: 0 Reln Cost: 0) teacher-8 => teacher-10 (Word Cost: 0 Reln Cost: 0) their-14 => No Match! WordCost: 0.233333333333333 RelationCost: 0.2 Function: Graph Match Cost: 0.22 Final Cost: 0.22 Thresh: 0.6 *************************** Id: 2147 Correct:RIGHT Value: FALSE Text: witnesses tell police a gas canister explode to start the fire in a multilevel building which house the ycua bolanos supermarket , a food court and a parking garage , cause the bottom floor to collapse . Hyp: television footage show several level of the multi level supermarket cover in soot , include the lower level parking garage . Map ----------- cover-11 => cause-31 (Word Cost: 0.8 Reln Cost: 1) footage-2 => No Match! garage-20 => garage-29 (Word Cost: 0 Reln Cost: 0.625) include-15 => explode-7 (Word Cost: 0.8 Reln Cost: 0.5) level-18 => floor-34 (Word Cost: 0.4 Reln Cost: 0) level-5 => collapse-36 (Word Cost: 0.8 Reln Cost: 1) level-9 => canister-6 (Word Cost: 0.8 Reln Cost: 0) lower-17 => bottom-33 (Word Cost: 0.4 Reln Cost: 0) multi-8 => multilevel-14 (Word Cost: 0.2 Reln Cost: 0) parking-19 => parking-28 (Word Cost: 0 Reln Cost: 0) several-4 => No Match! show-3 => tell-2 (Word Cost: 0.4 Reln Cost: 0.75) soot-13 => building-15 (Word Cost: 0.8 Reln Cost: 0) supermarket-10 => supermarket-21 (Word Cost: 0 Reln Cost: 1) television-1 => No Match! WordCost: 0.552727272727273 RelationCost: 0.85 Function: Graph Match Cost: 0.671636363636364 Final Cost: 0.671636363636364 Thresh: 0.6 *************************** Id: 2156 Correct:RIGHT Value: FALSE Text: gross_domestic_product , a measure of total output within the nation 's border , climb at a 3 % annual pace in the april june period . Hyp: annual rate increase of 3 % in second quarter much lower than forecast . LSA Matched: lower pace Map ----------- %-6 => %-18 (Word Cost: 0 Reln Cost: 0.4) 3-5 => 3-17 (Word Cost: 0 Reln Cost: 0) annual-1 => annual-19 (Word Cost: 0 Reln Cost: 0) forecast-13 => border-12 (Word Cost: 0.8 Reln Cost: 0) increase-3 => nation-10 (Word Cost: 0.8 Reln Cost: 1) lower-11 => pace-20 (Word Cost: 0.9 Reln Cost: 1) much-10 => No Match! quarter-9 => april-23 (Word Cost: 0.8 Reln Cost: 1) rate-2 => measure-4 (Word Cost: 0.4 Reln Cost: 0) second-8 => total-6 (Word Cost: 0.8 Reln Cost: 0) WordCost: 0.589655172413793 RelationCost: 0.857142857142857 Function: Graph Match Cost: 0.696650246305419 Final Cost: 0.696650246305419 Thresh: 0.6 *************************** Id: 1989 Correct:WRONG Value: FALSE Text: intel have decide to push_back the launch date for its 4 ghz pentium 4 desktop processor to the first_quarter of 2005 . Hyp: intel would raise the clock speed of the company 's flagship pentium 4 processor to 4 ghz . Map ----------- 4-13 => 4-11 (Word Cost: 0 Reln Cost: 0) 4-16 => 4-14 (Word Cost: 0 Reln Cost: 0) clock-5 => No Match! company-9 => date-8 (Word Cost: 0.8 Reln Cost: 0) flagship-11 => No Match! ghz-17 => ghz-12 (Word Cost: 0 Reln Cost: 1) intel-1 => intel-1 (Word Cost: 0 Reln Cost: 1) pentium-12 => pentium-13 (Word Cost: 0 Reln Cost: 0) processor-14 => processor-16 (Word Cost: 0 Reln Cost: 0.285714285714286) raise-3 => decide-3 (Word Cost: 0.8 Reln Cost: 0.4) speed-6 => launch-7 (Word Cost: 0.8 Reln Cost: 1) would-2 => No Match! WordCost: 0.47 RelationCost: 0.555555555555556 Function: Graph Match Cost: 0.504222222222222 Final Cost: 0.504222222222222 Thresh: 0.6 *************************** Id: 829 Correct:RIGHT Value: TRUE Text: the last australian to win miss universe be perth 's kerry anne wells in 1972 . Hyp: not since 1972 have an australian woman be name miss universe . Map ----------- 1972-3 => 1972-15 (Word Cost: 0 Reln Cost: 0) australian-6 => australian-3 (Word Cost: 0 Reln Cost: 0) be-8 => be-8 (Word Cost: 0 Reln Cost: 0) have-4 => No Match! miss-10 => miss-6 (Word Cost: 0 Reln Cost: 0) name-9 => win-5 (Word Cost: 0.8 Reln Cost: 0.333333333333333) not-1 => No Match! universe-11 => universe-7 (Word Cost: 0 Reln Cost: 0) woman-7 => wells-13 (Word Cost: 0.8 Reln Cost: 1) WordCost: 0.57037037037037 RelationCost: 0.631578947368421 Function: Graph Match Cost: 0.594853801169591 Final Cost: 0.594853801169591 Thresh: 0.6 *************************** Id: 723 Correct:WRONG Value: FALSE Text: the_city continue to grow through much of the 20th century . Hyp: the_city continue to grow , but its service deteriorate . Map ----------- but-6 => No Match! continue-2 => continue-2 (Word Cost: 0 Reln Cost: 0.4) deteriorate-9 => No Match! grow-4 => grow-4 (Word Cost: 0 Reln Cost: 0) its-7 => No Match! service-8 => No Match! the_city-1 => the_city-1 (Word Cost: 0 Reln Cost: 0) to-3 => to-3 (Word Cost: 0 Reln Cost: 0) WordCost: 0.37037037037037 RelationCost: 0.555555555555556 Function: Graph Match Cost: 0.444444444444444 Final Cost: 0.444444444444444 Thresh: 0.6 *************************** Id: 693 Correct:RIGHT Value: TRUE Text: this growth prove short live , for a swedish invasion -lrb- 1655 56 -rrb- devastate the flourishing city of warsaw . Hyp: warsaw be invade by the swedes in 1655 , and the_city be devastate . Map ----------- 1655-8 => 1655-12 (Word Cost: 0 Reln Cost: 0) be-12 => prove-3 (Word Cost: 0.8 Reln Cost: 0) be-2 => live-5 (Word Cost: 0.4 Reln Cost: 0) by-4 => No Match! devastate-13 => devastate-15 (Word Cost: 0 Reln Cost: 0.333333333333333) invade-3 => invasion-10 (Word Cost: 0.4 Reln Cost: 0.8) swedes-6 => No Match! the_city-11 => city-18 (Word Cost: 0.8 Reln Cost: 0) warsaw-1 => warsaw-20 (Word Cost: 0 Reln Cost: 0) WordCost: 0.438461538461538 RelationCost: 0.7 Function: Graph Match Cost: 0.543076923076923 Final Cost: 0.543076923076923 Thresh: 0.6 *************************** Id: 826 Correct:RIGHT Value: TRUE Text: a car_bomb explode outside a u.s. military base near baji . Hyp: a car_bomb explode outside a u.s. military base near beiji . Map ----------- base-8 => base-8 (Word Cost: 0 Reln Cost: 0) beiji-10 => No Match! car_bomb-2 => car_bomb-2 (Word Cost: 0 Reln Cost: 0) explode-3 => explode-3 (Word Cost: 0 Reln Cost: 0.25) military-7 => military-7 (Word Cost: 0 Reln Cost: 0) u.s.-6 => u.s.-6 (Word Cost: 0 Reln Cost: 0) WordCost: 0.16 RelationCost: 0.153846153846154 Function: Graph Match Cost: 0.157538461538462 Final Cost: 0.157538461538462 Thresh: 0.6 *************************** Id: 803 Correct:RIGHT Value: TRUE Text: because of reagan 's economic strategy , the federal budget_deficit balloon . Hyp: reagan 's economic strategy lead to huge federal budget_deficit . Map ----------- budget_deficit-9 => budget_deficit-10 (Word Cost: 0 Reln Cost: 0.5) economic-3 => economic-5 (Word Cost: 0 Reln Cost: 0) federal-8 => federal-9 (Word Cost: 0 Reln Cost: 0) huge-7 => No Match! lead-5 => balloon-11 (Word Cost: 0.8 Reln Cost: 0.25) reagan-1 => reagan-3 (Word Cost: 0 Reln Cost: 0) strategy-4 => strategy-6 (Word Cost: 0 Reln Cost: 0.5) WordCost: 0.321739130434783 RelationCost: 0.4 Function: Graph Match Cost: 0.35304347826087 Final Cost: 0.35304347826087 Thresh: 0.6 *************************** Id: 719 Correct:RIGHT Value: TRUE Text: once call the `` queen of the danube , '' budapest have long be the focal_point of the nation and a lively cultural center . Hyp: budapest be once popularly know as the `` queen of the danube . '' Map ----------- be-2 => be-14 (Word Cost: 0 Reln Cost: 0) budapest-1 => budapest-11 (Word Cost: 0 Reln Cost: 0) danube-12 => danube-8 (Word Cost: 0 Reln Cost: 0) know-5 => have-12 (Word Cost: 0.4 Reln Cost: 1) once-3 => once-1 (Word Cost: 0 Reln Cost: 0) popularly-4 => No Match! queen-9 => queen-5 (Word Cost: 0 Reln Cost: 0) WordCost: 0.190909090909091 RelationCost: 0.875 Function: Graph Match Cost: 0.464545454545455 Final Cost: 0.464545454545455 Thresh: 0.6 *************************** Id: 1806 Correct:RIGHT Value: FALSE Text: vanunu , 49 , be abduct by israeli agent and convict of treason in 1986 after discuss his work as a mid level dimona technician with britain 's sunday times newspaper . Hyp: vanunu 's disclosure in 1968 lead expert to conclude that israel have a stockpile of nuclear_warhead . Hyp Match: expert technician Map ----------- 1968-5 => No Match! conclude-9 => discuss-17 (Word Cost: 0.4 Reln Cost: 1) disclosure-3 => level-23 (Word Cost: 0.8 Reln Cost: 1) expert-7 => technician-25 (Word Cost: 0.5 Reln Cost: 0) have-12 => abduct-6 (Word Cost: 0.8 Reln Cost: 0.5) israel-11 => israeli-8 (Word Cost: 0.2 Reln Cost: 1) lead-6 => be-5 (Word Cost: 0.8 Reln Cost: 1) nuclear_warhead-16 => newspaper-31 (Word Cost: 0.8 Reln Cost: 0) stockpile-14 => agent-9 (Word Cost: 0.8 Reln Cost: 1) to-8 => No Match! vanunu-1 => vanunu-1 (Word Cost: 0 Reln Cost: 0) WordCost: 0.60952380952381 RelationCost: 0.888888888888889 Function: Graph Match Cost: 0.721269841269841 Final Cost: 0.721269841269841 Thresh: 0.6 *****