Suarez admitted to have used that word at least once -
"Suraez's defence was that he used the word 'negro' only once and that it was when Evra is alleged to have said to him: 'Don't touch me, South American.' Suarez said he had replied: 'Por que, negro,' or 'Why, black?'"
Source:
Luis Suarez evidence 'unreliable' and 'inconsistent: FA release details of race row | Mail Online
It's not one man's word against the other.
That doesn't really tell the full story. You need to read the full 113 page report the FA issued to see it is Suarez's word against Evra. Assuming you have a life though and aren't going to read it now here is the key difference they had to decide upon :
"Do we accept Mr Suarez's evidence that he used the word "negro" only once when he said to Mr Evra "Por que,negro?" ("Why, black?"), which was used in a conc...iliatory and friendly way that is customary in Uruguay? Or, do we accept Mr Evra's evidence that Mr Suarez used the word "negro" five times in the goalmouth when he said to Mr Evra "Porque tu eres negro"("Because you are black"), "No hablo con negros" ("I don't speak with blacks"), and "Dale,negro, negro, negro" ("Okay, blackie, blackie, blackie)?"
Sadly I don't have much of a life and did read the whole report and I cannot believe they have found him guilty. Evra's version of events supposedly occurs on the goal line and there were numerous players around them at the time, including his team mates and Spanish National De Gea, not one of them heard this exchange.
So not only have they taken Evra's word over that of Suarez, they've taken it without any evidence whatsoever, and given Evra's history with this sort of thing you'd have thought they'd at least have tried to be a bit more conciliatory with the punishment.
Interestingly Dirk Kuyt testified that he was 100% certain he heard Suarez say to the ref that he had only booked him because he was black. Again the FA completely discounted this despite the ref admitting he did not hear what Evra said. It really does make you think Liverpool have got a point about the FA having decided which way this was going to go right from the start....