What is the hardest language to learn?

[Maddolis]

English is up there due to all the little exceptions to rules and all that, however the hardest would probably be one of the hundreds of languages that are dying out with only a thousand odd people speaking it.
Aside from that, I've heard Chinese languages (Mandarin, Cantonese etc) are tough, on top of the different alphabet.