When I studied Hungarian, my impression was that it is more consistent relative to other languages - things like the noun cases and vowel harmony seem complex at first, but are really straightforward to use once you grok them. English, on the other hand, is more of an analytic language, so you have to rely more on chaining together phrasal patterns that "just sound right" and there are very few consistent rules. So I think a lot of the perceived difficulty of learning Hungarian is really the difficulty of unlearning the ambiguity and inconsistency you might be used to in English or a similar language.