Why?
mpmath internally uses Python's builtin long integers by default, but automatically switches to GMP/MPIR for much faster high-precision arithmetic if gmpy is installed or if mpmath is imported from within Sage.
With gmpy you rely on C libraries. Faster but those are still arbitrary precision computionations.