There are plenty tools like this, plolty dash, justpy, nicegui, lona, reflex, streamlit, just to name a few.
If your app does not involve complicated interactions, streamlit is really easy to pick up.
We also had a great experience with plotly dash for a more complicated application.
nicegui also seems very promising.
The big picture is similar. But ULMfit uses amd-lstm for the language modeling, bert uses masked LM instead. Bert has some other tricks like sentence prediction as well.