It sounds like it will be more painful than it probably will be. The local bank, while somewhat comical from a modern lender perspective, was an absolute dream to deal with. They approved our mortgage in 24 hours, they had local contacts and knew the appraisers, knew the excavator and well guy we used, and because of the location, they were fully aware of the difference between a typical doublewide and a really well made modular. Everything was easy, friendly and completely devoid of political or bureaucratic poo. We cringed at the thought of a po dunk bank but it turned out to be the best part of the whole process.
Good luck.