You need to compare the small print of both mortgages.
We did the same thing as you did, approached our bank that had our mortgage and were not happy with the rate so we approached a broker. Broker was able to get a better rate from our bank than we were. We went back to the bank and they wouldn't budge, hopefully you do better. We ended up moving our mortgage to a new fiancial institution.