Here’s my opinion having worked in the finance industry…
A finance and maths background is definitely useful. However unless you worked on a trading floor there is a bucket load you need to learn regardless.
Take me for example. I worked with big banks but that didn’t mean I had any clue how the markets actually works and what moves stock prices etc.