Interesting space you are working in. You may have thought through some of these questions already but firstly you need to ensure you have a good understanding of the following:
1. who you target customer is
2. what problem you are solving for them
3. what value you can offer them compared to alternatives
Are you looking for a bank to partner with? Or a bank that you can run your companies finances through? Most Kiwi banks will offer this provided you are incorporated and have your business number etc.