My bindings aren't staying the same across view/panel changes. I tried iterating over all views and setting their binding, but no dice.

How can I get my keybindings to persist across view/panel changes?

Bindings aren't really assigned per view, they are assigned per buffer. So what you need to do is add something to the file loading hook that sets the map of every file that gets opened.