Yo, Streets of Rogue developer dude here. I get the impression that the issue that you encountered seems to be something that you're familiar with in Unity-based games. If this is a common issue and you have any suggestions based on ways that other developers have handled this, I'd like to hear them.

Feel free to shoot me an email