I'd been thinking about how to support inputs that aren't 320x200, and my idea is to crop down or letterbox as needed. For example, a 320x240 input would have the top and bottom 20 lines cut off, while something like KQ6's intro would be centered in a field of 0. By default, that is, so you can specify at the command line that you want to cut the bottom 40 lines, or place the smaller view off-center.
Assuming of course that all inputs are the same size.
But no scaling, holy shit.