Some more progress, got a WIP UI now and already accounted for both window scaling *and* user driven UI scaling if it's too small (or too big!).
Immediate mode UI (through Paper) is such a breath of fresh air compared to gameobject style UI, I actually enjoying making it.