That's another of the reasons I switched to Gudebrod on the small spools, the size is stamped on the edge of the spool.
Even though I really don't have this problem, "glue stick, varnish, CA, UV resin" are probably the worst choices for gluing a paper label onto plastic.
I concur with Les that a contact cement like Barge should do the trick. I would use their TF (Toluene Free) product that comes in blue packaging over the original stuff in yellow & red packaging.
Good luck!