I tend to always fall back to work topics with work people as well. It's just the fact that I have such a unique range of interests that it isn't likely I am going to have a lot of common ground with many of them. That's crazy the idea of having drinks at work. I can't even imagine that working in a public school!
I just don't interact with a single colleague unless pushed to (private school here). I sit in my own little cavern and teach when I gotta teach.
I used to interact and go to dinner etc years back, but I just get so tired of the work talk and never engaged in it. From the beginning of my adult life I can't remember a single time I've taken work outside of work. I'd always move the conversation to something else, like how there are ants with door-heads!
I don't really do too much with work people outside of work either. That will be a small exception this week, but for the most part I keep the two lives separate.