I like this girl at work but I barely talk to her enough to be her friend. We have had small talks but just simple convos. My question is, would be okay if I ask her if she would like to hang out with me anytime she is available? Is it wrong or what?
That's how it's done,meathead.
The next time you're chatting, close with something like "It's fun talking with you but we have to get back to work. Would you like to get a drink/coffee/snack after work so we can talk some more?"