Weight lifting gloves don't really help to much. My dad has a bunch of builder's gloves, so I might try those.
And it could be a callus blister thing. It is red around the edges. I usually pick at them a lot, but I can only get them down to a certain point. I have been lifting with them and dealing with it, but they are just annoying. I will definitely look in to the pumice stone, but for now use a razor blade.
And I will definitely need to rethink where I place the bar in my hands.