just before they kissed there was some sort of fumble over the gun what was that about?

The reason the fumbled with the gun before the Kiss was because as they were giggling like they were drunk Beckett says, "It's not working Castle." and so she reaches for her gun and before she can draw it lâu đài grabs her hand and turns her so he can Kiss her.