Can we cross Sg Golok without go tru imigresen?

I just don't want to get any trouble if my HM knows that I've been there.