I know that villagers de-activate to stop lag but, it happens even when they have never touched cobblestone. Please fix this.

Use nametags and tag them. It makes them walk again (and be able to breed, which is a problem that may happen every time the server lags or stops).