The weird bit about the census is the idea of requiring everyone to go back to 'the lands of their ancestors' to be surveyed - hence Joseph having to drag his pregnant wife all the way to Bethlehem because he was 'of the line of David'. That just doesn't make any sense - it would be like insisting that anyone with, say, the surname Rochester could only be on the electoral role in that city.