When I bought my deer tag, the vendor asked me what unit I intended to hunt. Am I limited to that unit?

No. The information on your intended hunt is collected to help Fish and Game in its management. For example, if one particular unit appears to be drawing a mob, the department needs to know that and may want to look at season structures.