Because people have done triangle tests and concluded that there's no taste difference, holding texture constant (you can tell the difference between kosher and finishing salt because the latter is flakier).

There's a good essay about this in "The Man Who Ate Everything".