how can such a ballot be called 'secret'?

For the reasons you gave. There's a compromise between keeping the vote secret and preventing cheating by the people running the election. With a totally secret ballot it could be easy to fix the result.