The Vaporia district of old Ermoupolis is by far the nicest part of the city, with a line of waterfront properties and superb views across to the harbour.
There is pretty good public transport buses departing a few minutes walk away. Car parking is extremely limited so you may be better off without one...