St Kilda is close to your city just like many of Manly and Bondi, has an vibrant party all night atmosphere.
Kilda while popular areas aren't really a budget food havens that they used to be able to.