Aussie PM rules out early vote amid by-election woe