Ethics scandal ‘a much more serious threat to the Speaker’s power’ than any other time, longtime observer says