In order to enhance the power capacity, an improved Ku-band magnetically insulated transmission line oscillator(MILO) with overmoded slow-wave-structure(SWS) is proposed and investigated numerically and experimentally. The analysis of the dispersion relationship and the resonant curve of the cold test indicate that the device can operate at the near π mode of the TM01 mode, which is useful for mode selection and control. In the particle simulation, the improved Ku-band MILO generates a microwave with a power of 1.5 GW and a frequency of 12.3 GHz under an input voltage of480 k V and input current of 42 k A. Finally, experimental investigation of the improved Ku-band MILO is carried out. A high-power microwave(HPM) with an average power of 800 MW, a frequency of 12.35 GHz, and pulse width of 35 ns is generated under a diode voltage of 500 k V and beam current of 43 k A. The consistency between the experimental and simulated far-field radiation pattern confirms that the operating mode of the improved Ku-band MILO is well controlled inπ mode of the TM01 mode.