Fast reciprocating probe system on the HL-2A tokamak is described in detail, which can radially scan the edge plasma within 8cm from outboard midplane. This system consists of the high pressure gas-source, transmission bar, digital grating displacement measurement system and probe head assembly. The plasma parameter profiles measured include electron temperature and density as well as their decay lengths, floating potential, space potential, saturation ion current and particle flux in a discharge with this system. These results are consistent with those from other tokamaks, such as JT-60U, TEXT, HT-7 and so on.