Do I need to be physically fit or need much coordination to start?

No. Anyone who has determination can succeed in the martial arts. Physical fitness and improved coordination are just two of the many byproducts achieved during your training.