If the bugs look they have armor, curl when touched and don;t move real fast like centipedes, you probably have "Millipedes" They may have already been in the soil when you bought the plant, or a few somehow got into your house. They like to eat moist decaying material, sometimes roots and seedlings as well. Without proper moisture, they eventually die, so will the plant if it's left to stay dry for too long.

If you don't want to use chemicals, you can dump out all the soil outside and re-pot with all new soil, or, again, outdoors, keep watering the plants soil until it over-flows over the sides of the pot, the bugs should rise up to the surface with the water and spill out, you might have to do that more than once to get them all out.