There are a few businesses that are relatively cheap to start up. Some examples include starting a blog, an e-commerce store, or a pet sitting business. The cost of starting a blog can be as low as $3 per month, and an e-commerce store can be set up for around $500. The cost of starting a pet sitting business will depend on the number of pets you plan to care for, but can be fairly low to start.