Core and roughly chop your apples (no need to peel). Place them in a large pot, at least 5 1/2 quarts. Quarter your orange and add it to the pot.
Add spices: cinnamon, nutmeg and cloves. Add sugar and then pour in enough water to cover your fruit.* Bring the pot to a boil over high heat, then reduce heat to medium heat and lightly boil uncovered for 1 hour.
Reduce heat to medium/low heat, cover, and simmer for another 2 hours. The juice should begin to turn amber in color when it's finished. Add more sugar and hot water to taste. It should be sweet and spicy.
Strain your cider through a fine mesh strainer or through a cheesecloth placed over a regular colander, into a large bowl or punch bowl.
Squeeze to extract as much juice as possible and discard the fruit pulp. Serve hot.