One of the easiest Orange trees to grow in a container is the Satsuma Orange (Citrus reticulata). It does not need any pruning, is self-fertile and will start bearing fruit from a young age while the tree is still small (see photos!) Also, this type of orange is easy to peel and has no seeds.
The Satsuma Orange tree is native to Japan and will grow to a maximum height of about 2 meters when grown in a container. It can be planted at any time of the year, but Spring is best.
An Orange tree should be planted in a very large container - preferably a half wine barrel or something similar in size. Add stones to the bottom of the container to improve drainage and mix sand with the compost when planting. If you only use compost or potting soil the tree is very likely to fall over in windy conditions, container and all, so mixing in sand helps to keep the tree and it's pot bottom-heavy. (The soil can be acidic or alkaline - both are fine.) Place the container in a relatively sheltered position, as warm, dry winds can dry out the tree, which will cause the leaves and fruit to drop. After planting, don't dig in the pot again, as it will damage the shallow roots. Also ensure that you place the container where it will get a minimum of 6 hours sunshine a day, but preferably 8.
Orange trees flower in Spring and then bear fruit by the end of Autumn, or early Winter. (My oranges normally ripen at the end of May.) Leave the oranges on the tree for a week after they have completely turned orange, as that is when they will have the best flavor.
Satsuma Oranges need to be watered well in Summer, especially when grown in a container. Water your Orange tree as soon as the top 2cm of soil has dried out, but be careful not to overwater. If you need to fertilize, the best time to do so is in March, July or December.