Below are some of my favorite resources for learning, sharing, and buying.
For small, generic, or bulk parts, like LEDs and sensors, Ebay is often the cheapest option. For larger or more specialized purchases: