The biggest challenge for future intelligent species, and the reason why I know we're the first technological ones, is that we've mined all of the easily accessible metals and all of the easily accessible fossil fuels. Any intelligence arriving after us is going to have to make a civilization without iron, precious metals, oil, or coal. Unless you get into some sci-fi bio-engineering scenario where they're growing high tech, they're doomed to being stuck in the stone age. It's going to be hard for them to escape the planet, defend it from asteroids, deal with super-volcanoes, build advanced calculating devices... all of the stuff we would already find challenging even with all the resources we have.

Millions of years are not enough to replenish the fossil fuels, and the sun is going to start expanding before enough life lives and dies to produce any useful amount of biomass. Before then, more metals will become accessible, in places, but good luck working it at industrial levels without fossil fuels.

I'm not saying it's impossible, but we've given a severe handicap to advancing beyond a rudimentary agrarian society for any successor species; even if it's our own descendants re-arrising from a post-apocalyptic environmental catastrophe.