A typical galaxy has 100 billion stars. There are about 10 billion galaxies in the observable universe. So, there are 1,000,000,000,000,000,000,000 stars. A 2012 analysis put it at 1.6 planets per star. But, due to the fact that there is no universal time (only relative), the farther away something is, the farther back in time you observe it to be (if you were 65 million light-years from Earth, you would see Earth as it was 65 million years ago, when the dinosaurs went extinct). So, lets say that the average is about 1 planet per star (the above analysis was just for the Milky Way), so there are 1,000,000,000,000,000,000,000 stars, 1,000,000,000,000,000,000,000 planets, and 2,000,000,000,000,000,000,000 stars and planets in the universe, or 2.0*10^21 planets and stars in the universe (note that the information here is a little outdated, if you find better statistics, just swap out my numbers for yours and repeat my calculations).

I looked on Google, but their numbers (100 billion stars, 1 billion trillion stars, 10 billion galaxies, 200 billion galaxies, 10^21 planets, 10^24 planets) were contradictory, so I used the numbers that made the most sense.

Also, since the Universe is expanding, we will only be able to reach the Andromeda Galaxy, the nearest sizable galaxy besides our own. By the time the sun expands into a red giant, we will have collided with the Andromeda Galaxy. So, we will only be able to reach at most 200 billion stars (still a lot) and 240 billion planets (most of which are uninhabitable "Hot Jupiters").