They'll be able to store however many pictograms they can fit onto a clay slab (made using the precious few drops of water rendered from condemned criminals and baked in the reddish light of their bloated and dying sun). After establishing a civilization spanning the galaxy, with sentient computers the size of moons, they grew complacent, and forgot to backup. A hypernova then wiped out most of their civilization, along with all of their technological, and cultural know-how.
A few isolated outposts survived, along with their original homeworld at the edge of the galaxy. The few survivors in this far corner quickly turned to barbarism, and within a few short millenia, the heights and glory of their star-spanning civilization were forgotten and relegated to myth.
Having long ago strip-mined their star system, these few will never again ascend to their halcyon days, and await the inevitable, as their star dims and fades into the night.
But seriously, how can you predict the course of a billion years of existence? Of even our own, let alone that of an alien civilization?