So... why does the asset manager not have all the assets in it?

You need to setup your additional browse / source directories correctly to make it work.
I’ve written a tutorial about how to do this here: