That's definitely a valid criticism, and one that can be levelled to a lot of popular theories like string theory (where holographic theory originates from) and quantum loop gravity. It's a short-term problem though, since we're more and more capable of searching for the needed evidence.