The border stuff is what got him called a fascist, and the Democrats are now running on a platform to the right of this fascism. With support and excuses from the very same liberals who sounded the alarm, both in the US and on here. No more photoshoots and outcry at the cages, now it's all fine.
While the extreme attacks on asylum rights might not be technically fascist, neither are most of the things that get Trump called one. They're things fascists would happily do, along with many others.
Things that liberals considered fascist 4 and 8 years ago are now no longer so, because they want to do it themselves. Now it's the new things their opponents want that is fascist, and that will again change the next election when liberals will want to do some of those things. That's why the accusations will ring hollow for many, irrespective of the accuracy.