@menherahair My current handheld is one of these. It looks like the ones on the left, but they are from a different company. I haven't tried PS1 emulation on it, but it runs N64 games quite well (even though I have to use a separate app to do it instead of the pre-installed front-end). Best part is that they offer a custom Android-fork without the Google spyware.
https://dragonbox.de/en/gaming-systems/anbernic-rg405m-128gb-android-12.html
@menherahair Previously, I had one that ran a GNU+Linux distro with an emulation front-end slapped on top of it. The hardware was more than capable of running 5th gen stuff, but for whatever reason, the software made it next to impossible to run anything 3D, except for the Dreamcast. (PS1 ran fine, but memory cards didn't work for whatever reason) I checked everywhere online and everyone was having the same problems. I don't have these problems with the Android ones. Maybe, emulators are better supported on Android.