I did this for a while in college ~20 years ago with the original Mac Mini, it worked pretty well. A little clunky given multiple things to plug in but it was nice to have your entire environment with you locally.