There are many components that go into making an AI system in a home-lab system. One major component is Docker. For those who do not know it, this enables running a virtual system within the operating system that is currently running on the hardware. What makes Docker powerful is that it abstracts away most of the hardware components and allows use of resources. Another feature it enables is portability. It is possible to move the docker container (defined as a lightweight, standalone, executable package of software that includes everything needed to run an application) from one machine to another and still execute the application.
There are good instructions for setting this up. One that I found specifically useful was this one.
https://www.digitalocean.com/community/tutorials/how-to-install-and-use-docker-on-ubuntu-22-04
Docker is a wonderful container to many applications and here are some common commands that a user should know:
Common Commands:
run Create and run a new container from an image
exec Execute a command in a running container
ps List containers
build Build an image from a Dockerfile
bake Build from a file
pull Download an image from a registry
push Upload an image to a registry
images List images
login Authenticate to a registry
logout Log out from a registry
search Search Docker Hub for images
version Show the Docker version information
info Display system-wide information
