Handles in an operating system are references to resources like memory and hardware devices. The working set refers to the total memory required by a process, with private working set being the exclusive memory a process holds, while shared working set can be accessed by other processes to enhance throughput.