Distributed computing involves connecting multiple computers through a network to function as a single system. The computers can be physically close together or geographically distant. This approach provides scalability, allowing additional machines to be easily added as needed, as well as redundancy in case one machine fails since other similar machines can take over its functions.