Malo,
This is an excellent point. Yes, indeed, the proxy could establish one TCP connection to the origin web server and "route" HTTP requests from multiple web clients through that single TCP connection. That would have been an even better solution (though it was not expected from the students to think of it).
Indeed, a server typically closes a TCP connection to a client after a timeout.