This is funny. I feel this could evolve into a different game based on the number of players: 1 Player = Almost Pong 2 Players = Pong 3 Players = Pong + Almost Pong
3-player pong: two people control the paddle, one person controls the ball — switch off every time a point is scored? sounds like fun!
with no indicators to which player is controlling which object before the ball drops would cause another level of chaos in the fun