The rest of the 3D shit

Alot of the work has already been done in "virtual realty". You can get headsets which can monitor eye and head movementsand you could use these to remotely control the movements of a pair of cameras.
I'm pretty sure I've seen the focusing of the eyes picked up by measuring changes in the shape of the lens, so the technology is pretty much there to create really cool 3D. But the next problem was how to do this for a million or so viewers at the same time. What got me excited enough to write it down, was that I could see a way to do this.
The answer is to use huge "compound eyes" made up of millions of tiny fibreoptic lenses. These lenses wouldn't have to move, because the movement of the eyes and head could be replicated by switching between lenses in the same "compound eye".
The focusing movements of the eye could be interpreted by "zooming" to an eye placed closer to, or further away from the action. It is possible that viewers could learn eye or head movements which would signal a switch to a "giant's" or "worm's" eye view by changing the distance between the camera lens assigned to them. The technologyn used to make the "compound eyes" is so cheap that you could feasibly have an entire stadium coated with tiny lenses.
I imagine that this would be very exciting to use and it would work for any live event, but I guess sport would be the most popular.
I don't really like sport that much and the best thing I could imagine watching would be a performance of "The Magic Flute" in one of those 18th century style productions which make maximum use of diorama.