Bob Coyne Visualizing the
meaning of language
Home
Research
Bibliography

I am a PhD student in the Language and Speech Processing Groups in the Department of Computer Science at Columbia University. My advisor is Prof. Julia Hirschberg.

My research area is natural language processing and the automatic depiction of textual descriptions as 3D scenes. In particular, I'm interested in the ways that textual meaning is resolved by context inferred from the functional and physical properties of the background actions, setting, and constituent objects.

I've previously worked on computer graphics and user interface design, developing the paint and 2D animation system at  Symbolics. I was Director of Software Development at Nichimen Graphics, where we developed Mirai (a high-end 3D animation software package) as well as Nendo (a consumer-level polygonal 3D modeler). This software is now owned by Izware. At AT&T Research, Richard Sproat and I created WordsEye, a system for automatically depicting 3D scenes from textual input. We published a paper on WordsEye in the 2001 Siggraph Proceedings.

The gallery for the old version of WordsEye can be browsed at www.wordseye.com/gallery.
The current/research version of WordsEye is running at http://lucky.cs.columbia.edu:2001.
Captives of Time
Input text:  A silver head of time is on the grassy ground. The blossom is next to the head. It is in the ground. The green light is three feet above the blossom. The yellow light is 3 feet above the head. The large wasp is behind the blossom. It wasp is facing the head.