A lot of people frequently ask me what I am studying at school. Well I am studying Computer Science, and trying to focus my projects on human-computer interaction and advanced user interface design. Part of my research happens to be in a field called augmented reality. I have one video of an application I created last spring (you may want to fast-forward past the setup of fiducials to about 1:30, sorry this is the only video I have right now):

So that’s a simple application. It just lets users grab virtual objects and move or scale them. You do not have to physically interact with virtual objects for the application to be considered augmented reality. AR (the short term) is really just about relating the real and virtual worlds. It is the cross between the two that separates it from virtual reality. Watch out for applications that are coming to iPhone and other mobile devices that incorporate real world video and computer generated graphics (your online profiles might actually become physically attached to you).

You can see my application that I shared here uses fiducial markers to track the position and orientation of different real world objects, but the future is in tracking things without these strange looking pieces of paper. My final project last semester for a class in Augmented Reality with Steve Feiner did not use markers, but rather relied on compass and GPS information from an Android device to render relevant information on a heads-up display presenting possible donor to the Manhattanville project with information (I am looking for the demo video). In addition to these kind of interfaces, I am also interested in computer vision and I am currently working on a project that will be include an immersive interface (using a heads-up display) that uses tracking without these fiducials in a quest to give computers a better understanding of the real world and make our jobsĀ  easier. The tracking will use work done by Georg Klein and the result should be pretty cool. Stay tuned for updates from my research projects and other side projects I find myself getting into.

Written For Friends and For Nerds


First off, what the hell is Web 2.0? For many, Web 2.0 is about the syndication and collaboration. It is also about a migration to the web as a platform for application development. That meant migrating all of the data trapped on everyone’s desktops to the web, allowing your pictures to be shared with friends quickly and easily, or your documents to be saved in the cloud so that you and a bunch of friends could collaborate from the 5 or more different places you are during the day. In my opinion the best part about Web 2.0 was the stunning interfaces it presented. The developers realized they could create all the same eye candy as a desktop application on the web. Most significantly, Web 2.0 is about accessibility and scalability. It is about giving quick and easy access of software to as many people as possible, and on every platform that they may have, be it their computer, mobile device or braille screen. Oh yea, I said all people so that means physically handicapped people must enjoy the same beautiful experience in accessing their data through software as every man with two eyes, ears, and a pair of hands.

Web 2.0 Cloud. CC Markus Angermeier

Web 2.0 Cloud. CC Markus Angermeier

So, how have we done? This is a really tough question to answer, but I am gonna go with a “we’re workin’ on it.” I consider myself a power-user and I would not say I have want I think to be true accessibility to my information. So what exactly do I mean when I say truly accessible data? I mean data that is where you want it, when you want it. This goes further as I take it to include something tailored to me on my particular device. That means that if I want news while I am eating my breakfast, I better get news that includes topics that I like to read or watch on whatever the nearest suitable display is.

What is keeping us from having the news along with our friend’s latest updates (categorized by who you like more of course) next to my bowl of cereal? If you were eating breakfast on a Microsoft Surface, sure we could get you some interesting news over to the side of your bowl of cereal. Problem is that I really cannot afford a Surface of my own (damn economy). Right now, I get my news via my iPhone or my MacBook Pro and a bunch of RSS streams ripped apart by Google Reader. Sure it works, but it is not tailored to me. Sometimes my Facebook does a better job of keeping me in touch with the world. The next generation of web applications will do a better job sorting through this data overload I get from not just my Facebook and Twitter, but all of the RSS feeds that I read.

Fever. Now that is a company with a real Web 2.0 model. A one time fee gets your access to a set of code that allows you to harness the computing power you have to show you the hottest things on the web. The updates and actual installation of the software makes it a little less than ideal for the average Joe, but it remains to be a good example of a next generation web application. I think the next generation will be brining our computers processing powers to the web to enhance our personal experience. I wonder if the Google Chrome OS will actually do just that. Take any multi-player first person shooter game (like Call of Duty) as an example and you will see that each user renders their own experience based on a map of data that is shared through the web. The scary thing is that some of us are sick and scared of the web as a platform for our data. The privacy issues terrify people. I still find it shocking that all our medical records are on paper still. I still wonder how many diseases we could cure with proper sharing of medical information, maybe thats where the cure to cancer is hidden, in the data.

So what really is the next step for the web? Before the web takes another step forward, it is going to need to get the harnesses on its data. People need to always know what parts of their data are visible in the cloud. They really want to know what sensitive data is where, and who has access to a copy of it. The data they want to see should be delivered to them, tailored to fit the needs they are able to express to the machine. The next web is a beautiful looking web taylored to your needs, and it is coming with accessible design and development.

Written For People of the Web