<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>UX nerd &#187; multimodal interfaces</title>
	<atom:link href="http://uxnerd.com/tag/multimodal-interfaces/feed/" rel="self" type="application/rss+xml" />
	<link>http://uxnerd.com</link>
	<description></description>
	<lastBuildDate>Thu, 20 May 2010 13:02:21 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.4</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>What we finally worked on</title>
		<link>http://uxnerd.com/2009/06/what-we-finally-worked-on/</link>
		<comments>http://uxnerd.com/2009/06/what-we-finally-worked-on/#comments</comments>
		<pubDate>Fri, 12 Jun 2009 21:50:42 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[my projects]]></category>
		<category><![CDATA[multimodal interfaces]]></category>
		<category><![CDATA[software agents]]></category>

		<guid isPermaLink="false">http://uxnerd.com/?p=577</guid>
		<description><![CDATA[So we (Natasha and me) finally didn&#8217;t work on the GPGP application I posted about. You can&#8217;t always make things that make you proud but you can always make things in a way that makes you proud. So, I guess I reconciled with the world, in a selfish way.
We ended up working in a kind [...]]]></description>
			<content:encoded><![CDATA[<p>So we (<a href="http://usi.tm.tue.nl/pub/people_std.php?gen=15" target="_blank">Natasha</a> and me) finally didn&#8217;t work on <a href="http://uxnerd.com/2009/06/the-great-pacific-garbage-patch-with-edit/" target="_blank">the GPGP application I posted about</a>. You can&#8217;t always make things that make you proud but you can always make things in a way that makes you proud. So, I guess I reconciled with the world, in a selfish way.</p>
<p>We ended up working in a kind of <strong>calendar/to-do/agenda/personal assistant</strong> application that prompts the user to carry out a task in the optimal context in time and space. This application would help the user manage his/her activities. For tasks that have a fixed scheduling, its functionality is limited to providing reminders, exactly as a regular calendar application would. However, for tasks that may be executed freely at any time before a given deadline, it <strong>suggests the best moment to do something</strong> using information about the nature of the task and the user’s preferences, live monitoring of his/her level of busyness, time, location, etc.</p>
<p>Before I explain how it would work, and because I can picture you shaking your head and tightening your lips, let me say something. <a rel="attachment wp-att-580" href="http://uxnerd.com/2009/06/what-we-finally-worked-on/clippo/"><img class="alignright size-medium wp-image-580" title="clippo" src="http://uxnerd.com/wp-content/uploads/2009/06/clippo-300x242.gif" alt="clippo" width="300" height="242" /></a>This idea sounds familiar to you? Yes, to me too&#8230; When talking about applications that are supposed to be smart enough to suggest what you may or may not want to do, <strong>there&#8217;s a very thin line separating awesomness from complete failure</strong>. That&#8217;s what, I think, when you present an idea like this to people, makes people stand in two very distinct camps: either you love it or you hate it. There are few things, in UX, as polarizing as <strong><a href="http://en.wikipedia.org/wiki/Software_agent" target="_blank">agents</a></strong>. I was very sceptical about this idea at first. Then something happened.</p>
<p><span id="more-577"></span></p>
<p><a rel="attachment wp-att-597" href="http://uxnerd.com/2009/06/what-we-finally-worked-on/spice_girls/"><img class="size-full wp-image-597 alignleft" title="spice_girls" src="http://uxnerd.com/wp-content/uploads/2009/06/spice_girls.jpg" alt="spice_girls" width="275" height="145" /></a> I realized I was being guilty of the sin of ninetiness. Was it possible that my Clippy PTSD was blurring my vision? So I tried to shake off the clippiness, and think about it in an objective way. Surely I had seen other (working) examples, but where? I know what I&#8217;m going to say may be controversial and that some people will think that I&#8217;m abusing the definition of agent. But what does actually happen every time you do a search on Google, for example? That&#8217;s no plain text search, and neither is it a text search where results are ordered according to the old version of Page Rank anymore. It&#8217;s been a long time now that Google has been taking global and local search trends, current events, your personal profile, previous search queries, search history and it appears that even <a href="http://googleblog.blogspot.com/search/label/personalization" target="_blank">websites you visit</a> into account when choosing which results to display for your query, they even claim to be able to predict epidemic outbreaks.  <a href="http://en.wikipedia.org/wiki/Software_agent" target="_blank">According to Wikipedia</a> (hey, I&#8217;m not an expert) there are only four essential types of intelligent software agents:</p>
<ul>
<li>Buyer agents or shopping bots</li>
<li>User or personal agents</li>
<li>Monitoring-and-surveillance agents</li>
<li>Data Mining agents</li>
</ul>
<p>If you take a look at the definition for each of them, there&#8217;s no category Google search doesn&#8217;t belong to. So it looks like this is the secret of successful agents: not looking like a paper clip, actually not looking like anything, looking like they&#8217;re not even there. If people like to have their search results tweaked if they still feel that it&#8217;s their keyword choice that brought them about, would people accept to have reminders for tasks that they never actually schedule if the system can faithfully interpret their heart&#8217;s desires? Can it be done? Well, Google does a pretty good job&#8230; so I do think it&#8217;s possible. Will it be done? I don&#8217;t know, not by me, lol. We just had to come up with a new concept that&#8217;d make our(?) lives better, and as much as I came to undertand that this is not such a bad idea, I&#8217;m not in love with the concept either, let&#8217;s just say I find it interesting.</p>
<p><strong>So, how would it work?</strong> The user enters his/her schedule with fixed tasks in the same way as in a normal calendar. Also he/she enters the flexible tasks and some information about them (i.e. deadline, location, duration, sequential constraints, is this task repeating over time). The system uses location information (GPS) to learn about the user’s location, time zone and weather. Locations can be tagged (e.g. office, home, mall). Also, permanent ambient noise monitoring provides information about the current activities and level of busyness of the user (e.g. is he/she maintaining a conversation, typing on the keyboard, walking).<br />
Finally, specific rules entered by the user and machine learning on acceptance or rejection of its suggestions provide the system with the user’s preferences. Users can also manually set states related to mood or desired level of busyness for a certain time period. All these elements are used by the system to suggest the optimal moment to carry out a task based on proximity, weather, mood, availability, etc. This is applicable to management of a daily routine, a weekly schedule and long term planning. Information related to the pending tasks (content feed) and health advice can also help the user make optimal choices about his/her workflow. Finally, casual networking and social commitments are also supported because proximity, availability and coincidence in pending tasks can be monitored.</p>
<p><strong>Advantages, Challenges and Opportunities</strong>: this system has the potential to solve the problem of having to remember to look at a deadline calendar or to-do list because the user will be reminded to complete the tasks. Also, the fact that tasks are suggested in the right context will aid efficiency and avoid procrastination. The cognitive load to determine when to perform the task is switched from the user to the application. However this presents some challenges. Users will still have to manually enter information about their tasks, so the suggestions should be useful enough to justify the trade-off. Also, the application should remain non-invasive. This system also allows sharing schedules for joint tasks, displaying the user’s availability status, and the information about the user’s mood, busyness and daily tasks could potentially be used for other applications or to suggest entertainment for the user’s free time, eventually. The wide array of technical capabilities in a mobile phone provide flexible input and output modes that allow to ease task input and minimize invasiveness, respectively. The possibility to implement a multimodal interface also allows to use the system in different scenarios under different conditions.</p>
]]></content:encoded>
			<wfw:commentRss>http://uxnerd.com/2009/06/what-we-finally-worked-on/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
