Subject to Change

Creating Great Products and Services for an Uncertain world

by Adaptive Path | Peter Merholz, Brandon Schauer, David Verba, Todd Wilkens
2008 O'Reilly Media

If you only ever read one book about business, services, design or technology, this is it!



I am not going to give a huge summary of this book because I think you deserve to read it end to end. This book should be read by anyone involved with products or services from the top down. For designers it provides ample knowledge and examples of why qualitative research and understanding our customers can help you create designs that work. Business roles such as product managers and presidents will benefit from knowing that it is about people and not products.

The titles of the chapters in this book set the context and Adaptive path provides customer stories and research to back up all their findings. Another observation I made is that Subject to Change highlighted very similar principles to Robert Hoekman Jr Designing the Obvious.

  • The Experience is the Product
  • Experience as a Strategy
  • New Ways of Understanding People
  • Capturing Complexity, Building Empathy
  • Stop Designing "Products"
  • The Design Competency
  • The Agile Approach
  • An Uncertain World

Buy this book at amazon.ca

Designing the Obvious

A common sense approach to web & mobile application design
by Robert Hoekman Jr
2011 New Riders

I was able to read Designing the Obvious on a short flight from Chicago to Denver. It is a pretty quick read, but a little more wordy than the Steve Krug line of books. However, there are some very practical messages, tips and examples that can be very effective and useful to your own work. Because the book is newer it provides many up to date examples that we as designers have all used and know. I have used this post to highlight some quotes and statements from Hoekman that may be interesting to you. I would like to thank my buddy James for lending it to me. He has probably the most impressive personal design library I have ever seen.

When an application is designed badly, it tells you at every opportunity how bad it is. But when it's good you usually can't explain why its good. You can't put your finger on it but you know it when you see it.

Lead with Why, Follow with What

When you start with What, your present a thing. When you start with Why, you present a belief.
This was the second chapter in this book and perhaps the most important chapter. How many times have we worked on a project or product that was conceived by the engineering department or product management? We start working on these projects where the only specification and requirements provided are technical. When designers start asking questions and visiting customers we find it is not what is required. This chapter explains why its is important to know Why we are building something. Hoekman often asks his customers "why did you start this business?". It is a question that can get to the core values that all product decisions can be made upon. It is all about having a strategy.

Ignore the User, Know the Situation

Your product isn't better from the competition's just because you have crammed more features into it. Your long list of features makes good marketing material, but it also adds up to complicated software that confuses and frustrates users.
The above quote is a reoccurring message from this book, and one of my favourites. I can't even begin to count how many times I have been an accomplice to putting a band aid on new features that are being added in too late. These types of features end up costing the company way too much money, through bugs and user frustration.

Another brutal fact, Hoekman highlights is that the software should not block the user but keep them moving through the experience. Developers often throw dialog messages and widgets that reveal all the fanciness going behind the scenes. These types of messages get between the user and their goals. The users goals are personal and live outside the application.

The founders of 37 Signals didn't Design Basecamp to support who they are, They designed it to support what they were doing.

Hoekman touches on "Self Design" and it is something we all do. He provided examples from 37 Signals and how many of their successes is based on this practices. 37 Signals had internal problems and build many of their products as a solution to their problems. 37 Signals looked at the situation they had with project management. By immersing themselves in their own situation they were able to design a product that solved many of the issues they faced day to day.

Brutal Fact: People Lie... Questionnaires will produce quantifiable data, however it may be false. Hoekman provided an example of a Healthy sandwich being marketed by a fast food chain. When asking customers for market research would they be interested and eat this new sandwich, the overwhelming response was yes. However, the sandwich flopped. No one when asked would you eat this nice new healthy sandwich say "Hell, no - I want the regular greasy sandwich" People often don't do what they think they will do. If you asked, would you eat a over b, they will always choose the healthy choice in a questionnaire, they don't want to feel like an idiot. But that is not what they will do in reality.

Use Cases
Hoekman likes to add UI information into his use cases. He has some valid points, but it goes against all use case knowledge I have ever practiced. He even admits its not normal, however, it helps him visualize the experience better for himself and is an added aid for designers and developers. Sometimes I wear all three hats, so the concept was a little foreign to me. But I could see it having some value and he provides a good example of how he uses this.

Build Only What is Absolutely Necessary

In this chapter, Hoekman diggs back into the concept of What follows Why.
trying to match competing products feature-for-feature is like running through a battleground under cover fire. You can run all you want, but you have to keep shooting to get anywhere. Dishing out cover fire keeps you alive for a few minutes at a time. Long enough to hide. Companies that fight all the time to stay ahead fall into the endless cycle of trying to outdo the enemy.

AMEN.

The message of this chapter I found to be the most crucial for the success of a "good" user experience. Stick to what is truly essential. It goes back to your strategy. If something on the UI isn't relevant to the user completing a task, get rid of it. Only provide information and tools that are essential for the user to complete a task that supports your overall strategy. I look at this as "Cutting the fat". Another important note Hoekman re-enforces is that "nice-to-have" and cool features should be shelved and only focus on the truly essential features.

Support The Users Mental Model

This chapter looks a little deeper into users as "people". To many engineers, this is a foreign concept but if you have ever done a contextual inquiry, you live by it. My favourite section from this chapter was "Are You Sure". Working in software, I have seen and even recommended these erroneous little dialogs. Hoekman provides great insight that these messages make the user feel dumb and do not help them move forward. The proper action should be to complete the task and provide an undo step to go back if it was a mistake.

Turn Beginners into Intermediates, Immediately

This chapter touches on patterns and learning curves. One of the more interesting sections to me was on help. Hoekman illustrates examples and research where Help is really only used by experts. It makes sense when you think about it, Help really only works when you know what you are looking for. I have worked with my own Documentation Department. we have tried to make it more tutorial based, but you still need to know what you are looking for.

Conclusion

Overall I found the first quarter of the book pretty tough to get through. However, I was really engaged during the last 3/4. The remaining of the book provides great examples and good chapters and thinking that can be put to practice. This is a book that belongs in your library. I would recommend picking this one up.

Buy this Book from Amazon.ca


Rocket Surgery Made Easy

Written by Steve Krug
Published 2010
http://www.sensible.com/rocketsurgery/index.html


Steve Krug wrote “Rocket Surgery Made Easy” so it can be easily read on a plane. I did just that on a short flight from Toronto to Chicago. It was such a quick, easy and enjoyable read that I had time to write down a few notes for this post.

Published in 2010, “Rocket Surgery Made Easy” is a good follow up to “Don’t Make Me Think” written by Krug about 10 years earlier. This book is a great read for anyone involved in interactive design and creating user experiences. Rocket Surgery Made Easy targets how to do effective usability testing, debunking the myths of it being complicated and expensive (Nothing new – Krug admits Jakob Nielson has been doing this from the 80s).

Below are a few notes of what I took away from this book and some of the highlights.

Usability Testing: Watching people trying to use what you’re creating/designing/building (or something already created/designed/built), with the intention of (a) making it easier for people to use or (b) proving that it is easy to use.

Krug's maxims are his core values of what you should remember from this book.
  • A morning a month, that’s all we ask.
  • Start earlier than you think makes sense
  • Recruit loosely and grade on a curve
  • Make it a spectator sport
  •  Focus ruthlessly on small number of the most important problems
  • When fixing problems, always to the least you can do.
Krug defines quantitative usability testing of proving and measuring using data and have as little interaction with test subjects as possible. His book focuses more on qualitative testing. The purpose isn’t to prove or measure anything but enable you to improve your design. Its very simple yet, very effective and anyone and everyone should participate.

IF you can afford to hire a usability professional to do your testing for you – DO IT.

Test frequently and test often

  • Whether it’s a sketch on a napkin, wireframe or completed design, usability testing can be done.
  • Minimum Test once a month, 3 users and 3 Tests.
    • You can test more but that requires more deliberation, scheduling and planning. Try to get the most value from the least impact/investment. Focus on tweaks.
  • Test other peoples sites/apps – auditing your competitors is a very under-utilized resources.
    • Find out what already works well
    • A good way to wet your feet if getting into new usability

Who do you test with

  • Subject Matter Experts do not make optimal users. Users types are changing constantly. Users with domain knowledge will look for keywords and signs they are familiar with. You can get as good of results testing users without domain knowledge. If someone who knows nothing about a subject can complete a task, odds are, someone with domain knowledge will do it as fast or faster.
  • Recruit Loosely and don’t test the same person twice.

How to conduct testing

  • Steve Krug outlines a simple testing example/method for you to follow and gives some suggestions on how to conduct the tests
  • Some of the core concepts are to keep the tests short, and test areas that you think need testing.
  • The question I hear a lot from other departments is “What do we test”

What to test

  • Often customers who have a monolith of an application ask “what to test” when you have a huge application and have never done any usability testing in the past this can be quite a task.
  • Come up with a list of tasks by what is the most important thing for a user to do on your site/application (5-10). The secret is to make the tests reflect your users actual goals opposed to what your idea of what you think they ought to do.
  • Focus your tests on those 5-10 main tasks. Depending on the scale of the task you may want to spread it across multiple sessions
  • Allow all developers, project managers and stakeholders to sit in and listen to the test (not in the same room)

Fixing the Problems

  • Once the tests are complete, fix the issues that require the least amount of effort. The idea… make it better for users right now.
  • Tweak… don’t redesign
  • Take something away


Twitteriffic with a frown on the side

You know you have a successful product when your own servers can't handle the traffic. It's good when you catch an issue and present the user something meaningful. However, it would have been beneficial to provide some links to other methods of accessing twitter. I am unsure if all mobile apps are down because of this issue. If not, they could provide links to downloads and tools that a twitter user may be interested in. What's New, Plug-ins, etc. etc.

This is also really bad for their image. Look at how Twitter has been used to help connect people in distraught in the recent Earthquakes. Its importance and value has been overwhelming in a time of need. The fact that this even happens can really create havoc for their brand. Will you stop using it? No. You just might be a little put out.



Eye Tracking Software (Part 2)

Hooray! First Eye Tracking Test a Success


Using the open source Ogama and Eyetracker (via source code) I was able to capture and analyze eye and mouse movements. I accomplished this using the webcam built into my laptop. I have learned that the calibration is very sensitive and a better IR camera would help immensely. I choose to quickly analyze a Facebook group page of a friend of mine. Once I figure out the best conditions and settings I will let you know.

Heat Map

The heatmap displays fixations in terms of hot and cold. I can see from this heat map that my accuracy was low.


Saliency Map

The saliency can be captured without the camera. It captures the the state or quality by which an object, person or pixel stands out relative to its neighbours.


Attention Map

The attention map draws out the path that my eyes followed and the level of fixation they had a long the way.



Eye Tracking Software (Part 1)

Over the last couple of weeks I have been exploring Eye Tracking. I have been doing a lot of research on different software solutions and I have come to the conclusion that there is not one "affordable" out of the box solution that can get you up and running. I was very interested in finding a low cost, easy-to-use, non-obtrusive system to test my software interfaces. Trying to get information from the various companies I have researched has been difficult. Really, all I want to know is can I do eye tracking, mouse tracking, and see the results for a low cost?

So... What is Eye Tracking?

Simply, eye tracking uses cameras that record the movement of the eye(s) and documents the movement in X, Y and Sometimes Z coordinates. It will also track the duration of the gaze along with various other metrics. A test subject will wear a special apparatus or have cameras monitoring their eye movement. Meanwhile, the system will record or capture what the test subject is looking at. It could be a screen, a mobile device, walking through a store or operating a vehicle. The coordinates are then later mapped onto the video. Through analytics, many different types of charts and data can be presented to help make design decisions based on the test subjects experience.

Data can be presented in Heatmaps to see where the eye focus on a design or website.

Data can also map the path of the eye follows and how long the eye fixates on a specific point.

Eye tracking can even be used for operating machinary and vehicles. Here is a video from Tobii where they track the eye fixations of the driver of a motorcycle.



Eye Tracking Product "Leaders"


Tobii Technology is the world leader in eye tracking and eye control. Our products are widely used in various research fields and as a means to communicate. Tobii is divided into different business areas, each of which offers comprehensive solutions.
http://www.tobii.com

Noldus Information Technology develops, markets, and supports innovative software, instruments, integrated systems, and services for behavioral research.
http://www.noldus.com/

The eye tracking glasses are unobtrusive and robust and designed for a broad range of mobile eye tracking studies, e.g shelf-testing, out-of-home research, usability studies on mobile devices, driving research, visual perception research or analysis of trainings methods in professional sports.
http://eyetracking-glasses.com/

Eye tracking has never been this easy. Get setup in minutes. Calibration is simple and steady. The S1 Eye Tracker is portable, handles large data sets, and provides a high degree of accuracy.
http://mirametrix.com/

Eye tracking has never been this easy. Get setup in minutes. Calibration is simple and steady. The S1 Eye Tracker is portable, handles large data sets, and provides a high degree of accuracy.
http://www.seeingmachines.com/product/facelab/

There are also many Eye Tracking service providers such as http://eyetools.com/ who don't sell product but facilitate the entire end to end usability and eye tracking experience for your product.

Free Eye Tracking


Two tools I had come across which have provided the most success are Gaze Tracker 2.0 and Ogama. These two open source tools claim to do exactly what I require for testing web based applications and software. The Ogama tool has some bugs and kinks, but they have actually posted some fixes for me that I hope to Test this week. The only downside to this product is that you can only track single slides and screens (Stills). However, I hope play with it some more to learn as much as I can.

Ogama - Open Gaze and Mouse Analyzerhttp://www.ogama.net/
Gaze Tracker - he ITU Gaze Tracker is an open-source gaze tracking application that aims to provide a low-cost alternative to commercial gaze tracking systems and to make this technology more accessible. It is being developed by the Gaze Group at the IT University of Copenhagen, supported by the Communication by Gaze Interaction Association (COGAIN). http://www.gazegroup.org/

I will post my results when I get some time.


Synergy Rocks!


I just installed the latest version of Synergy. Like many individuals, I work day to day on multiple computers and types of computers. At home, I frequently use my Mac Book Pro and my work PC laptop Simultaneously. The office desk and kitchen table can get cluttered up quickly.

I have always used Synergy at the office for connecting to multiple PCs and sharing a keyboard and mouse, but I never tried it at home. Setup was pretty simple and I was rocking with one mouse across two different laptops.


Setup Instructions

  1. Download Synergy+ to the machines you want to connect to a single keyboard and mouse(you can link as many as you want).
  2. Setup the Server on the machine whose mouse and keyboard you would like to share
  3. Configure the Synergy client to point to the computer(Server) whose keyboard and mouse you would like to share. You just have to enter the computer name or IP

Features and notes

  • You can create profiles so you can have configurations for multiple locations.
  • You can configure any combination: left, right, above, below, across and back around again
  • I have been testing the beta version. It has been a little flaky on keeping the connection, but I am sure they will work it out.