Neue Technologien, neue Daten, neue Gestaltungsmöglichkeiten. Wie aus Cutting Edge Technologien sinnvolle Produkte gestaltet werden.
Nicht jede technische Erfindung (Invention) führt zu sinnvollen Produkten. Und manche sinnvollen Produkt-Idee kame zu früh, als die Technologie noch nicht reif war. Zumindest der unterhalb gezeigte Roller aus dem Jahr 1916 (zunächst mit Verbrennungsmotor, später auch als E-Scooter angeboten) erlebt gerade seine Renaissance. In Invention Design verfolgen wir einen Designprozess, der neue Technologien und Nützlichkeit vereint.
Sich schnell entwickelnde Technologien erweitern die Möglichkeiten für Produkte die wir gestalten können. In Invention Design II begeben wir uns an den Tellerrand des Jetzt, verstehen was gerade möglich wird und suchen dafür sinnvolle Anwendungsmöglichkeiten. Was können wir Nützliches schaffen, wenn Computer Sprache verstehen? Wenn wir präzise 3D-Modelle von Gebäuden haben? Wenn Computer assoziativ ‘denken’ können? In diesem Kurs navigieren wir von Technologie-Verständnis zu einem sinnvollen Produktkonzept.
In the course Invention Design II, we developed a guitar learning app that uses augmented reality to make the learning process as easy as possible. In the app, the user’s hand on the guitars fingerboard is recorded and displayed on the screen. On the mirrored image, the chords to be learned are drawn directly on the fingerboard.
This gives the user real-time visual feedback on how to grab a chord.
This makes it possible to learn guitar without sheet music and to have a fast success.
In a design sprint, we looked for a technology and an existing problem at the same time in order to solve the same with the technology. We choose the technology “Mixed Reality”, more concretely then the spin-off “Augmented Reality” (AR). The initial problem was to improve the learning experience or individual learning through AR. To better understand our solution space, we developed a solution matrix.
From this we developed several ideas over 2 weeks, which were later elaborated into a concrete use case “learning guitar”. We successfully validated our idea on the technical feasibility, social dependencies and interview partners.
To learn more about the learning experience of instruments and more specifically the guitar, we conducted numerous interviews and examined established solutions such as music books and learning apps for instruments. We also observed the use of existing learning apps and a classical lesson with a guitar teacher. Here it was important for us to get a realistic picture of the current situation and possibilities. The statements of a guitar teacher with 30 years of experience were just as relevant as the assessment of a beginner.
As a result, we were able to identify the following advantages of an AR app in the learning context of “guitar”:
Chords are visible on the guitar, direct feedback
Upright posture when practicing, as you do not have to lean over the guitar
App recognizes how well you play and adapts to the skill with speed and difficulty
Navigating the app via voice, direct visual response
During the design sprint, a first prototype was designed to simulate mixed reality glasses. This was to test whether a mixed reality app would enrich the experience of learning to play the guitar. For this purpose, a click prototype was created on an iPad. This was held up in the air for testing where the user was looking. Through this, we learned that a mixed reality app works well and allows guitar playing without notes.
Since the view of the guitar strings with glasses is only possible with a bad posture, we decided to use an augmented reality app. This should be available for the iPad or a PC with a webcam. To test whether playing via a mirrored view with the marking of chords makes it easier for beginners to get started, another prototype was created. The prototype AR app consisted of colored paper snippets marking chords and the iPad’s inner camera turned on. Users were quickly able to correctly grasp the first chords and practice chord changes.
The idea was further elaborated in another prototype. For this, an interface was designed and displayed in the prototyping app Protopie over the image of the inner camera. The successful recognition of correctly played chords was implemented using the Wizard of Oz method. Thus, the animations were triggered remotely using a keyboard. For testing, the guitar had to be fixed so that all animations were displayed at the correct position above the guitar.
The design sprint helped us to not get lost in research and to quickly find a concrete idea for a problem. The prototype created in one day was definitely enough to test the concept developed in the sprint. The testing was very honest, as we had only invested five days in the concept and there was clearly the possibility to discard everything and start again.
Besides the design sprint, we learned a lot about prototyping augmented reality applications. With the realization that it is important to think in advance about what insights should be gained with the prototype. Based on that, the simplest prototype that can support or refute the thesis should be designed. In doing so, we found that sometimes a simple prototype with tape and a selfie camera is enough to test an augmented reality idea.