Showing posts with label visualization. Show all posts
Showing posts with label visualization. Show all posts

Monday, July 23, 2012

Ambient displays and exploring datasets

Ambient displays are artefacts used to arise awareness about certain data not directly observable in the physical world (e.g., learning progress), and integrated in the environment. That is, they are not the main focus of the users activity but display information that could be consulted when needed, that make them aware of something interesting for their activity. In the concrete case of ambient displays for learning, several use cases have been analysed in the awesome Dirk and colleagues' literature review. Some conclusions could be drawn out of their work, for instance, that ambient displays if well used have been demonstrated not to distract the students. And that generally the amount of data displayed is quite low. The most sophisticated displays got to make what they called situational awareness, that is, besides acquiring some knowledge and understanding of the situation, the users could obtain a pinch about the future; that is, the data displayed if correctly interpreted could predict future events.

Therefore, I'm playing around with some datasets to come up with a suitable visualization for an ambient display: my dataset from the classon use case; another dataset from tinyarm, a tool for awareness of researchers; and, in the near future, with a dataset from stepUP. I have to first explore the dataset in order to determine how the visualizations should look like (bottom up approach). But I'm also exploring some tools for creating data visualizations, in order to get to know some novel visualization approaches that could be applied to the data (top down approach). Let's see what could I find in the mid-way, supported by the tools and the data itself.

In this regard I wanted to quickly visualize the tinyarm data, provided to me in JSON. I could not find a suitable tool, so my best chance was to export it into CSV using a JS script (I'm using JS for absolutely any processing I need, executed with node). I was pointed to a couple of tools to explore: on the one hand gephi, but it is more about networks (nodes and relations), not so useful for visualizing time series; and gapminder, that could be used to nicely visualize data about countries in the world, but you cannot upload your own data. Anyway, they point to another solution in the FAQ: to use Google Public Data Explorer, where you could upload your data in Dataset Publishing Language. For using this format, you should have your data in CSV plus a XML file describing your data: concepts (organized in topics) and their relations (slices). I can say that constructing the XML is not so easy (and so funny). Besides, I realized that there's a simpler and more powerful tool that I could use: Google Spreadsheets. So, after processing the data with the JS script I'm uploading it into a spreadsheet and visualizing the data using the built-in charts, very powerful to visualize this dataset (around 1.5k rows).

Regarding the visualization of the datasets for the ambient displays, my co-advisor @rcg0 pointed my to a very interesting blog post about visualization of speedos and tachometers. Roughly, it describes why the "in principle not convenient" circular visualization of the speedo make a lot of sense to detect acceleration. At the end of the post a visualization of the last BMW dashboard is presented, and the circle of the tachometer and speedo are linked by a fuzzy line to indicate that both measures are related, and this relation is important in sport mode (in this mode the link appears). That relation could be used as a metaphor for the relation between effort and outcomes (quality outcomes), since a great effort should imply a higher speed if controlling the gears correctly. Sometimes the students claim to devote a lot of effort in a course and the outcomes are not the ones they expect. By means of this dashboard they (and we as teachers) could detect easily these situations and we'll be able to help them to change to the correct gear.
Image from http://blog.visual.ly/
I have created a simple visualization using the Google chart's gauge. Let's see if it works for the purpose.

Wednesday, June 27, 2012

Paper prototyping and what I will be doing at KUL

It turns out the I'm learning good stuff about HCI in my stay at KUL. On the one hand I am following the course at Stanford (not at the rate I'd like); and on the other hand, the people in here really believes in the methodology (I remember the discussion I had with them about the utility of paper prototyping).

OK, so... what am I going to do here? Let's see! Narrowing the possibilities, I came up with two options: create data visualization for students including some gamification concepts anda data portraits, and create more complex visualizations for teachers, using complex techniques and a multitouch table as the backing for the collaboration of several teachers in a course.

Let's start from the second idea (the least mature one). Given the dataset I collected in a Multimedia Applications course, I'd use a to-be-defined visualization (like this d3 plugin or this d3 based library of reusable components) to present the data in a way that a teacher (or group of teachers) were able to take advantage of the data in order to improve the course. And then I have to explore the use of the the tabletop for the teachers to collaborate. More detailed information about the table is in this Bram's post.

Regarding the second idea, about visualization for students and data portraits, I started the to use the HCI methodology from the beginning. Firstly, in order to concretize the ideas I wanted to explore and establish a common artifact for sharing my ideas: I drew a storyboard that tells the story behind my project. I shared it with a couple of colleagues and I think it works well for its purpose.



And then, paper prototype time! At first, I didn't believe much in it but helped me in two ways: firstly to concretize a interface before programming it (I usually start programming and have some hints of what I want in the UI, but not it completely defined!); and secondly, because it helped me to explore several possibilities for the UI, since I had a general idea for the UI but let me explore and validate other possibilities.

I started with a prototype consisting of a list of portraits with the data of the students over them, and ordered according to their activity in the course (a weighted sum of several components, like progress in the sessions, attendance, questions and answers, and work from home). The weight of every component had to determined in the design of the gamification strategy: for example, +10p for finishing a section in the assignment, +1p for connecting to the assignment (maximum once a day, and an extra for connecting from home a day different of the face-to-face session) and +2p for questions and answers. Another good visual info was to blur the faces of the students that were bad in the course, to indicate that they were not completely enrolled to the course (thanks Joris!).




Next prototype, is similar but use a dock-like metaphor (Mac's dock) for positioning the students in a row, that again indicates their activity.


But, lately I have been attracted for the aesthetics (what is important according to the experts) of the circle-like visualizations. Moreover, this kind of visualization could be identified with a darts target, what brings more context for a game. It also can show clearly which students are in the good track and which one are out of it. I showed that to who I think will be my main collaborator in this project, and I think really liked it too.


Finally, I had to design an interface for the detailed info about the participants. I had the idea of using something similar to Big Brain Academy, but I have to think a bit about the variables that I want to represent and what is the relation between them to put them together. I have another couple of ideas to work with (visualization of the students working in distance sessions to provide virtual presence and elaborate more on the gamification of the activities).



Finally, I have developed a simple mockup of the app that will be completed these days using the target and my picture :) After finish, time to evaluate it again. That's what I learnt: continuos feedback is as good for students as it is for researchers/designers. See yap!


Tuesday, June 12, 2012

I write only in June!

It's a fact: I write in this blog only in June. I spent like a year to go back to the blog and write something "interesting".
Right now I'm in Leuven, doing a research stay with Prof. Erik Duval. Right now, my main concern is to find out very concrete aspects to collaborate with the "ariadne" lab people. Last week, I gave a short presentation about my PhD stuff and raised 3 topics for collaboration:
  • visualization of students data: I've collected a great amount of data during a experiment in class using classON; in order to make this data useful, I wanted to come up with nice visualization to make the data useful for teachers and students. I can distinguish two different scenarios: a) visualize in class (synchronous) what has to be very simple and straightforward (teacher and students are carrying out a task and the visual info is just a support); and b) visualize after the class, or even after the course (async), what could be much more elaborated and teachers/students could devote more attention to the artefact.
  • gamification: as classON collects different types of data, a useful purpose is making use of it to engage students. I'd have to analyse some gamification strategies and patterns, but I had in mind that the goals/badges/medals/whatever should be granted based on the history of the individual, e.g., if an individual demonstrates improvement on his regular activity.
  • use case: the last topic I proposed was to use classON in a course at KUL. The idea was not so well received, since it is designed of a scenario where the resources are scarce (the teacher's time to provide feedback) and that doesn't seem to happen in here. At the end, it could be used in a couple of sessions of different courses maybe...

Next step was to talk to each of the people in here, and propose them more concrete topics, relevant both for them and for me. After a few talks, I found 2 main topics of interest, both related to data visualization.

Firstly, try to exploit the relation between STEP UP! and classON, since both of them have commonalities: both are tools that provide awareness about what's happening in a course, and use visuals to transmit this info to the students/teachers. But they have also different approaches, since classON uses data related to progress, questions and question ratings; and stepup! makes use of more social data, like blog posts, comments on the blogs, tweets, toggle (time on activity report), etc. In this line, we envisage a couple of common interests: a) utility of the data types we collected for students and/or teachers; and b) utility of different visualizations for students/teachers (namely, data portraits, data tables, widget dashboard, etc). Besides, I want to explore another dimension that is the utility of visuals in class (sync) or after it (async). We'll see.

Secondly, we're trying to figure out common interests with a work for visualizing of the data collected in TiNYARM (papers read, toread, skimmed, etc.) in a community of research. Again, the data collected is "more social" and the subsequent SNA could be applied over it, but again there's a common ground on techniques we want to use (concretely, in the classon visualizations after the class for teachers/students to appraise what really happened and hints for improvement the learning activities). In this case, we roughly thought about a visualization like this one in order to represent questions and answers (instead of foo and bar), or papers read and recommended.

To sum up, on the one hand we have two groups of stuff: a set of types of data, and a set of visualization tools/techniques; on the other hand, we have two dimensions: target group (teachers/students), and synchrony of application (sync/async). Objetive: let's match of all these!



Thursday, June 23, 2011

Visualizations in the feedback loop

Second post of the day: I surprise myself!

This evening I attended to the workshop of R given by @jfelipe (Felipe Ortega) corresponding to the Visualizar'11 seminar. I was playing a bit with R in the past, and for me is not much more than the "open Matlab"; but it has nice features like extensibility installing new libraries and the graphs obtained are pretty beautiful... but interactiveless!

But after the workshop I had the great opportunity to talk with @infosthetics (Andrew Vande Moere) about my own research, that is, my PhD, and how I am introducing now the concept of visualization in it. And the 15 minutes we discussed were much inspiring and made me reflect about the directions that my PhD is taking (yeah, it's kind of live creature). Let's try to summarize the main ideas.

One of my previous ideas we discussed was the visualizations of learning events collected in the lab sessions will help teachers to make better decisions: visualizations to make them more intelligent (as stated in my previous post). Teachers will be able to orchestrate the classes in a better way and provide more effective and quick feedback to the students (hopefully!). I confirm that this is a good idea if executed appropriately: cool!

But the majority of the discussion was about the other leg of my topic: introducing visualizations for the students for awareness and reflection. He recommended me three important things these visualizations should comply with to be engaging (I have to measure it!!) for students: they have to be beautiful (esthetically good), fluent (that is, very straightforward and simple interaction, like this example) and that is part of a story. As I understood (if I did at all), this means that the visualization is not the end of the process (of learning) but a part of the story; it has to put into the mind of the student the next action he/she has to take (yeah, this is getting complicated!). Anyway, I am going to present to the student these engaging visualizations with their individual data and the aggregation of the data of all the students in the class. And I am going to collect all the data I could about access to the visuals, discussions between students and with the teacher, etc. to be able to demonstrate engagement.

And then I have to evaluate the tool I am developing, in a real scenario: typical control group and experiment group. I have to think better how to measure engagement (qualitative parameter measured as quantitative as possible?) and learning, decomposed in the attainment of learning outcomes that the learners are achieving during the course. How to measure that? Think, think, think. And, of course, I have to have always in mind the ethical implications of my experiments: one of the groups will have an advantage over the other if testing my tool with them? What if I don't know exactly if it works? I feel the responsibility over my shoulders...

Thanks Andrew for the nice+inspiring+engaging+fascinating conversation! I very very much appreciate it!

Wednesday, June 22, 2011

Visualization as a new keyword

During the last week I have been learning a lot about data visualization, above all thanks to visualizar11. Let's reflect a bit about the experience up to now...

Visualizar'11 (subtitled "understanding the infrastructures") is a workshop lasting 3 weeks (from 14/6 to 30/6) intended to develop several projects related somehow to data visualization with the underlying leitmotiv of the infrastructures. The first two days were devoted to keynotes and "communications" from experts in the field, and since then you can participate in one of the 10 selected projects (in my case, in order to learn a bit more about the topic). Right now I am more or less implicated in a project related to visualize the Google technological infrastructures in order to show implications to the "don't be evil" stuff: open source and closed components, effort devoted to them, etc. Let's see where it takes...

But why (the hell) do I want to learn more about data visualization? Because visualization is one of the tools for analysis of collected learning statistics (events). If well used, it can be very powerful since it permits to find relations among data not directly related to other data. As Enrico Bertini said in Visualizing Europe last week, we have to find the concrete field or context where visualization was not useful but indispensable. And I think that for learning analytics in class (in the enactment phase) it is indispensable for facilitating teacher monitoring of the activity of the students (in the context of a lab session).

W. Ross Ashby, from wikipedia

Another concept I want to highlight is Intelligence Amplification (W. Ross Ashby, 1956) as opposed to Artificial Intelligence. As Inês Salpico so well introduced during her communication at Visualizar11, the visualization is not supposed to be an AI product but a IA tool, that is, a tool that helps the user to amplify his/her potential (let's say intelligence) in order to accomplish a concrete task. And this is actually what I want to do in my PhD!!

Will I enable the visualization of the learning infrastructures? Hopefully!