Visualizations in the feedback loop

Second post of the day: I surprise myself!

This evening I attended to the workshop of R given by @jfelipe (Felipe Ortega) corresponding to the Visualizar'11 seminar. I was playing a bit with R in the past, and for me is not much more than the "open Matlab"; but it has nice features like extensibility installing new libraries and the graphs obtained are pretty beautiful... but interactiveless!

But after the workshop I had the great opportunity to talk with @infosthetics (Andrew Vande Moere) about my own research, that is, my PhD, and how I am introducing now the concept of visualization in it. And the 15 minutes we discussed were much inspiring and made me reflect about the directions that my PhD is taking (yeah, it's kind of live creature). Let's try to summarize the main ideas.

One of my previous ideas we discussed was the visualizations of learning events collected in the lab sessions will help teachers to make better decisions: visualizations to make them more intelligent (as stated in my previous post). Teachers will be able to orchestrate the classes in a better way and provide more effective and quick feedback to the students (hopefully!). I confirm that this is a good idea if executed appropriately: cool!

But the majority of the discussion was about the other leg of my topic: introducing visualizations for the students for awareness and reflection. He recommended me three important things these visualizations should comply with to be engaging (I have to measure it!!) for students: they have to be beautiful (esthetically good), fluent (that is, very straightforward and simple interaction, like this example) and that is part of a story. As I understood (if I did at all), this means that the visualization is not the end of the process (of learning) but a part of the story; it has to put into the mind of the student the next action he/she has to take (yeah, this is getting complicated!). Anyway, I am going to present to the student these engaging visualizations with their individual data and the aggregation of the data of all the students in the class. And I am going to collect all the data I could about access to the visuals, discussions between students and with the teacher, etc. to be able to demonstrate engagement.

And then I have to evaluate the tool I am developing, in a real scenario: typical control group and experiment group. I have to think better how to measure engagement (qualitative parameter measured as quantitative as possible?) and learning, decomposed in the attainment of learning outcomes that the learners are achieving during the course. How to measure that? Think, think, think. And, of course, I have to have always in mind the ethical implications of my experiments: one of the groups will have an advantage over the other if testing my tool with them? What if I don't know exactly if it works? I feel the responsibility over my shoulders...

Thanks Andrew for the nice+inspiring+engaging+fascinating conversation! I very very much appreciate it!