Advantages and drawbacks of log files for analysis
In preparation for the HICSS conference which I’ll be attending next week, I have been thinking about the difference between using real-time data (like screen captures) and log files when analyzing online interaction. In the paper I will present (based on the same study that I presented in HUMlab not long ago), I argue that valuable information is lost if we only focus on log files. Since in this study I had access to information about current activities of the informant, I was able to find explanations for temporal aspects such as delay. Without this information I might have concluded that delay is the result of the informant being slow at typing, when, in fact, she is engaged in other simultaneous activities.
Apart from presenting the paper, I will also give a brief presentation at the Persistent Conversation workshop. This should be a valuable session, since participants are asked to apply their theoretical framework to the same chat system. Again, I am confronted with the question of what different types of analyses can be carried out depending on what data you have access to. Here, the real-time data does not capture the communicative environment of the informants in front of their computers, but rather the real-time interaction in the online environment. Nevertheless, there are some important differences, for example concerning the type of information you get regarding the communicative intention of the conversational partners (information about when others are typing is available in real-time but not in the logs). However, in this specific case, the log files are also quite useful, since they link the different modes (text chat and white board) and allow for detailed revisiting of the relationship between the two. Depending on your research agenda, a combination might be to prefer. I look forward to discussing this further!
Some other topics I hope to get an opportunity to discuss at HICSS include:
- Tools for analysis and visualization of complex data
- Ethnography and design
- Ethical and legal concerns
- The notion of communicative affordances and its applicability
- Plans for my future study
I am really looking forward to this trip, both because I think it will be valuable to my research, and, admittedly, because I long for some vacation in a warmer climate! Updates to be expected. Aloha for now!
