Article
MyEvents: A Personal Visual Analytics Approach for Mining Key Events and Knowledge Discovery in Support of Personal Reminiscence
F. Parvinzamir,
Y. Zhao,
Z. Deng,
F. Dong,
F. Parvinzamir
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Queen's University Belfast, School of Electronics, Electrical Engineering and Computer Science, Belfast, UK
InsightZen Group, Hangzhou, China
Search for more papers by this authorY. Zhao
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Communication University of Zhejiang, Hangzhou, China
Search for more papers by this authorZ. Deng
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Search for more papers by this authorF. Dong
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Search for more papers by this authorF. Parvinzamir,
Y. Zhao,
Z. Deng,
F. Dong,
F. Parvinzamir
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Queen's University Belfast, School of Electronics, Electrical Engineering and Computer Science, Belfast, UK
InsightZen Group, Hangzhou, China
Search for more papers by this authorY. Zhao
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Communication University of Zhejiang, Hangzhou, China
Search for more papers by this authorZ. Deng
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Search for more papers by this authorF. Dong
University of Bedfordshire, Centre for Visualisation and Data Analytics, Luton, UK
Search for more papers by this authorAbstract
Reminiscence is an important aspect in our life. It preserves precious memories, allows us to form our own identities and encourages us to accept the past. Our work takes the advantage of modern sensor technologies to support reminiscence, enabling self-monitoring of personal activities and individual movement in space and time on a daily basis. This paper presents MyEvents, a web-based personal visual analytics platform designed for non-computing experts, that allows for the collection of long-term location and movement data and the generation of event mementos. Our research is focused on two prominent goals in event reminiscence: (1) selection subjectivity and human involvement in the process of self-knowledge discovery and memento creation; and (2) the enhancement of event familiarity by presenting target events and their related information for optimal memory recall and reminiscence. A novel multi-significance event ranking model is proposed to determine significant events in the personal history according to user preferences for event category, frequency and regularity. The evaluation results show that MyEvents effectively fulfils the reminiscence goals and tasks.
References
- [AAB*13] Andrienko G., Andrienko N., Bak P., Keim D., Wrobel S.: Visual Analytics of Movement. Springer, Berlin, 2013.
10.1007/978-3-642-37583-5 Google Scholar
- [AAFJ15] Andrienko N. and Andrienko G. and Fuchs G. and Jankowski P.: Scalable and privacy-respectful interactive discovery of place semantics from human mobility traces. Information Visualization 15, 2 (2016), 117–153.
- [AAH*13] Andrienko G., Andrienko N., Hurter C., Rinzivillo S., Wrobel S.: Scalable analysis of movement data for extracting and exploring significant places. IEEE Transactions on Visualization and Computer Graphics 19, 7 (July 2013), 1078–1094.
- [AMM*07] Aigner W., Miksch S., Müller W., Schumann H., Tominski C.: Visualizing time-oriented data – A systematic view. Computer Graphics 31, 3 (June 2007), 401–409.
10.1016/j.cag.2007.01.030 Google Scholar
- [BNG12]
Barata G., Nicolau H., Gonçalves D.: AppInsight : What have I been doing? In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI'12) (2012), pp. 465–472.
10.1145/2254556.2254645 Google Scholar
- [BSK05] Bryant F. B., Smart C. M., King S. P.: Using the past to enhance the present: Boosting happiness through positive reminiscence. Journal of Happiness Studies 6, 3 ( 2005), 227–260.
10.1007/s10902-005-3889-4 Google Scholar
- [BSSB10] Baur D., Seiffert F., Sedlmair M., Boring S.: The streams of our lives: Visualizing listening histories in context. IEEE Transactions on Visualization and Computer Graphics 16, 6 (November 2010), 1119–1128.
- [BWB14] Beecham R., Wood J., Bowerman A.: Studying commuting behaviours using collaborative visual analytics. Computers, Environment and Urban Systems 47 (2014), 5–15. Progress in Movement Analysis - Experiences with Real Data.
- [CYW*16] Chen S., Yuan X., Wang Z., Guo C., Liang J., Wang Z., Zhang X. L., Zhang J.: Interactive visual discovering of movement patterns from sparsely sampled geo-tagged social media data. IEEE Transactions on Visualization and Computer Graphics 22, 1 ( 2016), 270–279.
- [DFG12] Dias R., Fonseca M., Gonçalves D.: Interactive exploration of music listening histories. In Proceedings of the Workshop on Advanced Visual Interfaces AVI ( 2012), pp. 415–422.
10.1145/2254556.2254637 Google Scholar
- [Few17] Few S.: Data visualization effectiveness profile. Perceptual Edge (2017). https://www.perceptualedge.com/articles/visual_business_intelligence/data_visualization_effectiveness_profile.pdf.
- [FKP*02] Frohlich D., Kuchinsky A., Pering C., Don A., Ariss S.: Requirements for photoware. In Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work (New York, NY, USA, 2002), CSCW '02, ACM, pp. 166–175.
10.1145/587078.587102 Google Scholar
- [FKSS06] Fails J. A., Karlson A. K., Shahamat L., Shneiderman B.: A visual interface for multivariate temporal data: Finding patterns of events across multiple histories. In IEEE VAST (2006), P. C. Wong and D. A. Keim (Eds.), IEEE Computer Society, pp. 167–174.
10.1109/VAST.2006.261421 Google Scholar
- [GS14] Gotz D., Stavropoulos H.: Decisionflow: Visual analytics for high-dimensional temporal event sequence data. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014). 1783–1792.
- [HB03] Harrower M., Brewer C. A.: ColorBrewer.org: An online tool for selecting colour schemes for maps. Cartographic Journal 40, 1 (June 2003), 27–37.
- [HK09] Hilliges O., Kirk D. S.: Getting sidetracked: Display design and occasioning photo-talk with the photohelix. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2009), CHI '09, ACM, pp. 1733–1736.
- [HSN98] Harper B., Slaughter L., Norman K.: Questionnaire administration via the WWW : A validation & reliability study for a user satisfaction questionnaire. In WebNet (1998), vol. 97, pp. 1–4.
- [HTA*15] Huang D., Tory M., Adriel Aseniero B., Bartram L., Bateman S., Carpendale S., Tang A., Woodbury R.: Personal visualization and personal visual analytics. IEEE Transactions on Visualization and Computer Graphics 21, 3 (March 2015), 420–433.
- [HW03] Hsieh H.-F., Wang J.-J.: Effect of reminiscence therapy on depression in older adults: A systematic review. International Journal of Nursing Studies 40, 4 (2003), 335–345.
- [KSDK11] Koh L. C., Slingsby A., Dykes J., Kam T. S.: Developing and applying a user-centered model for the design and implementation of information visualization tools. In 2011 15th International Conference on Information Visualisation (July 2011), pp. 90–95.
10.1109/IV.2011.32 Google Scholar
- [KSTM10] Klimov D., Shahar Y., Taieb-Maimon M.: Intelligent visualization and exploration of time-oriented data of multiple patients. Artificial Intelligence in Medicine 49, 1 (May 2010), 11–31.
- [KTE14] Kruger R., Thom D., Ertl T.: Visual analysis of movement behavior using web data for context enrichment. In PacificVis (2014), I. Fujishiro, U. Brandes, H. Hagen and S. Takahashi (Eds.), IEEE Computer Society, pp. 193–200.
10.1109/PacificVis.2014.57 Google Scholar
- [KW11] Kalnikaite V., Whittaker S.: A saunter down memory lane: Digital reflection on personal mementos. International Journal of Human–Computer Studies 69, 5 (2011), 298–310. Designing for Reflection on Personal Experience.
- [Lew71] Lewis C. N.: Reminiscing and self-concept in old age. Journal of Gerontology 26, 2 (1971), 240–243.
- [MLL*13] Monroe M., Lan R., Lee H., Plaisant C., Shneiderman B.: Temporal event sequence simplification. IEEE Transactions on Visualization and Computer Graphics 19, 12 (December 2013), 2227–2236.
- [NGN08] Nunes M., Greenberg S., Neustaedter C.: Sharing digital photographs in the home through physical mementos, souvenirs, and keepsakes. In Proceedings of the 7th ACM Conference on Designing Interactive Systems (New York, NY, USA, 2008), DIS '08, ACM, pp. 250–260.
10.1145/1394445.1394472 Google Scholar
- [Oy12] Oy P.: Moves, 2012. https://www.moves-app.com/. Accessed on March 21, 2014.
- [PBW14] Petrelli D., Bowen S., Whittaker S.: Photo mementos: Designing digital media to represent ourselves at home. International Journal of Human–Computer Studies 72, 3 (2014), 320–336.
- [PMR*96] Plaisant C., Milash B., Rose A., Widoff S., Shneiderman B.: Lifelines: Visualizing personal histories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 1996), CHI '96, ACM, pp. 221–227.
- [PSM07] Pousman Z., Stasko J. T., Mateas M.: Casual information visualization: Depictions of data in everyday life. IEEE Transactions on Visualization and Computer Graphics 13, 6 (November 2007), 1145–1152.
- [PW10] Petrelli D., Whittaker S.: Family memories in the home: Contrasting physical and digital mementos. Personal Ubiquitous Computing 14, 2 (February 2010), 153–169.
- [PWB08] Petrelli D., Whittaker S., Brockmeier J.: Autotopography: What can physical mementos tell us about digital memories? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2008), CHI '08, ACM, pp. 53–62.
- [RCDH03] Ringel M., Cutrell E., Dumais S. T., Horvitz E.: Milestones in time: The value of landmarks in retrieving information from personal stores. In INTERACT (2003).
- [RHF05] Riehmann P., Hanfler M., Froehlich B.: Interactive Sankey diagrams. In Proceedings of IEEE Symposium on Information Visualization, InfoVis 2005 (2005), IEEE, pp. 233–240.
10.1109/INFOVIS.2005.21 Google Scholar
- [RWA*13] Rind A., Wang T. D., Aigner W., Miksch S., Wongsuphasawat K., Plaisant C., Shneiderman B.: Interactive information visualization to explore and query electronic health records. Foundations and Trends in Human–Computer Interactions 5, 3 (February 2013), 207–298.
10.1561/1100000039 Google Scholar
- [SC99] Shahar Y., Cheng C.: Intelligent visualization and exploration of time-oriented clinical data. In Proceedings of the 32nd Hawaii International Conference on System Science, volume Track4 (January 1999).
- [SGBBT06] Shahar Y., Goren-Bar D., Boaz D., Tahan G.: Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions. Artificial Intelligence in Medicine 38, 2 (October 2006), 115–135.
- [Shn96]
Shneiderman B.: The eyes have it: A task by data type taxonomy for information visualizations. In 1996 Proceedings of IEEE Symposium on Visual Languages (September 1996), pp. 336–343.
10.1109/VL.1996.545307 Google Scholar
- [SMM12] Sedlmair M., Meyer M., Munzner T.: Design study methodology: Reflections from the trenches and the stacks. IEEE Transactions on Visualization and Computer Graphics 18, 12 (December 2012), 2431–2440.
- [TBHC16] Thudt A., Baur D., Huron S., Carpendale S.: Visual mementos: Reflecting memories with personal data. IEEE Transactions on Visualization and Computer Graphics 22, 1 (January 2016), 369–378.
- [vdH14] van den Hoven E.: A future-proof past: Designing for remembering experiences. Memory Studies 7, 3 (2014), 370–384.
- [VEC09] Vrotsou K., Ellegard K., Cooper M.: Exploring time diaries using semi-automated activity pattern extraction. Electronic International Journal of Time Use Research 6, 1 (2009), 1–25.
10.13085/eIJTUR.6.1.1-25 Google Scholar
- [VGD06] Viégas F., Golder S., Donath J.: Visualizing email content: Portraying relationships from conversational histories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2006), pp. 979–988.
10.1145/1124772.1124919 Google Scholar
- [VJC09] Vrotsou K., Johansson J., Cooper M.: Activitree: Interactive visual exploration of sequences in event-based data using graph similarity. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 945–952.
- [vLBR*16] von Landesberger T., Brodkorb F., Roskosch P., Andrienko N., Andrienko G., Kerren A.: Mobilitygraphs: Visual analysis of mass mobility dynamics via spatio-temporal graphs and clustering. IEEE Transactions on Visualization and Computer Graphics 22, 1 (January 2016), 11–20.
- [WBC10] Whittaker S., Bergman O., Clough P.: Easy on that trigger dad: A study of long term family photo retrieval. Personal and Ubiquitous Computing 14, 1 (2010), 31–43.
- [WG12] Wongsuphasawat K., Gotz D.: Exploring flow, factors, and outcomes of temporal event sequences with the outflow visualization. IEEE Transactions on Visualization and Computer Graphics 18, 12 (December 2012), 2659–2668.
- [WGGP*11] Wongsuphasawat K., Guerra Gómez J. A., Plaisant C., Wang T. D., Taieb-Maimon M., Shneiderman B.: Lifeflow: Visualizing an overview of event sequences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2011), CHI '11, ACM, pp. 1747–1756.
10.1145/1978942.1979196 Google Scholar
- [WKP*12] Whittaker S., Kalnikaite V., Petrelli D., Sellen A., Villar N., Bergman O., Clough P., Brockmeier J.: Socio-technical lifelogging: Deriving design principles for a future proof digital past. Human–Computer Interaction 27, 1–2 (2012), 37–62.
- [WM99] Webster J. D., McCall M. E.: Reminiscence functions across adulthood: A replication and extension. Journal of Adult Development 6, 1 (1999), 73–85.
- [WPS*09] Wang T. D., Plaisant C., Shneiderman B., Spring N., Roseman D., Marchand G., Mukherjee V., Smith M.: Temporal summaries: Supporting temporal categorical searching, aggregation and comparison. IEEE Transactions on Visualization and Computer Graphics 15, 6 (November 2009), 1049–1056.
- [WV15] West V. L., Borland D. H. W.: Innovative information visualization of electronic health record data: A systematic review. Journal of the American Medical Informatics Association 22, 2 (March 2015), 330–339.
- [YWL*15] Yu L., Wu W., Li X., Li G., Ng W. S., Ng S.-K., Huang Z., Arunan A., Watt H. M.: iviztrans: Interactive visual learning for home and work place detection from massive public transportation data. In VAST (2015), M. Chen and G. L. Andrienko (Eds.), IEEE Computer Society, pp. 49–56.
