We present an interactive application for browsing severely damaged documents and other cultural artefacts. Such documents often contain strong geometric distortions such as wrinkling, buckling, and shrinking and cannot be flattened physically due to the high risk of causing further damage. Previous methods for virtual restoration involve globally flattening a 3D reconstruction of the document to produce a static image. We show how this global approach can fail in cases of severe geometric distortion, and instead propose an interactive viewer which allows a user to browse a document while dynamically flattening only the local region under inspection. Our application also records the provenance of the reconstruction by displaying the reconstruction side by side with the original image data.

Supporting Information

References

[BBM*01] Buehler C., Bosse M., McMillan L., Gortler S., Cohen M.: Unstructured lumigraph rendering. In Proc. 28th ACM Conference on Computer Graphics and Interactive Techniques (2001), pp. 425–432. 4, 5.
Google Scholar
[BH96] Bossen F., Heckbert P. S.: A pliant method for anisotropic mesh generation. In Proc. International Meshing Roundtable (1996), pp. 63–74. 5.
Google Scholar
[BP05] Brown M. S., Pisula C. J.: Conformal deskewing of non-planar documents. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (2005), vol. 1, pp. 998–1004. 2.
Google Scholar
[BS01] Brown M., Seales W.: Document restoration using 3d shape: a general deskewing algorithm for arbitrarily warped documents. In Proc. IEEE International Conference on Computer Vision (2001), vol. 2, pp. 367–374. 2.
Google Scholar
[BSY*07] Brown M., Sun M., Yang R., Yun L., Seales W.: Restoring 2d content from distorted documents. IEEE Trans. Pattern Analysis and Machine Intelligence 29 (2007), 1904–1916. 2.
10.1109/TPAMI.2007.1118
PubMed Web of Science® Google Scholar
[CT01] Cootes T., Taylor C.: Statistical models of appearance for computer vision. World Wide Web Publication, February (2001). 4.
Google Scholar
[FP10] Furukawa Y., Ponce J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Analysis and Machine Intelligence 32, 8 (2010), 1362–1376. 5.
10.1109/TPAMI.2009.161
PubMed Web of Science® Google Scholar
[KBH06] Kazhdan M., Bolitho M., Hoppe H.: Poisson surface reconstruction. In Proc. 4th Eurographics Symposium on Geometry processing (2006), pp. 61–70. 5.
Google Scholar
[LPRM02] Lévy B., Petitjean S., Ray N., Maillot J.: Least squares conformal maps for automatic texture atlas generation. In Proc. 29th ACM Conference on Computer Graphics and Interactive Techniques (2002). 2, 4, 5.
Google Scholar
[Ost79] Ostu N.: A threshold selection method from gray-level histograms. IEEE Trans. Systems, Man and Cybernetics 9, 1 (1979), 62–66. 5.
10.1109/TSMC.1979.4310076
Google Scholar
[PCCS11] Pietroni N., Corsini M., Cignoni P., Scopigno R.: An interactive local flattening operator to support digital investigations on artwork surfaces. IEEE Trans. Visualization and Computer Graphics 17, 12 (2011), 1989–1996. 2.
10.1109/TVCG.2011.165
PubMed Web of Science® Google Scholar
[SBR07] Schneider D., Block M., Rojas R.: Robust document warping with interpolated vector fields. In Proc. 9th International Conference on Document Analysis and Recognition (2007), vol. 1, pp. 113–117. 2, 5.
Google Scholar
[SdS01] Sheffer A., De Sturler E.: Parameterization of faceted surfaces for meshing using angle-based flattening. Engineering with Computers 17, 3 (2001), 326–337. 2.
10.1007/PL00013391
Web of Science® Google Scholar
[SLMB05] Sheffer A., Lévy B., Mogilnitsky M., Bogomyakov A.: Abf++: fast and robust angle based flattening. ACM Trans. Graph. 24, 2 (2005), 311–330. 2.
10.1145/1061347.1061354
Web of Science® Google Scholar
[SSK*05] Surazhsky V., Surazhsky T., Kirsanov D., Gortler S. J., Hoppe H.: Fast exact and approximate geodesics on meshes. ACM Trans. Graph. 24, 3 (2005). 5.
10.1145/1073204.1073228
PubMed Web of Science® Google Scholar
[SSS06] Snavely N., Seitz S. M., Szeliski R.: Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 3 (2006), 835–846. 2.
10.1145/1141911.1141964
Web of Science® Google Scholar
[SY99] Schmitt F., Yemez Y.: 3d color object reconstruction from 2d image sequences. In Proc. International Conference on Image Processing (ICIP) (1999), vol. 3. 5.
Web of Science® Google Scholar
[SYY*05] Sun M., Yang R., Yun L., Landon G., Seales B., Brown M.: Geometric and photometric restoration of distorted documents. In Proc. IEEE International Conference on Computer Vision (2005), vol. 2, pp. 1117–1123. 2.
Google Scholar
[Ter11] Terras M.: Artefacts and errors: Acknowledging issues of representation in the digital imaging of ancient texts. Books on Demand, 2011, pp. 43–61. 2.
Google Scholar
[TN11] Tian Y., Narasimhan S.: Rectification and 3d reconstruction of curved document images. Proc. IEEE Conference on Computer Vision and Pattern Recognition (2011), 377–384. 2.
Google Scholar
[TSL00] Tenenbaum J. B., Silva V. d., Langford J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500 (2000), 2319–2323. 3.
10.1126/science.290.5500.2319
CAS PubMed Web of Science® Google Scholar
[WACS11] Wu C., Agarwal S., Curless B., Seitz S. M.: Multicore bundle adjustment. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (2011), pp. 3057–3064. 5.
Google Scholar
[Wu07] Wu C.: Siftgpu: A gpu implementation of scale invariant feature transform (sift). http://cs.unc.edu/~ccwu/siftgpu, 2007. 5.
Google Scholar
[Wu11] Wu C.: Visualsfm: A visual structure from motion system. http://www.cs.washington.edu/homes/ccwu/vsfm/, 2011. 5.
Google Scholar
[ZT05] Zhang L., Tan C.: Warped image restoration with applications to digital libraries. In Proc. 8th International Conference on Document Analysis and Recognition (2005), pp. 192–196. 2.
Google Scholar

Citing Literature

Volume32, Issue2pt3

May 2013

Pages 327-334

Interactive Exploration and Flattening of Deformed Historical Documents

Abstract

Supporting Information

References

Citing Literature

References

Information

About Wiley Online Library

Help & Support

Opportunities

Connect with Wiley

Interactive Exploration and Flattening of Deformed Historical Documents

Abstract

Supporting Information

References

Citing Literature

References

Related

Information