[3D Scan and Print] Paintings!

I made a super-high resolution 3-D scanner for paintings. With that, we scanned two paintings by Rembrandts and a Van Gogh. In order to visualize the result, these were 3-D printed in full color and full dimension!

Introduction

Paintings are not unlike sculptures, paint as a material has a huge impact on the way a painting looks. By illuminating a painting with light, it automatically gives highlights and shadows that form the way we see it. This is especially the case in the of late Rembrandt paintings and Van Gogh. This fact is often overlooked or not fully appreciated. In order to capture this topography convincingly, we needed to capture it in a very high resolution, which is already a problem for most 3-D scanners. Furthermore, the topography of the paint is very small compared to the size of the canvas and we want to capture color at the same time as we capture depth. This depth data is relevant for conservators and restorers (think of status-reports or analytical information about the craquela) and could in principle be used for exploitation using the museum shops (note that we as a university do not pursue this).

Explanation of our method from the Sunday Times

Explanation of our method from the Sunday Times

Therefore we devised a 3-D imaging method based on commercially available camera’s. We designed it such that it was dependent on the camera’s pixel count, so that by using 40 megapixel camera’s, we can capture large area’s at once with a very large accuracy. The camera’s were setup in stereo, and used triangulation in the exact way that our human eye does it. We also used a projector to project fringes to aid this triangulation. This yields an enormous depth map at the same time as we capture color. The scan of the Rembrandt’s Jewish Bride at the Rijksmuseum contains a billion points, all labeled with color information. In order to visualize this, we cannot use our computer screen (a billion points is more than 500x the amount of points a Full-HD screen can display. The logical step is then to print it. This was done by Oce (Canon Group) using their ‘state-of-the-art’ Fine Art 3-D printer that prints a depiction as large as the Jewish bride with a resolution of 50 microns in a few hours.

tedxdelft_djvdt
Although such a print might fool the regular observer, anyone with knowledge of paintings will immediately see that this is not painted with a brush. (Anyone with a microscope will see its drops painted mechanically with a nozzle.) If you consider such a print light-years ahead of a common poster reproduction, it is still light-years away from the original. We noticed that things like glossiness and transparency that are in each painting are very distinguishing in the original, and we are not yet able to reproduce. We are now working on further research in trying to model these facts as well. The goal of making such accurate reproductions, and comparing them with the original, is that we learn to understand exactly what we are looking at, and why it looks the way it does. What we learned so far is that there are many more elements that make the painting look the way it does, a part from the color and topography, that have an importance that we did not anticipate.

Scanning Equipment

The scanning equipment is actually very straightforward, and only consists out of these parts. The rest of the parts is just cables and stuff to make the camera move in X and Y.

Capture device Nikon D800E
Lenses Nikon 80mm PC-E scheimpflug & polarisation filters
Projector Picoprojector fitted with a crossed polarisation filter

Scanning the Jewish Bride at the Rijksmuseum

Scanning the Jewish Bride at the Rijksmuseum

3-D Scanning

Real all about our scanning method in my thesis: http://repository.tudelft.nl/search/ir/?q=zaman .
We used a hybrid system using stereo vision (2 camera’s) and fringe projection (using a projector). This system gives us unrivaled detail and capture speed, capturing 40 million points per capture, each point in 3-D space (XYZ) and in full color (RGB). Multiple captures allows us to capture the Jewish Bride for instance, a work that spans 160×120 cm; giving us more than a billion XYZ/RGB points. This is all done with proprietary camera’s that anyone can buy off-the shelf.

3-D Renders

3-D Printing

Printer and 3D printing technology (c) 2013 Océ (Canon Group). I was not directly involved in the development of the printer or the 3D pritning process. Nor did i push any buttons on the printer. The whole data-to-print part was all done by Océ.
3D Printing Technology by High Resolution Océ 3-D Fine Art Reproductions (more PR material at http://files.oce.com/video/hr3d.html). Printer by and with 3-D printing technology from Océ. Video (c) Océ, and if shown, should be shown in entirety including proper attributions including the Océ trademark.

Images

For all images, see this link: https://www.dropbox.com/sh/90n5pectl08yk39/MJ_2oZtQqz

Thanks

Thanks to our museum partners:
Mauritshuis, Kröller-Müller Museum, Rijksmuseum.
And our technical partners:
Delft University of Technology and Océ.

Media

Nu.nl http://www.nu.nl/tech/3584817/nederlander-3d-print-werken-van-meesterschilders.html
TU Delta http://delta.tudelft.nl/artikel/tu-geeft-reproducties-diepte/27189
Engineering.com http://www.engineering.com/3DPrinting/3DPrintingArticles/ArticleID/6380/Analyzing-Rembrandt-and-Van-Gogh-in-3D.aspx
Huffington Post USA http://www.huffingtonpost.com/2013/10/04/3d-scanning-art_n_4037853.html
Huffington Post UK http://www.huffingtonpost.co.uk/2013/09/25/3d-printers-used-worlds-masterpiece-paintings_n_3987420.html
Hackaday http://hackaday.com/2013/09/24/priceless-paintings-scanned-and-printed-in-3d/
Gizmodo http://gizmodo.com/3d-printing-fine-art-fakes-is-here-to-stay-1383456733
Engadget http://www.engadget.com/2013/09/24/3d-art-printer/
Pauw & Witteman http://www.uitzendinggemist.nl/afleveringen/1366849#00:22:35
Designboom http://www.designboom.com/art/oce-3d-printer-creates-identical-reproductions-of-fine-art-paintings-09-30-2013/
Core77 http://www.core77.com/blog/fine_art/what_happens_when_you_combine_hi-tech_scanning_and_printing_with_3d_printing_art_forgery_well_not_really_25618.asp
Habrahabr http://habrahabr.ru/post/195238/
TEDx Delft 2013 http://www.tedxdelft.nl/2013/10/looking-under-rembrandts-skin/
La Repubblica http://www.repubblica.it/tecnologia/2013/10/14/news/arte_i_capolavori_si_stamperanno_in_3d_copie_identiche_agli_originali_per_tutti-68564417
RTL-Z http://www.rtlnieuws.nl/economie/toekomstmakers/printen-relief
The Australian http://www.theaustralian.com.au/news/world/d-prints-master-art-of-the-greats/story-fnb64oi6-1226747823212#
New York Times http://www.nytimes.com/2013/10/24/arts/international/technology-mimics-the-brushstrokes-of-masters.html?_r=0
The Sunday Times http://www.thesundaytimes.co.uk/sto/news/uk_news/Arts/article1332581.ece?CMP=OTH-gnws-standard-2013_10_26

TEDxDelft2013 Exhibition

Exhibited the reproductions at TEDx Delft 2013

Tim Zaman

MSc Biorobotics. Specialization in computer vision and deep learning. Works at NVIDIA.

You may also like...

35 Responses

  1. Ari says:

    Hello, Looking to track down this printer. My company has need for it asap.

  2. Hi Tim Zaman, do you think that this 3D printer could create an image with reliefs and brush strokes from a digital painting or from a photo modified with artistic filters or painterly effects like those on photoshop? (without the need to scan an existing painting)

  3. Kim Thoman says:

    Hello Tim,
    I’ve been painting for over 30 years and have recently become interested in making sculptures that are 3D printed objects that use my paintings as skin and combining these objects with steel structures.

    Please send an email and I’ll send a pic.

    I’m dissatisfied that my 3D printed object (I call her Venus), printed on a 3D Systems Projet 660 doesn’t show the texture of my paintings. They are not highly textured like Van Gogh, but nonetheless, I’d like them to show.

    Any suggestions?
    Kim Thoman
    Artist Website: http://www.kimthoman.com

  4. Thank you for sharing your info. I truly appreciate your efforts and I will
    be waiting for your further post thank you once again.

  5. Keith Mangan says:

    Inspiring stuff; I’m mesmerised ..:)

    I’m really interested in the technical side of this; camera setups; rigging setups and software; is this info available to the public???

    I live in a 3d world (designing / modelling and visualisation) and just love the fine detail of this ( the craters of Mars is a a perfect analogy;inner space )

    I presume you have got to work with many works of art and on a purely conversational topic; I wonder if you have discovered any mistakes/errors in the paintings themselves (fingerprints; hairs etc )..

    Please let me know if their are any papers;further reading available.

    Many Thanks

    Keith

    • Tim Zaman says:

      Yep, on a van Gogh we found a hair in the lower right corner that had not been seen before and is half embeded in the paint. it’s about 6 cm long and probably the artists [van Gogh’s]; this is actually not that special, there are multiple confirmed van Gogh hairs. Furthermore, the method is kind of public [read my thesis on that; Google], the code itself was mostly in Matlab but has now been rewritten to C++. Might open that up sometime.

      • Keith Mangan says:

        Wow that was fast…:) Thanks for the reply..
        I didnt know that about hairs 🙂

        I d’ont think my colleagues do either ; Can you send me a direct link to your thesis if possible.

        Keep up the amazing work..

        Keith

  1. September 25, 2013

    […] wish a Venus De Milo in their vital room—with her arms re-attached? [YouTube around Tim Zaman around […]

  2. September 26, 2013

    […] want a Venus De Milo in their living room — with her arms re-attached? [YouTube via Tim Zaman via […]

  3. September 27, 2013

    […] to render the resultant scan–and use an Oce printer that combines graphics and 3D printing to duplicate the painting […]

  4. September 27, 2013

    […] to render the resultant scan–and use an Oce printer that combines graphics and 3D printing to duplicate the painting […]

  5. September 30, 2013

    […] amazing, thesis-worthy work to scan old-master paintings for preservation purposes, has become the feed into a demonstration of the level of detail that a […]

  6. September 30, 2013

    […] researcher tim zaman designed and built a photographic scanning system which captures high-resolution, three-dimensional […]

  7. September 30, 2013

    […] replicas of artworks that, to the untrained eyes, look exactly the same as the original. Engineer Tim Zaman showed that it’s possible to make high quality and full color scans of paintings using off […]

  8. September 30, 2013

    […] (Link) […]

  9. October 1, 2013

    […] holland kutató Tim Zaman egy olyan fényképészeti letapogató rendszert tervezett és épített, amellyel lehetségessé […]

  10. October 1, 2013

    […] pomoci modernej techniky dokáže Tim Zaman dokonale naskenovať akýkoľvek obraz a vytlačiť ho v 3D tlačiarni so všetkými ťahmi […]

  11. October 1, 2013

    […] Tim Zaman es el creador de un sistema de escaneo fotográfico que captura imágenes en tres dimensiones de las pinturas, luego los datos son llevados a una impresora 3D para crear una replica exacta. Primero las pinturas son escaneadas con dos cámaras y una proyección de franjas, lo que permite capturar hasta los detalles microscópicos de la pintura, todo este proceso toma un día por metro cuadrado. Las imágenes que se obtienen se vuelven a imprimir sobre un lienzo, pero la gracias está en que la replica imita a la perfección los trazos y el relieve de cada pintura. […]

  12. October 3, 2013

    […] Via: Tim Zaman. […]

  13. October 3, 2013

    […] Um pesquisador holandês, chamado Tim Zaman, de 25 anos, desenvolveu um sistema de digitalização fotográfica que permite  reproduzir, por meio de impressoras 3D, qualquer obra arte. Simplificando a explicação, seu projeto está baseado na combinação entre cameras HD, que capturam as imagens das telas, e as impressoras 3D. Dois exemplos de reprodução feitas por Zaman são de obras de Van Gogh e Rembrandt. As réplicas que esse sistema cria são realmente impressioantes, pelo que se pode ver aqui. […]

  14. October 4, 2013

    […] researcher and art enthusiast Tim Zaman has developed a 3D photographic scanning system that can capture the sculptural topography of a […]

  15. October 5, 2013

    […] Source: [Timzaman][Océ] […]

  16. October 10, 2013

    […] researcher Tim Zaman has built a photographic scanning system that uses two cameras and fringe projection to scan the […]

  17. October 10, 2013

    […] has their own approach for reproducing paintings. The group, along with with Dutch researcher Tim Zaman, have been working with the Rijksmuseum and Kröller-Müller museums in the Netherhlands to develop […]

  18. October 10, 2013

    […] Tim Zaman, a Dutch researcher at Delft University of Technology, has constructed a photographic scanning system that can accurately scan the surface of a painting and then print it. See, you can't really get a feel for a Rembrant merely by looking at a flat picture of one because so much detail and intricacy is missing without the texture of the artist's brushstrokes and the physicality of the dried paint. Zaman's device scans paintings to an accuracy of 50 microns and prints them out at 600 ppi, letting you enjoy some of the world's most celebrated artwork exactly how it was meant to be seen. “Paintings are not unlike sculptures, paint as a material has a huge impact on the way a painting looks," Zaman said. "By illuminating a painting with light, it automatically gives highlights and shadows that form the way we see it." […]

  19. October 11, 2013

    […] researcher Tim Zaman has built a photographic scanning system that uses two cameras and fringe projection to scan the […]

  20. October 19, 2013

    […] researcher Tim Zaman has built a photographic scanning system that uses two cameras and fringe projection to scan the […]

  21. October 20, 2013

    […] →3D scanning and printing made possible with the Nikon D800. […]

  22. October 24, 2013

    […] Printed Paintings | Tim Zaman […]

  23. October 29, 2013

    […] to render the resultant scan–and use an Oce printer that combines graphics and 3D printing to duplicate the painting […]

  24. November 23, 2013

    […] Fascinating Keynotesby Harry Verwayen of Europeana, Dieter Fellener of Fraunhofer Institute who talked about technologies focusing on industrialization and automation of the whole 2d-3d digitization process. Keynote by Tim Zaman from Delft: talked and showed “Scanning and Printing of Paintings in High Res- full-color-3D.” […]

  25. July 26, 2014

    […] transforming the world of reprographics, more specifically the reproduction of classic paintings. Tim Zaman, a researcher at Delft University of Technology has made a near perfect replica of Rembrandt’s […]

  26. October 23, 2015

    […] cloud data, this will be of particular interest to you: The scanner that Tim developed was used to replicate all 2 square-meters of the Jewish Bride by Rembrandt, which captured a massive pointcloud containing over a billion points! Tim is now a part-time PhD […]

  27. December 2, 2015

    […] page ici avec plusieurs vidéos, photos et […]

  28. December 7, 2015

    […] is Tim Zaman, he is a Dutch researcher who developed a method to 3D print the painting and make an accurate […]