Introduction: Ink painting is the traditional culture of our country, and it is the same as the Chinese Peking Opera. It has a long history, a long history and a profound foundation. It is a bright pearl in the treasures of oriental art. However, such a profound and profound jewel has been learned by AI. Is it a bit shocking? Recently, the multimedia computing team of the Institute of Automation of the Chinese Academy of Sciences announced their latest technology in replicating Chinese ink painting and Chinese calligraphy with AI.

Source of information: Voice of the Chinese Academy of Sciences

The AI ​​technology developed by the multimedia computing team of the Institute of Automation of the Chinese Academy of Sciences is generally working like this:

A photo (or scan) of a static freehand ink painting is recorded into the system, and the AI ​​system automatically extracts the strokes in the painting and analyzes and models the strokes. And infer the drawing process according to the relationship between the strokes, and design the rendering method. Eventually a static ink painting is restored to a dynamic drawing process.

AI painted orchid

So how does the team at the Institute of Automation of the Chinese Academy of Sciences let AI learn to create ink and wash?

First of all, we must be clear about the three stages of ink painting: first, draw some more significant strokes; secondly, draw detailed strokes; and finally draw some decorative strokes. Just like the one shown below:


Again, even if each stage of a painting is determined, the specific stroke order at different stages is yet to be determined. From the point where the pen ends, this also requires the scientists of the automation institute to exert their nuanced investigation power.

It is concluded that the stroke order of ink painting is influenced by many factors such as shape, shadow color, semantic information and paint reflection of the painter. Therefore, when the computer draws the order, it is necessary to consider adding local constraint rules.

Take the picture below:


From R1 to R7, the spatial rules, color rules, shape rules, ink color, ink color, stroke size, and circular constraints of ink painting are respectively indicated. Specifically, when determining the order of strokes, you need to follow the following principles:


After determining the specific stroke order of a painting, you can teach AI to re-enact the painting. When delivering an ink painting to the AI, it needs to complete the following steps:


The more intuitive form of expression is the following picture:

Flow chart of reconstruction model based on multi-stage prior


The AI ​​dynamic drawing process of ink painting is compared with the painter’s drawing process

After determining the drawing process of the ink painting, the scientific researcher will also draw each stroke in the stroke sequence dynamically according to the stroke direction of the stroke. Specifically, it is the process of re-engraving the brush on the rice paper.

At this point, the Chinese ink paintings, which are very artistic in our view, were dismantled into “mathematics” by the researchers of the Chinese Academy of Sciences. I don’t know if the ink painters will see the rhythm of the rice bowl and the rush of the rice bowl.

Prawn drawn by AI

However, Xiao Bian believes that the current AI can imitate only the primary meaning of ink painting, the real master level is still difficult for it. Moreover, the introduction of ink painting reconstruction is not only a topic of great research value, but also a variety of application scenarios.

such as:

1. Early childhood teaching of ink painting teaching software to help children learn ink painting at home:

Is it clearer after a stroke?

2, easy to create a Chinese style ink painting story, so that Chinese animation can also be inked:

The following is the completion of the AI ​​ink paintings published by the Institute of Automation of the Chinese Academy of Sciences:

In addition, in addition to ink painting, the Institute of Automation of the Chinese Academy of Sciences also allowed AI to re-enact Chinese calligraphy works. And compared to the uncertainty of the ink brush stroke sequence, the fixed order of the man’s stroke seems to make the business a bit simpler.

However, it is different from the usual font size in the usual font library. Researchers at the Chinese Academy of Sciences found that in fact, when the calligrapher wrote, the font size varied. Even in the same work, the same character size in different locations is not the same. In this way, with the mixed arrangement of Chinese characters, it is even more vivid that the calligraphy works are vivid and vivid.

Therefore, considering these factors, the researchers of the Institute of Automation of the Chinese Academy of Sciences have also designed the following process for calligraphy works:



It can be seen that the AI-made calligraphy works are more vivid and comfortable than the calligraphy works that can be presented by computers.

In addition, relevant introductions on the creation of ink painting AI by the multimedia computing team of the Institute of Automation of Chinese Academy of Sciences can be seen: