Abstract
De novo molecular design plays an important role in drug discovery. Here a novel generative model, Tree-Invent, was proposed to integrate topological constraints in the generation of molecular graph. In this model, a molecular graph is represented as a topological tree in which ring system, non-ring atom and chemical bond are regarded as ring node, single node and edge respectively. The molecule generation is driven by three independent sub-models for carrying out operations of node addition, ring generation and node connection. One unique feature of the generative model is that topological tree structure can be specified as constraint for structure generation, which provides more precise control on structure generation. Combining with reinforcement learning, Tree-Invent model could efficiently explore targeted chemical space. Moreover, Tree-Invent model is flexible enough to be used in versatile molecule design settings such as scaffold decoration, scaffold hopping and linker generation.