Text2PointCloud: Text-Driven Stylization for Sparse PointCloud

Abstract

We present Text2PointCloud, a method to process sparse, noisy point cloud input and generate high-quality stylized output. Given point cloud data, our iterative pipeline stylizes and deforms points guided by a text description and gradually densifies the point cloud. As our framework utilizes the existing resources of image and text embedding, it does not require dedicated 3D datasets with high-quality textures, which are produced by skillful artists or high-resolution colored 3D models. Also, since we represent 3D shapes as a point cloud, we can visualize fine-grained geometric variations with a complex topology such as flowers or fire. To the best of our knowledge, it is the first approach for directly stylizing the uncolored, sparse point cloud input without converting it into a mesh or implicit representation, which might fail to express the original information in the measurements, especially when the object exhibits complex topology.