EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering

Understand

Generating accurate multilingual text with diffusion models has long been desired but remains challenging.

• Recent methods have made progress in rendering text in a single language, but rendering arbitrary languages is still an unexplored area.
• This paper introduces EasyText, a text rendering framework based on DiT (Diffusion Transformer), which connects denoising latents with multilingual character tokens encoded as character tokens.
• We propose character positioning encoding and position encoding interpolation techniques to achieve controllable and precise text rendering.