Marginaliadaily

Creating 3D Optical Illusions with AI

orig. “JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising” · Siang-Ling Zhang, Huai-Hsun Cheng, Tsung-Ju Yang, Yu-Lun Liu

Computer Vision Intermediate 5 min read AI-assisted, reviewed by Alex Dong
In the margin
Heads up
Imagine being able to create stunning 3D visual illusions that change as you look at them from different angles, and now AI can do it quickly and easily

3D visual illusions are like magic tricks for your eyes, where one object looks like two different things depending on the angle you view it from.

Creating these illusions used to be a slow and difficult process, with existing methods producing unrealistic colors or visible seams.

The new approach, called JanusMesh, uses a two-stage process to generate these illusions. First, it creates a 3D shape that can be viewed from different angles, and then it adds textures to the shape to make it look realistic from each angle.

This process uses denoising, which is like cleaning up noise in an image, and diffusion priors, which help the AI understand what the texture should look like from different views

The ability to create realistic 3D visual illusions quickly and easily has many potential applications, from art and design to education and training. It could also be used to create more realistic special effects in movies and video games, or to help architects and engineers visualize and communicate their designs more effectively

Source

Siang-Ling Zhang, Huai-Hsun Cheng, Tsung-Ju Yang, Yu-Lun Liu

Paste it and we'll explain it even more simply.

Member notes Sign in ↗
AD Alex Dong TEAM
The editorial team picked this paper because it is worth your time, and an AI drafted this note. We check each one and rewrite it when the draft misses the mark.
A Smarter Way for AI to Understand Videos
Intermediate
Making Sense of Long Videos
Intermediate
Teaching AI to Understand Videos from a First-Person View
Intermediate