Text to 3D Unity Plugin

Makedraft Text-to-3D Unity Plugin

What is it?

• A Unity plugin that lets you generate 3D models from text prompts in only a few seconds.

Why's it on itch.io?

• This plugin is currently in beta and is pending release on Unity Asset Store. The wait time is a few months, so it's released here for now.

How do you use it?

• Give it a prompt, click generate and it will download a 3D model in OBJ format with pre-textured vertex colors into the Assets/Makedraft/ directory.  The plugin auto-creates the Assets/Makedraft/ directory.
• Optionally, you can specify negative prompts, a seed and resolution. You'll likely want to leave resolution and the seed to the default, and you'll likely find the negative prompts to be quite useful.

Requirements

• It requires a subscription to https://3d.makedraft.com. 
  • Note that it is NOT https://makedraft.com. Makedraft 3D is a different service under the same brand!
  • The subscription is needed to pay for GPU inference cost.
• Purchasing this asset will grant you 3 months of Makedraft 3D and access to the official Unity plugin when it's released.
• Please email david@makedraft.com with your order number and give 30 minutes to an hour depending on the time of day. 
• Your subscription doesn't start until your first generation.

How does it work?

• It uses the same model architecture as Large Reconstruction Model and TripoSR. Think of it as an upgraded TripoSR, with none of the core issues (Eg. No marching cube shifting problem, improved resolution, improved texture quality).
  • Hong, Yicong, et al. "Lrm: Large reconstruction model for single image to 3d." arXiv preprint arXiv:2311.04400 (2023).
  • Tochilkin, Dmitry, et al. "Triposr: Fast 3d object reconstruction from a single image." arXiv preprint arXiv:2403.02151 (2024).

Strengths

• It is quite good at generating 3D models intended to be background characters or objects.
• As an example of the quality of the generations, with a sample size of <40 generations and absolutely no cherry picking, 20 of the generations were good enough quality to be usable in a game as background characters, background objects or for prototyping.
• To see examples of the generated models, see https://3d.makedraft.com/gallery.

Limitations

• It is NOT good at generating models with flat surfaces such as tables or chairs.
• Polygon count can be high depending on what you're generating. This is a work-in-progress.
• Highly detailed prompts can end up creating poorer models. Clear and concise prompts is the best way to produce good quality models.

Goals

• Image to 3D is coming in a month. Note you'll receive optional updates after you purchase the plugin.
• The eventual hope is to have a standalone Unity plugin that doesn't require a subscription, and you'd be able to use your own GPU to generate 3D models. For now, this is difficult since it'd need to account for different drivers, GPUs and OS. Please email david@makedraft.com if this interests you.

Feedback

• Please email david@makedraft.com with your feedback if you want to see a feature or like something improved. 
• You can expect immediate action on any feedback and will likely see an update within the same day to a few days.