Your application

Please complete the following fields to be considered for this project.

Please fill in this required field.
Please fill in this required field.
Please fill in this required field.
Please fill in this required field.
Please fill in this required field.
How much commitment will you have to this project?
Please select an option.
Are you available to dedicate 1-2 hours per week to the Build Project?
Please select an option.
Your application has been 
successfully submitted!
Explore more projects
Close
You already submitted an application for this project.
Explore more projects
Close
There was an error submitting your form. Please try again later or contact us.
Oops! Something went wrong while submitting the form.

This project is no longer accepting applications. Subscribe to our newsletter to be notified of new projects!

Get updates
Coloring 3D Objects Using Generative AI
Pablo Wiedemann
Pablo Wiedemann
Get updates
Register today
Apply now

Coloring 3D Objects Using Generative AI

Learn how to use modern AI image generators to color and stylize 3D objects through text prompts.

Register today
Apply now
Tuesdays
 at
7:00
P.M.
 ET /
4:00
P.M.
PT
8 weeks, 2-3 hours per week
Intermediate
No experience required
No experience required
Some experience required
Degree and experience required

Description

Generative AI is currently one of the most in-demand skills across multiple industries. As this technology continues to spread across a wide range of fields, the demand for professionals with experience in generative AI is only expected to grow. An area of particular interest is the intersection of computer graphics and generative AI. Can we utilize generative AI to create/edit 3D content? This holds significant potential for industries such as video games, digital architecture, e-commerce, and AR/VR.

You'll wear the hat of a Junior Machine Learning Scientist and leverage generative AI models to enhance 3D digital objects. You will use advanced technologies like "ControlNet" and the "Segment Anything Model" to generate and apply new colors and textures to 3D models. You will also become familiar with industry-standard tools such as Google Colab, PyTorch, and Diffusers.

Session timeline

  • Applications open
    May 27, 2024
  • Application deadline
    June 23, 2024
  • Project start date
    Week of July 8, 2024
    Week of
    July 8, 2024
  • Project end date
    Week of

What you will learn

  • Use Python to manipulate 3D objects and scenes
  • Use Hugging Face and PyTorch to run the latest ML models
  • Use Google Colab to perform ML experiments and share those with others
Build Projects are 8-week experiences that operate on a rolling basis. Selected participants engage in weekly live workshops with a Build Fellow and 2-15 other students.

Project workshops

1
Introduction
2
3D Object manipulation using Python
3
Introduction to ControlNet
4
ControlNet Part 2
5
Segment Anything Model
6
Image Super-Resolution
7
Consolidation and Cleanup
8
Presentations

Prerequisites

  • Good understanding of Python: you should be able to work with common data structures like lists, dictionaries, and sets; perform basic data and image manipulation and analysis using packages like NumPy and PIL.  
  • Basic knowledge of Machine Learning: you should understand ML concepts such as supervised and unsupervised learning, encoder/decoder, latent space, backpropagation, etc.  
  • Familiarity with PyTorch: You should know what a tensor is and how to manipulate it.  
  • Big plus: you have experience with computer graphics or 3D modeling tools. E.g. you have taken a course in computer graphics or related fields  
  • Other prerequisites: before the project starts, you'll need to have good internet connection to use Google Colab

Sign up today

Get access to all of our Build projects, including this one, by creating your Build account!

Register today
Log in

Apply to

Pablo

's project today!

Get started by submitting your application.

Apply now

Stay updated!

Subscribe to our newsletter to be notified when projects reopen!

Please fill in this required field.
By clicking “Subscribe” you agree to our Terms of Services and Privacy Policy.

Thanks for subscribing!

We'll notify you when projects reopen. In the meantime, you can explore our resources and learn more about our Fellows.

Discover our articles
There was an error submitting your form. Please try again later or contact us.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
About the expert

Pablo is the co-founder and Chief Product Officer at Hypothetic Inc., a 3D Generative AI company. With over seven years of experience as a Machine Learning scientist he has worked on ML for Computer Animation, 3D Rendering, and Fluid Simulations, and founded three ML companies. He holds an MSc in Applied Mathematics.

Visit
Pablo
's Linkedin