/3/ here

/3/ here.

How hard would be to code an application that takes thousands of anime pictures, train a NN on it and generates a 3D model based on it?

Other urls found in this thread:

youtube.com/watch?v=Oie1ZXWceqM
sciencedirect.com/science/article/pii/S228843001530049X
github.com/andersbll/neural_artistic_style
stats.stackexchange.com/questions/214908/is-it-possible-to-train-neural-network-to-draw-picture-in-a-certain-style
waifu2x.udp.jp/
dailymail.co.uk/sciencetech/article-3346683/What-computers-think-HUMANS-look-like-Neural-network-learns-create-bizarre-pictures-people.html
quora.com/Why-does-the-latest-anime-animation-3D-look-so-weird/answer/Martin-Schneider-2?srid=mhun
wired.co.uk/article/jaw-dropping-3d-model-software
twitter.com/NSFWRedditGif

Wow, you visit another internet board? Crazy.

If you have to ask you can't do it.

>generates a 3D model
>from static 2D images
AHAHAHAHAHA good luck with that.

I just entered college last week.

Harder than it would be to make the model yourself

Pretty hard mate. Less work just to 3D model the loli by hand.

It would be extremely painful

Your a big loli

I do plan on selling the software.

4u

Tbh senpai I have no experience in this area, but I can tell you now that won't be easy to make.

youtube.com/watch?v=Oie1ZXWceqM

It sounds like a good grad project.

Do you want it to only work for animu grills? Or also for recreating 3D grills/other 2D things?

my interest is anime shit, but I'm sure I could make millions if I make it general.

it'd be hard enough making one for photos of 3DPD, for anime it'd be pretty much impossible, since there's no consistent lighting or even positions of things like facial features

>learning babbys first java / C
>i want to code neural networks
s l o w d o w n

Very,

...

this is why 2d > 3d

Neat.

Do cartoons really use that many angles. I'm thinking they might just have 10-20 different angle they can put characters at which cover every scenario. If that's true, it could be a barrier to hd grills

Do you have a clear, unambiguous, objective, way to grade the results?

Can you transfer that grading into code?

Do you have a way to translate the output of the NN into a model?

If you answered yes to all three, then it's easy to get some output. Hard to get usable output, and harder to get good output. Even harder to get consistently good output.

If you didn't answer yes to all three, it's impossible.

It's a great idea OP. But you're gonna have a hard time.

sciencedirect.com/science/article/pii/S228843001530049X
youtube.com/watch?v=Oie1ZXWceqM
github.com/andersbll/neural_artistic_style
stats.stackexchange.com/questions/214908/is-it-possible-to-train-neural-network-to-draw-picture-in-a-certain-style
waifu2x.udp.jp/
dailymail.co.uk/sciencetech/article-3346683/What-computers-think-HUMANS-look-like-Neural-network-learns-create-bizarre-pictures-people.html

The cost of computing power and time would far far outweigh the cost of getting your own personal 3D anime artist.

>not selling the software and becoming rich

Nobody would buy it. The cost to produce any acceptable output is massive, probably in the $10k to $20k range. Producing not only acceptable but good results every single time would cost you at least over a million. This is without a development team to produce the software into an end user product.

>not making a prototype and then selling the idea to autodesk

I can guarantee you AutoDesk will not even open the email.

"FREE 3D WAIFUS EVERYTIME GAURENTEED XD"

>what is venture capital

They will make 500x what you sold it to them for. You don't like taking it in the ass from corporations, do you?

comunist pls kys

I rather seek a patent than giving it to the looser homelex hobby OS comunity.

>Implying I'm communist
Communism is a plague the only creates hollow counties.

But, I also know when a corporation is scamming me. In the case of selling it, Autodesk is barely using lube.

You're asking if a computer can create a new dimension of detail when given a series of images based in a lower dimension. This would depend on if the images in the lower dimension were all consistent in design (e.g. eye placement relative to mouth is consistent throughout) and the images include pictures from all angles, and some topology. You could map it into a 3D space kind of like how people can map a chart of the earth into a globe.
But by the time you've done all that designing in 2D, you might as well have just made a model from scratch. Though maybe you could try to map shading on characters as topology, but it would be rough and I have a feeling many artists are not seriously thinking about depth when adding shade, and are rather trying to get cel-shading aesthetic or some other aesthetic. And getting the hairstyles mapped would be a nightmare. It wouldn't be reliable for training a NN with.

Or I get money, make a company, hire employees, then I'm fired by the board of CEOS and my company is hired by autodesk in the end.

there's no way to win.

Make sure you are the only one with access to the source code, other than devs who are on a restricted machine that can't connect to the Internet or USBs.

They can't fire you then because that will kill the company.

Photogrammetry is used to take 2d photos to create a 3d model. This is usually okay to create a quick and dirty model that needs clean up when more advance 3d scanning is unavailable.

However, one issue with what you want is that Anime does not use consistent models that are capable of existing in 3d space. So existing algorithms will fail.

Using NNs you could replicate the style of the anime such that it could "draw" what the character would look like at certain angles and poses, BUT learning AI needs an Input to map to an Output. In other words along with the photos of the anime character it needs control values that represent the correct answer. Without something representing whats correct, there's nothing to learn.


One option would be to create a standard bone structure and overlay it on every anime picture, providing the correct answer, and hope the NN can learn from that. BUT this would take a significant amount of work, and considering the volume of styles, constant retraining would be required.

So yeah it's possible to get something, but a human 3d modeling a character is FAR easier, faster and produce more reliable results.

Even hand-modelled anime renders look like shit. The industry has been trying very very hard to move in that direction because it would drastically cut costs, but it just looks like shit.

This is the best explanation I've found so far: quora.com/Why-does-the-latest-anime-animation-3D-look-so-weird/answer/Martin-Schneider-2?srid=mhun

that video is amazing

Your main problem is that 2d drawing, especially cartoons are often impossible geometries because parts are different shapes depending on the angle you view them. That's why its so hard to get 3d models always look stiff compared to animation. Disney actually came up for a solution to this a while ago I would start there.

wired.co.uk/article/jaw-dropping-3d-model-software

He doesn't have to do it from scratch. I'm sure there are tons of tools if OP could just learn to google

Oh I love that song.

Hey dude, try it out. That sounds like an interesting project, and you might get some neat results.

There is a crude way with a cracked version of a 3DSexvilla called The Klub17. In the game there is a tool that will generate a rough 3D face from 1-2 photos, then it can be further manipulated with sliders to perfect their face. Here are some of my attempts

this is a blue board, m8y

Anime is possible, though I haven't tried it myself, you can use the same in-game generator on picture of the characters face head on(should be easy to obtain) then apply it to the Hentai Models, since their head shape would better accommodate the wild proportions.

sorry about that, these two are at least sfw