What's stopping studios from upscaling every frame of an anime with something like waifu2x and making a 4k version?

What's stopping studios from upscaling every frame of an anime with something like waifu2x and making a 4k version?

Other urls found in this thread:

mega.nz/#!0sACGB7L!kRgWhJk5VehU4PV6UihYKM1c6WKTi2VUZHI22CadNIY
twitter.com/NSFWRedditGif

Time.

Time is money in the extremely stressful and tightly scheduled everyday life of late-night anime show production.

Some studios can't even keep up with their schedule and fall behind.

But it's an automated process.

It doesn't work like this retard.

Yeah rendering farms cost money dumbdumb

Explain

It's just 2D stuff, you could do it on any computer in the studio.

Do you know how much time and money this shit costs? You need specialised equipment to render quickly and I don't feel optimistic about the prospect of studios having spare high-end computers lying around.

Why do you need a high end computer?

They're just upscaling video, not rendering 3D models.

How many frames do you think an episode has in it?

Waifu2x is good, but not enough to upscale a whole episode. There will be issues with quality along the run. Try doing it yourself with a few screenshots.

you are a literal retard

There's only one way to solve this.

>Jacob's bitch
>Fakku shill
Heed our call and answer us, Daiz!

30,000, excluding the OP/ED which you would only have to do once. But it only takes a second or two to upscale an image on my toaster.

You could get several episodes done in a day.

Anyway, waifu2x looks kind of crap because it smooths out any textures, it's only practical for really simplistic looking shows.

This
Waifu2x is good for pictures but if you make an animation out of it would look bad because of the way it works.
They would need to make a program that would upscale whole episodes at once to make the frames look "consistent"

>Just upscale 26400 frames of animation
Great idea OP, you should send it to Japan asap.

...

A resized image has the same amount of details as the smaller one, or rather less because every time you use a filter you lose detail and color information. Usually characters are drawn 3x-4x bigger than they need to be and resized during compositing, not the other way around. It's one of the reasons why animation is so expensive.
Also, once an image is compressed, you can't do anything with it anymore. I mean you can, but it's going to look like one of those "cum to our anime meetup" posters. Learn some basics about animation before asking something embarrasing.

>Implying most BD of older anime aren't already blatant upscales

You ain't summoning shit with that pathetic ritual.

I BESEECH THEE, SO THAT YOU MAY ANSWER OUR CRIES AND SHED LIGHT UPON OUR WAY.

HEED MY PLEA AND COME FORTH TO THIS THREAD, GREAT AND UNRIVALED GOD OF ALL SUBS.

I HEREBY SUMMON YOU, DAIZ!

fansubbing
Hi10p
10bit
h.264
h.265
Nyaa
Tokyotosho
Underwater
Commie
MPC
VLC
VP8
VP9
WebM
One-Punch Man
Crunchyroll
Artifacts
Codec
Fakku

>Also, once an image is compressed, you can't do anything with it anymore

Do you actually think they don't hold on to all their source material?

Most of that is outdated user.

so just to be clear, nobody has done time-coherent upscaling, right?

I have!

It's like asking them to make anime in 60 frames.

Never seen an anime studio use it but Neptunia devs used it when porting some side story PSV games to PC.

What's stopping studios from using vector graphics for everything

The insane amount of time it would take to create a vector graphic of similar detail level to a non-vector image

i don't believe you

>yfw it actually works
Also, prove it faggot.

>not wanting his anime to look like a watercolor painting.

Yeah that shit there.
You can tell they are using the same filter for anime as well by those distinctive washed out thick black lines.

All those faggots in this thread saying applying filters to every frame would be too costly or impossible...

Anyway waifu2x is an overglorified shit, I can tell they are upscales a mile a way and I can achieve similar results with any graphic program.

Make this same thread in about 2 day's time. These things take a while

Been meaning to watch haibane for quite a while, so I take it that I should grab the DVD release instead?

I'm not into graphics but my guess is that present tools are just bad. The process of creating anything from scratch could exactly be the same, using lines and gradients, with just different underlying representation. I can only see the problem when you take pictures and run filters on them to make backgrounds

old anime are literally water colored

Because they would have to draw at such a higher resolution, the ways they cut corners would be FAR more noticeable, etc, etc.

It would be a huge drain on the art side of things.

I don't know much about old animation, but wouldn't it be really hard to use water colours for anything other than backgrounds and such?

It allows for lots of people to get reasonably good upscales without having to learn the rudiments of graphic programs or stuff. Waifu2x is a good compromise.

Miyazaki

It won't make much of a difference if you watch it in full screen mode. You'll either watch a pre-rendered upscale or a real-time rendered upscale with madvr or whatever you are using.

BD releases just tend to be better because they have better compression.

The sad truth is that if an anime is old, it will always be low quality.

Watercolors have been used for backgrounds but absolutely not animated objects. It's called cel animation because everything was painted on celluloid sheets and watercolors would not stick on those. They used acrylic painting.

>The sad truth is that if an anime is old, it will always be low quality.
If by old you literally mean "from around 2000 to around 2006". That's the true quality dead zone where they were mastering digitally at SD.
Stuff older than that can either be awful quality or amazing quality, depending on whether they still have the masters.

I've actually waifu2x'ed an entire anime (the Sono Hanabira OVA before it got an HD re-release). It took just north of 15 hours to upscale a 24 minute OVA, and I had to re-do it a few times because I kept fucking up.

It was passable at best:
mega.nz/#!0sACGB7L!kRgWhJk5VehU4PV6UihYKM1c6WKTi2VUZHI22CadNIY

Since I've now actually figured out how to build a neural network myself, I might one day re-do Waifu2x to upscale using multiple frames. The difficulty will be finding training data though.

doesn't waifu2x run through the lua vm?
seems like you could make it a lot faster

But they do, have you seen the Ichigo Mashimaro BD release?

Yeah I guess that time frame is literally the worst

But I have my doubts that you can reach the current level of detail and cleanliness from old analog masters.

Sure there aren't any problems of upscaling there which is already a great thing. But there are problems of noise especially due to deterioration.

Those can be cleaned and fixed but it takes too much time and effort, not likely to happen for most anime series

I did this over a year ago so my memory isn't that great, but I was pretty sure I was using a CuDNN implementation.

They did this to Aria, it's not ok.
It doesn't work for the animated medium

Thing is, waifu2x can do that much faster, automatically and in a batch run. You'd take several minutes to hours per frame.

>But there are problems of noise especially due to deterioration.

Only actual autists care about this shit. That random strand of hair stuck on the animation cel can be charming in its own way.

you can try and make a script that screenshots any episode of Yozakura Quartet, then processes it with waifu2x.

one (1) Frame takes me around 2~4 seconds on the web interface, so let's say it'll take 2 secs for every frame.

YZQ usually has around 10.000 KEYframes, which will alread take you 20k seconds or 5,6 hours. Let's say a keyframe makes for 4-5 other frames, and we're looking at a day per episode.

the waifu2x one looks like shit though.

a) Artists. Most animators work with pen and paper. Even though they can achieve comparable results on tablets, time, money, and willpower are needed to make a transition. It would also be more expensive (at least on the short run), so why bother if you can just scan sufficiently detailed drawing in required HD resolution?

b) Tools. Hand-drawn vector animation toolchains have been neglected because of lack of need in them, and lack of need kept them undeveloped. Ironically (or not?), >Flash is/was the best solution. It's a bit crazy that animation and game studios now use 3D CG toolchains to produce more or less decent results because there is no vector tools with such capabilities. IIRC, only Toei uses vector CG tools because that's what they switched to in the '00s, and their Deviantart-tier coloring speaks for itself.

Try getting the PAL DVD rip.

It looks like ass

That's just first generation of statistics-based upscalers, modern ones are way better at guessing details to reconstruct.

Google "super resolution" papers to learn more.

They do this when they release early 2000's anime in BD.

It's so easy, why don't all anime studios do this?

Except they usually fuck it up and use some horrible warpsharp filter.

It's probably gonna be a few more years before upscaling technology can work on animation without it looking like total ass.

Because it creates random “artistic touches” not present originally, like that zero with umlauts in oppic?

Because it is likely to produce them differently after a small change in the source, turning anything that moves into a wobbly mess?

I am pretty sure that even most simple horizontal panning would cause that zero to wiggle like crazy.

waifu2x is a meme scaling algorithm. The denoising is way too aggressive and it's slow as shit for not even that great results (especially with anime - it's been trained for much sharper lineart than what you generally get with actual anime footage). You'd be better off using something like NNEDI3, which runs in a fraction of time. You could do lot of other filtering on top of that too and still end up with less processing time with waifu2x for overall much better results.

Though it's not like Japan knows anything about decent processing in the first place. Just look at the cancer that is QTEC upscales. I guess nothing but waifu2x would probably be a slight improvement over that at least.

So, let's say you want to make a neural network that is trained to achieve maximum quality for anime and real time is not an objective (as NNEDI is pretty good for that task).

What training set would you use?

where can I learn about video and other stuff you know? can it be self taught?

Waifu2x uses CUDA right? Just buy 6 Titan X and do this in 1~2 hours.

Don't respond to the idiot.
The fuck is wrong you?

Time.
Using shitty filters.
Etc.

Might aswell just upscale it and add some blur filters.

It wouldn't be temporally coherent.