Whakautu poto: Ka mahi te whakanui ake i te AI mā te whakangungu i tētahi tauira ki ngā whakaahua taumira iti me te taumira teitei kua takirua, kātahi ka whakamahia hei matapae i ngā pika tāpiri e whakaponohia ana i te wā e whakanui ake ana. Mena kua kite te tauira i ngā kakano, i ngā kanohi rānei rite tonu i te wā e whakangungu ana, ka taea e ia te tāpiri i ngā taipitopito whakamīharo; ki te kore, ka "whakaaroaro" pea i ngā taonga toi pēnei i ngā porowhita, te kiri ware pi, te kimo rānei i roto i te ataata.
Ngā kōrero matua hei whakaaroaro:
Matapae: Ka whakaputa te tauira i ngā taipitopito e tika ana, ehara i te mea ka oti te hanga anō i te mooni.
Kōwhiringa tauira: He pumau ake ngā CNN; he koi ake te āhua o ngā GAN engari ka tūpono pea rātou ki te hanga āhuatanga hou.
Ngā tirotirohanga o ngā taonga tuku iho: Kia tūpato ki ngā porowhita, ngā kakano e tāruaruatia ana, ngā "me te mea he reta", me ngā mata kirihou.
Te pumau o te ataata: Whakamahia ngā tikanga wā, ki te kore ka kite koe i te kanapa me te nekeneke mai i te anga ki te anga.
Te whakamahinga nui: Mena he mea nui te tika, whakaaturia te tukatuka, ā, whakamahia ngā hua hei tauira.
Kua kite pea koe i tēnei: ka huri te ahua iti, pakari hei mea pakari hei tā, hei rere, hei maka rānei ki roto i tētahi whakaaturanga me te kore e māharahara. He rite ki te tinihanga. Ā, - i te huarahi pai rawa atu - he ahua pēnā 😅
Nō reira, ko te mahi a te AI Upscaling he mea motuhake ake i te "whakarei ake a te rorohiko i ngā taipitopito" (he piupiu-ā-ringa) ā, he tata ki te "matapae a te tauira i te hanganga taumira-teitei e tika ana i runga i ngā tauira i akohia mai i ngā tauira maha" (Hohonu Ako mō te Taumira-Ahua Nui: He Rangahau). Ko taua taahiraa matapae te kaupapa katoa - ā, koinei te take ka ātaahua te āhua o te AI upscaling… he kirihou pakupaku rānei… he rite rānei ki te huruhuru tāpiri i tupu i tō ngeru.
Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:
🔗 Te mahi a te AI
Akohia ngā kaupapa matua o ngā tauira, ngā raraunga, me te whakatau whakatau i roto i te AI.
🔗 Te ako a te AI
Tirohia me pēhea e whakapai ake ai ngā raraunga whakangungu me ngā urupare i te mahi a te tauira i roto i te wā.
🔗 Te kite a te AI i ngā āhuatanga rerekē
Kia mārama ki ngā tauira taketake me te tere o te tohu a te AI i ngā whanonga rerekē.
🔗 Te tohu a AI i nga ahuatanga
Tūhurahia ngā tikanga matapae e kitea ai ngā tohu me te matapae i te hiahia ā meake nei.
Te mahi a te AI Upscaling: te ariā matua, i roto i ngā kupu o ia rā 🧩
Ko te whakanui i te taumira he whakanui i te taumira: he nui ake ngā pika, he nui ake te ahua. Ko te whakanui i te taumira tuku iho (pērā i te bicubic) he whakaroa i ngā pika me te whakangawari i ngā whakawhiti (whakawhitinga Bicubic). He pai, engari kāore e taea te hanga hou - ka whakawhitiwhiti noa.
Ko te whakanui ake i te AI e whakamātau ana i tētahi mea māia ake (arā, "super-resolution" i roto i te ao rangahau) (Te Ako Hōhonu mō te Whakaahua Super-resolution: He Rangahau):
-
Ka tirohia te tāuru iti-taumira
-
Ka mōhio ki ngā tauira (ngā taha, ngā kakano, ngā āhuatanga o te kanohi, ngā whiu tuhinga, te raranga papanga…)
-
E matapae ana i te āhua o tētahi putanga teitei ake te taumira
-
Ka whakaputa raraunga pika tāpiri e ōrite ana ki aua tauira
Ehara i te mea "whakahoki mai i te mooni kia tino tika," engari he rite ki te "whakapae i tētahi whakaaro tino pono" (Image Super-Resolution Using Deep Convolutional Networks (SRCNN)). Mena he ahua whakapae tērā, kāore koe i te hē - engari koinei anō te take e pai ai te mahi 😄
Āe, ko te tikanga o tēnei ko te whakanui ake i te AI he moemoeā noa iho… engari i roto i te huarahi whai hua, e whakaute ana i ngā pika.
He aha te mea e pai ai te putanga o te whakapai ake i te AI? ✅🛠️
Mena kei te arotake koe i tētahi kaiwhakahou AI (he tautuhinga kua whakaritea rānei), koinei te mea tino nui:
-
Te whakaora taipitopito me te kore e tunua rawa. Mā
te whakanui ake i te tauine ka tāpirihia he pakari me te hanganga, ehara i te haruru pakari, i ngā pore rūpahu rānei. -
Te whakatikatika i ngā taha
Ka noho ma tonu ngā rārangi ma. Ka wiri ngā taha, ka pihi rānei ngā poroporo i ngā tauira kino. -
Te āhua tūturu o te kakano
Kaua te makawe e rite ki te whiu paraihe peita. Kaua te pereki e rite ki te tā tauira e tāruaruatia ana. -
Te whakahaere haruru me te pēhitanga
He maha ngā whakaahua o ia rā ka mate i te JPEG. Kāore te whakahōhonutanga pai e whakanui ake i taua kino (Real-ESRGAN). -
Te mōhio ki te kanohi me te tuhinga
Ko ngā kanohi me te tuhinga ngā wāhi māmā ki te kite i ngā hapa. Ka ata tirohia e ngā tauira pai (he momo motuhake rānei). -
Te ōritetanga puta noa i ngā anga (mō te ataata)
Mēnā ka rere ngā taipitopito mai i tētahi anga ki tētahi anga, ka hamama ō kanohi. Ka ora, ka mate rānei te whakanui ake i te ataata mā te pumau o te wā (BasicVSR (CVPR 2021)). -
Ngā mana whakahaere whai tikanga
Ka hiahia koe ki ngā kiriata e hono ana ki ngā hua tūturu: te whakakore haruru, te whakakore i te haruru, te tango i ngā taonga tuku iho, te pupuri i ngā kōpura, te whakakoi… ngā mea whai hua.
He ture marino e mau tonu ana: ko te "whakanui" pai rawa atu ko te mea kāore e tino kitea e koe. Me te mea he kāmera pai ake tāu i te tīmatanga 📷✨
Ripanga Whakataurite: ngā kōwhiringa whakanui AI rongonui (me ō rātou painga) 📊🙂
Kei raro nei tētahi whakatairite whai hua. He āhua pōuri ngā utu nā te mea he rerekē ngā taputapu i runga i te raihana, ngā paihere, ngā utu rorohiko, me ērā atu mea ngahau katoa.
| Utauta / Huarahi | Pai rawa atu mō | Te āhua o te utu | He aha i mahi ai (tata ki te) |
|---|---|---|---|
| Ngā taputapu whakapai papamahi kāhua-Topa (Whakaahua Topa, Ataata Topa) | Ngā whakaahua, ngā ataata, ngā mahi ngāwari | Utu-āhua | He kaha ngā tauira whānui + he nui ngā whakatikatika, he "mahi noa iho" ... te nuinga |
| Ngā āhuatanga momo "Super Resolution" a Adobe (Adobe Enhance > Super Resolution) | Ngā kaiwhakaahua kei roto kē i taua pūnaha | Ohaurunga-y | He whakahounga taipitopito pakari, he tikanga pupuri tonu (he iti ake te whakaari) |
| Ngā momo ESRGAN-Tuturu / ESRGAN (ESRGAN-Tuturu, ESRGAN) | Ngā mahi DIY, ngā kaiwhakawhanake, ngā mahi puranga | Kore utu (engari he nui te wā) | He tino pai ki ngā taipitopito kakano, ka pā kino ki te mata mena kāore koe e tūpato |
| Ngā aratau whakanui e hangai ana ki te horapa (SR3) | He mahi auaha, he hua ātaahua | Whakaranu | Ka taea te waihanga i ngā taipitopito ataahua - ka taea hoki te tito i ngā mea wairangi, nō reira… āe |
| Ngā kaiwhakapai ake kēmu (kāhua DLSS/FSR) (NVIDIA DLSS, AMD FSR 2) | Te tākaro me te whakaputa i te wā tūturu | Kua pūpūhia | Ka whakamahi i ngā raraunga nekehanga me ngā akoranga o mua - ka angitu te mahi maeneene 🕹️ |
| Ngā ratonga whakanui kapua | Te whai huatanga, ngā wikitoria tere | Utu-mō-ia-whakamahinga | Tere + tauine, engari ka taea e koe te whakahaere i te hokohoko me te ngawari i ētahi wā |
| Ngā kaiwhakatairanga AI e aro ana ki te ataata (BasicVSR, Topaz Video) | Ngā kiriata tawhito, anime, ngā pūranga | Utu-āhua | Ngā mahi tinihanga wā poto hei whakaiti i te kanapa + ngā tauira ataata motuhake |
| Te whakanui ake i te waea atamai/taiwhanga whakaahua | Whakamahinga noa | Kei roto | He tauira māmā kua whakatikatikaina kia pai ai te putanga, kaua kia tino tika (he whai hua tonu) |
Te whakahōputu i te whaki āhua rerekē: He nui te mahi a te "Paid-ish" i roto i taua ripanga. Engari kua mārama koe ki te whakaaro 😅
Te mea ngaro nui: ka ako ngā tauira i tētahi mahere mai i te kounga iti ki te kounga teitei 🧠➡️🖼️
Kei te ngako o te nuinga o te whakanui ake i te AI ko te whakaritenga ako e tirotirohia ana (Image Super-Resolution Using Deep Convolutional Networks (SRCNN)):
-
Tīmata ki ngā whakaahua taumira teitei (te "pono")
-
Whakaitihia ki ngā putanga taumira iti (te "whakauru")
-
Whakangunguhia he tauira hei hanga anō i te kounga teitei taketake mai i te kounga iti
I roto i te wā, ka ako te tauira i ngā hononga pēnei i:
-
"Ko tēnei momo pōuriuri huri noa i te kanohi nō ngā kamo te nuinga o te wā"
-
"He maha ngā wā ka tohu tēnei rōpū pika i te tuhinga serif"
-
"He rite te āhua o tēnei pikinga taha ki tētahi rārangi tuanui, ehara i te haruru matapōkere"
Ehara i te maumahara i ngā whakaahua motuhake (i te tikanga māmā), engari he ako i te hanganga tatauranga (Hohonu Ako mō te Whakaahua Tino Taumira: He Tirotiro). Whakaarohia he rite ki te ako i te wetereo o ngā kakano me ngā taha. Ehara i te wetereo rotarota, he rite tonu ki… wetereo ā-ringa a IKEA 🪑📦 (he kupu whakarite uaua, engari he tata).
Ngā mea nui: he aha ngā mea ka tupu i te wā o te whakatau (ina whakahōu koe) ⚙️✨
Ina whāngaihia e koe tētahi whakaahua ki roto i tētahi kaiwhakatikatika AI, he rite tonu te ahua o tētahi ara mahi penei:
-
Te tukatuka i mua
-
Tahurihia te wāhi tae (i ētahi wā)
-
Whakaōritehia ngā uara pika
-
Tapatapahia te ahua kia poraka mēnā he nui (tirohia te mooni VRAM 😭) (Repo Real-ESRGAN (ngā kōwhiringa taera))
-
-
Tangohanga āhuatanga
-
Ka kitea e ngā paparanga tōmua ngā tapa, ngā kokonga, ngā rarawe
-
Ka kitea ngā tauira e ngā paparanga hohonu ake: ngā kakano, ngā āhua, ngā wāhanga o te mata
-
-
Te Whakahoutanga
-
Ka whakaputa te tauira i tētahi mahere āhuatanga teitei ake te taumira
-
Kātahi ka hurihia tēnā hei putanga pika tuturu
-
-
Te tukatuka i muri i te tukatuka
-
Te whakakoi kōwhiringa
-
Whakakore haruru kōwhiringa
-
Te pehi i ngā taonga tuku iho (te tangi, te porowhita, te aukati)
-
Kotahi te taipitopito ngawari: he maha ngā taputapu e whakapaipai ana i ngā taera, kātahi ka whakaranua ngā tuitui. He taputapu pai e huna ana i ngā rohe taera. Ka waiho e ngā taputapu iti he tohu mātiti mena ka kōpiko koe. Āe, ka kōpiko koe, nā te mea he pai ki te tangata te tirotiro i ngā hapa iti i te 300% whakanui pērā i ngā gremlin iti 🧌
Ngā whānau tauira matua i whakamahia mō te whakapai ake i te AI (me te take he rerekē ai te āhua) 🤖📚
1) Te whakatau-rahi e ahu mai ana i te CNN (te hoiho mahi matarohia)
He tino pai ngā whatunga io honohono mō ngā tauira ā-rohe: ngā taha, ngā kakano, ngā hanganga iti (Image Super-Resolution Using Deep Convolutional Networks (SRCNN)).
-
Ngā Painga: tere, pumau, iti ake ngā ohorere
-
Ngā Huakore: tera pea he āhua "tukatuka" mēnā ka pēhia kia kaha
2) Te whakanui ake i te GAN (āhua ESRGAN) 🎭
Ka whakangungu ngā GAN (Whatunga Tautohe Whakaputa) i tētahi kaihanga whakaahua ki te whakaputa whakaahua kounga teitei e kore e taea e te kaiwhakawehewehe te wehewehe mai i ngā mea tūturu (Whatunga Tautohe Whakaputa).
-
Ngā Painga: ngā taipitopito pakari, te kakano whakamiharo
-
Ngā Huakore: ka taea te tito i ngā taipitopito kāore i reira - i ētahi wā he hē, i ētahi wā he mīharo (SRGAN, ESRGAN)
Ka taea e te GAN te hoatu i taua koi whakamiharo ki a koe. Ka taea hoki e ia te hoatu i tētahi tukemata tāpiri ki tō kaupapa whakaahua. Nō reira… whiriwhiria ō pakanga 😬
3) Te whakanui ake i te horapa (te kāri mohoao auaha) 🌫️➡️🖼️
Ka tangohia e ngā tauira horapa te haruru i ia taahiraa, ā, ka taea te ārahi hei whakaputa i ngā taipitopito kounga teitei (SR3).
-
Painga: tino pai ki te tuhi taipitopito, inā koa mō ngā mahi auaha
-
Ngā Huakore: ka taea te mawhiti atu i te tuakiri/hanganga taketake mena he kaha ngā tautuhinga (SR3)
Koinei te wāhi e tīmata ai te "whakapiki ake" me te "whakaaro anō." I ētahi wā koinā tonu te mea e hiahiatia ana e koe. I ētahi wā kāore.
4) Te whakanui ake i te ataata me te ōritetanga o te wā 🎞️
He maha ngā wā ka tāpirihia e te whakanui ake i te ataata he arorau e mōhio ana ki te nekehanga:
-
Ka whakamahi i ngā anga tata hei whakau i ngā taipitopito (BasicVSR (CVPR 2021))
-
E ngana ana ki te karo i ngā mea e kimo ana, e ngokingoki ana hoki
-
He maha ngā wā ka whakakotahi i te super-resolution me te denoise me te deinterlacing (Topaz Video)
Mena he rite te whakanui ake i te ahua ki te whakaora i tētahi peita, he rite te whakanui ake i te ataata ki te whakaora i tētahi pukapuka hurihuri me te kore e huri i te āhua o te ihu o te kiripuaki i ia whārangi. He uaua ake tēnei i te whakaaro.
He aha te āhua rūpahu o te whakapai ake i te AI i ētahi wā (me pēhea te kite) 👀🚩
Kāore e taea te kite i te angitu o te whakapai ake i te AI. Kia ako koe i ngā tauira, ka kitea e koe i ngā wāhi katoa, pērā i te hoko waka hou, ā, ka kite ohorere koe i taua tauira i ngā tiriti katoa 😵💫
Ngā kōrero noa:
-
Te kiri ware pi i ngā mata (he nui rawa te denoise + te whakangawari)
-
Ngā porowhita whakakoi rawa i ngā taha (te rohe "tapahi rawa") (te whakawehenga rua-ira)
-
Ngā kakano tāruarua (ka huri ngā pakitara pereki hei tauira tārua-whakapiri)
-
He rerekētanga iti pakari e karanga ana i te "arogarithm"
-
Te whakarerekētanga tuhinga, ina huri ngā reta ki ngā reta tata-reta (te momo kino rawa atu)
-
Te nekenekehanga taipitopito e huri mārire ana ngā āhuatanga iti, inā koa i roto i ngā rerengamahi horapa (SR3)
Ko te wāhanga uaua: i ētahi wā ka "pai ake" te āhua o ēnei taonga ina tirohia kotahi. He pai ki tō roro te koi. Engari i muri i tētahi wā poto, ka ahua ... hē.
He rautaki pai te whakaiti i te tirohanga, me te tirotiro mēnā he āhua tūturu i te tawhiti tirohanga noa. Ki te pai noa te āhua i te 400% whakanui, ehara tēnā i te wikitoria, he mahi whakangahau tēnā 😅
Te mahi a te AI Upscaling: te taha whakangungu, me te kore e pāngia e te pāngarau 📉🙂
Ko te whakangungu i ngā tauira tino-taumira ko te tikanga:
-
Ngā huinga raraunga takirua (tāuru iti-res, ūnga teitei-res) (Whakaahua Taumira-Nui Ma te Whakamahi i ngā Whatunga Whakawhitiwhiti Hōhonu (SRCNN))
-
Ngā mahi ngaronga e whiu ana i ngā hanganga hē (SRGAN)
Ngā momo mate noa:
-
Te ngaronga o te pika (L1/L2)
Ka akiaki i te tika. Ka puta he hua ngoikore. -
Ngaronga Tirohanga
Ka whakataurite i ngā āhuatanga hohonu ake (pēnei i te "he te āhua ") kaua ki ngā pika tuturu (Perceptual Losses (Johnson et al., 2016)). -
Te Ngaronga Tautohe (GAN)
Ka akiaki i te tūturutanga, i ētahi wā ka whakaiti i te tika o te kōrero (SRGAN, Generative Adversarial Networks).
He pakanga tonu kei te haere tonu:
-
Me whakarite kia pono ki te taketake,
ki te -
Me waiho kia ātaahua ki te titiro
He rerekē ngā wāhi e tau ai ngā taputapu rerekē ki taua whānuitanga. Ā, ka pai ake pea koe ki tētahi i runga i te mea kei te whakaora koe i ngā whakaahua whānau, kei te whakarite rānei i tētahi pānui e nui ake ai te "ātaahua" i te tika o te tātaritanga.
Ngā rerenga mahi whai hua: ngā whakaahua, ngā karapa tawhito, ngā anime, me ngā ataata 📸🧾🎥
Ngā whakaahua (ngā whakaahua o ngā whare, ngā whenua, ngā whakaahua o ngā hua)
Ko te tikanga pai rawa atu ko:
-
Whakakorehia te haruru mārie i te tuatahi (mēnā e tika ana)
-
Whakapaipai me ngā tautuhinga matatika
-
Tāpirihia anō te witi mēnā he maeneene rawa te āhua (āe, tino)
He rite te witi ki te tote. Ka pakaru te tina i te nui rawa, engari kāore e reka te witi 🍟
Ngā karapa tawhito me ngā whakaahua kua tino kōpeketia
He uaua ake ēnei nā te mea ka taea e te tauira te whakamahi i ngā poraka kōpeketanga hei "kano".
Whakamātauria:
-
Te tango, te whakakore rānei i ngā mea hanga
-
Kātahi ka whai hua
-
Kātahi ka whakakoi mārire (kaua e nui rawa… e mōhio ana ahau, e kī ana te katoa i tēnā, engari tonu)
Anime me te toi raina
Ngā painga o te toi raina mai i:
-
Ngā tauira e tiaki ana i ngā taha ma
-
āhua o
te whakanekeneke anime nā te mea he māmā ake, he ōrite hoki ngā āhua. (Waimarie.)
Ataata
Ka tāpirihia e te ataata ētahi atu taahiraa:
-
Denoise
-
Wetewete (mō ētahi pūtake)
-
Whakarei ake
-
Te whakangawari, te whakaū rānei i te wā (BasicVSR (CVPR 2021))
-
Te whakahokinga mai o te witi hei whakakapi i te hononga
Ki te kore koe e aro ki te ōritetanga o te wā, ka memeha haere taua āhua kanapa. Kia kitea rā anō, kāore e taea te wareware. Pērā i te tūru haruru i roto i te rūma marino 😖
Te whiriwhiri i ngā tautuhinga me te kore e whakapae noa (he tinihanga iti) 🎛️😵💫
Anei tētahi whakaaro pai hei tīmatanga:
-
Ki te āhua kirihou ngā mata,
Whakaitihia te haruru, whakaitihia te whakakoi, whakamātauria he tauira, he aratau rānei hei tiaki i te mata. -
Ki te tino kaha rawa te āhua o ngā kakano,
whakaitihia ngā nekehanga "whakarei ake i ngā taipitopito" me te "whakaora i ngā taipitopito" rānei, tāpirihia he kakano ngawari ki muri. -
Ki te tiaho ngā taha,
whakaitihia te whakakoi, tirohia ngā kōwhiringa pehi āwhata. -
Ki te āhua "AI" rawa te ahua o te ahua,
kia āta whakaaro. I ētahi wā ko te mahi pai ko te… whakaiti i te kaha.
Me kī anō: kaua e whakanui ake i te 8x nā te mea ka taea e koe. Ko te 2x, 4x rānei te mea pai rawa atu. Haunga tēnā, kei te tono koe ki te tauira kia tuhi pakiwaitara mō ō pika 📖😂
Ngā tikanga matatika, te pono, me te pātai whakamā o te "pono" 🧭😬
Ka huna te rārangi i te whakanui ake i te AI:
-
Ko te whakaora ko te whakahoki mai i ngā mea o mua
-
Ko te whakarei ake he tāpiri i te mea kāore i te
Mō ngā whakaahua whaiaro, he pai noa iho (ā, he ataahua hoki). Mō ngā mahi pāpāho, ngā taunakitanga ture, ngā whakaahua hauora, ngā mea katoa rānei e hira ana te pono… me tūpato koe (OSAC/NIST: Aratohu Paerewa mō te Whakahaere Whakaahua Mamati Tūpāpaku, Aratohu SWGDE mō te Tātari Whakaahua Tūpāpaku).
He ture māmā:
-
Mena he nui ngā tūponotanga, me whakaaro ki te whakapiki ake i te hangarau mohio (AI) hei tauira noa iho, kaua hei whakamutunga.
He mea nui anō hoki te whakaaturanga i roto i ngā horopaki ngaio. Ehara i te mea he kino te AI, engari nā te mea me mōhio te hunga whakarongo mēnā i hangaia anōtia ngā taipitopito, i hopukina rānei. He mea whakaute noa iho tēnā.
Ngā tuhipoka whakamutunga me te whakarāpopototanga poto 🧡✅
Nā, ko te mahi a te AI Upscaling koia tēnei: ka ako ngā tauira i te hononga o ngā taipitopito taumira teitei ki ngā tauira taumira iti, kātahi ka matapae i ngā pika tāpiri pono i te wā o te upscaling ( Hohonu Ako mō te Taumira-Ahua Nui: He Rangahau ). I runga i te whānau tauira (CNN, GAN, horapa, ataata-wā), ka taea e taua matapae te ātaahua me te pono… he maia rānei, ā, i ētahi wā he koretake 😅
Whakarāpopototanga tere
-
Ka whakaroahia e te whakanui ake tuku iho ngā pika (Bicubic interpolation)
-
Mā te whakanui ake i te AI ka matapae i ngā taipitopito ngaro mā te whakamahi i ngā tauira kua akohia (Image Super-Resolution Using Deep Convolutional Networks (SRCNN))
-
He hua pai ngā hua mai i te tauira tika me te pupuri i te mana
-
Mātakihia ngā āwhata, ngā mata ware pi, ngā kakano e pūmau ana, me te kimokimo i roto i te ataata (BasicVSR (CVPR 2021))
-
He "whakahoutanga whaitake" te whakanui ake i te taumata, ehara i te pono tino tika (SRGAN, ESRGAN)
Ki te hiahia koe, kōrero mai ki ahau he aha tāu e whakapai ake ana (ngā kanohi, ngā whakaahua tawhito, ngā ataata, ngā anime, ngā matawai tuhinga), ā, ka tūtohu atu ahau i tētahi rautaki tautuhinga hei karo i ngā hapa noa o te "ahua AI" 🎯🙂
Tauira o te ao tūturu: Te whakapai ake i ngā whakaahua hua o te mākete tawhito 📸
Horopaki
He toa kāmera iti kua whakamahia kētia, e 40 ngā whakaahua hua i kaweakehia mai i tētahi paetukutuku tawhito, he 800px te whānui. E hiahia ana te rangatira ki te whakamahi anō i aua whakaahua ki tētahi whārangi hokohoko ipurangi hou, ko te rahi whakaahua e taunakitia ana he 1,600px te whānui.
Ko te raruraru: mā te whakarerekētanga rahi noa ka āhua ngohengohe ngā kāmera, engari mā te whakanui ake i te AI ka āhua rūpahu ngā pupuri rapa, ngā tau raupapa, me ngā tohu arotahi. He mea nui tēnei nā te mea ka whakawhirinaki ngā kaihoko ki aua taipitopito i mua i te hoko.
Ehara i te mea ko te "whakaora" i ngā mōhiohio ngaro kia tino tika te whāinga. Engari ko te waihanga i ngā whakaahua rārangi kia ma ake, me te pupuri tonu i ngā kōnae taketake kia wātea, nā te mea ka matapaehia e te AI te taipitopito pono, kaua te pono kua oti te whakapūmau.
Ngā mea e hiahiatia ana e te tukanga mahi
Ngā whakaahua hua taketake, ko ngā putanga tino iti te kōpeketanga e wātea ana
He rahi putanga ūnga, pērā i te 2× teitei mai i te 800px ki te 1,600px te whānui
He taputapu, he tauira rānei me ngā mana whakahaere motuhake mō te whakakore haruru, te whakakoi, me te tango taonga tuku iho
He rārangi arowhai arotake māmā mō te tuhinga, ngā taha, ngā waitohu, ngā tīwiri, ngā pātene, te kiri hiako, me ngā whakaata
He kōpaki mō ngā tuhinga taketake me tētahi kōpaki motuhake mō ngā kaweake kua whakatikahia, kia kore ai he mea e tuhia anōtia
Tauira tohutohu
Whakamahia tēnei momo tohutohu ina whakamātautau ana i tētahi kaiwhakahou AI:
Whakanuia ake tēnei whakaahua hua mā te 2× mō tētahi rārangi hokohoko ipurangi. Kia tata tonu te āhua o te taonga, te tūnga o te waitohu, ngā tohu arotahi, ngā taha pātene, me te kakano o te mata ki te taketake. Whakamahia he horoinga pēhi ngawari, he whakakoi iti, ā, karohia te hanga tuhinga tāpiri, ngā karawarawa, ngā tapanga, ngā tau raupapa, ngā taipitopito whakapaipai rānei. Me āhua tūturu te ahua o te whakaahua whakamutunga i te rahi whārangi hua noa, kaua e koi noa i te 400% whakanui.
Me pēhea te whakamātautau
Tīmata ki ngā whakaahua whakauru e rima i mua i te tukatuka i te puranga katoa:
Kotahi te whakaahua hua ma me te rama pai
Kotahi te whakaahua kua kōpeketia ki te JPEG me te āhua poraka
Kotahi te whakaahua me ngā tuhinga iti kua tāia, ngā tohu arotahi rānei
Kotahi te ahua pōuri me te haruru i roto i ngā atarangi
Kotahi te ahua me te whakarewa whakaata, te karāhe rānei
I muri i te whakanui ake i te tauine, whakatairitehia ia hua ki te taketake i te 100% me te 200%. Tirohia mēnā kei te ōrite tonu ngā ingoa waitohu, ngā porowhita, ngā tīwiri, ngā putanga, me ngā tauira kakano. Mena ka hangaia e te tauira he "tāpiri reta" he tohu mata rūpahu rānei, whakaitihia te tautuhinga whakakoi, te tautuhinga whakaora taipitopito rānei.
Hua
Hua whakaahua: i runga i te wā i whakaritea ai he whakamātautau whakaahua-rima i mua atu, ā, i muri mai i te whakamahinga o tēnei tukanga mahi.
E iwa meneti te roa o te horoi ā-ringa me te whakarerekē rahi mō ia whakaahua, arā, e 45 meneti mō ngā whakaahua e rima.
E toru meneti te roa o te tukanga mahi ā-AI mō ia whakaahua, arā, 15 meneti mō ia whakaahua e rima.
E 30 meneti pea te roa o te penapena mō ngā whakaahua e rima, arā, tata ki te 4 hāora te roa o te penapena puta noa i te puranga whakaahua e 40.
Hua o te tirotiro kounga: 4 o roto i te 5 ngā whakaahua i eke ki te arotakenga tuatahi. Kotahi te whakaahua i rahua nā te mea i whakapōturitia te kuputuhi o te karāhe iti e te kaiwhakapai ake, nō reira i tukatukahia anō me te whakakoi iti iho, kāore hoki i whakarei ake i te kuputuhi.
Ko te inenga nui i konei ehara i te mea ko te "ahua koi ake". Engari: e hia ngā whakaahua e paahitia ana e te arotake taha-ki-taha, kāore he taipitopito hangai?
He aha te mea ka hē
Ka taea e te tauira te huri i te puehu, i ngā poraka JPEG, i ngā karawarawa rānei hei kakano "tūturu".
Ka taea e ngā tuhinga iti te huri hei tuhinga rūpahu e āhua pono ana kia whakanuia rā anō e koe.
Ka āhua ware pi te rapa, te hiako, te mea paraihe rānei ki te nui rawa o te denoise.
Mā te whakakoi kaha ka puta he porowhita huri noa i ngā taha o te hua.
Ka taea e te tukatuka puranga te huna i ngā hapa, no reira arotakehia he tauira i mua i te kaweake i ngā mea katoa.
Mō te hokohoko tuihono, ko te ture haumaru ko te māmā noa iho: kaua rawa e whakamahi i te whakapai ake i te hangarau mohio (AI) hei huna i ngā pakaru, hei whakarerekē i te āhua, hei hanga rānei i tētahi hua kia hou ake i tōna āhua o nāianei.
He kai tango-ā-ringa whai hua
Ka tino pai te mahi a te whakapai ake i te AI ina whakaarohia he mahi whakaoti whakahaere, ehara i te pātene whakatika makutu. Whakamahia ngā tautuhinga 2× ātaahua, tirohia ngā taipitopito e arohia ana e ngā kaihoko, ā, puritia te ahua taketake kia mau tonu te pono o te putanga whakatika.
Tauira o te ao tūturu: Te whakanui ake i tētahi ataata whakangungu tawhito me te kore e whakakanapa
Horopaki
He ataata whakaaturanga haumaru e whitu meneti te roa kei tētahi kamupene whakangungu iti i hopukina i te tau 2014 i te 720p. He uara tonu ngā ihirangi, engari he ngawari te āhua o ngā ataata i runga i te paetukutuku hou a te kamupene, inā koa i runga i ngā mata pona nui ake.
E hiahia ana te tīma ki te kaweake i tētahi putanga 1080p ma, me te kore e tāruatia anō. Ko te mōrearea, mā te whakanui ake i te AI ka āhua rite ngā mata ki te ware pi, ka huri i ngā tuhinga o ngā tohu hei "mea rite ki ngā kupu", ka hanga rānei i te kakano pīataata mai i te anga ki te anga.
Ehara i te mea kia āhua hou te ataata. Engari kia mārama ake, kia pumau ake, kia iti ake te kōpeketanga, me te pupuri tonu i te mata o te kaiako, ngā tapanga whakatūpato, ngā nekehanga ringa, me ngā taipitopito taputapu kia rite ki te taketake.
Ngā mea e hiahiatia ana e te tukanga mahi
Kōnae ataata taketake, kaua i te tango pāpāho pāpori kua kōpeketia mēnā ka taea
Te rahi kaweake whāinga, pērā i te 720p ki te 1080p kaua e peke tika ki te 4K
He whakaneke ake ataata me ngā kōwhiringa whakakore haruru, whakakoi, whakatika kōpeketanga, me te ōritetanga o te wā
He ataata whakamātautau poto me ngā mata, ngā nekehanga, ngā tuhinga, me ngā mata taipitopito
He rārangi arowhai arotake mō te kimo, ngā āputaputa, te tuhinga piko, te kakano o te mata, me ngā taha nekeneke
He tārua kua tiakina o te ataata taketake hei whakataurite me te whakaatu mēnā e tika ana
Tauira tohutohu
Whakamahia tēnei momo tohutohu i mua i te tukatuka i te ataata katoa:
Whakarei ake i tēnei ataata whakangungu 720p ki te 1080p. Whakatairangahia te nekehanga maori, ngā taha pumau, te tuhinga kua oti te pānui, me te kakano kiri pono. Whakamahia he whakatikatika pēhanga ngawari me te whakakoi iti. Kaua e hanga tuhinga ngaro, waitohu, tapanga, karawarawa, taipitopito kanohi, tohu taputapu rānei. Āta karohia te kanapa o te anga-ki-anga. Me mārama ake te hua whakamutunga i te rahi tirohanga noa, kaua e koi hangai ina mutu me te whakanui ake.
Me pēhea te whakamātautau
I mua i te tukatuka i te kōnae 7-meneti katoa, kaweakehia he tauira 20-hekona kei roto:
Te mata o te kaiako i a ia e kōrero ana
He ringa e neke ana puta noa i te anga
He tapanga whakatūpato, he tuhinga iti rānei kua tāia
He mata kakano, pērā i te papanga, te raima, te konganuku paraihe, te kirihou rānei
He paraharaha kāmera, he nekehanga wiri rānei
Mātakihia te tauira kia rua ngā wā: kotahi i te tere noa, kotahi i te wā i whakamutua ai, i te wā i whakamutua ai, i te wā i whakamutua ai, i te wā i whakamutua ai. I te tere noa, tirohia mēnā he kimo, he kakano ngokingoki, he nekehanga tauhou rānei i ngā taha. Ina whakamutua, whakatairitehia ngā putanga taketake me ngā putanga kua whakapaia hei tirotiro mēnā kei te ōrite tonu te tuhinga, ngā pātene, ngā taputapu, me ngā āhuatanga o te mata.
Hua
Hua tauira: i runga i te wā i tangohia ai tētahi riipene whakamātautau 20-hekona te roa, kātahi ka whakamahia ngā tautuhinga ōrite ki tētahi ataata 7-meneti te roa.
E 35 meneti te roa o te tukanga mahi "whakarerekē rahi me te whakakoi" ā-ringa, tae atu ki te kaweake me te arotake, engari i kitea te kanapa i runga i te makawe o te kaiako me ngā porowhita huri noa i ngā tohu haumaru.
E 55 meneti te roa o te tukanga mahi āwhina-AI tae atu ki ngā kaweake whakamātautau, engari i whakaitihia ngā raruraru arotake mai i te 8 ngā take e kitea ana i te kaweake tuatahi ki te 2 ngā take iti i te kaweake whakamutunga.
I paahitia e te putanga whakamutunga ngā arowhai 10 o roto i te 12 i te rārangi arowhai arotake. Ko ngā take e rua i toe ko te ngawari o te tuhinga papamuri me te haruru iti i te kokonga pōuri kotahi. I whakaaetia ngā mea e rua nā te mea i noho rite tonu te kaiako, ngā taputapu, me ngā hikoinga haumaru.
Ehara te inenga whai tikanga i konei i te "1080p kua tutuki". Engari: e hia hēkona o te ataata e whakaatu ana i ngā taonga whakararuraru i te wā e purei noa ana?
He aha te mea ka hē
Tērā pea ka whakakoi te tauira i ngā poraka kōpeketanga, kia rite ai ki te kakano tūturu.
Ka āhua maia ake te ahua o ngā tuhinga pai engari ka iti ake te tika.
Ka māeneene rawa ngā mata mēnā he nui rawa te haruru.
Ka kanapa pea ngā taha e neke ana mēnā ka motuhake rawa te whakahaere a te taputapu i ia anga.
Tērā pea ka kino ake te āhua o te kaweake 4K i te kaweake 1080p kua āraia nā te mea me nui rawa ngā taipitopito e hangaia ana e te tauira.
Ko te hapa nui ko te whakatau i tētahi anga kua whakatā noa iho. Me ātaahua te ahua o te whakanui ake i te ataata i roto i te nekehanga, kaua ko te mea whakamiharo anake hei whakaahua tonu.
He kai tango-ā-ringa whai hua
Mō te ataata, ka pai ake te mahi a te whakapai ake i te AI ina whakamatautauria he wāhanga poto i te tuatahi, ka pupuri i te mea papai kia pakupaku, ka aromatawai i te nekehanga i mua i te koi. He pai ake te hua ngawari engari pumau i te putanga koi e kimo ana i ia nekehanga.
Ngā Pātai Auau
Te whakanui ake i te AI me tana mahi
Mā te whakanui ake i te taumira o te ahua (e kiia ana ko te "super-resolution") ka whakanui ake i te taumira o te ahua mā te matapae i ngā taipitopito taumira teitei e ngaro ana mai i ngā tauira i akohia i te wā whakangungu. Engari i te totoro noa i ngā pika pēnei i te interpolation bicubic, ka ako te tauira i ngā taha, ngā kakano, ngā mata, me ngā whiu rite ki te tuhinga, kātahi ka whakaputa raraunga pika hou e hono ana ki aua tauira i akohia. Ehara i te mea he "whakaora i te mooni" engari he "hanga i tētahi whakapae pono" e kīia ana he taiao.
Te whakanui ake i te AI ki te bicubic, ki te whakarerekētanga tuku iho rānei
Ko ngā tikanga whakanui ake tuku iho (pērā i te bicubic) ka hono i waenga i ngā pika o nāianei, ka whakangawari i ngā whakawhiti me te kore e hanga taipitopito hou. Ko te whāinga o te whakanui ake i te AI he hanga anō i te hanganga whaitake mā te mohio ki ngā tohu tirohanga me te matapae i te āhua o ngā putanga teitei-whakataurite o aua tohu. Koia te take ka tino koi ake ngā hua o te AI, me te take hoki ka taea e rātou te whakauru mai i ngā taonga tuku iho, te "hanga" rānei i ngā taipitopito kāore i te kitea i roto i te pūtake.
He aha te āhua o ngā mata he ware pi, he maeneene rawa rānei
Ko ngā mata ware pi ka puta mai i te whakakorenga haruru me te whakangawari kaha me te whakakoi e tango ana i te kakano kiri tūturu. He rite tonu te mahi a te maha o ngā taputapu ki te haruru me te kakano pai, nō reira mā te "horoi" i te ahua ka taea te muku i ngā pore me ngā taipitopito ngawari. Ko tētahi huarahi noa ko te whakaiti i te whakakorenga haruru me te whakakoi, te whakamahi i te aratau tiaki kanohi mēnā e wātea ana, kātahi ka tāpirihia he paku kiko kia iti ake te āhua kirihou o te hua, kia nui ake te whakaahua.
Ngā taonga whakanui AI noa hei tirotiro māu
Ko ngā tohu noa ko ngā porowhita huri noa i ngā taha, ngā tauira kakano e tāruatia ana (pēnei i ngā pereki tārua-whakapiri), te rerekētanga moroiti pakari, me te tuhinga e huri ana hei "mehemea he reta". I roto i ngā rerengamahi e hangai ana ki te horapa, ka taea hoki e koe te kite i te nekenekehanga taipitopito i te wā e huri mārire ana ngā āhuatanga iti. Mō te ataata, he tohu nui te kimo me te ngokingoki taipitopito puta noa i ngā anga. Mena he pai te āhua i te whakanui tino nui, tera pea he tino kaha rawa ngā tautuhinga.
Ngā rerekētanga o ngā hua i waenganui i a GAN, CNN, me ngā kaiwhakatairanga horapa
Ko te whakatau-rahi e ahu mai ana i te CNN he pumau ake, he māmā ake te matapae, engari ka āhua "kua tukatukahia" mēnā ka kaha te pana. Ko ngā kōwhiringa e ahu mai ana i te GAN (kāhua ESRGAN) he maha ngā wā ka puta he kakano pakari ake me te koi e kitea ana, engari ka taea e rātou te whakaaro pohehe i ngā taipitopito hē, inā koa i ngā mata. Ka taea e te whakanui ake e ahu mai ana i te horapa te whakaputa i ngā taipitopito ataahua, e tika ana, engari ka neke atu pea i te hanganga taketake mēnā he kaha rawa ngā tautuhinga ārahi, kaha rānei.
He rautaki tautuhinga whai hua hei karo i te āhua "tino AI"
Tīmatahia kia ātaahua: kia 2×, kia 4× rānei i mua i te toro atu ki ngā āhuatanga tino nui. Ki te āhua kirihou ngā mata, whakahokia te whakakore haruru me te whakakoi, ka whakamātau i te aratau mataara-kanohi. Ki te tino kaha rawa ngā kakano, whakaitihia te whakarei ake i ngā taipitopito, ā, whakaarohia te tāpiri i ngā momo kākano ngawari i muri mai. Ki te kanapa ngā taha, whakaitihia te whakakoi, ā, tirohia te pehi i te āro, i te pehi taonga rānei. I roto i te maha o ngā paipa, ko te "iti" te mea e toa ana nā te mea ka mau tonu te pono pono.
Te whakahaere i ngā karapa tawhito, i ngā whakaahua JPEG kua tino kōpeketia rānei i mua i te whakanui ake
He uaua ngā whakaahua kōpeke nā te mea ka taea e ngā tauira te whakamahi i ngā taonga poraka hei kakano tūturu, ā, ka whakanuia ake. Ko te tukanga mahi noa ko te tango i ngā taonga, te tango rānei i te aukati i te tuatahi, kātahi ka whakanui ake, kātahi ka whakakoi mārire mēnā e tika ana. Mō ngā matawai, mā te horoi mārie ka āwhina i te tauira ki te arotahi ki te hanganga tūturu kaua ki te kino. Ko te whāinga he whakaiti i ngā "tohu kakano rūpahu" kia kore ai te kaiwhakanui e akiakihia ki te whakatau whakaaro maia mai i ngā whakaurunga haruru.
He aha te uaua ake o te whakanui i te ataata i te whakanui i te whakaahua
Me rite tonu te whakanui ake i te ataata puta noa i ngā anga, kaua e pai anake ki te whakaahua kotahi. Mēnā ka pīataata ngā taipitopito i waenga i ngā anga, ka tere te whakararuraru i te hua. Ka whakamahia e ngā huarahi arotahi-ataata ngā mōhiohio wā mai i ngā anga tata hei whakau i te hanga anō me te karo i ngā taonga kanapa. He maha ngā rerenga mahi kei roto ko te whakakore haruru, te tango hononga mō ētahi pūtake, me te whakauru anō i ngā kōpura kia rite ai te raupapa katoa, kaua ki te koi hangai.
Ina kāore e tika ana te whakanui ake i te AI, he mōrearea rānei te whakawhirinaki atu ki
Ko te whakapai ake i te hangarau mohio (AI) he mea pai ake te whakaaro he whakarei ake, ehara i te taunakitanga. I roto i ngā horopaki nui pēnei i te mahi nūpepa, te taunakitanga ture, te whakaahua hauora, te mahi tātaritanga rānei, ka taea e te whakaputa pika "pono" te whakapohehe i a ia anō nā te mea ka tāpirihia pea ngā taipitopito kāore i hopukina. Ko te anga haumaru ake ko te whakamahi hei whakaahua me te whakaatu i te tukanga a te AI i hanga anō i ngā taipitopito. Mena he mea nui te pono, tiakina ngā mea taketake me te tuhi i ia taahiraa tukatuka me te tautuhinga.
Ngā Tohutoro
-
arXiv - Te Ako Hōhonu mō te Whakaahua Taumira-Nui: He Rangahau - arxiv.org
-
arXiv - Te Whakataunga Atahanga Tino-Whakataurite mā te Whakamahi i ngā Whatunga Whakawhitiwhiti Hōhonu (SRCNN) - arxiv.org
-
arXiv - Real-ESRGAN - arxiv.org
-
arXiv - ESRGAN - arxiv.org
-
arXiv - SR3 - arxiv.org
-
Kaiwhakawhanake NVIDIA - NVIDIA DLSS - developer.nvidia.com
-
AMD GPUOpen - FidelityFX Super Resolution 2 - gpuopen.com
-
Te Tūāpapa Tirohanga Rorohiko (CVF) Uru Tuwhera - BasicVSR: Te Rapunga mō ngā Wāhanga Matua i roto i te Ataata Taumira-Nui (CVPR 2021) - openaccess.thecvf.com
-
arXiv - Ngā Whatunga Taupatupatu Whakaputa - arxiv.org
-
arXiv - SRGAN - arxiv.org
-
arXiv - Ngā Ngaronga Tirohanga (Johnson et al., 2016) - arxiv.org
-
GitHub - Pūnaha Real-ESRGAN (ngā kōwhiringa taera) - github.com
-
Wikipedia - Te whakapūtanga rua-pū - wikipedia.org
-
Topaz Labs - Whakaahua Topaz - topazlabs.com
-
Topaz Labs - Ataata Topaz - topazlabs.com
-
Pokapū Āwhina Adobe - Adobe Enhance > Super Resolution - helpx.adobe.com
-
NIST / OSAC - Aratohu Paerewa mō te Whakahaere Whakaahua Mamati Tūpāpaku (Putanga 1.0) - nist.gov
-
SWGDE - Ngā Aratohu mō te Tātari Whakaahua Tūpāpaku - swgde.org