Ehara te AI i te mea he tauira whakahirahira, he kaiawhina kōrero rānei e whaiwhai ana i te tangata. Kei muri i ēnā mea katoa, he maunga - he moana i ētahi wā - o ngā raraunga. Ā, he pono, ko te penapena i aua raraunga? Koinei te wāhi e pōrearea ai ngā mea. Ahakoa kei te kōrero koe mō ngā paipa tautuhi whakaahua, mō te whakangungu tauira reo nunui rānei, ka tere te huri o ngā whakaritenga rokiroki raraunga mō te AI ki waho o te mana whakahaere mena kāore koe e whakaaroaro. Me wehewehe tātou he aha te take he tino uaua te rokiroki, he aha ngā kōwhiringa kei runga i te tēpu, me pēhea te whakataurite i te utu, te tere, me te tauine me te kore e pau.
Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:
🔗 Pūtaiao raraunga me te mātauranga horihori: Te heke mai o te auahatanga
Te tūhura i te huarahi e akiaki ai te AI me te pūtaiao raraunga i te auahatanga o ēnei rā.
🔗 Te mātauranga wai horihori: Te heke mai o te AI me ngā raraunga pokapū
He tirohanga ki ngā raraunga AI whakahaere-motuhake me ngā auahatanga hou.
🔗 Te whakahaere raraunga mō ngā taputapu AI me tirotiro e koe
Ngā rautaki matua hei whakapai ake i te rokiroki me te whai huatanga o ngā raraunga AI.
🔗 Ngā taputapu AI pai rawa atu mō ngā kaitātari raraunga: Whakapai ake i te whakatau tātari
Ngā taputapu AI tino pai e whakarei ake ana i te tātari raraunga me te whakatau kaupapa.
Nā… He aha te mea e whai hua ai te rokiroki raraunga AI? ✅
Ehara i te mea ko te "rahi ake o ngā terabytes". Ko te rokiroki tūturu e pai ana ki te AI ko te whai hua, te pono, me te tere mō ngā oma whakangungu me ngā kawenga mahi whakatau.
He iti noa ngā tohu e tika ana kia mōhiotia:
-
Tauine : Te peke atu i ngā GB ki ngā PB me te kore e tuhi anō i tō hoahoanga.
-
Mahi : Ka kore e taea e ngā GPU te mahi i te roanga o te wā whakaroa; kāore e murua ngā arai.
-
Tauwhāinga : Ngā whakaahua poto, te tāruarua, te whakaputanga - nā te mea ka pakaru ngā whakamātautau, ka pakaru hoki ngā tāngata.
-
Te whai hua o te utu : Te taumata tika, te wā tika; ki te kore, ka puta puku mai te pire pērā i te arotake taake.
-
Te tata ki te rorohiko : Whakatakotoria te rokiroki ki te taha o ngā GPU/TPU, ki te ārai rānei i te tuku raraunga mā te mataara.
Ki te kore, he rite ki te whakahaere i tētahi Ferrari me te wahie o te mīhini tapahi tarutaru - ka neke tonu, engari kāore e roa.
Ripanga Whakataurite: Ngā Kōwhiringa Rokiroki Noa mō te AI
| Momo Rokiroki | Taunga Pai rawa atu | Papa Tākaro Utu | He aha i pai ai (kāore rānei e pai) |
|---|---|---|---|
| Rokiroki Ahanoa Kapua | Ngā pakihi hou me ngā pakihi rahi-waenga | $$ (taurangi) | Ngāwari, pakari, tino pai mō ngā roto raraunga; kia tūpato ki ngā utu putanga + ngā tono whakapā. |
| NAS i runga i te papa | Ngā whakahaere nui ake me ngā tīma hangarau mōhiohio | $$$$ | Te whakaroa e taea te matapae, te mana whakahaere katoa; te whakapaunga moni ā-mua + ngā utu whakahaere tonu. |
| Kapua Ranu | Ngā whakaritenga e tino hiahiatia ana mō te whakatutuki i ngā whakaritenga | $$$ | Ka whakakotahi i te tere ā-rohe me te kapua pīwariwari; ka tāpirihia e te whakarite te ānini. |
| Ngā Huinga Katoa-Flash | Ngā kairangahau tino hihiri | $$$$$ | Tino tere rawa te IOPS/throughput; engari ehara te TCO i te mea whakakatakata. |
| Ngā Pūnaha Kōnae Tohatoha | Ngā kaiwhakawhanake AI / ngā tautau HPC | $$–$$$ | Te I/O whakarara i te tauine nui (Kanapanapa, Tauine Whānuitanga); he tūturu te taumahatanga mahi. |
He aha te take e tino piki haere ai ngā hiahia mō ngā raraunga AI 🚀
Ehara i te mea ko te hopu whakaahua whaiaro anake te mahi a te AI. He hiakai rawa atu.
-
Ngā huinga whakangungu : Kei roto i te ILSVRC a ImageNet anake te ~1.2M whakaahua kua tohua, ā, he nui atu i tērā ngā kohinga motuhake o te rohe [1].
-
Putanga : Ko ia whakatikatika - tapanga, wehewehenga, whakanuinga - ka waihanga i tētahi atu "pono".
-
Ngā tāurunga roma : Te tirohanga ora, te ine waea, ngā whāngai pūoko… he ngongo ahi tonu.
-
Ngā hōputu kore hanganga : Kuputuhi, ataata, oro, rangitaki - he nui rawa atu i ngā ripanga SQL kua whakaritea.
He kai paramanawa, ka taea e koe te kai katoa, ā, ka hoki mai anō te tauira mō te kai reka.
Kapua vs Kei te Wāhi: Te Tautohe Mutunga Kore 🌩️🏢
He āhua whakamīharo te kapua: tata mutunga kore, ā-ao whānui, utua i a koe e mahi ana. Kia puta rā anō ngā utu putanga mai - ā, kātahi ka rite ō utu rokiroki "iti" ki te whakapaunga rorohiko [2].
I tētahi atu taha, ka tukuna e te pūnaha whakahaere-ā-rohe te mana whakahaere me te mahi tino pakari, engari me utu anō hoki koe mō ngā taputapu, te hiko, te whakamatao, me te tangata hei tiaki tamariki.
Ko te nuinga o ngā tīma ka noho ki waenganui pōrearea: ranu . Puritia ngā raraunga wera, tairongo, me te tere whakaputanga nui kia tata ki ngā GPU, ā, ko te toenga ka purangatia ki ngā taumata kapua.
Ngā Utu Rokiroki e Piki Korekore Ana 💸
Ko te kaha he paparanga mata noa iho. Ka puranga ake ngā utu huna:
-
Te nekehanga raraunga : Ngā tāruatanga ā-rohe, ngā whakawhiti raraunga ā-kapua, tae atu ki te putanga mai o te kaiwhakamahi [2].
-
Te Whakarea : Ko te whai i te 3-2-1 (e toru ngā tārua, e rua ngā pāpāho, kotahi kei waho o te papaanga) ka pau te wāhi engari ka penapena i te rā [3].
-
Te hiko me te whakamatao : Mena nāu te whata, nāu te wera.
-
Ngā tauwhitinga whakaroa : Ko te tikanga o ngā taumata iti ake he tere whakaora hukapapa.
Haumarutanga me te Whakatutukitanga: Ngā Kaiwawao Whakaaetanga Mārire 🔒
Ka taea e ngā ture te whakatau i te wāhi e noho ai ngā paita. I raro i te UK GDPR , ko te neke i ngā raraunga whaiaro ki waho o te UK me whai huarahi whakawhiti ture (SCC, IDTA, ture rānei e tika ana). Whakamāoritanga: me "mōhio" tō hoahoa rokiroki ki te whenua [5].
Ngā mea taketake hei tunu mai i te rā tuatahi:
-
Whakamunatanga - i te wā e okioki ana, i te wā e haereere ana hoki.
-
Te urunga iti rawa te mana + ngā ara arotake.
-
Mukua ngā parenga pērā i te pumau, ngā raka ahanoa rānei.
Ngā Ārai Mahi: Ko te Whakaroa te Kaikōhuru Wahangu ⚡
Kāore ngā GPU e pai ki te tatari. Mēnā ka roa te rokiroki, he whakamahana whakahīhī rātou. Mā ngā taputapu pēnei i te NVIDIA GPUDirect Storage ka tapahia te takawaenga CPU, ka tukuna tika ngā raraunga mai i te NVMe ki te mahara GPU - koia tonu te mea e hiahiatia ana e te whakangungu nui [4].
Ngā whakatikatika noa:
-
NVMe katoa-ira mō ngā maramara whakangungu wera.
-
Ngā pūnaha kōnae whakarara (Lustre, Spectrum Scale) mō te tuku raraunga maha-pūnga.
-
Ngā utauta async me te sharding + prefetch hei ārai i te noho mangere o ngā GPU.
Ngā Mahi Whai Hua mō te Whakahaere i te Rokiroki AI 🛠️
-
Te Whakarārangi : Ngā maramara wera i runga i te NVMe/SSD; purangahia ngā huinga tawhito ki ngā taumata ahanoa, ki ngā taumata makariri rānei.
-
Tango atu + tahataha : Penapenahia ngā pūtake kotahi, puritia ngā rerekētanga + ngā whakaaturanga anake.
-
Ngā ture mō te huringa ora : Ka whakarōpū aunoa i ngā putanga tawhito, ā, ka pau te wā [2].
-
3-2-1 manawanui : Puritia kia maha ngā tārua, puta noa i ngā momo pāpāho, me te pupuri i tētahi kia motuhake [3].
-
Ngā taputapu : Te rere o te aro turuki, ngā whakaroa p95/p99, ngā pānui kore angitu, te putanga mā te kawenga mahi.
He Take Tere (He Mea Hangaia engari He Mea Noa) 📚
Ka tīmata tētahi tīma tirohanga me te ~20 TB i roto i te rokiroki mea kapua. Ā muri ake nei, ka tīmata rātou ki te tārua i ngā huinga raraunga puta noa i ngā rohe mō ngā whakamātautau. Ka piki haere ā rātou utu - ehara i te mea mai i te rokiroki tonu, engari mai i te waka putanga . Ka nekehia e rātou ngā maramara wera ki NVMe tata ki te tautau GPU, ka pupuri i tētahi tārua tūāpapa i roto i te rokiroki mea (me ngā ture huringa ora), ā, ka pinea ko ngā tauira anake e hiahiatia ana e rātou. Hua: He pukumahi ake ngā GPU, he iti ake ngā pire, ā, ka pai ake te akuaku o ngā raraunga.
Te Whakamahere Pūmanawa o Muri o te Kōpaki 🧮
He tātai matawhānui mō te whakatau tata:
Pūmanawa ≈ (Huinga Raraunga Mata) × (Tauwehenga Whakamārama) + (Raraunga Kua Tukatukahia/Kua Whakanuia) + (Ngā Wāhi Tirotiro + Ngā Rangitaki) + (Tawhiti Haumaru ~15–30%)
Kātahi ka tirohia te hauora o te rorohiko ki te putanga raraunga. Mena me pupuri tonu ngā utauta ia-pūnga ki te ~2–4 GB/s, kei te rapu koe i te NVMe, i te FS whakarara rānei mō ngā ara wera, me te rokiroki ahanoa hei pono.
Ehara i te mea mō te wāhi anake 📊
Ina kī te tangata he whakaritenga rokiroki AI , ka whakaarohia e rātou he terabytes, he petabytes rānei. Engari ko te mahi tino nui ko te taurite: te utu me te mahi, te ngāwari me te tutuki i ngā whakaritenga, te auahatanga me te pumau. Kāore e tere te mimiti o ngā raraunga AI. Ko ngā tīma e whakauru wawe ana i te rokiroki ki roto i te hoahoa tauira ka karo i te toremi ki roto i ngā repo raraunga - ā, ka tere ake hoki tā rātou whakangungu.
Ngā Tohutoro
[1] Russakovsky me ētahi atu. Te Wero Mōhio Tirohanga Tauine Nui a ImageNet (IJCV) — te tauine me te wero o te huinga raraunga. Hononga
[2] AWS — Te utu me ngā utu o Amazon S3 (te whakawhiti raraunga, te putanga, ngā taumata huringa ora). Hononga
[3] CISA — te tohutohu ture tārua 3-2-1. Hononga
[4] Ngā Tuhinga NVIDIA — Te tirohanga whānui mō te rokiroki GPUDirect. Hononga
[5] ICO — Ngā ture GDPR o te UK mō ngā whakawhiti raraunga o te ao. Hononga