Te Rokiroki Taonga mō te AI: Ngā Kōwhiringa, Ngā Kōwhiringa, Ngā Kōwhiringa

Ina rongo te nuinga o te tangata i te kupu "mātauranga horihori," ka whakaarohia e rātou ngā kupenga io, ngā rauropi whakahirahira, ngā karetao āhua āhua tangata rānei. Ko te mea kāore i te tino whakahuatia i te tīmatanga ko tēnei: ​​Ka pau te rokiroki i te AI me te kaha o tana kai i ngā rorohiko . Ehara i te mea ko ngā rokiroki taonga noa iho e noho puku ana i muri, e mahi ana i te mahi koretake engari he mea nui rawa atu o te whāngai i ngā tauira ki ngā raraunga e hiahiatia ana e rātou.

Me wehewehe tātou he aha te mea e tino hira ai te rokiroki taonga mō te AI, he aha tōna rerekētanga mai i ngā "tiaki tawhito" o ngā pūnaha rokiroki, me te take e waiho ai hei tētahi o ngā tino huarahi mō te tauine me te mahi.

Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:

🔗 Ko ēhea ngā hangarau me whakamahi hei whakamahi i te AI whakaputa nui mō ngā pakihi?
Ngā hangarau matua e hiahiatia ana e ngā pakihi hei whakatairanga i te AI whakaputa hua.

🔗 Te whakahaere raraunga mō ngā taputapu AI me tirotiro e koe
Ngā mahi pai mō te whakahaere raraunga hei whakapai ake i te mahi AI.

🔗 Ngā pānga o te matauranga horihori ki te rautaki pakihi
Te pānga o te AI ki ngā rautaki pakihi me te whakatau kaupapa mō te wā roa.

He aha te mea e whai hua ai te rokiroki taonga mō te AI? 🌟

Ko te whakaaro nui: kāore te rokiroki ahanoa e aro ki ngā kōpaki, ki ngā tahora poraka pakari rānei. Ka wehea ngā raraunga ki ngā "ahanoa," ia mea ka tohua ki ngā raraunga matua. Ka taea e aua raraunga matua te waiho hei mea taumata-pūnaha (rahi, tohu wā, akomanga rokiroki) me ngā tohu kī:uara kua tautuhia e te kaiwhakamahi [1]. Whakaarohia he rite ki ia kōnae e mau ana i tētahi puranga tuhipoka piri e whakaatu ana ki a koe he aha tonu, me pēhea te hanga, me te wāhi e uru ai ki roto i tō pūnaha.

Mō ngā tīma AI, he mea nui taua ngāwari:

• Tauine me te kore he mate pōuri - Ka toro atu ngā roto raraunga ki ngā petabyte, ā, ka ngāwari te whakahaere i tēnei e ngā toa ahanoa. Kua hangaia mō te tipu tata kore mutunga me te roa o te maha-AZ (e whakamanamana ana a Amazon S3 mō te "11 nines" me te tāruarua whakawhiti-rohe i te taunoa) [2].

• Te nui o ngā raraunga meta - He tere ake te rapu, he ma ake ngā tātari, he atamai ake ngā paipa mai i te mea ka eke te horopaki me ia mea [1].

• Kapua-taketake - Ka tae mai ngā raraunga mā te HTTP(S), arā, ka taea e koe te whakataurite i ngā kukume me te pupuri i te whakangungu tohatoha kia rere tonu.

• Te manawanui kua whakauruhia - Ina whakangungu koe mō ngā rā, kāore e taea e koe te tūpono ki te patu i te maramara pirau i te wā 12. Mā te rokiroki taonga ka karohia tēnā e te hoahoa [2].

He peke tuara koretake te āhua: he paru pea roto, engari ka taea tonu te tiki mai i ngā mea katoa ina toro atu koe ki te tiki.

Ripanga Whakataurite Tere mō te Rokiroki Taonga AI 🗂️

Me arotake tonu te whakaaro pai i ngā utu e whakamahia ana e koe i te ao tūturu—ina koa ko te putanga mai, te nui o ngā tono, me te ranunga o ngā momo rokiroki.

He aha i aroha ai te whakangungu AI ki te rokiroki taonga 🧠

Ehara te whakangungu i te "rōpū kōnae iti noa iho". He miriona miriona ngā tuhinga e pakaru ana i te wā kotahi. Ka piko ngā pūnaha kōnae hierarki i raro i te taumaha o te wā kotahi. Ka karohia e te rokiroki ahanoa tēnā me ngā mokowā ingoa papatahi me ngā API ma. He kī ahurei tō ia ahanoa; ka horapa ngā kaimahi ka tiki i te wā kotahi. Ko ngā huinga raraunga kua wehea + te I/O whakarara = ka noho pukumahi ngā GPU, kaua e tatari noa.

Tohutohu mai i ngā rua: puritia ngā maramara wera tata ki te rōpū rorohiko (rohe kotahi, rohe rānei), ā, kia kaha te pupuri i te SSD. Mena kei te hiahia koe ki ngā whāngai tata-tika ki ngā GPU, te NVIDIA GPUDirect Storage - ka tapahia e ia ngā arai peke CPU, ka tapahia te whakaroa, ā, ka whakapiki ake i te whānui o te raraunga ki ngā whakatere [4].

Ngā raraunga matua: Te mana nui kāore i te tino whakanuia 🪄

Koinei te wāhi e tiaho ai te rokiroki taonga i roto i ngā huarahi kāore i te tino kitea. I te tukuake, ka taea e koe te tāpiri i ngā raraunga ritenga (pēnei i te x-amz-meta-… mō te S3). Hei tauira, ka taea e te huinga raraunga tirohanga te tohu i ngā whakaahua me te rama=iti , te pōuri=teitei rānei . Mā tēnā ka taea e ngā paipa te tātari, te taurite, te wehewehe rānei me te kore e matawai anō i ngā kōnae mata [1].

Ā, ko te putanga . He maha ngā toa taonga e pupuri ana i ngā putanga maha o tētahi taonga taha-taha-tino pai mō ngā whakamātautau tāruarua, ngā kaupapa here whakahaere rānei e hiahia ana kia hurihia [5].

Ahanoa vs Poraka vs Rokiroki Kōnae ⚔️

• Rokiroki Poraka : He rawe mō ngā pātengi raraunga tauwhitinga - he tere, he tika hoki - engari he nui rawa te utu mō ngā raraunga kore hanganga tauine petabyte.

• Rokiroki Kōnae : He mōhio, he pai mō te POSIX, engari ka pōrearea ngā whaiaronga i raro i ngā kawenga whakarara nui.

• Rokiroki Ahanoa : I hangaia mai i te whenua mō te tauine, te whakarara, me te urunga e whakahaerehia ana e ngā raraunga [1].

Ki te hiahia koe ki tētahi kupu whakarite pōrearea: ko te rokiroki poraka he kāpata kōnae, ko te rokiroki kōnae he kōpaki papamahi, ā, ko te rokiroki ahanoa… he poka mutunga kore me ngā tuhipoka piri hei āwhina i a ia kia whai hua.

Ngā Rerenga Mahi AI Ranu 🔀

Ehara i te mea he kapua anake i ngā wā katoa. Ko te āhua o te ranunga noa he penei:

• Rokiroki ahanoa kei te wāhi noho (MinIO, Dell ECS) mō ngā raraunga tairongo, ngā raraunga kua whakahaeretia rānei.

• Te rokiroki mea kapua mō ngā kawenga mahi pakū, ngā whakamātautau, te mahi tahi rānei.

Ka pā tēnei taurite ki te utu, te tutuki i ngā whakaritenga, me te tere o te mahi. Kua kite ahau i ngā tīma e maka ana i ngā terabyte ki roto i tētahi peere S3 i te pō kotahi hei whakamārama i tētahi tautau GPU rangitahi - kātahi ka whakangaromia katoatia ina mutu te tere tere. Mō ngā tahua iti, mā te tauira tere-papatahi/kore-putanga a Wasabi [3] ka māmā ake te matapae i te ao.

Te Wāhanga Kāore tetahi e whakamanamana ana 😅

Tirohia te pono: ehara i te mea he tino pai.

• Whakaroa - Kia tawhiti rawa te rorohiko me te rokiroki, ka tere haere ō GPU. a GDS , engari he mea nui tonu te hoahoa [4].

• Ngā ohorere utu - Ka puta puku mai ngā utu mō te putanga me te tono API ki te tangata. Ka whakakorea e ētahi kaiwhakarato (ka whakakorea e Wasabi; kāore ētahi) [3].

• Te pōrearea o ngā raraunga meta i te tauine nui - Mā wai e whakamārama te "pono" i roto i ngā tohu me ngā putanga? Me hiahia koe ki ngā kirimana, ngā kaupapa here, me ētahi pūkenga whakahaere [5].

He mea nui te rokiroki taonga mō ngā hanganga: he mea nui, engari ehara i te mea ataahua.

Kei hea te anga whakamua 🚀

• He rokiroki atamai ake, e mōhio ana ki te AI, e tohu aunoa ana, e whakaatu ana hoki i ngā raraunga mā roto i ngā paparanga patai rite ki te SQL [1].

• Te whakaurunga taputapu tata ake (ngā ara DMA, ngā tango NIC) kia kore ai ngā GPU e hiahia ki te I/O [4].

• Utu mārama, matapaetia (ngā tauira kua māmā ake, ngā utu putanga kua whakakorea) [3].

E kōrerotia ana te rorohiko hei te heke mai o te AI. Engari i roto i te ao tūturu? Ko te ārai ko te whāngai tere i ngā raraunga ki ngā tauira me te kore e whakapau moni nui . Koia te take e tipu haere ai te tūranga o te rokiroki taonga.

Whakarāpopototanga 📝

Ehara i te mea whakamīharo te rokiroki taonga, engari he mea taketake. Ki te kore he rokiroki tauine, e mōhio ana ki ngā raraunga raraunga, e pakari ana, ka rite te whakangungu i ngā tauira nunui ki te oma marathon i roto i ngā hu.

Āe, he mea nui ngā GPU, he mea nui ngā anga. Engari ki te mea he nui tō hiahia mō te AI, kaua e warewarehia te wāhi e noho ai ō raraunga . Ko te tūponotanga, kei te pupuri puku te rokiroki taonga i te mahi katoa.

Ngā Tohutoro

[1] AWS S3 – Ngā raraunga ā-mea - pūnaha me ngā raraunga ā-rite
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingMetadata.html

[2] AWS S3 – Ngā akomanga rokiroki - te pakari (“11 iwa”) + te manawanui
https://aws.amazon.com/s3/storage-classes/

[3] Wasabi Hot Cloud – Utu - utu papatahi, kāore he utu putanga/API
https://wasabi.com/pricing

[4] NVIDIA GPUDirect Storage – Ngā Tuhinga - Ngā ara DMA ki ngā GPU
https://docs.nvidia.com/gpudirect-storage/

[5] AWS S3 – Te Whakaputanga - ngā putanga maha mō te whakahaere/te āheinga ki te whakaputa anō
https://docs.aws.amazon.com/AmazonS3/latest/userguide/Versioning.html

Kimihia te AI Hou i te Toa Kaiāwhina AI Whaimana

Mō Mātou