He aha te Pokapū Raraunga AI? [Ataata me te Pātaitai]

Whakautu poto: He wāhi nui te pokapū raraunga AI, e arotahi ana te hiko, te whakamatao, te papanga, me te rokiroki ki ngā tauira whakangungu me te mahi, ehara i te rūma tūmau me ngā GPU tāpiri. Ko ngā maramara te mea rongonui; ko te whare te mea e whakatau ana mēnā ka mahi. Ki te kore e taea e ngā whakaahua te wehe atu, whakahoutia he pūtau iti; me reti e te nuinga o ngā tīma.

Ngā kōrero matua hei whakaaroaro:

Maramara vs hanga: Ko te mana, te whakamatao, te papanga, me te rokiroki e whakatau ana mēnā ka mahi ngā whakateretere.

Ngā wāhi ehara i te whare kingi: Whakahoutia kia rua ngā whata ina kore e taea te wehe atu i ngā raraunga; kaua e hoko i tētahi kāreti.

Toharite vs tau waenga: Mō ngā oma e waru, ka tīmata anō te tau waenga; whakamahia te toharite 18-hāora.

Ātete ki te whakamahinga hē: Kaua e whakahuahia he PUE mō ngā whata e rua i roto i te whare whakauru.

Ngā hua tauira: E waru ngā oma he mahere iti, ehara i te penapena whakaputanga 50%.

Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:

🔗 He pono te AI? Ataata me te pātaitai
Tūhurahia te pono o te AI mā te ataata whakahihiri me te pātaitai taunekeneke.

🔗 Me pēhea te whakamahi i te AI i te oranga o ia rā
Tirohia ngā huarahi whai hua ka taea e te AI te whakahaere i ngā mahi me ngā mahinga o ia rā.

🔗 Me pēhea te whakamahi i te AI i te mahi
Akohia ngā huarahi whai hua hei whakamahi i te AI kia hua ake ai te hua i te wāhi mahi.

🔗 Ka taea e te AI te whakaaro māna ake?
Kia mārama mēnā ka taea e te matauranga horihori te whakaaro takitahi, te whai whakaaro rānei.

Te rerekētanga mai i tētahi pokapū raraunga "noa"

Ka arotauhia e ngā whare tuku iho ngā mahi whakauru me te wā mahi puta noa i ngā ratonga iti maha. E aro nui ana koe ki te tauutuutu, āe, me te PUE hei ariā - he pūngao tāpiri ka tahuna e te whare hei tuku i te watt o te rorohiko. Kāore koe, i te nuinga o te wā, e hoahoa ana i ia ara ia taha huri noa i tētahi whatanga e mahi ana pērā i te pāmu whakamahana kawe.

Ka hurihia e ngā pae AI ngā ōwehenga. Ka piki ake te kiato. Ka noho te whatunga hei papanga e kore e taea e te mahi whakangungu te haere ngoikore me te kore. Me pupuri tonu ngā pūwāhi tirotiro e te rokiroki kia neke, kia noho mangere rānei ngā whakateretere, pērā i ngā hōiho reihi i roto i te waka.

He rerekētanga ahurea anō hoki. Ka whakaaro ngā kaimahi hinonga ki ngā tīkiti me ngā matapihi whakawhiti. Ka whakaaro ngā kaimahi AI ki ngā rarangi mahi me te mamae ina mate tetahi pona i te mutunga o te wā. Ki taku whakaaro ka taea tonu e koe te karanga i ngā "pokapū raraunga" e rua nā te mea koinā. Ka huna noa te tapanga i ngā paipa wai.

Ehara i te whakatauranga matatika. He rerekē ngā mīhini, he kotahi te ingoa whānau.

Ngā GPU, ngā whakateretere, me te whata e kai ana i te mana

Ki te hikoi koe i te papa teitei tuku iho, ka ātaahua te āhua o ngā whata. Ki te hikoi koe i te rarangi AI, ka āhua rite ki te hiahia ki te horomia te whare.

Ehara te taputapu tino hira i te PTM mohio. Ko te paepae whakateretere: ngā GPU, ngā maramara AI rānei, kua tākaihia ki roto i ngā tūmau, kātahi ko ngā whatanga, kātahi ko ngā rarangi e tohatoha ana i te papanga whānui-rahi. Ka hono ngā GPU i ngā maramara ki roto i tētahi mea ka taea te whakaari hei whakateretere nui kotahi; ka mahi te papanga tautau i te mahi kotahi i te tauine rarangi. Ka mahi noa te whakangungu whakarara mena ka noho matotoru, ka taea te matapae i aua hononga. Ka ngaro tēnā, ā, ko tō "tautau" he puranga teihana mahi utu nui e tohatoha ana i te waehere poutapeta.

Ka whai te hiko i ngā maramara. Ehara i te PDU tari matotoru. Ngā megawatts o te kawenga IT ina kī te whare - kāore au e hanga i tētahi tau. Ko te kiato mō ia whata te hurihanga o te kōrero. He iti ake ngā whata. He oumu iti ia whata. Ko te mea whakawhāiti ko te teihana hiko, ehara i te rārangi hiahia o ngā GPU. E mōhio ana koe ki te āhua: e hiahia ana te hunga hoko ki ētahi atu whakatere; e hiahia ana te kamupene hiko ki tētahi kōrero roa me tētahi haki nui rawa.

Kotahi te kupu whakarite āhua kuware e kore e taea e au te whakakore: he kararehe hiakai te whata. Ka taea e koe te whakatupu i tētahi tere ake. Me whāngai tonu koe i a ia, me te horoi tonu i te wera. Mēnā ka mahue tētahi o ēnei, ka nui te utu mō te taumaha pepa.

Te mana, te wera, me te raruraru whakamatao

Te hiko e tomo ana, te wera e puta ana. Koinā te whakapono katoa.

Ka tukuna te wera e ngā whata matotoru te hau i tētahi ara kāore i tonoa kia whakahaerehia e te hau. Ka taea e koe te pana kaha ake i te hau - ngā whakawhiti wera o te tatau o muri, ngā ara wera ake, te pupuri mohio - ā, ka mahi pai tēnā tae noa ki tētahi taumata. Kātahi ka puta mai he wai:

• Whakamatao tika-ki-te-maramara

• Ngā koropiko whakamatao e hanga ana i te rūma tipu kia rite ki te mahi matū

• Te rumakitanga ki roto i ētahi hoahoa, e ohorere tonu ana te hunga e whakaaro ana kāore e tika kia whakapuakina te rerenga kōrero e te wai me ngā kaimahi

Kāore tetahi o ēnei i te ataahua. Ko te hua anake tēnei, nā te mea kua utua kētia e koe te whakateretere e whakaroa ana i te tere, ā, kāore e taea te whakamahi katoa.

He mea nui tonu te PUE. He ōwehenga, ehara i te tuakiri. Ka whaia e ngā kaiwhakahaere nā te mea ko ia watt e pau ana ki ngā pā me ngā papu he watt kāore i haere ki te GPU. Kāore au e whakahua i tētahi tatauranga "noa"; ka nekehia e te āhuarangi me te āhua o te tuhi i te rohe, ā, he kino ake te tika rūpahu i te kore. Kei roto hoki te wai i te kōrero. Ka mitimiti ētahi tipu. Ka horomia e ētahi. te whakamatao mimiti tae noa ki te wā e meinga ai e te awa, e te tauraki rānei, he mea tōrangapū.

Whatunga: he aha te hiranga o te papanga me te hiranga o ngā maramara

Ka whakaahuahia ngā GPU e te tangata. Me whakaahuahia hoki ngā pana.

He kōrero te whakangungu. He mano tini ngā whakatere e whakawhitiwhiti ana i ngā pikinga, ngā tawhā, ngā maramara o te tauira, i roto i te tukutahitanga piri. Ki te wiri te papanga, ka tatari te mahi katoa i te peke puhoi rawa. Koia te take e aro nui ai ngā AI ki te whatunga whānui-rahi, te iti o te whakaroa, me ngā āhuahanga e kore e taka ki te haurua ina rahua te hononga. He papanga InfiniBand, he Ethernet i roto i te mahi kotahi, ka hono ngā GPU i roto i te pouaka, me te taura me tika i te wā tuatahi.

He kōrero rerekē te whakatau. Ko te mahi tauira e aro ana ki te whakaroa o te hiku - ko te whakautu puhoi, ehara i te whakautu noa. Ko te puranga me te wā-tūturu ka wehewehe i te tuakiri. Ko te rōpū whakangungu e hiahia ana ki te nekehanga nui, ā-rōpū, ā-katoa. Ko te rōpū mahi e hiahia ana ki ngā tono iti me te noho motuhake, me te kore e raru te waka i te taurite kawenga.

Ko te mea ngaro, i ahau e noho nei: e whakaarohia ana e te tangata te whatunga he rite ki te paipa wai, ā, ko ngā parai he rite ki te wharekai. I roto i tēnei whare, ko te paipa wai te wharekai. Ki te ngaro tēnā, ka hoko koe i tētahi kīhini kāore e taea te tango i te tuku.

Whakangungu vs whakatau: e rua ngā whare, i ētahi wā he tino pono

He kaupapa whakangungu. Ka hangaia e koe he rōpū, ka whāngaihia ngā raraunga, ka āta tirohia, ka oma mō ngā hāora, mō ngā wiki rānei, ka inoi kia noho kore he raruraru. He nui ngā puranga, he hiahia ki te whānui o te hononga, he manawanui mārire - kia ngaua rā anō e te pona rahua te oma. Kotahi te whakatere mate i roto i tētahi mahi hono piripono ka taea te aukati i te katoa o te kōrere.

He toa hokohoko te whakatau whakatau. Kua whakangungua ngā tauira, kei te whakautu pātai, kei te whakarōpū whakaahua, kei te whakaputa tuhinga. He mea nui te whakaroa. Ka taea e te whakatere tawhito ake i te taha o te kiritaki te hinga i tētahi whakatere ataahua i tawhiti atu i te whenua.

Nō reira, ka wehea koe. Ka whaia e ngā puni whakangungu te mana, te whenua, me te kiato. Ka whaia e ngā pae whakatau te whakaroa me te aroaro. Kei reira anō hoki ngā whare ranu, nā te mea kāore te whakapaipai e mutu. Āe - ehara i te mea e rua ngā whare i ngā wā katoa. I ētahi wā kotahi te whare me te taura weriweri me ngā koropiko whakamatao e rua.

Koinei hoki te wāhi e whakamahia ai te colocation, ngā puni hyperscale, me te on-prem fork. Ka hangaia ngā hyperscalers i ngā tauine e whakaatu ana i a tātou katoa me te mea kei te whakarite tāonga tātou. Ka hokona e ngā Colos te kiato mā te whatanga. Ka puta tonu te on-prem ina kore e taea e ngā raraunga te wehe atu.

Te nui o te rokiroki, ngā pūwāhi tirotiro, me ngā maramara hiakai

Kāore tetahi e whakatakoto ana i te pūnaha kōnae whakarara ki te uhi o te pukapuka iti.

Me tere te taenga mai o ngā raraunga whakangungu kia kore ai ngā GPU e patupatu. Me tau ngā wāhi tirotiro kia kore ai e moumou te wiki i te tukinga. Me utaina ngā taumaha tauira i mua i te tīmatanga o te tārua e mahi ana. Ko te kaha rokiroki - ehara i te mea ko te kaha anake - te aukati puku. Ka taea e koe te whakapau moni nui ki ngā whakateretere me te whakakī i a rātou ki tētahi huinga ātaahua i hangaia mō ngā mīhini mariko.

He mōhio te tauira: he tautau kanapa, he rarangi mahi, me te tatari I/O e titiro whakamuri ana me te mea he nama nama kino. Mā te whakarōpū i te tatau me te kore e whakarōpū i te ara raraunga ka whiwhi koe i te wā mangere tino utu nui. Kia whāngaihia ngā maramara, kia whakaae rānei kua hokona e koe he whakairo.

Pūmanawa, whakaritenga, me te paparanga mahi kāore i te ātaahua

Ko ngā taputapu te mea rongonui. Ko ngā kaiwhakarite wā te mahi.

Kāore he hua o te pokapū raraunga AI mēnā kāore e taea e ngā mahi te kimi i ngā GPU, mēnā kāore e taea e ngā tīma e rua te tohatoha i te rōpū me te kore he pakanga ringa, mēnā kāore e taea te whakakapi i te tūranga i rahua, mēnā ka neke haere te pūmanawa tae noa ki te hinganga o te papanga i roto i te nekehanga puhoi. Te whakarite, te mātakitaki, te aukati mana - te paparanga mahi koretake, koinei te huarahi e mōhio ai koe he mea nui.

He āwangawanga tōku mō tēnei paparanga. Waihoki, ki te mea he raruraru whakamatao te NIC kua whirihorahia mō te ahiahi katoa... ka kitea tēnā i te ara uaua.

Ina mate tetahi pūnga i waenganui o te whakahaere

Ka mate te pūnga. Ka tukinga tonu ngā matapihi whakarerekētanga ki ngā whakangungu kāore e aro ki tō maramataka. Ka whakarite tahi koe i ngā mahi nui, ka ārai i ngā puna whakatau, ka tuhi pukapuka whakahaere mō ngā hapa e ahua ana "he puhoi te mahi" tae noa ki te ahua "kua mate te mahi." He mea nui tonu te tauutuutu - te hiko, te whakamatao, ngā ara, te rokiroki - engari he iti ake te pai o te aratau hapa i te kiriata tawhito e iwa-o-te-wā mahi. Whakatau: tārua, ringihia te pūnga mate, whakautu tonu. Ko ngā tohu tirotiro e hiahia ana te whakangungu, kaua ko te tumanako.

Tauwāhi, wai, whatunga whatunga, me ngā hoa noho tata

Kaua tētahi o ēnei e whakataka ki te taha o tētahi whare iti kia pai ai te tirohanga.

Ko te hononga whatunga te tukanga whiriwhiri wāhi tūturu. He māmā ake te whenua ki te whakataurite ki tētahi teihana hiko me tētahi ratonga hiko he kiritaki kē atu āna. Ko te wai hei whakamatao, ki te whakamahia e koe, ka noho hei take mō te hoa noho ina nui te ua. Te haruru. Te rahi o te tirohanga. Te wera i te taiapa rohe. Ka kitea e ngā komiti whakamahere ngā whakaaro mō "te kapua" i te wā e hiahia ana ki tētahi mara me tētahi awa.

Kei te taha kē te whakaroa. He pai ki te whakatau tata ki ngā kaiwhakamahi me te hono atu. Ka taea e te whakangungu te huna i roto i ngā mākete hiko iti ake te utu me ngā āhuarangi makariri. E kōrero ana te umanga me te mea he kotahi te pae tino pai. Kāore. He whakaaetanga kei roto i te panuitanga pāpāho.

Te wera toenga me te oumu kāore i karangatia

He tino pai ki ngā pukapuka iti tēnei wāhanga. Ka tukuna te mahana o te para ki ngā kāinga, ki ngā puna kaukau, ki ngā whare kati kōtuhi; he rerenga kōrero ataahua tēnei. I ētahi wā he pono te porowhita ā-rohe. I ētahi wā kei te wāhi hē te puni, ā, ka haere tonu te wera ki te rangi. E ruarua ana ahau ki te putanga o te pukapuka iti; kāore au e ruarua ana ki te ahupūngao.

Ko wai e hiahia ana ki tētahi (ā, ko wai me reti hei utu)

Kāore e hiahiatia ana e te nuinga o te iwi te hoko i tētahi o ēnei whare.

Ko te rārangi poto:

• Ngā Hyperscalers, nā te mea ko te hua te kahui

• Ngā taiwhanga, ina ko te wā rarangi te aukati, kāore rānei e taea e ngā raraunga te wehe

• Ahakoa he tinihanga, he peeke, he rōpū hōhipera, he kāwanatanga, he kaihanga rānei me tētahi huinga raraunga ngaro - kei te wāhi noho, kei tētahi whare herehere tūmataiti rānei

Me reti katoa. Te wāhi noho tahi me te kiato rite-AI. He rahui kapua. He rōpū whakahaere. Ka whiwhi koe i ngā whakateretere me te kore e noho hei kaiwhakahaere tipu hiko. Ka memeha te aroha i te wā tuatahi ka pātai mai tetahi ko wai kei te waea mai mō te porowhita whakamatao i te 3 i te ata.

He mea whakahīhī tēnei, ka whakaae ahau. Ko te pupuri i te rōpū hiko he rite ki te pupuri i te tikanga matapae. Kātahi ka tae mai te pire hiko, ā, ka noho te whakahīhī.

He aha te mahi a te whare

Nā, he aha te Pokapū Raraunga AI? He puni motuhake, he nui te kiato, kei reira ngā whakateretere, te hiko, te whakamatao, te papanga, me te rokiroki e whakaritehia ana i runga i ngā tauira whakangungu me te mahi - ehara i te hangarau mōhiohio whānui me te GPU i te kokonga. He rite ki te whare putunga. He rite tana whanonga ki te teihana hiko e mahi pāngarau ana.

Ki te kore koe e maumahara ki tētahi atu mea: ko ngā maramara te mea rongonui; ko te teihana hiko, ko te whakamatao, me te whatunga te mea e whakatau ana mēnā he whakaaro pai aua maramara. Ka taea e te whakangungu me te whakatau te noho tahi; e hiahia tonu ana rātou ki ngā tikanga rerekē. Ko te nuinga o ngā whakahaere me reti. Ko ētahi me hanga. Ka kite ngā hoa noho tata i tētahi ara, i tētahi ara.

He whare tō te kapua i ngā wā katoa. I ēnei rā, he whakaaro anō tō te whare.

Tauira o te ao tūturu: He pūtau whakangungu e rua ngā whata ina kore e taea e ngā whakaahua te wehe

Horopaki

Ko Tomos te kaiārahi hanganga i Kestrel Precision, he kaihanga 400-tangata i West Midlands. Kua whai whare iti kē rātou: ERP, ngā tiritiri kōnae, ngā mīhini mariko, te rohe whakauru i tīmata ai tēnei tuhinga. Whakamatao hau. Ethernet noa. He SAN e tino ātaahua ana mō ngā kōpae tari.

Me whakangungu te tīma tirohanga-mīhini i tētahi tauira tirotiro mō ngā whakaahua wheketere. Kāore e taea e ngā whakaahua te wehe atu i te papaanga. E whakaatu ana i tētahi tukanga kāore e whakatakotoria e te kamupene ki runga i tētahi kōpae kapua, ahakoa he kōpae tūmataiti. Ko te otinga a Procurement he tūmau whakatere-rua e whā me tētahi kiriata ko "tō mātou pokapū raraunga AI" te taitara. Ka uru ngā tūmau ki roto i ngā whata e rua o nāianei, nā te mea he wāhi kei reira, ā, i rite te wāhi ki te here.

Kāore. I roto i ngā wiki e rua, ka tangi pukumahi ngā GPU, kātahi ka ata whakaroa. Ka ngokingoki ngā mahi ina tae mai tētahi pūwāhi tirotiro ki te SAN. Ka mate tētahi pūnga i te tekau mā tahi o ngā hāora, ā, kua... ngaro noa iho te oma. Kāore a Tomos i kore e hoko maramara. Kua hokona e ia he puranga teihana mahi utu nui e tohatoha ana i te waehere poutapeta. He whare umanga tonu te whare.

Kāore rātou e hiahia ana ki tētahi kāmpus, ki tētahi teihana hiko hou, ki tētahi awa rānei. E hiahia ana rātou ki tētahi pūtau iti e rite ana ki tētahi pokapū raraunga AI iti: te hiko ka taea e ngā whata te pupuri, te wera e wehe atu ana me te kore e tunua ngā maramara, he papanga ka taea e te mahi whakangungu te kōrero mōna, he rokiroki ka taea te tango i tētahi tirotiro, me tētahi pukapuka whakahaere mō te wā e mate ai tētahi pona. Nā te mea kāore e taea e ngā whakaahua te wehe atu, ehara i te otinga te reti i tētahi whare herehere colo e whā tekau meneti te tawhiti. Ko te whakahou i ngā whata e rua te otinga.

Ngā mea e hiahiatia ana e te pūtau

• He tahua hiko ine i taua rarangi, mai i ngā PDU, ehara i te rārangi hiahia GPU. Mēnā kāore e taea e te kaha tāpiri te whāngai i ngā tūmau e whā i te kawenga whakangungu, ka mutu te kōrero i reira, ā, ka titiro rātou ki tētahi tae matotoru ake, ehara i te merekara

• Kāore i tonoa kia whakahaerea te whakamatao i te hau i tēnei matotoru: ngā whakawhiti wera o muri o te tatau mēnā ka taea e te whare, he porowhita wai iti rānei mēnā ka taea e ia. Ki te kore tētahi o ēnei, kāore ngā tūmau e haere ki roto

• He papanga whānui-rahi motuhake i waenganui i ngā pūnga e whā, ehara i te Ethernet tari. Mena he pana 10 Gb anake tā te kaihoko i roto i te rarangi ingoa, ehara tēnā i te taupū

• Te rokiroki tere ā-rohe mō ngā pūwāhi tirotiro me ngā maramara whakangungu, ehara i te VM SAN

• He kaiwhakarite wā, he wā tirotiro, me te ara tīmata anō kua tuhia. Ko te taputapu te mea rongonui. Ko tēnei paparanga te mahi

• He pouaka whakatau kua āraia mō te raina wheketere, motuhake mai i te kōrerorero whakangungu, nā te mea e hiahia ana te mahi ki te whakaroa me te wehe i te hiku, ehara i te mea he rōpū

• Whakaaetanga ki te taki i te mana, ngā karaka GPU, ngā huihuinga whakatere, me te karaka pakitara mahi. Ki te kore e taea e rātou te tirotiro i aua mea, ka whakaahuahia e rātou ngā GPU, ā, ka ngaro i a rātou ngā pana

Tauira tohutohu

Nā Tomos tēnei i whakamārama i roto i te reo noa:

Kaua e kīia tēnei he puni AI. Hangaia he pūtau whakangungu e rua-whatanga i roto i te whare o nāianei mō ngā tūmau whakatere-rua e whā. Ka noho tonu ngā whakaahua wheketere ki te papaanga. Ko te angitu: ka oti i ngā pona e whā te tunu whakangungu tirotiro-wā 12-wā me te kore e whakaroa te wera, ka tuhi i tētahi pūwāhi tirotiro i roto i ngā meneti kaua i ngā tekau meneti, ka tīmata anō mai i taua pūwāhi tirotiro ina patua e tātou tētahi taumata i runga i te whakaaro. Me pupuri tonu ngā GPU e te whakamatao i ā rātou karaka whakangungu. Me waiho te whatunga hei papanga e tohaina ana e aua pouaka e whā, kaua he ara i roto i te puranga tari. Me whāngai te rokiroki i ngā maramara. Mena kāore e uru ngā whakawhiti wera o muri, me kī atu, ā, kati. Kaua e whakahua i te PUE mō ngā whatanga e rua i roto i te whare whakauru. Ko taua tau he whare tapere.

Kātahi ka whakaurua e ia tēnei ki roto i te mahi whakangungu tonu:

Wāhi tirotiro i ia 30 meneti ki te puna tere o te rohe. Mēnā ka mate tētahi rarangi, tīmata anō mai i te wāhi tirotiro whakamutunga. Kaua e tatari ki te SAN. Kaua e haere tonu te whakangungu i te mea kua heke te tere o ngā karaka. Tuhia, ā, mutu kia kite ai tātou i te tūnga.

Ko te āhua o te hāora pai penei: e waru ngā GPU katoa i ngā karaka whakangungu, kua tau te kōnae tirotiro, kei te mahi tonu. Ko te āhua o te hāora kino penei: kei te hamama katoa ngā pā, kua heke ngā karaka, kua tuhia te tirotiro 2% i muri i ngā meneti tekau, ā, kei te kī mai tētahi i roto i te tari "kua piki te taupū". Ehara te piki i te whakangungu.

Me pēhea te whakamātautau

Ka tuhia e rātou te whakamātautau i mua i te whakahoutanga, koinei te kaupapa katoa o te kore whakawhirinaki ki te whakaaturanga.

• Ko te tunu 12-wā ōrite, ko ngā whakaahua tirotiro 120,000 ōrite, e waru ngā oma

• Ko te wā he karaka pakitara ki te tunu kua oti, tae atu ki te tīmatanga anō, mai i te tuku mahi ki te pūwāhi tirotiro whakamutunga o te wā 12

• He whakawātea i te wera: Ka noho tonu ngā karaka GPU ki te whāinga whakangungu mō te oma. He rahua te mahi whakatere ahakoa ka mutu te mahi

• He tukunga mō te rokiroki: te wā tuhi tirotiro, te tau waenga me te kino rawa atu, mai i te rārangi mahi

• He whakawātea i te papanga: kāore te mahi e tatari tahi ana i te wā e ora ana te rangatira. Ki te kore e kitea taua tatari, kāore i oti te taputapu

• E rua o ngā oma e waru ka mate te tūranga i tētahi taahiraa kua whakaritea, hei whakamātautau i te ara tīmata anō

• He whakamātautau motuhake te whakatau whakatau, he 200-ahua mai i te raina wheketere ki te pouaka tuku kua āraia. Kāore te angitu whakangungu e kiia he angitu tuku

• Ka hopukina e rātou te mana whatanga mai i ngā PDU i roto i ngā tauira 15-meneti kia kore ai tetahi e hanga i tētahi megawatt

Te whakaae mō te karanga i te pūtau "kua rite ki te AI": 8 o ngā tohutao e 8 kua oti; 0 o te 8 e whakaatu ana i te whakamātao wera; ka tīmata anō ngā oma e rua kua mate; ka noho ngā tohu tirotiro i roto i ngā meneti. Ki te ngaro i a rātou tēnā, kei a rātou tonu he rūma tūmau me ngā kāri whakairoiro papai.

Hua

He hua tauira tēnei, mai i tētahi whakamātautau e waru ngā oma i titoa, ehara i te tatauranga Kestrel kua whakaputaina.

Ngā Whakaaro: e whā ngā tūmau whakatere-rua i roto i ngā whatanga e rua; kotahi te tauira tirotiro; 120,000 ngā whakaahua poto; e waru ngā oma o tētahi tunu 12-wā pumau; kei roto i te karaka pakitara ngā tīmatanga anō kia oti rā anō te tunu; ko te tikanga o te whakatere he takanga kua rēhitatia mai i te karaka whakangungu; ko te wā tirotiro te tuhi, ehara i te hiahia; ko te mana whatanga he tauira PDU, ehara i te PUE o te puni.

I mua i te whakahoutanga, ko ngā GPU i roto i ngā whata hau-whakamatao noa i runga i te Ethernet tari me te VM SAN:

• E 5 o ngā oma e 8 i oti i te nganatanga tuatahi. Ko te karaka pakitara toharite i roto i aua e rima: 14 hāora

• E 3 o te 8 i tīmata anō i muri i te tūnga i te haora 11 pea (e rua i muri i te matenga o tētahi pona me tētahi pūwāhi tirotiro tawhito, kotahi i muri i te whakakīnga o te SAN e tētahi pūwāhi tirotiro). Ngāna anō tonu, kāore he tatari mō te pō i roto i te karaka: 11 hāora i moumouhia me te 14 hāora tuarua o te nganatanga, 25 hāora rānei ki tētahi tunu kua oti i runga i aua mea e toru

• Ko te roanga toharite mō te tunu kai kua oti puta noa i ngā waru, tae atu ki ngā tīmatanga anō: 18 hāora. (E rima i te 14, e toru i te 25. Ko te toharite o ngā waru katoa he 14 tonu, ā, mā tēnā ka huna ngā tīmatanga anō. Koia te take ko te toharite te tūāpapa i konei.)

• E 7 o te 8 ngā oma i roto i te pūwero wera. Te wā waenga i te karaka kua whakaitihia: 3 hāora i roto i te ngana 14-hāora

• Te tuhi i ngā pūwāhi tirotiro: te toharite 22 meneti

• Ehara i te whakamātautau ka taea e rātou te wikitoria i te Rank-kill. Kāore i a rātou he pukapuka oma. Ko ngā matenga aituā e rua te mea i kitea

• Te kawenga IT teitei i runga i ngā whata e rua i te wā whakangungu: tata ki te 18 kW. He nui ngā watts o te rarangi. Kāore i a ia te whakamatao, te papanga rānei

Whai muri i ngā whakawhiti wera o muri o te tatau i runga i aua whata e rua, he papanga motuhake i waenganui i ngā pūnga e whā, he puna NVMe iti mō ngā pūwāhi tirotiro, he pūwāhi tirotiro 30-meneti, me te pukapuka whakahaere tīmata anō:

• 8 o te 8 i oti i te nganatanga tuatahi. Te roa o te karaka pakitara: 9 hāora

• Te pūwero wera: 0 o te 8

• Te tuhi i te pūwāhi tirotiro: 90 hēkona te toharite. Te mea kino rawa atu i roto i te huinga: 3 meneti

• I tīmata anō ngā patu-taumata e rua mai i te pūwāhi tirotiro 30 meneti whakamutunga. He karaka pakitara tāpiri mō aua oma e rua: tata ki te 40 meneti ia oma, tae atu ki te tātaritanga, nō reira tata ki te 9 hāora 40 meneti te roa o te noho a aua tokorua. Ko te toharite mō ngā rauna e waru e mau tonu ana ki te 9 hāora

• Kei te tata tonu te kawenga hangarau matihiko ki te 18 kW. Ngā maramara ōrite. Ngā whanonga hanga rerekē

I roto i tēnei tauira, i heke te wā toharite ki te tunu kua oti mai i te 18 hāora ki te 9 hāora, ara, 9 hāora ia hāora, 72 hāora puta noa i ngā oma e waru. Ko te wā-tuatahi i oti mai i te 5 o te 8 ki te 8 o te 8. Ko te tere o te whakatere i heke mai i te 7 o te 8 ki te 0 o te 8. Ko taua tau whakamutunga te mea e kī ana mēnā i hokona e rātou he whakateretere, he taumaha pepa rānei. E kore rātou e kī he penapena 50% te huringa wā i roto i te whakaputanga. He huinga iti, he huinga ngāwari hoki ngā oma e waru.

He tauira whakatau tata ēnei tatauranga i runga i te whakamātautau kua whakahuatia, he tauira iti, he tauira kotahi, me te whare whakauru kotahi. Ehara i te PUE, ehara i te megawatt o te puni, ehara hoki i te tohu me hanga e Kestrel he wāhi whakangungu i roto i te mara. I roto i ngā hāora e 9 te arotakenga o ngā poro rākau; kāore i hunaia e rātou. Ko te tatauranga 18 kW he pānui PDU porowhita, ehara i te nama ratonga. Kāore i hurihia e rātou ngā hāora 72 hei utu, nā te mea he rūpahu te utu hiko whakauru o te wheketere.

He motuhake, he iti ake te tirotiro tuku: 200 ngā whakaahua rārangi ki te pouaka taiapa, kei te papaanga katoa. He whakatauira tēnā, ehara i te whakangungu. Ko te whakaranu i ngā mea e rua he hapa whare-whakakotahi i roto i te iti.

He aha te mea ka hē

• E kīia tonutia ana e te hokohoko ngā tūmau e whā ko "te pokapū raraunga AI". Ka hunaia e te tapanga ngā paipa wai, ā, ko te hoko e whai ake nei he maha atu ngā GPU mō te ara tūroro kotahi

• Ka tomo ngā whakawhiti o te tatau o muri, ā, kāore tetahi e tono ana i te taha wai. Kei te hamama tonu ngā pā. Kei te heke tonu ngā karaka

• He pana kotahi te papanga, kāore he ara tāpiri. Kotahi te hononga i rahua, ā, e whā ngā teihana mahi o te "rōpū"

• Ka noho tonu ngā pūwāhi tirotiro ki te SAN nā te mea ko te puna NVMe te "wāhanga tuarua". Kāore te wāhanga tuarua e tae mai i mua i te pona mate e whai ake nei

• E whakahuahia ana he PUE mō ngā whata e rua i roto i tētahi whare whakauru. Ko te āhuarangi, te rohe, me te toenga o te rarangi ERP ka waiho taua ōwehenga hei kākahu

• Ka tohaina te papanga e te whakangungu me te mahi. Ka tatari te raina wheketere i te waipuke o te pūwāhi tirotiro. Ko te whakaroa o te hiku te hua i reira, ehara i te matotoru

• Ka mate tētahi pona, ā, ka whakaarohia e tētahi he tīkiti wā mahi, kaua he tīmatanga anō o te pūwāhi tirotiro. Ka kōrero ngā kaiwhakahaere hinonga me ngā kaiwhakahaere AI mō te ahiahi katoa

• I taea e rātou te reti i tētahi whare herehere, engari kāore e taea e ngā whakaahua te wehe. Nā te wareware ki taua here ka tukuna rātou ki roto i tētahi kōrero kapua, ā, me whakangāwari rātou

He kai tango-ā-ringa whai hua

He aha te Pokapū Raraunga AI, i tēnei āhua, ehara i te whare putunga, ehara hoki i te nama GPU. Ko te pūtau e tuku ana i ngā whakateretere kia whakaoti i te oma: te mana ka taea e rātou te pupuri, te wera e wehe atu ana, he papanga, he pūwāhi tirotiro, me te tangata kei runga i te matau ina mate te tūranga. Kāore i hiahiatia e Kestrel he puni. E rua ngā whata i hiahiatia e rātou hei whakamutu i te whakaari. Me reti e te nuinga o ngā tīma taua whanonga. Ko ētahi, me te huinga raraunga huna me te whare ka taea te tango i te wera, me hanga he pūtau me te whakakore i te reti.

Ngā Pātai Auau

He aha te Pokapū Raraunga AI?

He pae rorohiko kiato-rahi te wāhi e piko ana te hiko, te whakamatao, te whatunga, me te rokiroki ki te whakangungu whakarara me te mahi tauira, kaua ki ngā rarangi tūmau whānui. Kua hangaia kia taea ai e te tini o ngā whakatere te whakangungu me te mahi tauira me te kore e rewa, e tū i runga i te whatunga, e tatari rānei i runga i te kōpae. He rohe whakauru te whare umanga noa. He whare kotahi te AI, ko tōna wae uara ko te whakatere, pērā i ngā GPU, i ngā maramara TPU rānei. He rite tōna āhua ki te whare putunga, ā, he rite tana mahi ki te teihana hiko e mahi pāngarau ana.

He aha te rerekētanga o tētahi pokapū raraunga AI i tētahi pokapū raraunga noa?

Ka arotauhia e ngā whare tuku iho ngā mahi whakauru me te wā mahi puta noa i ngā ratonga iti maha. Ka hurihia e ngā pae AI ngā ōwehenga: ka piki ake te kiato, ka noho te whatunga hei papanga e kore e taea te ngoikore te mahi whakangungu ki waho, ā, me pupuri tonu e te rokiroki ngā pūwāhi tirotiro kia neke, kia noho mangere rānei ngā whakatere. Ka whakaaro ngā kaimahi hinonga ki ngā tīkiti me te huri matapihi. Ka whakaaro ngā kaimahi AI ki ngā rarangi mahi me te ahua kino ina mate tetahi pona i te mutunga o te wā. Ka taea tonu e koe te waea atu ki ngā pokapū raraunga e rua. Ka huna noa te tapanga i ngā paipa wai.

He aha te nui o te hiko e whakamahia ana e ngā pokapū raraunga AI?

Ehara te taputapu tino hira i te CPU atamai. Ko te paepae whakatere: ngā GPU, ngā maramara AI rānei, kua tākaihia ki roto i ngā tūmau, kātahi ko ngā whatanga, kātahi ko ngā rarangi e tohatoha ana i te whānuitanga whānui-teitei. Ko te mātotoru mō ia whatanga te hurihanga o te kōrero: he iti ake ngā whatanga, he oumu iti ia whatanga. Ka puta mai ngā megawatts o te kawenga IT ina kī te whare, ahakoa kāore e tika ana te hanga i tētahi tau noa. Ko te mea whakawhāiti ko te teihana hiko, ehara i te rārangi hiahia o ngā GPU.

Me pēhea te whakamatao i ngā pokapū raraunga AI?

Ka tukuna te wera e ngā whata matotoru te hau i tētahi ara kāore i tonoa kia whakahaerea e te hau. Ka taea e koe te pana kaha ake i te hau mā te whakamahi i ngā whakawhiti wera o muri, ngā ara wera ake, me te pupuri mohio. Kātahi ka puta mai te wai: te whakamatao tika-ki-te-maramara, ngā koropiko whakamatao, me te rumaki ki roto i ētahi hoahoa. Ko te whakateretere e whakawhāiti ana i te hau he mea kua utua e koe, ā, kāore e taea te whakamahi katoa. He mea nui tonu te PUE nā te mea ko ia watt e pau ana ki ngā pā me ngā papu he watt kāore i haere ki te GPU. Kei roto hoki i te kōrero te wai: ko ētahi tipu e mitimiti ana, ko ētahi e horomia ana.

He aha te hiranga o te whatunga me te hiranga o ngā GPU?

He kōrerorero te whakangungu: he mano tini ngā whakatere e whakawhitiwhiti ana i ngā rōnaki, ngā tawhā, me ngā maramara o tētahi tauira i roto i te tukutahi piri. Ki te wiri te papanga, ka tatari te mahi katoa i te peke puhoi rawa. Koia te take e aro nui ai ngā whare AI ki te whatunga whānui-rahi, te whakaroa iti, ngā papanga InfiniBand-ish, te Ethernet rānei i roto i te mahi kotahi, me ngā āhua e kore e taka ki te haurua ina rahua te hononga. E aro ana te whakatau ki te whakaroa hiku, ki ngā tono iti maha, me te wehenga. I roto i tēnei whare, ko te paipa wai te wharekai.

He aha te whakamahinga o te Pokapū Raraunga AI: te whakangungu, te whakatau whakatau rānei?

He kaupapa te whakangungu: huihuia he rōpū, whāngaihia ngā raraunga, tirohia kia tika, ā, whakahaerehia mō ngā hāora, wiki rānei. He huarahi hokohoko te whakatau: kua whakangungua ngā tauira, kua whakautua inaianei, me te whakaroa e whai tikanga ana. Ka whaia e ngā puni whakangungu te mana, te whenua, me te kiato. Ka whaia e ngā pae whakatau te whakaroa me te aroaro. Kei te noho ngā whare ranu nā te mea ehara i te mutunga kore te whakapaipai, i ētahi wā kotahi te whare me ngā porowhita whakamatao e rua. Ka taea e te whakatere tawhito ake tata ki te kiritaki te patu i tētahi mea ataahua i tawhiti atu i tētahi whenua.

He aha te hiranga o te rokiroki i roto i te pokapū raraunga AI?

Me tere te taenga mai o ngā raraunga whakangungu kia kore ai ngā GPU e patupatu. Me tū ngā wāhi tirotiro kia kore ai e moumou te wiki i te tukinga. Me utaina ngā taumaha tauira i mua i te tīmatanga o te tārua e mahi ana. Ko te kaha rokiroki te mea e ārai ana i te puku, ehara i te kaha anake. Ka taea e koe te whakapau moni nui ki ngā whakateretere me te whakakī i a rātou ki tētahi huinga pai kua hangaia mō ngā mīhini mariko.

He aha te mea ka tupu ina mate tetahi pūnga i waenganui o te whakahaere?

Ka taea e te whakaterenga mate kotahi i roto i tētahi mahi whakangungu piripono te whakaroa i te katoa o te kōrero. Ko ngā tohu tirotiro e hiahiatia ana e te whakangungu, kaua ko te tumanako. Ka mimiti te whakaaro i te pona mate, ka pupuri i te whakautu tauira, ā, ka noho ora tonu. Ka tukinga tonu ngā matapihi whakarerekētanga ki ngā oma whakangungu kāore e aro ki tō maramataka. He mea nui tonu te tāruarua mō te hiko, te whakamatao, ngā ara, me te rokiroki, engari he iti ake te pai o te aratau rahunga i te kiriata tawhito e iwa-o-te-wā mahi.

He aha te pānga o tētahi Pokapū Raraunga AI ki te whatunga hiko, te wai, me ngā hoa noho tata?

Ko te hononga whatunga te tukanga whiriwhiri wāhi tūturu. He māmā ake te whenua ki te whakataurite ki tētahi teihana hiko me tētahi ratonga hiko he kiritaki kē atu āna. Ki te whakamahia e koe te wai hei whakamatao, ka noho hei take mō te hoa noho ina nui te ua, me te haruru, te rahi o te tirohanga, me te wera i te taiapa rohe. Ka taea e te whakangungu te huna i roto i ngā mākete hiko iti ake te utu me ngā āhuarangi mātao. He pai ki te whakatau tata ki ngā kaiwhakamahi. Kāore he wāhi tino tika kotahi. He whakaaetanga kei roto i tētahi panuitanga pāpāho.

Me whai pokapū raraunga AI ahau, me reti rānei?

Kāore te nuinga o te tangata e hiahia ki te whai i tētahi o ēnei whare. Ka hangaia ngā hyperscalers nā te mea ko te hua ko te kahui. Ka hangaia ngā taiwhanga ina he aukati te wā rarangi, kāore rānei e taea e ngā raraunga te wehe. Ka taea e te peeke, te hōhipera, te kāwanatanga, te kaihanga rānei me te huinga raraunga ngaro te whakarite kia tika te noho i roto i te whare, i te whare tūmataiti rānei. Me utu e te katoa: te noho tahi kua rite ki te AI, he rahui kapua, he rōpū whakahaere rānei. Ka whiwhi koe i ngā whakateretere me te kore e noho hei kaiwhakahaere tipu hiko.

Ngā Tohutoro

1. IEA - www.iea.org

2. LBNL - datacenters.lbl.gov

3. Te Matapihi Kakariki - www.thegreengrid.org

4. LBNL - datacenters.lbl.gov

5. LBNL - datacenters.lbl.gov

6. Uptime Institute - journal.uptimeinstitute.com

7. NVIDIA - developer.nvidia.com

8. NVIDIA - docs.nvidia.com

9. NVIDIA - docs.nvidia.com

10. NVIDIA - docs.nvidia.com

11. Kapua Google - docs.cloud.google.com

Kimihia te AI Hou i te Toa Kaiāwhina AI Whaimana

Mō Mātou