Whakautu poto: Ko te whakamahi i tētahi tauira AI ko te whiriwhiri i tētahi tauira tuku (wā-tūturu, puranga, rerema, taha rānei), kātahi ka taea te tāruarua, te tirotiro, te haumaru, me te whakahurihuri i te ara katoa. Ina whakaputahia e koe ngā mea katoa me te whakataurite i te whakaroa p95/p99 i runga i ngā kawenga rite ki te whakaputa, ka karohia e koe te nuinga o ngā hapa "mahi i runga i taku pona".
Ngā kōrero matua hei whakaaroaro:
Ngā tauira whakatinanatanga: Kōwhiria te wā-tūturu, te puranga, te rere, te taha rānei i mua i te tukunga atu ki ngā taputapu.
Te Whakaputa Anō: Putanga o te tauira, ngā āhuatanga, te waehere, me te taiao hei ārai i te hē.
Te Tirotiro: Te aroturuki tonu i ngā hiku whakaroa, ngā hapa, te kukū, me ngā tohatoha raraunga, putanga rānei.
Ngā whakahōunga haumaru: Whakamahia ngā whakamātautau kanari, kikorangi-kakariki, atarangi rānei me ngā paepae whakahōunga aunoa.
Haumarutanga me te tūmataitinga: Whakamahia te mana whakamana, ngā herenga reiti, me te whakahaere mea ngaro, me te whakaiti i te PII i roto i ngā rangitaki.
Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:
🔗 Me pehea te ine i te mahi AI
Akohia ngā inenga, ngā paearu, me ngā arowhai o te ao tūturu mō ngā hua pono o te AI.
🔗 Me pēhea te whakahaere aunoa i ngā mahi mā te AI
Tahurihia ngā mahi tāruarua hei rerengamahi mā te whakamahi i ngā tohutohu, ngā taputapu, me ngā whakaurunga.
🔗 Me pēhea te whakamātautau i ngā tauira AI
Te hoahoa i ngā aromatawai, ngā huinga raraunga, me te whakatauranga hei whakatairite i ngā tauira i runga i te whakaaro kotahi.
🔗 Me pehea te korero ki a AI
Pātaihia ngā pātai pai ake, whakatakotohia te horopaki, ā, kia tere te whiwhi whakautu mārama ake.
1) He aha te tikanga tūturu o te "whakatakotoranga" (me te take ehara i te mea he API noa iho) 🧩
Ina kī te tangata "whakatakotoria te tauira," ko tētahi o ēnei pea te tikanga:
-
Whakaaturia he pūwāhi kia taea ai e te taupānga te karanga whakatau i te wā tūturu (Vertex AI: Whakatakotoria he tauira ki tētahi pūwāhi, Amazon SageMaker: Whakatau wā tūturu)
-
Whakahaerehia te kaute puranga i ia pō hei whakahou i ngā matapae i roto i te pātengi raraunga (Amazon SageMaker Batch Transform)
-
Whakatau rere (ka puta tonu ngā kaupapa, ka puta tonu ngā matapae) (Rerenga Raraunga Kapua: kotahi tonu te wā, kotahi noa te wā rānei, ngā aratau rerema Rerenga Raraunga Kapua)
-
Te whakatinanatanga o te taha (waea, pūtirotiro, taputapu tāmau, "tērā pouaka iti rānei i roto i te wheketere") (whakataunga LiteRT i runga i te taputapu, tirohanga whānui LiteRT)
-
Te whakatinanatanga o ngā taputapu ā-roto (atanga kaiwhakamahi e anga ana ki te kaitātari, ngā pukatuhi, ngā tuhinga kua whakaritea rānei)
Nō reira, he iti ake te "whakamāmā i te tauira" i te whakatinanatanga, engari he rite ki:
-
tākai + tuku + tauine + aroturuki + whakahaere + hurihanga (Whakatakotoranga Kahurangi-Kakariki)
He rite tonu ki te whakatuwhera i tētahi wharekai. He mea nui te tunu i tētahi rihi reka, ae. Engari me whai tonu koe i te whare, i ngā kaimahi, i te pouaka whakamātao, i ngā tahua kai, i te mekameka tuku kai, me te huarahi hei whakahaere i te tere o te tina me te kore e tangi i roto i te pouaka tio. Ehara i te kupu whakarite tino tika… engari ka mārama koe. 🍝
2) He aha te mea e pai ai te putanga o "Me pēhea te whakatakoto i ngā tauira AI" ✅
He mea hoha te "whakatakotoranga pai". Ka taea te matapae i tana whanonga i raro i te pēhanga, ā, ki te kore, ka taea e koe te tātari tere.
Koinei te āhua o te kupu "pai":
-
Ngā hanganga ka taea te tārua
He waehere kotahi + he whakawhirinakitanga kotahi = he whanonga kotahi. Kāore he āhua whakamataku "e mahi ana i runga i taku pona" 👻 (Docker: He aha te ipu?) -
Kirimana atanga mārama
Kua tautuhia ngā tāuru, ngā putanga, ngā kauwhata, me ngā tauira taha. Kāore he momo ohorere i te 2am. (OpenAPI: He aha te OpenAPI?,Kauwhata JSON) -
Te mahinga e rite ana ki te ao tūturu.
Ko te whakaroa me te tere o te mahi e inehia ana i runga i ngā taputapu rite ki te whakaputa me ngā kawenga tūturu. -
Te aroturuki me ngā niho
Ngā inenga, ngā rangitaki, ngā tohu, me ngā arowhai nekehanga e whakaoho ana i te mahi (ehara i te mea ko ngā papaaho anake kāore e whakatuwheratia e tetahi). (Pukapuka SRE: Te aroturuki i ngā pūnaha tohatoha) -
Rautaki whakarewatanga haumaru
Canary, kikorangi-kakariki rānei, he ngāwari te huri whakamuri, he putanga kāore e hiahiatia he inoi. (Tukunga Canary, Whakatakotoranga Kikorangi-Kakariki) -
Mōhio ki ngā utu,
he mea pai te "Tere" kia rite rā anō te pire ki tētahi nama waea 📞💸 -
Te haumarutanga me te tūmataitinga i roto i
te whakahaere Ngā mea ngaro, te whakahaere urunga, te whakahaere PII, me te āheinga arotake. (Kubernetes Secrets, NIST SP 800-122)
Ki te taea e koe te mahi i aua mea i ngā wā katoa, kua eke kē koe ki mua i te nuinga o ngā tīma. Kia pono tātou.
3) Kōwhiria te tauira whakatinanatanga tika (i mua i te whiriwhiri i ngā taputapu) 🧠
Whakatau API wā-tūturu ⚡
Pai rawa atu ina:
-
e hiahia ana ngā kaiwhakamahi ki ngā hua tere (ngā taunakitanga, ngā tirotiro tinihanga, te kōrerorero, te whakawhaiaro)
-
me puta ngā whakataunga i te wā e tonoa ana
Ngā tūpato:
-
He mea nui ake te whakaroa o te p99 i te toharite (The Hiku i te Tauine, Pukapuka SRE: Te Aroturuki i ngā Pūnaha Tohatoha)
-
Me āta whakatikatika te whakapūtātanga aunoa (Kubernetes Horizontal Pod Autoscaling)
-
Ka taea e ngā tīmatanga makariri te huna… pērā i te ngeru e pana ana i te karāhe mai i te tēpu (te huringa ora o te taiao whakatinanatanga AWS Lambda)
Te kaute puranga 📦
Pai rawa atu ina:
-
ka taea te whakaroa i ngā matapae (te whakatau i te mōrearea mō te pō kotahi, te matapae i te huringa, te whakarei ake i te ETL) (Amazon SageMaker Batch Transform)
-
e hiahia ana koe ki te whai huatanga o te utu me ngā mahi māmā ake
Ngā tūpato:
-
te hou o ngā raraunga me ngā whakakī anō
-
te pupuri i te arorau āhuatanga kia rite ki te whakangungu
Whakatau rere 🌊
Pai rawa atu ina:
-
ka tukatuka tonu koe i ngā kaupapa (IoT, clickstreams, pūnaha aroturuki)
-
e hiahia ana koe ki ngā whakataunga tata-wā-tūturu me te kore he whakautu tono tino pakari
Ngā tūpato:
-
te tikanga o te kotahi-tūturu me te kotahi-iti rawa (Cloud Dataflow: kotahi-tūturu me te kotahi-iti rawa)
-
whakahaere āhua, ngana anō, tārua tauhou
Te whakatinanatanga o te taha 📱
Pai rawa atu ina:
-
iti te whakaroa me te kore e whakawhirinaki ki te whatunga (whakataunga LiteRT i runga i te taputapu)
-
ngā here tūmataiti
-
ngā taiao tuimotu
Ngā tūpato:
-
rahi tauira, pākahiko, ine ine, wehewehenga taputapu (Ine ine i muri i te whakangungu (Arotau Tauira TensorFlow))
-
he uaua ake ngā whakahōutanga (kāore koe e hiahia kia 30 ngā putanga kei te ngahere…)
Kōwhiria te tauira i te tuatahi, kātahi ka tīpako i te puranga. Ki te kore, ka akiakihia e koe te tauira tapawhā ki roto i te wā oma porowhita. He mea pērā rānei. 😬
4) Te tākai i te tauira kia ora tonu ai i te wā e pa atu ana ki te mahi hanga 📦🧯
Koinei te wāhi e mate puku ai te nuinga o ngā "whakatakotoranga ngāwari".
Putanga katoa (āe, katoa)
-
Tauira taonga (taumaha, kauwhata, tohu, mahere tapanga)
-
Arorau āhuatanga (ngā panonitanga, te whakataurite, ngā kaiwhakakōwaehere)
-
Waehere whakatau (i mua/i muri i te tukatuka)
-
Taiao (Python, CUDA, ngā pukapuka pūnaha)
He huarahi māmā e whai hua ana:
-
whakamahia te tauira hei taonga tuku
-
rongoatia me te tohu putanga
-
me whai kōnae raraunga rite ki te kāri tauira: te kaupapa, ngā inenga, ngā tuhipoka whakaahua raraunga whakangungu, ngā herenga e mōhiotia ana (Ngā Kāri Tauira mō te Pūrongo Tauira)
He āwhina ngā ipu, engari kaua e karakia ki a rātou 🐳
He pai ngā ipu nā te mea:
-
whakatio i ngā whakawhirinakitanga (Docker: He aha te ipu?)
-
whakapūmau i ngā hanganga
-
whakangawari i ngā whāinga whakatinanatanga
Engari me whakahaere tonu e koe:
-
ngā whakahōutanga o te ahua turanga
-
Hototahi ki ngā taraiwa GPU
-
matawai haumarutanga
-
rahi o te ahua (kāore tetahi e pai ki te 9GB "hello world") (ngā mahi pai o te hanga Docker)
Whakapūmautia te atanga
Whakatauhia tō hōputu tāuru/tāpui i te tīmatanga:
-
JSON mō te māmā (pōturi ake, engari he hoa) (Kaupapa JSON)
-
Protobuf mō te mahi (Tirohanga whānui mō ngā Pūrere Protocol)
-
ngā utunga e hangai ana ki te kōnae mō ngā whakaahua/oro (me ngā raraunga raraunga)
Ā, whakamanahia ngā tāurunga. Ko ngā tāurunga kore tika te tino take o ngā tīkiti "he aha i whakahokia mai ai ngā mea koretake". (OpenAPI: He aha te OpenAPI?, JSON Schema)
5) Ngā kōwhiringa tuku - mai i te "API māmā" ki ngā tūmau tauira katoa 🧰
E rua ngā ara noa:
Kōwhiringa A: Tūmau taupānga + waehere whakatau (huarahi kāhua FastAPI) 🧪
Ka tuhi koe i tētahi API e utaina ana te tauira, ā, ka whakahokia mai ngā matapae. (FastAPI)
Ngā Painga:
-
ngāwari ki te whakarite
-
he pai mō ngā tauira māmā ake, mō ngā hua tīmatanga rānei
-
te whakamanatanga māmā, te ara, me te whakaurunga
Ngā ngoikoretanga:
-
nāu ake te whakatikatika mahi (te puranga, te miro, te whakamahinga GPU)
-
Ka hanga hou koe i ētahi wira, tera pea he kino i te tīmatanga
Kōwhiringa B: Tūmau tauira (huarahi TorchServe / Triton) 🏎️
Ngā tūmau motuhake e whakahaere ana i:
-
te puranga (Triton: Te puranga hihiri me te whakatinanatanga tauira ōrite)
-
te mahi tahi (Triton: Te Whakahaere Tauira Mahi Tahi)
-
ngā tauira maha
-
Te whai huatanga o te GPU
-
ngā pūwāhi whakapūmau kua whakaritea (ngā tuhinga TorchServe, ngā tuhinga Triton Inference Server)
Ngā Painga:
-
ngā tauira mahi pai ake i waho o te pouaka
-
he wehenga māhorahora ake i waenga i te mahi ratonga me te arorau pakihi
Ngā ngoikoretanga:
-
te uauatanga o te mahi anō
-
ka ahua uaua te whirihoranga, pērā i te whakarite i te pāmahana o te kaukau
He tino noa te tauira ranu:
-
tūmau tauira mō te whakatau (Triton: Te puranga hihiri)
-
he kuwaha API angiangi mō te whakamana, te hanga tono, ngā ture pakihi, me te whakawhāiti reiti (whakatere i te kuwaha API)
6) Ripanga Whakataurite - ngā huarahi rongonui hei whakatinana (me ngā kare pono) 📊😌
Kei raro nei tētahi tirohanga whānui o ngā kōwhiringa e whakamahia ana e te tangata ina rapu huarahi ana ki te whakatinana i ngā Tauira AI.
| Utauta / Huarahi | hunga whakarongo | Utu | He aha i mahi ai |
|---|---|---|---|
| Docker + FastAPI (he rite rānei) | Ngā tīma iti, ngā pakihi hou | Āhua kore utu | He māmā, he ngāwari, he tere te tuku - ka "rongo" koe i ngā raruraru tauine katoa (Docker, FastAPI) |
| Kubernetes (DIY) | Ngā tīma papaaho | Te whakawhirinaki ki te hangarau | Mana whakahaere + tauine… he maha hoki ngā pona, ko ētahi he mea kanga (Kubernetes HPA) |
| Pūhara ML whakahaeretia (ratonga ML kapua) | Ngā tīma e hiahia ana kia iti ake ngā mahi | Utu i a koe e haere ana | Ngā rerengamahi whakatinanatanga kua hangaia, ngā matau aroturuki - he utu nui i ētahi wā mō ngā pito mutunga e mau tonu ana (whakatinanatanga Vertex AI, whakatau wā-tūturu SageMaker) |
| Ngā mahi kore tūmau (mō te whakatau māmā) | Ngā taupānga e ārahi ana i ngā huihuinga | Utu mo ia whakamahi | He pai mō ngā waka tūtae - engari ka taea e ngā tīmatanga makariri me te rahi o te tauira te whakakino i tō rā 😬 (AWS Lambda tīmatanga makariri) |
| Tūmau Whakatau NVIDIA Triton | Ngā tīma e aro ana ki te mahi | Pūmanawa kore utu, utu hanganga | He tino pai te whakamahinga o te GPU, te puranga, te maha-tauira - me manawanui te whirihoranga (Triton: Te puranga hihiri) |
| Ratonga Rama | Ngā tīma maha-PyTorch | Pūmanawa kore utu | He pai ngā tauira tuku taunoa - me whakatikatika pea mō te tauine teitei (tuhinga TorchServe) |
| BentoML (tākai + tūnga) | Ngā kaihangarau ML | Matua kore utu, he rerekē ngā tāpiri | He maeneene te takai, he pai te wheako kaiwhakawhanake - me whai tonu koe i ngā kōwhiringa ā-roto (takai BentoML mō te whakatinanatanga) |
| Ray Serve | Ngā tāngata pūnaha tohatoha | Te whakawhirinaki ki te hangarau | Ka tauine whakapae, he pai mō ngā paipa - he "nui" te āhua mō ngā kaupapa iti (Ngā tuhinga a Ray Serve) |
Tuhipoka tēpu: He kupu tūturu te kupu "Free-ish". Nā te mea kāore e kore he utu. He pire tonu kei hea, ahakoa ko tō moe. 😴
7) Te mahi me te tauine - te whakaroa, te tere o te mahi, me te pono 🏁
Ko te whakatikatika i te mahi te wāhi e huri ai te whakatinanatanga hei mahi toi. Ehara i te "tere" te whāinga. Ko te whāinga kia tere tonu.
Ngā inenga matua e whai tikanga ana
-
te whakaroa o te p50: te wheako kaiwhakamahi noa
-
p95 / p99 whakaroa: te hiku e whakaoho ana i te riri (Te Hiku i te Tauine, Pukapuka SRE: Te Aroturuki i ngā Pūnaha Tohatoha)
-
te whakaputanga: ngā tono mō ia hekona (ngā tohu rānei mō ia hekona mō ngā tauira whakaputa)
-
te auau hapa: mārama noa, engari kāore anō kia arohia i ētahi wā
-
Te whakamahinga rauemi: CPU, GPU, mahara, VRAM (Pukapuka SRE: Te Aroturuki i ngā Pūnaha Tohatoha)
Ngā rīwhi noa hei kukume
-
Whakakotahitanga
Whakakotahitia ngā tono hei whakanui ake i te whakamahinga o te GPU. He pai mō te putanga mahi, ka pā kino pea ki te whakaroa mēnā ka nui rawa te mahi. (Triton: Whakakotahitanga hihiri) -
Te Ine Ine
Ka taea e te iti o te tika (pērā i te INT8) te tere ake te whakatau me te whakaiti i te mahara. Tērā pea ka paku heke te tika. I ētahi wā kāore, he mea miharo. (Te ine ine i muri i te whakangungu) -
Te whakahiato/te arotau i
te kaweake ONNX, ngā arotau kauwhata, ngā rere rite ki te TensorRT. He kaha, engari ka uaua te patuiro 🌶️ (ONNX, ngā arotau tauira ONNX Runtime) -
Te Keteroki
Mena ka tukurua ngā tāurunga (ka taea rānei e koe te keteroki i ngā tāpiringa), ka taea e koe te penapena nui. -
Aunoa i
te Tauine i runga i te whakamahinga o te CPU/GPU, te hohonutanga o te rarangi, te tere tono rānei. Kāore i te tino arohia te hohonutanga o te rarangi. (Kubernetes HPA)
He tohutohu rerekē engari he pono: me ine ki ngā rahi kawenga rite ki te whakaputa. Ka teka ngā kawenga whakamātautau iti ki a koe. Ka menemene mārie rātou, kātahi ka tukua koe i muri mai.
8) Te aroturuki me te mātakitaki - kaua e rere matapo 👀📈
Ehara i te mea ko te aroturuki tauira anake te aroturuki i te wā mahi. Me mōhio koe mēnā:
-
he hauora te ratonga
-
kei te whanonga te tauira
-
kei te rere haere ngā raraunga
-
Kei te iti haere te pono o ngā matapae (tirohanga whānui o Vertex AI Model Monitoring, Amazon SageMaker Model Monitor)
Ngā mea hei aroturuki (te huinga iti rawa e taea ana)
Hauora ratonga
-
te maha o ngā tono, te tere hapa, ngā tohatoha whakaroa (Pukapuka SRE: Te Aroturuki i ngā Pūnaha Tohatoha)
-
te mākū (CPU/GPU/mahara)
-
te roa o te rarangi me te wā i roto i te rarangi
Whēkenga tauira
-
ngā tohatoha āhuatanga whakauru (ngā tatauranga taketake)
-
ngā paerewa whakauru (mō ngā tauira whakauru)
-
ngā tohatoha putanga (te māia, te ranunga akomanga, ngā awhe kaute)
-
te kimi i ngā hapa i ngā whakaurunga (para e tomo mai ana, para e puta atu ana)
Te rere o ngā raraunga me te rere o ngā ariā
-
Me whai hua ngā whakatūpato nekeneke (Vertex AI: Te piko me te nekeneke o te āhuatanga aroturuki, Amazon SageMaker Model Monitor)
-
karohia te pāme whakatūpato - ka ako i te tangata kia kaua e aro ki ngā mea katoa
Te takiuru, engari ehara i te huarahi "takihia ngā mea katoa ake ake" 🪵
Rārangi:
-
ngā ID tono
-
putanga tauira
-
ngā hua whakamana kaupapa (OpenAPI: He aha te OpenAPI?)
-
he iti noa ngā raraunga utauta hanganga (ehara i te PII mata) (NIST SP 800-122)
Kia tūpato ki te tūmataitinga. Kāore koe e hiahia kia waiho ō rangitaki hei turuturu raraunga mōu. (NIST SP 800-122)
9) Ngā rautaki CI/CD me te whakatinanatanga - whakaarohia ngā tauira pērā i ngā tukunga tūturu 🧱🚦
Ki te hiahia koe ki ngā whakatinanatanga pono, hangaia he paipa. Ahakoa he mea māmā noa iho.
He rere mārō
-
Ngā whakamātautau wae mō te tukatuka i mua me te tukatuka i muri
-
Whakamātautau whakauru me te "huinga koura" whakauru-putanga e mōhiotia ana
-
Te tūāpapa whakamātautau kawenga (ahakoa he māmā)
-
Hangaia he taonga tuku iho (ipu + tauira) (Ngā mahi pai rawa atu mō te hanga Docker)
-
Whakatakotoria ki te whakaaturanga
-
Tukunga Canary ki tētahi wāhanga iti o te waka (Canary Release)
-
Whakapiki haere mārire
-
Te hurihanga aunoa i ngā paepae matua (Te Whakatakotoranga Kikorangi-Kakariki)
Ngā tauira hurihuri hei whakaora i tō hinengaro
-
Canary: tuku ki te 1-5% o te hunga e toro ana i te tuatahi (Canary Release)
-
Kahurangi-kakariki: whakahaerehia te putanga hou i te taha o te tawhito, hurihia ina rite (Whakatakotoranga Kahurangi-Kakariki)
-
Whakamātautau atarangi: tukuna ngā tāngata tūturu ki te tauira hou engari kaua e whakamahia ngā hua (he pai mō te aromatawai) (Microsoft: Whakamātautau atarangi)
Ā, hurihia ō pūwāhi mutunga, tō ara rānei mā te tauira putanga. Ka mihi atu koe ki a koe mō ngā mea kei te heke mai. Ka mihi atu hoki koe ki a koe mō ngā mea o nāianei, engari kia ata noho.
10) Te haumarutanga, te tūmataitinga, me te "kaua e turuturu i ngā mea" 🔐🙃
Ka tae pōturi mai ngā kaitiaki, pērā i te manuhiri kāore i karangatia. He pai ake te karanga wawe.
Rārangi arowhai mahi
-
Te manatoko me te whakamanatanga (ko wai ka taea te waea atu ki te tauira?)
-
Te whakawhāiti tere (te tiaki i te tukino me ngā awha tūpono) (te whakawhāiti i te API Gateway)
-
Te whakahaere i ngā mea ngaro (kāore he kī i roto i te waehere, kāore hoki he kī i roto i ngā kōnae whirihora…) (Kaiwhakahaere Ngā Mea Ngaro AWS, Ngā Mea Ngaro Kubernetes)
-
Ngā mana whakahaere whatunga (ngā whatunga iti tūmataiti, ngā kaupapa here ratonga-ki-ratonga)
-
Ngā rangitaki arotake (ina koa mō ngā matapae tairongo)
-
Te whakaiti i ngā raraunga (penapenahia ngā mea e tika ana) (NIST SP 800-122)
Mena ka pā te tauira ki ngā raraunga whaiaro:
-
ngā tohu whakatika, tohu tātai rānei
-
karohia te tuhi i ngā kawenga mata (NIST SP 800-122)
-
tautuhi i ngā ture pupuri
-
te rere o ngā raraunga tuhinga (hoha, engari he tiaki)
Waihoki, he mea nui te werohanga tere me te whakamahi kino i te putanga mō ngā tauira whakaputa. Tāpirihia: (OWASP Top 10 mō ngā Tono LLM, OWASP: Werohanga Tere)
-
ngā ture horoi whakauru
-
tātari putanga ina tika
-
ngā ārai mō te karanga taputapu, ngā mahi pātengi raraunga rānei
Kāore he pūnaha e tino tika ana, engari ka taea e koe te whakaiti i tōna pakarukaru.
11) Ngā mahanga noa (arā, ngā mahanga noa) 🪤
Anei ngā mea rongonui:
-
tūnga
o mua i te whakangungu me te whakaputa. Ka heke whakarere te tika, ā, kāore tetahi e mōhio he aha. (Whakamana Raraunga TensorFlow: kitea te tūnga o mua i te whakangungu) -
Kāore he whakamana kaupapa
Kotahi te huringa whakarunga e pakaru ana i ngā mea katoa. Kāore hoki i te haruru i ngā wā katoa… (Kaupapa JSON, OpenAPI: He aha te OpenAPI?) -
Ko te kore aro ki te whakaroa o te hiku,
ko te p99 te wāhi e noho ai ngā kaiwhakamahi ina riri ana rātou. (Te Hiku i te Tauine) -
Ko te wareware i te utu o
ngā pūwhakamutunga GPU e mahi mangere ana he rite ki te waiho i ngā rama katoa i roto i tō whare e kā ana, engari he moni te hanga o ngā pūrama rama. -
Kāore he mahere whakamuri.
Ehara te "Ka whakatū anō mātou" i te mahere. He tumanako noa iho, he koti roa. (Te Whakatūnga Kahurangi-Kakariki) -
Te wā mahi aroturuki anake
Ka taea te mahi tonu i te wā e hē ana te tauira. He kino ake pea tēnā. (Vertex AI: Te hianga me te rerekētanga o te āhuatanga aroturuki, Amazon SageMaker Model Monitor)
Ki te mea kei te pānui koe i tēnei, ā, kei te whakaaro koe "āe, e rua ā mātou mahi," nau mai ki te karapu. He kai mā te karapu, ā, he iti noa te ahotea. 🍪
12) Whakarāpopototanga - Me pēhea te Whakatakoto i ngā Tauira AI me te kore e ngaro tō hinengaro 😄✅
Mā te whakatinanatanga ka huri te AI hei hua tūturu. Ehara i te mea whakamīharo, engari koinei te wāhi e whiwhi ai i te whakawhirinaki.
Whakarāpopototanga tere
-
Whakatauhia tō tauira whakatinanatanga i te tuatahi (wā-tūturu, puranga, roma, taha) 🧭 (Whakawhitinga Puranga Amazon SageMaker, aratau roma raraunga kapua, whakatau LiteRT i runga i te taputapu)
-
Mōkihi hei tāruarua (putanga katoa, whakanohohia ki roto i ngā ipu me te kawenga) 📦 (ngā ipu Docker)
-
Kōwhiria te rautaki tuku i runga i ngā hiahia mahi (API māmā, tūmau tauira rānei) 🧰 (FastAPI, Triton: Puranga hihiri)
-
Inehia te whakaroa p95/p99, kaua ko te toharite anake 🏁 (Te Hiku i te Tauine)
-
Tāpirihia te aroturukitanga mō te hauora ratonga me te whanonga tauira 👀 (Pukapuka SRE: Te Aroturuki i ngā Pūnaha Tohatoha, Te Aroturuki Tauira Vertex AI)
-
Hurihia kia haumaru mā te whakamahi i te canary, te kikorangi-kakariki rānei, kia māmā ai te huri whakamuri 🚦 (Tukunga Canary, Whakatakotoranga Kikorangi-Kakariki)
-
Tunua te haumaru me te tūmataitinga mai i te rā tuatahi 🔐 (Kaiwhakahaere Ngā Mea Huna a AWS, NIST SP 800-122)
-
Kia hoha, kia matapaetia, kia tuhia hoki - he ataahua te hoha 😌
Āe, ko te āhua o te whakatinanatanga o ngā Tauira AI he rite ki te takaro pōro poihau mura i te tīmatanga. Engari ina pumau tō paipa, ka tino makona. He rite ki te whakarite i tētahi pouaka kua raruraru… ko te pouaka anake te waka whakaputa.
Tauira o te ao tūturu: Te whakatinana i tētahi tauira whakarōpū tīkiti tautoko
Horopaki
Whakaarohia he kamupene SaaS tito noa engari he tūturu, me ngā kaihoko tautoko 12 me te tata ki te 900 tīkiti kiritaki ia wiki. E hiahia ana te tīma ki tētahi tauira AI hei whakarōpū i ngā tīkiti e haere mai ana mā te kāwai, te akiaki, me te huarahi kua tohua i mua i te whakautu a te kaihoko tangata.
Ehara tēnei i te karetao tautoko aunoa katoa. Kāore te tauira e tuku whakautu ki ngā kiritaki. Ka āwhina noa i te whakatere tere i ngā tīkiti, te tohu i ngā kēhi mōrearea, me te hoatu i tētahi tīmatanga ma ake ki ngā kaihoko.
Ko te tauira whakatinanatanga pai rawa atu i konei ko te whakatau API wā-tūturu. Ka uru ia tīkiti hou ki te tēpu āwhina, ka tātaitia e te ratonga AI i roto i ngā rau mirihekona torutoru, ā, ka rongoatia e te tēpu āwhina te kāwai i matapaetia, te kaupapa matua, te kaute whakapono, me te putanga tauira.
Ngā mea e hiahiatia ana e te kaiawhina
Ngā whakaurunga āwhina:
kaupapa tīkiti
tinana tīkiti
momo mahere kiritaki
rohe pūkete
te rohe hua, mēnā kua mōhiotia kētia
te maha o ngā tīkiti o mua i ngā rā 30 kua hipa
Ngā ture āwhina:
kaua rawa e takiuru i ngā karere mata a te kiritaki mēnā kei roto ngā raraunga whaiaro
tuku atu ngā tautohe nama, ngā tūmomo mōrearea ture, ngā tono muku pūkete, me ngā take haumarutanga ki te arotake tangata
ara-aunoa anake ina kei runga ake te māia i tētahi paepae kua tautuhia, pērā i te 0.85
rongoatia te putanga tauira me ia matapae
hoki atu ki te whakarōpū ā-ringa mēnā he puhoi, he kore rānei e wātea ana te ratonga tauira
Tauira tohutohu
He kaiawhina tautoko koe mō te whakarite tīkiti. Whakarōpūtia ia tīkiti ki tētahi wāhanga: Utu, Takiuru, Pūrongo Pepeke, Tono Āhuatanga, Whakakorenga Pūkete, Haumarutanga, Ētahi Atu rānei.
Whakahokia mai te kāwai, te taumata akiaki, te kaute māia, te take poto, me te rārangi tautoko e taunakitia ana.
Kaua e tito noa i ngā kōrero ngaro. Mena kei roto i te tīkiti he kōrero ture, he kōrero haumarutanga, he kōrero kore utu, he kōrero muku pūkete, he kōrero riri rānei a te kiritaki, tohua kia arotakehia e te tangata.
Mena kei raro iho i te 0.85 te māia, whakahokia mai te "Arotake ā-ringa" hei rarangi i tūtohutia.
Putanga tauira
Putanga ngoikore:
Kāwai: Pepeke Matua
: Teitei
Tukuna ki te tautoko.
Putanga pai ake:
Kāwai: Takiuru
Whakaterenga: Waenga
Whakapono: 0.91
Rārangi e taunakitia ana: Uru ki te Pūkete
Take: Kāore e taea e te kiritaki te uru atu ki tā rātou pūkete i muri i te tautuhi anō i tā rātou kupuhipa. Kāore he tūmomo mōrearea haumarutanga, he take utu rānei e whakahuatia ana.
Arotake tangata e hiahiatia ana: Kāore
Putanga tauira: ticket-triage-v1.3
He māmā ake te arotake i te putanga pai ake nā te mea kei roto ko te kaute whakawhirinaki, te whakatau ara, te take, me te putanga tauira.
Me pēhea te whakamātautau
I mua i te tukunga atu o ngā tikiti ora ki te tauira, waihangahia he "huinga koura" iti o ngā tikiti tūturu engari kua hunaia.
Ka taea te whakauru i tētahi huinga whakamātautau māmā:
50 tīkiti utu
50 ngā tīkiti takiuru
50 ngā pūrongo pepeke
30 ngā tono whakakore
20 tīkiti e aro ana ki te haumarutanga
20 tīkiti whakapoauau, tīkiti kāwai-whakaranu rānei
Kātahi ka tirohia:
E whiriwhiria ana rānei e te tauira te kāwai kotahi me te kaiarotake tangata?
Kei te tika te whakapiki ake i ngā tīkiti haumarutanga, ture, me ngā tīkiti whakakore?
Ka whakahokia mai te "Arotake ā-Ringa" ina iti te whakapono?
Kei raro tonu i te whāinga a te tīma te roanga o te p95?
Ka hē te ratonga ina kore e wātea te tauira?
Mō te whakatinanatanga, whakamahia te whakamātautau atarangi i te tuatahi. Tukuna ngā tīkiti tūturu ki te tauira hou, engari kaua e whakamahia āna matapae i tēnei wā. Whakatauritehia tana putanga ki te whakarōpūtanga tangata noa mō ētahi rā. Mena he pumau ngā hua, neke ki te tukunga kanari 5%, kātahi ki te 25%, kātahi ki te 100%.
Hua
He hua tauira, i runga i te wā i whakaritea ai ngā tīkiti tauira 100 i mua atu, ā, i muri mai i te whakamahinga o te tukanga mahi:
kua heke te wā whakarōpū ā-ringa mai i te 6 meneti mō ia tīkiti ki te 1 meneti 40 hēkona mō ia tīkiti
i penapenahia e te tīma mō te 7.2 hāora puta noa i te 100 tīkiti
Ko te whakaaetanga kāwai me te arotake tangata he 87% puta noa i te huinga koura 220-tikiti
100% o ngā tīkiti whakamātautau 20 e aro ana ki te haumarutanga i tukuna ki te arotake tangata
Ko te roanga o te whakaroa o te p95 he 480 ms i runga i ngā kawenga rite ki te whakaputa
ko te roanga o te whakaroa o te p99 he 910 ms
i raro i te 2 meneti te roa o te wā hurihuri nā te mea i noho ora tonu te pito whakamutunga o te tauira tawhito i te wā i tukuna ai te canary
Ehara ēnei tau i te paerewa whānui. He tauira inenga ēnei ka taea e te tīma te whakaputa anō mā te wā i ngā mahi whakarōpū, te whakatairite i ngā matapae ki tētahi huinga whakamātautau kua tohua, me te whakamātautau i te pūwāhi mutunga me ngā kawenga tīkiti tūturu.
He aha te mea ka hē
Ko te mōrearea nui ko te whakawhirinaki nui rawa ki te tauira. Tērā pea he take haumarutanga nui kei roto i tētahi tīkiti kua tohua ko "iti te tere", ina koa mēnā kāore i te mārama te tuhituhi a te kiritaki.
Ētahi atu hapa noa:
te whakamahi i ngā tīkiti whakamātautau kua oti te whakakoi kāore e ōrite ki ngā tīkiti kiritaki tūturu
te tuhi i ngā karere katoa a te kiritaki me ngā raraunga whaiaro
kāore e rongoa ana i te putanga tauira me ia matapae
te arahi aunoa i ia tīkiti, ahakoa he iti te whakapono
te wareware i tētahi rarangi whakamuri ā-ringa
te ine i te roanga o te wā engari kāore e aro ki te p95 me te p99
te waiho i ngā kāwai tawhito kia noho tonu i roto i te tauira i muri i te whakarerekētanga a te tīma tautoko i ana rarangi
He kai tango-ā-ringa whai hua
Kāore e hiahiatia kia tīmata nui te whakatinanatanga pai o te AI. Tīmata ki te rerengamahi whaiti kotahi, ki te atanga mārama kotahi, ki te huinga whakamātautau koura kotahi, me te ara hurihanga haumaru kotahi. Mena ka penapena wā te tauira me te kore e huna i te mōrearea, he pai te whakatinanatanga kia tauinehia.
Ngā Pātai Auau
Te tikanga o te whakatinana i tētahi tauira AI i roto i te whakaputanga
Ko te whakatinanatanga o tētahi tauira AI he nui atu i te whakaatu noa i tētahi API matapae. I roto i te mahi, kei roto ko te tākai i te tauira me ōna whakawhirinakitanga, te whiriwhiri i tētahi tauira tuku (wā-tūturu, puranga, rerema, taha rānei), te whakatauine me te pono, te aroturuki i te hauora me te nekehanga, me te whakarite i ngā ara whakarewatanga me te hurihanga haumaru. Ka noho pumau tonu te whakatinanatanga pakari i raro i te kawenga, ā, ka taea tonu te tautuhi ina he tetahi mea.
Me pēhea te whiriwhiri i waenga i te wā-tūturu, te puranga, te rerema, te whakatinanatanga taha rānei
Kōwhiria te tauira whakatinanatanga i runga i te wā e hiahiatia ana ngā matapae me ngā here e whakahaerehia ana e koe. Ka uru ngā API wā-tūturu ki ngā wheako taunekeneke e whai tikanga ana te whakaroa. Ka pai te mahi a te kaute puranga ina whakaaetia ngā whakaroa, ā, ka arahi te whai huatanga utu. Ka pai te rerema ki te tukatuka huihuinga tonu, inā koa ka uaua te tikanga tuku. He pai te whakatinanatanga taha mō te mahi tuimotu, te tūmataitinga, ngā whakaritenga whakaroa tino-iti rānei, ahakoa ka uaua ake te whakahaere i ngā whakahoutanga me ngā rerekētanga taputapu.
Me aha te putanga hei karo i ngā hapa whakatinanatanga "e mahi ana i runga i taku pona"
He putanga nui atu i te taumaha tauira anake. I te nuinga o te wā, ka hiahia koe ki tētahi tauira tauira kua whakapūtātia (tae atu ki ngā tohu, ki ngā mahere tapanga rānei), te tukatuka-mua me te arorau āhuatanga, te waehere whakatau, me te taiao wā-oma katoa (ngā whare pukapuka Python/CUDA/pūnaha). Whakamahia te tauira hei tauira tukunga me ngā putanga kua tohua me ngā raraunga māmā e whakaahua ana i ngā tumanakohanga kaupapa, ngā tuhipoka aromatawai, me ngā herenga e mōhiotia ana.
Ahakoa me whakatinana mā te ratonga FastAPI māmā, mā te tūmau tauira motuhake rānei
He pai te mahi a tētahi tūmau taupānga māmā (he huarahi ā-FastAPI) mō ngā hua tōmua, ngā tauira māmā rānei, nā te mea ka mau tonu te mana whakahaere mō te ara, te whakamana, me te whakaurunga. Ka taea e tētahi tūmau tauira (ā-TorchServe, ā-NVIDIA Triton rānei) te whakarato i te puranga kaha ake, te ōritetanga, me te whai huatanga o te GPU mai i te tīmatanga. He maha ngā tīma e tau ana ki tētahi pūnaha ranu: he tūmau tauira mō te whakatau me tētahi paparanga API angiangi mō te whakamana, te hanga tono, me ngā herenga reiti.
Me pēhea te whakapai ake i te whakaroa me te tere o te tuku me te kore e pakaru te tika
Tīmata mā te ine i te whakaroa p95/p99 i runga i ngā taputapu rite ki te whakaputa me ngā kawenga tūturu, nā te mea ka taea e ngā whakamātautau iti te whakapohehe. Ko ngā momo whakamātau noa ko te puranga (he pai ake te putanga, he kino ake pea te whakaroa), te ine ine (he iti ake, he tere ake, i ētahi wā he iti noa ngā taupatupatu tika), ngā rerenga whakahiato me te arotau (he rite ki te ONNX/TensorRT), me te pupuri i ngā whakaurunga, i ngā whakaurunga rānei. Mā te tauine aunoa i runga i te hohonu o te rarangi ka taea hoki te aukati i te whakaroa hiku kia piki ake.
He aha te aroturukitanga e hiahiatia ana i tua atu i te "kua eke te pito mutunga"
Kāore e ranea te wā mahi, nā te mea ka āhua ora te ratonga i te mea ka heke te kounga o te matapae. I te iti rawa, aroturukihia te rahinga tono, te tere hapa, me ngā tohatoha whakaroa, me ngā tohu kukū pēnei i te CPU/GPU/mahara me te wā rarangi. Mō te whanonga tauira, aroturukihia ngā tohatoha tāuru me te putanga me ngā tohu rerekē taketake. Tāpirihia ngā arowhai nekeneke e whakaoho ana i te mahi kaua ki ngā matohi haruru, me te takiuru i ngā ID tono, ngā putanga tauira, me ngā putanga whakamana kaupapa.
Me pēhea te whakarewa i ngā putanga tauira hou me te haumaru, me te whakaora tere hoki
Me rite ngā tauira ki ngā tukunga katoa, me te paipa CI/CD e whakamātautau ana i te tukatuka i mua me te tukatuka i muri, e whakahaere ana i ngā arowhai whakauru ki te "huinga koura," ā, e whakatū ana i tētahi turanga kawenga. Mō ngā whakarewatanga, ka tukuna mārire e Canary te waka piki, ko te kikorangi-kakariki ia ka pupuri i te putanga tawhito kia ora tonu hei whakahokinga. Ka āwhina te whakamātautau atarangi ki te aromatawai i tētahi tauira hou i runga i te waka tūturu me te kore e pā ki ngā kaiwhakamahi. Me waiho te whakahokinga hei tikanga tuatahi, kaua hei whakaaro i muri mai.
Ko ngā hapa tino kitea i te wā e ako ana koe ki te whakatinana i ngā tauira AI
Ko te āhua rerekē o te mahi whakangungu te mea tawhito: he rerekē te tukatuka i mua i te whakangungu me te whakaputa, ā, ka heke mārire te mahi. Ko tētahi atu raruraru e pā ana ko te korenga o te whakamana kaupapa, ina pakaru ngā tāurunga i roto i ngā huarahi ngaro nā te huringa whakarunga. Ka whakaitihia hoki e ngā tīma te roa o te whakaroa o te hiku, ka aro nui ki ngā toharite, ka warewarehia te utu (ka tere te tāpiri o ngā GPU mangere), ā, ka pekehia te whakamahere whakamuri. He tino mōrearea te wā mahi aroturuki anake, nā te mea he kino ake te "piki engari he hē" i te heke.
Ngā Tohutoro
-
Ratonga Tukutuku Amazon (AWS) - Amazon SageMaker: Whakatau wā-tūturu - docs.aws.amazon.com
-
Ratonga Tukutuku Amazon (AWS) - Amazon SageMaker Puranga Whakawhiti - docs.aws.amazon.com
-
Ratonga Tukutuku Amazon (AWS) - Aroturuki Tauira SageMaker a Amazon - docs.aws.amazon.com
-
Ratonga Tukutuku Amazon (AWS) - Whakawhāiti tono API Gateway - docs.aws.amazon.com
-
Ratonga Tukutuku Amazon (AWS) - Kaiwhakahaere Ngā Mea Ngaro AWS: Kupu Whakataki - docs.aws.amazon.com
-
Ratonga Tukutuku Amazon (AWS) - Te huringa ora o te taiao whakahaere AWS Lambda - docs.aws.amazon.com
-
Kapua Google - Vertex AI: Whakatakotoria he tauira ki tētahi pito - docs.cloud.google.com
-
Tirohanga whānui mō te Aroturuki Tauira Vertex AI - Google Cloud - docs.cloud.google.com
-
Google Cloud - Vertex AI: Te piko me te nekeneke o te āhuatanga aroturuki - docs.cloud.google.com
-
Blog Kapua Google - Rerenga Raraunga: aratau rere kotahi-tūturu, kotahi-te-iti rawa hoki - cloud.google.com
-
Google Cloud - Ngā aratau rerema o te Cloud Dataflow - docs.cloud.google.com
-
Pukapuka SRE a Google - Te Aroturuki i ngā Pūnaha Tohatoha - sre.google
-
Rangahau Google - Te Hiku i te Tauine - research.google
-
LiteRT (Google AI) - Tirohanga LiteRT - ai.google.dev
-
LiteRT (Google AI) - LiteRT i runga i te taputapu whakaaro - ai.google.dev
-
Docker - He aha te ipu? - docs.docker.com
-
Docker - Ngā mahi pai mō te hanga Docker - docs.docker.com
-
Kubernetes - Kubernetes mea ngaro - kubernetes.io
-
Kubernetes - Te Whakatairanga Aunoa o te Pod Whakapae - kubernetes.io
-
Martin Fowler - Tukunga o Canary - martiinfowler.com
-
Martin Fowler - Te Whakatakotoranga Kikorangi-Kakariki - martiinfowler.com
-
Kaupapa OpenAPI - He aha te OpenAPI? - openapis.org
-
Kaupapa JSON - (paetukutuku i tohua) - json-schema.org
-
Ngā Pūrere Whakapūmau - Tirohanga whānui mō ngā Pūrere Whakapūmau - protobuf.dev
-
FastAPI - (paetukutuku i tohua) - fastapi.tiangolo.com
-
NVIDIA - Triton: Te Whakakotahitanga Hihiri me te Whakahaere Tauira Wātahi - docs.nvidia.com
-
NVIDIA - Triton: Te Whakahaere Tauira Whakakotahi - docs.nvidia.com
-
NVIDIA - Ngā tuhinga Tūmau Whakatau Triton - docs.nvidia.com
-
PyTorch - Ngā tuhinga TorchServe - docs.pytorch.org
-
BentoML - Te takai mō te whakatinanatanga - docs.bentoml.com
-
Ray - Ngā tuhinga a Ray Serve - docs.ray.io
-
TensorFlow - Te ine i muri i te whakangungu (Te Arotau Tauira TensorFlow) - tensorflow.org
-
TensorFlow - Whakamana Raraunga TensorFlow: kitea te piko o te mahi whakangungu - tensorflow.org
-
ONNX - (paetukutuku i tohua) - onnx.ai
-
ONNX Runtime - Tauira arotautanga - onnxruntime.ai
-
NIST (Te Whare Wānanga Paerewa me te Hangarau ā-Motu) - NIST SP 800-122 - csrc.nist.gov
-
arXiv - Ngā Kāri Tauira mō te Pūrongo Tauira - arxiv.org
-
Microsoft - Whakamātautau atarangi - microsoft.github.io
-
OWASP - Ngā Tono LLM Pai rawa atu e 10 mō te OWASP - owasp.org
-
Kaupapa Haumarutanga GenAI OWASP - OWASP: Werohanga Tere - genai.owasp.org