Kua whakaaro kē koe he aha te mea e huna ana i muri i te kupu rongonui "AI Engineer"? I whakaaro anō hoki ahau. Mai i waho he ahua kanapa, engari ko te mea pono he mahi hoahoa ōrite, he tautohetohe i ngā raraunga pōrearea, he tuitui i ngā pūnaha, me te tirotiro tonu mēnā kei te mahi ngā mea i tā rātou e tika ana. Ki te hiahia koe ki te putanga kotahi-rārangi: ka hurihia e rātou ngā raruraru pōuriuri hei pūnaha AI mahi e kore e hinga ina puta mai ngā kaiwhakamahi tūturu. Ko te tirohanga roa ake, he ahua pōrearea ake - āe, kei raro iho. Hopukia te kawheine. ☕
Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:
🔗 Ngā taputapu AI mō ngā kaihangarau: Te whakanui ake i te whai huatanga me te auahatanga
Kitea ngā taputapu AI kaha e whakarei ake ana i te hua me te auahatanga o te hangarau.
🔗 Ka whakakapia rānei ngā kaihanga pūmanawa e te AI?
Tūhurahia te heke mai o te hangarau pūmanawa i te ao o te aunoatanga.
🔗 Ngā tono hangarau o te matauranga horihori e whakarerekē ana i ngā ahumahi
Akohia me pēhea te hanga hou a te AI i ngā tukanga ahumahi me te akiaki i te auahatanga.
🔗 Me pēhea te noho hei miihini AI
He aratohu taahiraa-i-te-taahiraa hei tīmata i tō haerenga ki tētahi umanga i roto i te hangarau AI.
He tirohanga tere: ngā tūturu 💡
I te taumata māmā rawa, ka hoahoa, ka hanga, ka tuku, ka tiaki hoki te miihini AI i ngā pūnaha AI. Ko ngā mahi o ia rā ko:
-
Te whakamāori i ngā hiahia hua, pakihi rānei kāore i te tino mārama ki tētahi mea ka taea e ngā tauira te whakatutuki.
-
Te kohikohi, te tāpiri tapanga, te horoi, me te - hei tikanga - te tirotiro anō i ngā raraunga ina tīmata te memeha haere.
-
Te whiriwhiri me te whakangungu i ngā tauira, te aromatawai i aua tauira ki ngā inenga tika, me te tuhi i ngā wāhi ka rahua ai.
-
Te tākai i te mea katoa ki roto i ngā paipa MLOps kia taea ai te whakamātautau, te whakatinana, me te tirotiro.
-
Te mātakitaki i te ngahere: te tika, te haumaru, te tika… me te whakarerekē i mua i te hē.
Ki te mea kei te whakaaro koe "he hangarau pūmanawa me te pūtaiao raraunga me te iti o te whakaaro hua" - āe, koinā te āhua.
He aha te mea e wehewehe ana i pai i ētahi atu ✅
Ka taea e koe te mōhio ki ngā pepa hoahoanga katoa i whakaputaina mai i te tau 2017, ā, ka taea tonu e koe te hanga i tētahi raruraru pakarukaru. Ko te hunga e angitu ana i roto i tēnei mahi ko:
-
Whakaarohia i roto i ngā pūnaha. Ka kite rātou i te huringa katoa: ngā raraunga e uru mai ana, ngā whakataunga e puta ana, ngā mea katoa ka taea te whai.
-
Kaua e whaia te makutu i te tuatahi. Ngā tūāpapa me ngā tirotiro māmā i mua i te whakarārangi i te uauatanga.
-
Whakauruhia te urupare. Ehara i te mea he tāpiri te whakangungu anō me te huri whakamuri, engari he wāhanga o te hoahoa.
-
Tuhia ngā mea. Ngā taupatupatu, ngā whakapae, ngā herenga - he hoha, engari he koura ā muri ake nei.
-
Kia tino aro ki te AI whai kawenga. Kāore ngā mōrearea e memeha mā te hihiri, ka tuhia, ka whakahaeretia.
He kōrero poto: I tīmata tētahi tīma tautoko me tētahi ture kuware + he pūtake whakahoki. Nā tēnā i mārama ai ā rātou whakamātautau whakaae, nō reira, i te wā i whakawhitihia ai tētahi tauira nui i muri mai, he pai ā rātou whakataurite - ā, he ngāwari te hoki whakamuri ina hē te mahi.
Te huringa ora: te ao pōrearea me ngā hoahoa ātaahua 🔁
-
Whakaahuahia te āhua o te raruraru. Tautuhia ngā whāinga, ngā mahi, me te āhua o te "pai rawaka".
-
Horoia ngā raraunga. Horoia, tāpirihia he tapanga, wehewehea, putanga. Whakamanahia tonutia kia mau ai te rerekētanga o te kaupapa.
-
Whakatauirahia ngā whakamātautau. Whakamātauria ngā mea māmā, whakamātauria ngā kaupapa matua, tāruaruatia, tuhia.
-
Tukuna atu. Ngā paipa CI/CD/CT, ngā whakatinanatanga haumaru, ngā manu kōtukutuku, ngā hurihanga.
-
Kia mataara. Aroturukihia te tika, te whakaroa, te hē, te tika, ngā putanga a ngā kaiwhakamahi. Kātahi ka whakangungu anō.
I runga i tētahi parāoa reti, he rite tēnei ki tētahi porowhita ātaahua. Ina mahi, he rite tonu ki te tākaro i te pākete me te puruma.
Te AI kawenga ina tae te rāpa ki te rori 🧭
Ehara i te mea ko ngā papa reti ataahua te mea nui. Ka whakawhirinaki ngā kaihangarau ki ngā anga hei whakamana i te mōrearea:
-
Mā te NIST AI RMF ka whakaratohia he hanganga mō te kimi, te ine, me te whakahaere i ngā mōrearea puta noa i te hoahoa tae noa ki te whakatinanatanga [1].
-
ngā Mātāpono OECD ki tētahi kāpehu - he aratohu whānui e whaihia ana e te nuinga o ngā whakahaere [2].
He maha hoki ngā tīma e waihanga ana i ā rātou ake rārangi arowhai (arotake tūmataitinga, ngā kēti tirotiro-ā-tangata) kua maheretia ki ēnei huringa ora.
Ngā tuhinga kāore e whakaarohia he kōwhiringa: Kāri Tauira me ngā Pepa Raraunga 📝
E rua ngā pepa ka mihi atu koe ki a koe anō mō muri mai:
-
Kāri Tauira → whakamāramahia te whakamahinga e tika ana, ngā horopaki arotake, me ngā whakatūpato. I tuhia kia taea ai e te hunga hua/ture te whai i ēnei [3].
-
Ngā Rau Raraunga mō ngā Huinga Raraunga → whakamāramahia te take i noho ai ngā raraunga, ngā mea kei roto, ngā whakaaro rerekē pea, me ngā whakamahinga haumaru, me ngā whakamahinga mōrearea [4].
Ka mihi puku atu koe ā muri ake nei (me ō hoa kapa ā muri ake nei) ki a koe mō te tuhi i aua mea.
Ruku hohonu: ngā paipa raraunga, ngā kirimana, me te whakaputanga 🧹📦
Ka pōrearea ngā raraunga. Ka whakatinanahia e ngā miihini AI atamai ngā kirimana, ka whakaurua ngā haki, ā, ka herea ngā putanga ki te waehere kia taea ai e koe te hoki whakamuri i muri mai.
-
Whakamana → whakakōwaea te kaupapa, ngā awhe, te hou; whakaputa aunoa i ngā tuhinga.
-
Te Whakaputa Putanga → whakarārangihia ngā huinga raraunga me ngā tauira ki ngā taurangi Git, kia whiwhi ai koe i tētahi rangitaki huringa ka taea e koe te whakawhirinaki.
Tauira iti: I tukuna e tētahi kaihokohoko ngā arowhai kaupapa hei aukati i ngā whāngai a ngā kaiwhakarato e kī ana i ngā kore. Nā taua waea haerenga kotahi i aukati i ngā hekenga maha i roto i te recall@k i mua i te kitenga o ngā kaihoko.
Ruku hohonu: te tuku me te tauine 🚢
Ehara i te mea ko te whakahaere i tētahi tauira i roto i te prod he model.fit(). Kei roto i te whitiki taputapu i konei:
-
Docker mō te tākai ōrite.
-
Ko Kubernetes mō te whakarite, te tauine, me te whakatinanatanga haumaru.
-
Ngā anga MLOps mō ngā manu kōtuku, ngā wehewehenga A/B, te kimi i ngā mea o waho.
Kei muri i te ārai ko ngā tirotiro hauora, te whai i ngā mea e hiahiatia ana, te whakaritenga o te PTM me te GPU, te whakatikatika i te wā mutu. Ehara i te mea whakamīharo, engari he mea tino tika.
Ruku hohonu: Ngā pūnaha GenAI me te RAG 🧠📚
He rerekētanga anō tā ngā pūnaha whakaputa uri - ko te pūtake o te whakahoki mai.
-
Ngā tāpiritanga + rapunga vector mō ngā rapunga ōrite i te tere.
-
whakaritenga ki te tiki mekameka, te whakamahi taputapu, te tukatuka muri.
Ngā kōwhiringa mō te wehewehe, te whakahou i te tūnga, te arotake - mā ēnei waeatanga iti ka whakatau mēnā ka whiwhi koe i tētahi karetao kōrerorero tawhito, i tētahi atu pairati rānei.
Ngā pūkenga me ngā taputapu: he aha kei roto i te puranga 🧰
He ranunga o ngā taputapu ML matarohia me te ako hōhonu:
-
Ngā Anga: PyTorch, TensorFlow, scikit-learn.
-
Ngā Paipa: Te rere o te hau, me ētahi atu, mō ngā mahi kua whakaritea.
-
Te Hanga: Docker, K8s, ngā anga mahi.
-
Te Aroturukitanga: ngā aroturuki nekehanga, ngā aroturuki whakaroa, ngā arowhai ōritetanga.
Kāore tetahi e whakamahi i ngā mea katoa. Ko te mahi nui ko te mōhio ki te nui o ngā mea puta noa i te huringa ora hei whakaaroaro marie.
Tēpu taputapu: ko ngā mea e tino rapua ana e ngā kaihangarau 🧪
| Utauta | hunga whakarongo | Utu | He aha i whai hua ai |
|---|---|---|---|
| PyTorch | Ngā kairangahau, ngā miihini | Pūtake tuwhera | Ngāwari, pythonic, hapori nui, kupenga ritenga. |
| TensorFlow | Ngā tīma e aro nui ana ki ngā hua | Pūtake tuwhera | Te hōhonutanga o te pūnaha rauropi, te TF Serving me te Lite mō ngā whakatinanatanga. |
| ako-scikit | Ngā kaiwhakamahi ML tawhito | Pūtake tuwhera | He pai ngā tūāpapa, he pai te API, kua oti te tukatuka i mua. |
| MLflow | Ngā tīma me ngā whakamātautau maha | Pūtake tuwhera | Ka pupuri i te whakaritenga o ngā oma, ngā tauira, me ngā taonga tuku iho. |
| Rere hau | Ngā tāngata o te paipa | Pūtake tuwhera | He pai ngā DAG, te whakaritenga, me te ngāwari ki te tirotiro. |
| Docker | Ko te katoa | Matua kore utu | He rite tonu te taiao (te nuinga). He iti ake ngā "e mahi ana i runga i taku pona anake" e whawhai ana. |
| Kubernetes | Ngā tīma infra-heavy | Pūtake tuwhera | Te tauine aunoa, ngā whakahōutanga, te kaha o te umanga. |
| Tauira e mahi ana i runga i ngā K8 | Ngā kaiwhakamahi tauira K8s | Pūtake tuwhera | Tūnga paerewa, matau paheke, tauine. |
| Ngā whare pukapuka rapunga vector | Ngā kaihanga RAG | Pūtake tuwhera | He tere te ōrite, he pai mō te GPU. |
| Ngā toa vector whakahaeretia | Ngā tīma RAG hinonga | Ngā taumata utu | Ngā taupū kore tūmau, te tātari, te pono i te tauine. |
Āe, kāore i te ōrite te āhua o te whakarārangi kupu. Ko ngā whiringa taputapu te tikanga he pērā.
Te ine i te angitu me te kore e totohu i roto i ngā tau 📏
Ko ngā inenga e whai tikanga ana ka whakawhirinaki ki te horopaki, engari he ranunga o ēnei:
-
Te kounga o te matapae: te tika, te maumahara, te F1, te whakatikatika.
-
Pūnaha + kaiwhakamahi: whakaroa, p95/p99, pikinga tahuritanga, reiti otinga.
-
Ngā tohu mō te tika: te ōritetanga, te pānga rerekē - whakamahia me te āta [1][2].
Kei reira ngā inenga hei whakaatu i ngā taupatupatu. Ki te kore, whakawhitihia.
Ngā tauira mahi tahi: he hākinakina tīma 🧑🤝🧑
Ko ngā kaihangarau AI te tikanga e noho ana i te wāhi e hono ana ki:
-
Ngā tāngata e pā ana ki te hua me te rohe mahi (te tautuhi i te angitu, ngā ārai).
-
Ngā kaihanga raraunga (ngā pūtake, ngā kaupapa, ngā SLA).
-
Haumarutanga/ture (tūmataitinga, tutuki i ngā whakaritenga).
-
Hoahoa/rangahau (whakamātautau kaiwhakamahi, inā koa mō GenAI).
-
Ngā mahi/SRE (ngā wā mahi me ngā whakangungu ahi).
Me tumanako ka kapi ngā papa ma i ngā tuhituhinga me ngā tautohetohe wera mō ngā inenga - he mea hauora tēnā.
Ngā mahanga: te repo nama hangarau 🧨
Ka kukume mai ngā pūnaha ML i te nama huna: ngā whirihoranga raruraru, ngā whakawhirinakitanga pakarukaru, ngā tuhinga piri kua warewarehia. Ka whakatūria e ngā tohunga ngā ārai - ngā whakamātautau raraunga, ngā whirihoranga pato, ngā hurihanga - i mua i te tipu o te repo. [5]
Ngā kaitiaki hauora: ngā mahi hei āwhina 📚
-
Tīmatahia i te iti. Whakamātauria te mahi a te paipa i mua i te whakauaua i ngā tauira.
-
Ngā paipa MLOps. CI mō ngā raraunga/tauira, CD mō ngā ratonga, CT mō te whakangungu anō.
-
Ngā rārangi arowhai AI whai kawenga. Kua maheretia ki tō whakahaere, me ngā tuhinga pēnei i ngā Kāri Tauira me ngā Pepa Raraunga [1][3][4].
Whakahoutanga Tere o ngā FAQ: whakautu kotahi-rerenga 🥡
Ka hangaia e ngā kaihangarau AI ngā pūnaha mai i te tīmatanga ki te mutunga, he mea whai hua, he mea whakamātautau, he mea whakatinana, he mea haumaru hoki - me te whakamārama anō hoki i ngā taupatupatu kia kore ai tetahi e mōhio.
TL;DR 🎯
-
Ka tangohia e rātou ngā raruraru pōuri → ngā pūnaha AI pono mā te mahi raraunga, te whakatauira, ngā MLOp, me te aroturuki.
-
Ko te mea pai ko te ngāwari i te tuatahi, te ine tonu, me te tuhi i ngā whakapae.
-
Te hangarau whakaputa hangarau = ngā paipa + ngā mātāpono (CI/CD/CT, te tika i ngā wā e tika ana, te whakaaro mōrearea kua whakauruhia).
-
He taputapu noa iho ngā taputapu. Whakamahia te iti rawa e āwhina ana i a koe kia haere i roto i te tereina → te ara → te mahi → te mātakitaki.
Ngā hononga tohutoro
-
NIST AI RMF (1.0). Hononga
-
Ngā Mātāpono AI o te OECD. Hononga
-
Ngā Kāri Tauira (Mitchell et al., 2019). Hononga
-
Ngā Rau Raraunga mō ngā Huinga Raraunga (Gebru et al., 2018/2021). Hononga
-
Te Nama Hangarau Huna (Sculley et al., 2015). Hononga