I mua, i noho te AI i runga i ngā tūmau nui me ngā GPU kapua. Ināianei kei te mimiti haere, kei te neke haere i te taha o ngā pūoko. te AI mō ngā pūnaha whakauru - kei te ngunguru kē i roto i ngā pouaka whakamātao, i ngā waka rererangi, i ngā taputapu mau ... tae atu ki ngā taputapu kāore e āhua "atamai".
Anei te hiranga o tēnei panonitanga, ngā mea e uaua ai, me ngā kōwhiringa e tika ana kia whai wā koe.
Ngā tuhinga ka pai pea koe ki te pānui i muri i tēnei:
🔗 Ngā taputapu whakahaere AI pai rawa atu e whakarite ana i ngā pūnaha AI mārama, e tutuki ana i ngā tikanga matatika
He aratohu ki ngā taputapu hei āwhina i te pupuri i te AI matatika, tutuki ture, me te mārama.
🔗 Te rokiroki taonga mō te AI: ngā kōwhiringa, ngā kōwhiringa, ngā kōwhiringa
Te whakataurite i ngā kōwhiringa rokiroki ahanoa kua whakaritea mō ngā kawenga mahi AI.
🔗 Ngā whakaritenga rokiroki raraunga mō te AI: ngā mea e tika ana kia mōhio koe
Ngā āhuatanga matua hei whakaaroaro māu i te wā e whakamahere ana i te rokiroki raraunga AI.
AI mō ngā Pūnaha Whakauru🌱
He iti noa ngā taputapu whakauru, he maha ngā wā ka whakamahia he pākahiko, ā, he iti noa ngā rauemi. Heoi, ka huakina e te AI ngā wikitoria nui:
-
Ngā whakataunga wā-tūturu, kāore he haerenga hoki-mai i te kapua.
-
Te tūmataitinga nā te hoahoa - ka taea te pupuri i ngā raraunga mata ki runga i te pūrere.
-
He iti ake te whakaroa ina he mea nui ngā mirihekona.
-
He whakatau mōhio ki te pūngao mā te tauira āta whiriwhiri + ngā kōwhiringa taputapu.
Ehara ēnei i te painga ā-ringa: mā te pana i te rorohiko ki te taha ka whakaiti i te whakawhirinakitanga ki te whatunga, ā, ka whakapakari ake i te tūmataitinga mō ngā whakamahinga maha [1].
Ehara te mahi tinihanga i te kaha - engari he mōhio ki ngā rauemi iti. Whakaarohia te oma marathon me te peke tuara… ā, ka tangohia tonutia ngā pereki e ngā miihini.
Ripanga Whakataurite Tere o te AI mō ngā Pūnaha Whakauru 📝
| Utauta / Anga | Hunga Whakarongo Pai rawa atu | Utu (tata) | He aha i mahi ai (ngā tuhipoka rerekē) |
|---|---|---|---|
| TensorFlow Lite | Ngā kaiwhakawhanake, ngā kaiwhaiwhai | Koreutu | Hiko, kawe, MCU pai → kapinga pūkoro |
| Te Ārai Tapa | Ngā Tīmatanga me ngā Pakihi Hou | Ngā taumata Freemium | Te rerema mahi tōia-me-taka - pērā i te "AI LEGO" |
| Pūhara Nvidia Jetson | Ngā miihini e hiahia ana ki te mana | $$$ (kāore i te iti te utu) | GPU + whakatere mō te tirohanga taumaha/ngā kawenga mahi |
| TinyML (mā Arduino) | Ngā kaiako, ngā kaihanga tauira | Utu iti | Ngāwari te whakatata atu; e ārahihia ana e te hapori ❤️ |
| Mīhini AI Qualcomm | Ngā OEM, ngā kaihanga waea pūkoro | Rerekē | NPU-whakateretere i runga i te Snapdragon - he tere puku |
| ExecuTorch (PyTorch) | Ngā kaiwhakawhanake pūkoro me te taha | Koreutu | Te wā whakahaere PyTorch i runga i te taputapu mō ngā waea/ngā taputapu mau/ngā taputapu kua whakauruhia [5] |
(Āe, kāore i te ōrite. Pērā anō hoki te ao tūturu.)
He aha te hiranga o te AI i runga i ngā taputapu whakauru mō te ahumahi 🏭
Ehara i te mea ko te whakanui noa iho: i runga i ngā raina wheketere, ka hopukina e ngā tauira kiato ngā hapa; i roto i te ahuwhenua, ka tātarihia e ngā pona iti-mana te oneone i te mara; i roto i ngā waka, kāore e taea e ngā āhuatanga haumaru te "waea ki te kāinga" i mua i te aukati. Ina kore e taea te whiriwhiri i te whakaroa me te tūmataitinga , he rautaki te neke i te rorohiko ki te taha [1].
TinyML: Te toa puku o te AI whakauru 🐜
e TinyML ngā tauira i runga i ngā pūmana iti me ngā kiropaita ki ētahi megapaita o te RAM - engari ka taea tonu te kimi kupumatua, te mōhio ki ngā tohu, te kite i ngā hapa, me te maha atu. He rite ki te mātakitaki i te kiore e hiki ana i tētahi pereki. He tino whakamīharo.
He tauira hinengaro tere:
-
Ngā tapuwae raraunga : ngā tāurunga pūoko rerema iti.
-
Ngā Tauira : ngā CNN/RNN kiato, ngā ML matarohia, ngā kupenga kua whakarōpūtia/kua inetia rānei.
-
Tahua : miliwatt, ehara i te watts; KB–MB, ehara i te GB.
Ngā Kōwhiringa Taputapu: Te Utu me te Mahi ⚔️
Ko te whiriwhiri taputapu te wāhi e kore e angitu ai te nuinga o ngā kaupapa:
-
Karaehe Rāhipere Pi : he PTM hoahoa, whānui te whakamahinga; he pakari mō ngā tauira.
-
NVIDIA Jetson : ngā kōwae AI taha i hangaia mō tētahi kaupapa motuhake (hei tauira, a Orin) e tuku ana i ngā tekau ki ngā rau o ngā TOPS mō te tirohanga matotoru, ngā puranga maha-tauira rānei - he rawe, engari he utu nui ake, he taumaha ake hoki te mana [4].
-
Google Coral (Edge TPU) : he whakatere ASIC e tuku ana i te ~4 TOPS i te 2W (~2 TOPS/W) mō ngā tauira kua inehia - he tino pai te mahi/W ina tutuki i tō tauira ngā here [3].
-
Ngā Pūnaha Whakahaere Waea Atamai (Snapdragon) : ka tukuna tahitia me ngā NPU me ngā SDK hei whakahaere i ngā tauira i runga i te pūrere.
Ture matua: taurite te utu, te pāmahana, me te rorohiko. He maha ngā wā ka hinga te "pai, i ngā wāhi katoa" i te "hou, i ngā wāhi katoa."
Ngā Wero Noa i roto i te AI mō ngā Pūnaha Whakauru 🤯
He maha ngā wā ka raru ngā kaihangarau ki:
-
Mahara iti : kāore e taea e ngā taputapu iti te pupuri i ngā tauira nunui.
-
Tahua pākahiko : he mea nui ia milliamp.
-
Te arotautanga tauira:
-
Te ine rahinga → ngā taumaha/whakahohenga int8/float16 iti ake, tere ake.
-
Tapatapa → tangohia ngā taumaha koretake mō te iti.
-
Te whakarōpū/te tiritiri taumaha → te kōpeke atu.
He tikanga paerewa ēnei mō te whai huatanga o runga i te taputapu [2].
-
-
Te whakanui ake : he whakaaturanga Arduino akomanga ≠ he pūnaha whakaputa motuka me ngā here haumaru, tūpato, me te huringa ora.
Te patuiro i ngā hapa? Whakaarohia te pānui pukapuka mā roto i tētahi kōhao kī… me ngā mīti e mau ana.
Ngā Mahi Whai Hua ka Kitea e Koe Ake Nei 🚀
-
Ngā taputapu mau atamai e mahi ana i ngā tirohanga hauora i runga i te taputapu.
-
ngā kāmera IoT i ngā huihuinga me te kore e rere ngā kiriata mata.
-
Ngā kaiawhina reo tuimotu mō te whakahaere kore-ringa - kāore he whakawhirinakitanga ki te kapua.
-
Ngā waka rererangi aunoa mō te tirotiro, te tuku, me te mahi tika.
I te poto: Kei te tata haere mai te AI - ki ō tātou ringaringa, ki roto i ā tātou kīhini, me puta noa i ā tātou hanganga.
Me pēhea te tīmatanga o ngā kaiwhakawhanake 🛠️
-
Tīmata ki te TensorFlow Lite mō ngā taputapu whānui me te kapinga MCU→pūkoro; whakamahia te ine/tapa wawe [2].
-
Tirohia a ExecuTorch mēnā kei te whenua PyTorch koe e noho ana, ā, e hiahia ana koe ki tētahi wā whakahaere i runga i te pūrere pūkoro me te pūnaha tāmau [5].
-
Whakamātauria ngā kete Arduino + TinyML mō te hanga tauira tere, ātaahua hoki.
-
He pai ake ki a koe ngā pūnaha tirohanga? e Edge Impulse te arai mā te hopu raraunga, te whakangungu, me te whakatinanatanga.
-
Whakaarohia te taputapu hei tangata whenua tuatahi - he tauira i runga i ngā CPU, kātahi ka whakamanahia i runga i tō whakaterenga ūnga (Edge TPU, Jetson, NPU) hei whakaū i te whakaroa, te wera, me ngā taumata tika.
Poto-poto: Ka tukuna e tētahi tīma tētahi pūoko wiri-kē ki runga i tētahi pūoko pūtau-moni. Kāore te tauira float32 e eke ki te tahua hiko; ka tapahia e te int8 te pūngao mō ia whakatau, ka tapahia te mahara, ā, ka oti te mahi mā te huringa mahi a te MCU - kāore he whatunga e hiahiatia ana [2,3].
Te Huringa Mārie o te AI mō ngā Pūnaha Whakauru 🌍
Kei te ako ngā tukatuka iti, iti te utu ki te rongo → whakaaro → mahi - ā-rohe. Ka whai tonu te roa o te pākahiko i a tātou, engari he mārama te huarahi: he tauira piri ake, he kaikohikohi pai ake, he whakatere atamai ake. Ko te mutunga? He hangarau e ahua whaiaro ake ana, e aro nui ana hoki nā te mea ehara i te mea he hono noa - engari he aro nui.
Ngā Tohutoro
[1] ETSI (Rorohiko Tapa Uru-maha) - Ngā painga whakaroa/tūmataitinga me te horopaki ahumahi.
ETSI MEC: Tirohanga whānui o te Pepa Ma Hou
[2] Kete Utauta Arotau Tauira TensorFlow a Google - Te ine, te tapahi, te whakarōpū mō te whai huatanga o runga i te pūrere.
Aratohu Arotau Tauira TensorFlow
[3] Google Coral Edge TPU - Ngā paearu Perf/W mō te whakaterenga o te taha.
Ngā Paearu Edge TPU
[4] NVIDIA Jetson Orin (Mana) - Ngā kōwae Edge AI me ngā kōpaki mahi.
Tirohanga Whānui mō ngā Kōwae Jetson Orin
[5] PyTorch ExecuTorch (Ngā Tuhinga Whaimana) - Te wā whakahaere PyTorch i runga i te taputapu mō te waea pūkoro me te taha.
Tirohanga Whānui mō ExecuTorch