THEME-MATTERS: Koyon Dacewar Tufafi ta Hanyar Kulawa da Jigo

1. Gabatarwa

Koyon dacewar tufafi yana da muhimmanci ga aikace-aikace kamar hada kayan tufafi da shawarwarin tufafi na kan layi. Wannan takarda tana jayayya cewa dacewa ba matsala ta gani kawai ba ce, amma jigo ko mahallin (misali, "aiki" da "sadaka") yana da tasiri sosai. Marubutan sun gabatar da tsarin farko na koyon dacewar tufafi mai kulawa da jigo da kuma bayanan da ya dace, Fashion32.

2. Ayyukan Da Suka Gabata & Bayanan Baya

Ayyukan da suka wanzu an rarraba su zuwa koyon dacewa biyu-biyu (koyon ma'auni) da koyon gaba daya kayan (tsararrun tsari kamar LSTM). Duk da haka, waɗannan galibi suna yin watsi da mahallin jigo, suna ɗaukar dacewa a matsayin aikin daidaita gani kawai.

2.1 Koyon Dacewar Tufafi

Hanyoyin sun haɗa da koyon ma'auni don nau'ikan abubuwa biyu da ƙirar tsari don gaba ɗaya kayan, ta amfani da bayanan kamar Polyvore.

2.2 Nazarin Tufafi Mai Kulawa da Jigo

Kafin wannan aikin, bayanai ko tsare-tsare kaɗan ne suka haɗa bayanan jigo kamar lokaci ko nau'in taron a cikin kimanta dacewa.

3. Bayanan Fashion32

Sabon bayanan na ainihi da aka gina don magance rashin alamun jigo a cikin albarkatun da suka wanzu.

3.1 Gina Bayanan

Masu tsara tufafi na ƙwararru daga masu sayar da samfuran sun ba da bayanan, suna tabbatar da ingantattun alamun duka jigogin kayan da nau'ikan abubuwa.

3.2 Kididdigar Bayanan

Bayanan ya ƙunshi nau'ikan jigogi daban-daban (misali, Aiki, Na Yau da Kullun, Biki) da cikakken tsarin matsayi na nau'ikan abubuwan tufafi.

4. Hanyar Da Aka Gabatar: Tsarin Kulawa da Jigo

Babban ƙirƙira shine tsarin mataki biyu wanda da farko ya koyi wurin haɗawa na musamman na nau'i sannan ya yi amfani da tsarin kulawa da jigo a kansa.

4.1 Koyon Wurin Musamman na Nau'i

Yana tsara abubuwan kayan da suka dace a cikin nau'i ɗaya don su kasance kusa a cikin wurin da aka koya, yana samar da tushe don auna dacewa.

4.2 Tsarin Kulawa da Jigo

Yana koyon haɗa takamaiman jigogi tare da mahimmanci (ma'aunin kulawa) na dacewar biyu tsakanin nau'ikan abubuwa daban-daban. Misali, don jigon "Aiki", dacewar tsakanin "jaket" da "wando na riga" yana samun kulawa mai girma.

4.3 Maki Dacewa na Gaba Daya Kayan

Ana ƙididdige makin dacewa na ƙarshe na kayan da aka ba da jigo ta hanyar tattara makin dacewar biyu na duk nau'ikan abubuwa a cikin kayan da aka auna kulawar jigo.

5. Gwaje-gwaje & Sakamako

5.1 Tsarin Gwaji

An gudanar da gwaje-gwaje akan bayanan Fashion32. An kwatanta tsarin da aka gabatar da manyan ma'auni kamar tsarin Bi-LSTM daga [5] da tsarin Mai Kulawa da Nau'i daga [10].

5.2 Sakamako na Ƙididdiga

Tsarin kulawa da jigo da aka gabatar ya fi duka ma'auni akan ma'auni na yau da kullun kamar AUC (Yankin Ƙarƙashin Lankwasa) da daidaiton FITB (Cike-gurbi) don hasashen dacewa mai kulawa da jigo.

5.3 Nazarin Halayen

Hoto na 1 a cikin takarda yana kwatanta ra'ayi yadda ya kamata: Kayan A (tare da guntun siket) suna dacewa ta gani amma an ɗauke su bai dace da jigon "Aiki" ba. Tsarin zai iya ba da shawarar gyare-gyare (kamar dogon riga a cikin Kayan B) don dacewa da jigo. Ma'aunin kulawa yana ba da fassara, yana nuna waɗanne nau'ikan abubuwa biyu suke da mahimmanci ga wani jigo.

6. Tattaunawa & Nazari

6.1 Fahimtar Tushe

Babban nasarar takarda shine gane dacewar tufafi a matsayin aikin tunani na mahalli, ba kawai na gani ba. Wannan yana motsa fagen bayan ma'auni na kamannin gani mai sauƙi—tsarin da ya mamaye tun farkon ayyuka kamar hanyoyin sadarwar Siamese don dawo da hoto. Fahimtar cewa kayan "sadaka" sun gaza a cikin "zauren zartarwa" a bayyane take ga mutane amma wani makaho ne ga AI. Ta hanyar sanya jigo a tsakiya, marubutan sun haɗa gibin mahimmanci tsakanin sifofin gani na ƙasa da manufar ma'ana mai girma, suna daidaita fahimtar na'ura kusa da hukuncin ɗan adam kamar yadda aka tattauna a cikin nazarin kimiyyar fahimi kan fahimtar mahalli.

6.2 Gudanarwar Ma'ana

Hujjar tana da inganci ta tsari: (1) Gano gibin (rashin kulawa da jigo), (2) Gina albarkatun da ake bukata (bayanan Fashion32), (3) Gabatar da sabon tsari (wurin nau'i + kulawa da jigo) wanda yayi amfani da sabbin bayanan bisa ma'ana, da (4) Tabbatar da hujja ta zahiri. Gudanar daga koyon musamman na nau'i (kama alaƙar abubuwa na ciki) zuwa kulawa da jigo (daidaita waɗannan alaƙar bisa mahalli) yana da kyau. Yana kwatanta nasarar tsare-tsare a wasu fagage, kamar yadda tsare-tsaren Transformer ke amfani da kulawar kai don auna mahimmanci na kalmomi daban-daban bisa mahalli, kamar yadda takardun tushe kamar "Attention Is All You Need" suka kafa.

6.3 Ƙarfafawa & Kurakurai

Ƙarfafawa: Bayanan Fashion32 da aka tsara babbar gudummawa ce mai amfani wanda zai ƙarfafa ƙarin bincike. Tsarin kulawa na tsarin yana ba da fassara mai mahimmanci—wanda ba kasafai a cikin tsare-tsaren tufafi mai zurfi ba. Haɓakar aikin sa akan manyan ma'auni a bayyane yake kuma yana da ma'ana.
Kurakurai: Dogaron tsarin akan jigogi da aka ƙayyade, masu rabuwa shine ƙafar Achilles dinsa. Salon ainihi yana da ruwa; kayan na iya zama "aiki-na yau da kullun" ko "mai hankali-na yau da kullun," suna haɗa jigogi. Rarrabuwar jigo 32 bazai iya kama wannan ƙayyadadden ba, yana iya haifar da hasashe masu rauni a iyakokin jigo. Bugu da ƙari, aikin bai bincika hulɗar tsakanin sifofin gani da jigogi ba sosai; kulawar jigo tana aiki a saman haɗewar gani da aka riga aka koya, yana iya rasa damar haɗin gwiwa, daidaitawar siffa na ƙasa kamar yadda ake gani a cikin ayyukan canja salo kamar CycleGAN.

6.4 Fahimta Mai Aiki

Ga masu bincike: Gaba gaba shine wakilcin jigo mai ci gaba ko mai alamomi da yawa da bincika haɗuwar nau'i-nau'i (rubutu+hoto) don ƙarin fahimtar mahalli, watakila an samo daga tsare-tsaren harshe na gani kamar CLIP. Ga masu aikin masana'antu (misali, JD.com, Amazon): Nan da nan gwada wannan fasahar a cikin tsarin ba da shawara don siyayya bisa lokaci ("Kayan don Bikin Aure"). Ma'aunin kulawa mai fassara za'a iya amfani da shi don samar da bayani masu gamsarwa don shawarwari ("Mun haɗa wannan jaket da waɗannan wando saboda suna da mahimmanci don kamannin ƙwararru"), suna haɓaka amincewar mai amfani da haɗin kai. Hakanan za'a iya amfani da haɗewar musamman na nau'i don sarrafa kaya da nazarin yanayi.

7. Cikakkun Bayanan Fasaha & Tsarin Lissafi

Tushen tsarin ya ƙunshi koyon haɗawa da ma'aunin kulawa. Bari $x_i$ da $x_j$ su zama sifofin siffa na gani don abubuwan tufafi guda biyu na nau'ikan $c_i$ da $c_c_j$ bi da bi. Aikin haɗawa na musamman na nau'i $f_c(\cdot)$ yana tsara su zuwa wurin dacewa.

Ana ƙididdige makin dacewar biyu $s_{ij}$ a matsayin aikin nisa a cikin wannan wuri, sau da yawa ta amfani da tsarin koyon ma'auni kamar: $s_{ij} = \exp(-||f_{c_i}(x_i) - f_{c_j}(x_j)||^2_2)$.

Tsarin kulawa da jigo yana gabatar da ma'auni $\alpha_{ij}^{(t)}$ don nau'in abubuwa biyu $(i, j)$ a ƙarƙashin jigo $t$. Wannan ma'auni ana koyon shi ta hanyar hanyar sadarwar jijiyoyi wanda ke la'akari da jigo $t$ da nau'ikan $c_i, c_j$. Makin dacewar kayan ƙarshe $C(O, t)$ don kayan $O$ da jigo $t$ shine tarin makin nau'i biyu da aka auna:

$C(O, t) = \frac{1}{|\mathcal{P}|} \sum_{(i,j) \in \mathcal{P}} \alpha_{ij}^{(t)} \cdot s_{ij}$

inda $\mathcal{P}$ shine saitin duk nau'ikan abubuwa a cikin kayan $O$.

8. Tsarin Nazari: Misalin Hali

Hali: Kimanta kayan {Jaket (Nau'i: Rigar Waje), Rigar Hotuna (Nau'i: Saman), Wando Mai Tsage (Nau'i: Ƙasa), Takalmi (Nau'i: Kafa)} don jigon "Hirar Aiki."

Aiwatar da Tsarin:

1. Haɗawa na Musamman na Nau'i: Tsarin yana dawo da wakilcin wurin da aka koya na kowane abu bisa ga nau'insa.
2. Ƙididdigar Dacewar Nau'i Biyu: Yana ƙididdige tushen dacewar gani $s_{ij}$ don kowane nau'i biyu (misali, Jaket & Wando Mai Tsage).
3. Auna Kulawa da Jigo: Don jigon "Hirar Aiki", hanyar sadarwar kulawa tana ba da manyan ma'auni $\alpha$ ga nau'ikan biyu masu mahimmanci don ƙwararru (misali, Jaket-Ƙasa, Saman-Ƙasa) da ƙananan ma'auni ga nau'ikan biyu marasa mahimmanci (misali, Saman-Kafa). Yana yiwuwa ya ba da ma'auni mai ƙasa sosai ga dacewar tsakanin "Jaket" da "Rigar Hotuna" saboda wannan nau'in biyu ba na al'ada ba ne ga jigo.
4. Makin Kayan & Bincike: Makin da aka tattara $C(O, t)$ zai zama ƙasa. Ƙananan ma'aunin kulawa akan nau'in Jaket/Rigar da yuwuwar ƙananan tushen dacewa $s_{ij}$ na Jaket/Wando Mai Tsage suna ba da gudummawar wannan. Tsarin mai fassara zai iya haskakawa: "Ƙananan dacewa don 'Hirar Aiki' saboda rashin dacewar Rigar da salon wando. Shawarar musanya: Maye gurbin Rigar Hotuna da Rigar Maɗaukaki Mai Ƙarfi; maye gurbin Wando Mai Tsage da Chinos."

9. Ayyukan Gaba & Hanyoyi

• Tsarin Jigo Na Sirri: Matsawa daga jigogi na duniya ("Aiki") zuwa mahalli na sirri ("Aiki Na Yau da Kullun na Kamfanina").
• Jigogi Masu Ƙarfi & Nau'i-Nau'i: Haɗa bayanan ainihin lokaci (yanayi, wuri, taron kalanda) da bayanin rubutu daga kafofin watsa labarun don ayyana jigogi cikin sauri.
• Mataimakan Tufafi Masu Ƙirƙira: Haɗa tsarin dacewa mai kulawa da jigo a matsayin mai suka ko jagora a cikin hanyoyin sadarwar adawa (GANs) ko tsare-tsaren watsawa don samar da sabbin abubuwan tufafi masu dacewa da jigo ko cikakkun kayan daga farko.
• Tufafi Mai Dorewa & Inganta Kayan Tufafi: Ba da shawarar yadda ake haɗawa da daidaita abubuwan kayan tufafi da suka wanzu (wani nau'i na "hadawa kayan") don sabbin jigogi, yana haɓaka amfani mai dorewa.
• Dacewa Tsakanin Yankuna: Faɗaɗa ra'ayin kulawa da jigo zuwa wasu yankuna kamar ƙirar cikin gida (kayan daki masu dacewa don jigon "ƙarami" da "bohemian") ko haɗin abinci (abubuwan da suka dace don "fika na rani" da "abincin dare na yau da kullun").

10. Nassoshi

1. Han, X., et al. (2017). "Koyon Dacewar Tufafi tare da Bi-LSTMs." ACM Multimedia.
2. Vasileva, M. I., et al. (2018). "Koyon Haɗawa Mai Kulawa da Nau'i don Dacewar Tufafi." ECCV.
3. He, R., et al. (2016). "Shawarwari Bisa Fassara." RecSys.
4. Zhu, J.-Y., et al. (2017). "Fassarar Hoto zuwa Hoto mara Haɗin gwiwa ta amfani da Hanyoyin Sadarwar Adawa masu Daidaituwar Zagaye." ICCV. (CycleGAN)
5. McAuley, J., et al. (2015). "Shawarwari Bisa Hoto akan Salo da Madadin." SIGIR.
6. Veit, A., et al. (2015). "Koyon Salon Tufafi na Gani tare da Haɗuwar Dyadic daban-daban." ICCV.
7. Simo-Serra, E., et al. (2015). "Koyon Sauƙaƙe: Cikakkun Hanyoyin Sadarwar Convolution don Tsaftace Zane Mai Ƙarfi." SIGGRAPH.
8. Vaswani, A., et al. (2017). "Kulawa Shine Duk Abin Da Kuke Bukata." NeurIPS.
9. Ge, Y., et al. (2019). "DeepFashion2: Ma'auni Mai Iri-iri don Ganowa, Ƙididdigar Matsayi, Rarraba da sake Ganowa na Hotunan Tufafi." CVPR.
10. Lai, J.-H., et al. (2020). "THEME-MATTERS: Koyon Dacewar Tufafi ta Hanyar Kulawa da Jigo." arXiv:1912.06227.