Dergi makalesi Açık Erişim

Mutation-Based White Box Testing of Deep Neural Networks

Cetiner, Gokhan; Yayan, Ugur; Yazici, Ahmet


MARC21 XML

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nam##2200000uu#4500</leader>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">user-tubitak-destekli-proje-yayinlari</subfield>
    <subfield code="o">oai:aperta.ulakbim.gov.tr:281893</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Deep Neural Networks (DNNs) are used in many critical areas, such as autonomous vehicles, generative AI systems, etc. Therefore, testing DNNs is vital, especially for models used in critical areas. Mutation-based testing is a very successful technique for testing DNNs by mutating their complex structures. Deep Mutation Module was developed to address mutation-based testing and the robustness challenges of DNNs. It analyses the structures of DNNs in detail. It tests models by applying mutation to parameters and structures using its fault library. Testing DNN structures and detecting faults is a highly complex and open-ended challenge. The method proposed in this study applies mutations to DNN parameters to expose faults and weaknesses in the models, thereby testing their robustness. The paper focuses on mutation-based tests of an Reinforce Learning (RL) model developed for electric vehicle routing, a Long Short-Term Memory (LSTM) model developed for prognostic predictions, and a Transformer-based neural network model for electric vehicle routing tasks. The best mutation scores for the LSTM model were measured as 96%, 91.02%, 71.19%, and 68.77%. The test results for the RL model resulted in mutation scores of 93.20%, 72.13%, 77.47%, 79.28%, and 55.74%. The mutation scores of the Transformer model were 75.87%, 76.36%, and 74.93%. These results show that the module can successfully test the targeted models and generate mutants classified as "survived mutants" that outperform the original models. In this way, it provides critical information to researchers to improve the overall performance of the models. Conducting these tests before using them in real-world applications minimizes faults and maximizes model success.&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">publication</subfield>
    <subfield code="b">article</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="a">Creative Commons Attribution</subfield>
    <subfield code="u">http://www.opendefinition.org/licenses/cc-by</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="a">Cetiner, Gokhan</subfield>
    <subfield code="u">Univ Eskisehir Osmangazi, Comp Engn Dept, TR-26040 Eskisehir, Turkiye</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="z">md5:df79a819f2f4c8dea2fa8a1472e232d2</subfield>
    <subfield code="s">134</subfield>
    <subfield code="u">https://aperta.ulakbim.gov.trrecord/281893/files/bib-b3fe9166-b0fb-4c5c-ba13-31eaa5b911d0.txt</subfield>
  </datafield>
  <controlfield tag="005">20250417231004.0</controlfield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2024-01-01</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.1109/ACCESS.2024.3482114</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">Mutation-Based White Box Testing of Deep Neural Networks</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="4">
    <subfield code="v">12</subfield>
    <subfield code="c">19</subfield>
    <subfield code="p">IEEE ACCESS</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="a">Yayan, Ugur</subfield>
    <subfield code="u">Univ Eskisehir Osmangazi, Software Engn Dept, TR-26040 Eskisehir, Turkiye</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="a">Yazici, Ahmet</subfield>
    <subfield code="u">Univ Eskisehir Osmangazi, Comp Engn Dept, TR-26040 Eskisehir, Turkiye</subfield>
  </datafield>
  <controlfield tag="001">281893</controlfield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-tubitak-destekli-proje-yayinlari</subfield>
  </datafield>
</record>
0
0
görüntülenme
indirilme
Görüntülenme 0
İndirme 0
Veri hacmi 0 Bytes
Tekil görüntülenme 0
Tekil indirme 0

Alıntı yap