diff --git a/processing/wikiproc/R/clean_html.R b/processing/wikiproc/R/clean_html.R index e0aaaec2c1176f5e7eb050c2ae5e1f3f987fc671..85214c86261e22e0c2fdec554d25e32a9acb69ed 100644 --- a/processing/wikiproc/R/clean_html.R +++ b/processing/wikiproc/R/clean_html.R @@ -29,5 +29,6 @@ clean_html <- function(html) { gsub("\n *\n+", "\n", .) %>% gsub(" +", " ", .) %>% gsub("[ citation needed ] ", "", ., fixed = TRUE) %>% + gsub("[ edit ] ", "", ., fixed = TRUE) %>% sub(" ", "", .) } diff --git a/processing/wikiproc/tests/testthat/article-4-raw.html b/processing/wikiproc/tests/testthat/article-4-raw.html index 6a27f0570b2c6be7b2603b84b81f24cd590f3cb9..ee9ad2b67c414f265c1e0f75420d1a444a811731 100644 --- a/processing/wikiproc/tests/testthat/article-4-raw.html +++ b/processing/wikiproc/tests/testthat/article-4-raw.html @@ -70,7 +70,7 @@ <h2><span class="mw-headline" id="Scientific_efforts_and_peer_recognition">Scientific efforts and peer recognition</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/w/index.php?title=Hasan_Abdullayev&action=edit&section=4" title="Edit section: Scientific efforts and peer recognition">edit</a><span class="mw-editsection-bracket">]</span></span></h2> <p>Academician Hasan Abdullayev is the author of 28 monographs, several scientific textbooks, approximately six hundred scientific journal articles. He holds 585 patents from USSR (including 171 secret and 65 top secret patents for technologies with military applications),<sup id="cite_ref-19" class="reference"><a href="#cite_note-19">[19]</a></sup> and 35 foreign patents from France, Germany, Great Britain, Japan, Sweden, Italy, Bulgaria, India, and U.S. (United States Patent 3,472,652).<sup id="cite_ref-20" class="reference"><a href="#cite_note-20">[20]</a></sup> </p><p>Academician Abdullayev received highest praise from his colleagues, including <a href="/wiki/Nobel_Prize" title="Nobel Prize">Nobel Prize</a> winner academician <a href="/wiki/Zhores_Alferov" title="Zhores Alferov">Zhores Alferov</a>, <a href="/wiki/Nobel_Prize" title="Nobel Prize">Nobel Prize</a> winner academician <a href="/wiki/Alexander_Prokhorov" title="Alexander Prokhorov">Alexander Prokhorov</a>, <a href="/wiki/Kurchatov_Institute" title="Kurchatov Institute">Kurchatov Institute</a> President and Director <a href="/wiki/Evgeny_Velikhov" title="Evgeny Velikhov">Evgeny Velikhov</a>, academician <a href="/w/index.php?title=Bentsion_Vul&action=edit&redlink=1" class="new" title="Bentsion Vul (page does not exist)">Bentsion Vul</a>, academician Vladimir Tuchkevich,<sup id="cite_ref-21" class="reference"><a href="#cite_note-21">[21]</a></sup> academician <a href="/wiki/Sergey_Kapitsa" title="Sergey Kapitsa">Sergey Kapitsa</a>, academician <a href="/wiki/Roald_Sagdeev" title="Roald Sagdeev">Roald Sagdeev</a>, Nobel Prize winner professor <a href="/wiki/Rudolf_Ludwig_Mossbauer" class="mw-redirect" title="Rudolf Ludwig Mossbauer">Rudolf Ludwig Mossbauer</a>, academician <a href="/wiki/Nikolay_Bogolyubov" title="Nikolay Bogolyubov">Nikolay Bogolyubov</a>,<sup id="cite_ref-GSE_22-0" class="reference"><a href="#cite_note-GSE-22">[22]</a></sup> Soviet Academy of Sciences Presidents academician Alexander Nesmeyanov, academician <a href="/wiki/Anatoly_Petrovich_Alexandrov" class="mw-redirect" title="Anatoly Petrovich Alexandrov">Anatoly Petrovich Alexandrov</a>, academician <a href="/wiki/Mstislav_Keldysh" title="Mstislav Keldysh">Mstislav Keldysh</a><sup id="cite_ref-23" class="reference"><a href="#cite_note-23">[23]</a></sup> and other Soviet and foreign scientists. -</p><p>According to a 2008 article, "Academician Abdullayev was called the Father of Physics in Azerbaijan and one of the Founders of the School of Semiconductor Research in the Soviet Union by such authoritative scientists as academicians Zh.Alferov, Yu.Gulyaev, L.Kurbatov, V.Isakov, Professor D.Nasledov, and others. In fact, the <a href="/wiki/Great_Soviet_Encyclopedia" title="Great Soviet Encyclopedia">Great Soviet Encyclopedia</a>, the most authoritative Soviet encyclopedia - the Soviet equivalent of the Encyclopædia Britannica in the West, listed the names of scientists, making the greatest contributions to the development of semiconductor electronics and microelectronics in this order: A.F.Ioffe (who was Abdullayev's mentor during his postdoctoral studies in Leningrad), N.P.Sazhin, Ya.I.Frenkel, B.M.Vul, V.M.Tuchkevich, H.B.Abdullayev, Zh.I.Alferov, L.V.Keldish, and others (Third Edition, 1970, page 351).<sup id="cite_ref-24" class="reference"><a href="#cite_note-24">[24]</a></sup> Thus, already in 1970, this encyclopedia put academician Abdullayev as the sixth most influential scientist in semi-conductor research, higher than such giants as Academicians Alferov and Keldish!"<sup id="cite_ref-GSE_22-1" class="reference"><a href="#cite_note-GSE-22">[22]</a></sup> +</p><p>According to a 2008 article, "Academician Abdullayev was called the Father of Physics in Azerbaijan and one of the Founders of the School of Semiconductor Research in the Soviet Union by such authoritative scientists as academicians Zh.Alferov, Yu.Gulyaev, L.Kurbatov, V.Isakov, Professor D.Nasledov, and others. In fact, the <a href="/wiki/Great_Soviet_Encyclopedia" title="Great Soviet Encyclopedia">Great Soviet Encyclopedia</a>, the most authoritative Soviet encyclopedia - the Soviet equivalent of the Encyclopædia Britannica in the West, listed the names of scientists, making the greatest contributions to the development of semiconductor electronics and microelectronics in this order: A.F.Ioffe (who was Abdullayev's mentor [ edit ] during his postdoctoral studies in Leningrad), N.P.Sazhin, Ya.I.Frenkel, B.M.Vul, V.M.Tuchkevich, H.B.Abdullayev, Zh.I.Alferov, L.V.Keldish, and others (Third Edition, 1970, page 351).<sup id="cite_ref-24" class="reference"><a href="#cite_note-24">[24]</a></sup> Thus, already in 1970, this encyclopedia put academician Abdullayev as the sixth most influential scientist in semi-conductor research, higher than such giants as Academicians Alferov and Keldish!"<sup id="cite_ref-GSE_22-1" class="reference"><a href="#cite_note-GSE-22">[22]</a></sup> </p><p>Academician Abdullayev was recognized as the top expert on the chemical element <a href="/wiki/Selenium" title="Selenium">selenium</a>, and thus entrusted authoring the article on selenium in the third (final) edition of the top scientific reference publication - the <a href="/wiki/Great_Soviet_Encyclopedia" title="Great Soviet Encyclopedia">Great Soviet Encyclopedia</a>.<sup id="cite_ref-25" class="reference"><a href="#cite_note-25">[25]</a></sup> </p> <h2><span class="mw-headline" id="Publications">Publications</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/w/index.php?title=Hasan_Abdullayev&action=edit&section=5" title="Edit section: Publications">edit</a><span class="mw-editsection-bracket">]</span></span></h2> @@ -175,7 +175,7 @@ <li><span class="nowrap"> <a href="/wiki/WorldCat_Identities" class="mw-redirect" title="WorldCat Identities">WorldCat Identities</a> (via VIAF): <a rel="nofollow" class="external text" href="https://www.worldcat.org/identities/containsVIAFID/109565605">109565605</a></span></li></ul> </div></td></tr></tbody></table></div> -<!-- +<!-- NewPP limit report Parsed by mw1244 Cached time: 20190111175009