Commit 208394e0 authored by Marvin Hofer's avatar Marvin Hofer
Browse files

step description

parent 74331231
......@@ -47,11 +47,11 @@
<h2 class="text-white pl-5 pt-1">DASHBOARD</h2>
<!--h4 class="text-white pl-5 pt-1" style="display:inline;">Statistics:</h4-->
<!-- TODO removed stats, made it h2 -->
<h2 class="text-light" style="display:inline;">~ 55 GB/release |
<h3 class="text-light" style="display:inline;">
~ 55 GB/release |
~ 21B Triples/month |
~ 5200 Triples/sec. |
140+ wikis extracted</h2>
140+ wikis extracted</h3>
</div>
<div class="col-md-2">
<!-- <div class="disclaimer bg-danger">
......@@ -114,12 +114,9 @@
</ul>
This dashboard gives details about the current release progress, including several <a href="#steps">steps</a>.
</p>
<p>
<span class="text-muted">TODO databus query</span>
</p>
<!-- <h4>Configuration</h4> -->
<p>
The configuration of MARVIN is public available at <a href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config">gitlab</a>.
The <strong>configuration of MARVIN is public available at </strong><a href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config">gitlab</a>.
Further information are described in <a href="https://svn.aksw.org/papers/2020/semantics_marvin/public.pdf">The New DBpedia Release Cycle: IncreasingAgility and Efficiency in Knowledge ExtractionWorkflows</a>.
</p>
<h4 class="text-danger">DISCLAIMER: The release depends on several external dependencies. Therefore we can not guarantee a full release every month.
......@@ -157,17 +154,16 @@
<h4 style="display:inline;">Release Steps. Expand to see documentation for each step.</h4> <input type="image" src="images/unfold.svg" style="height: 1em; width: auto;" class="collapsible"/>
<div class="content" style="display: none;">
<p>
<span class="text-danger">TODO</span>
<ol>
<li>Download Mappings:</li>
<li>Download Ontology</li>
<li>Download Wikimedia Dumps:</li>
<li>Extract</li>
<li>Post-Process</li>
<li>Backup Unredirected</li>
<li>Marvin Release</li>
<li>Parse Marvin Release</li>
<li>DBpedia Release</li>
<li>Download Mappings: Download latest DBpedia mappings form <a target="_blank" href="http://mappings.dbpedia.org/">mappings.dbpedia.org</a></li>
<li>Download Ontology: Download latest DBpedia ontology </li>
<li>Download Wikimedia Dumps: Download latest Wikimedia dumps from <a target="_blank" href="https://dumps.wikimedia.org/">dumps.wikimedia.org</a></li>
<li>Extract: Start DBpedia information extraction</li>
<li>Post-Process: Post-processing of extracted data</li>
<li>Backup Unredirected: Backup unredirected original files</li>
<li>Marvin Release: Deploy raw MARVIN release</li>
<li>Parse Marvin Release: Parse raw Marvin release and backup parse-logs</li>
<li>DBpedia Release: Deploy cleaned DBpedia release</li>
</ol>
</p>
</div>
......@@ -202,7 +198,7 @@
<div id="mappings-progress-step"><strong>Progress</strong> </div>
<div class="progress">
<div id="mappings-progress" class="progress-bar progress-bar-striped font-weight-bold" style="width: 100%;">
Step 0/7
Step 0/9
</div>
</div>
</p>
......@@ -210,9 +206,9 @@
<strong>Configuration:</strong>
<br>
View
<a target="_blank" href="#">Download</a>,
<a target="_blank" href="#">Extraction</a>
<a target="_blank" href="#">Release</a>
<a target="_blank" href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/blob/master/extractionConfiguration/download.mappings.properties">Download</a>,
<a target="_blank" href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/blob/master/extractionConfiguration/extraction.mappings.properties">Extraction</a>,
<a target="_blank" href="#">https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/tree/master/databus-poms/dbpedia/mappings</a>
configuration.
</p>
<p>
......@@ -234,7 +230,7 @@
<div id="generic-progress-step"><strong>Progress</strong> </div>
<div class="progress">
<div id="generic-progress" class="progress-bar progress-bar-striped font-weight-bold" style="width: 100%;">
Step 0/7
Step 0/9
</div>
</div>
</p>
......@@ -242,9 +238,9 @@
<strong>Configuration:</strong>
<br>
View
<a target="_blank" href="#">Download</a>,
<a target="_blank" href="#">Extraction</a>
<a target="_blank" href="#">Release</a>
<a target="_blank" href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/blob/master/extractionConfiguration/download.generic.properties">Download</a>,
<a target="_blank" href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/blob/master/extractionConfiguration/extraction.generic.properties">Extraction</a>
<a target="_blank" href="#">https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/tree/master/databus-poms/dbpedia/generic</a>
configuration.
</p>
<p>
......@@ -266,7 +262,7 @@
<div id="wikidata-progress-step"><strong>Progress</strong> </div>
<div class="progress">
<div id="wikidata-progress" class="progress-bar progress-bar-striped font-weight-bold" style="width: 100%;">
Step 0/7
Step 0/9
</div>
</div>
</p>
......@@ -274,9 +270,9 @@
<strong>Configuration:</strong>
<br>
View
<a target="_blank" href="#">Download</a>,
<a target="_blank" href="#">Extraction</a>
<a target="_blank" href="#">Release</a>
<a target="_blank" href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/blob/master/extractionConfiguration/download.wikidata.properties">Download</a>,
<a target="_blank" href="https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/blob/master/extractionConfiguration/extraction.wikidata.properties">Extraction</a>
<a target="_blank" href="#">https://git.informatik.uni-leipzig.de/dbpedia-assoc/marvin-config/-/tree/master/databus-poms/dbpedia/wikidata</a>
configuration.
</p>
<p>
......@@ -453,7 +449,7 @@
<div class="card">
<div class="card-body">
<h4><a id="marvin-mappings-group-link" target="_blank" href="https://databus.dbpedia.org/marvin/mappings/">7: MARVIN Mappings Release Completeness</a></h4>
<span class="text-muted">TODO add State </span>
<!-- <span class="text-muted">TODO add State </span> -->
<p>
<a id="marvin-mappings-comp-query" target="_blank">query</a>
</p>
......@@ -484,7 +480,7 @@
<div class="card">
<div class="card-body">
<h4><a id="marvin-generic-group-link" target="_blank" href="https://databus.dbpedia.org/marvin/generic/">7: MARVIN Generic Release Completeness</a></h4>
<span class="text-muted">TODO add State </span>
<!-- <span class="text-muted">TODO add State </span> -->
<p>
<a id="marvin-generic-comp-query" target="_blank">query</a>
</p>
......@@ -515,7 +511,7 @@
<div class="card">
<div class="card-body">
<h4><a id="marvin-wikidata-group-link" target="_blank" href="https://databus.dbpedia.org/marvin/wikidata/">7: MARVIN Wikidata Release Completeness</a></h4>
<span class="text-muted">TODO add State </span>
<!-- <span class="text-muted">TODO add State </span> -->
<p>
<a id="marvin-wikidata-comp-query" target="_blank">query</a>
</p>
......@@ -588,7 +584,7 @@
<div class="card">
<div class="card-body">
<h4><a id="dbpedia-mappings-group-link" target="_blank" href="https://databus.dbpedia.org/dbpedia/mappings/">9: DBpedia Mappings Release Completeness</a></h4>
<span class="text-muted">TODO add State </span>
<!-- <span class="text-muted">TODO add State </span> -->
<p>
<a id="dbpedia-mappings-comp-query" target="_blank">query</a>
</p>
......@@ -619,7 +615,7 @@
<div class="card">
<div class="card-body">
<h4><a id="dbpedia-generic-group-link" target="_blank" href="https://databus.dbpedia.org/dbpedia/generic/">9: DBpedia Generic Release Completeness</a></h4>
<span class="text-muted">TODO add State </span>
<!-- <span class="text-muted">TODO add State </span> -->
<p>
<a id="dbpedia-generic-comp-query" target="_blank">query</a>
</p>
......@@ -650,7 +646,7 @@
<div class="card">
<div class="card-body">
<h4><a id="dbpedia-wikidata-group-link" target="_blank" href="https://databus.dbpedia.org/dbpedia/wikidata/">9: DBpedia Wikidata Release Completeness</a></h4>
<span class="text-muted">TODO add State </span>
<!-- <span class="text-muted">TODO add State </span> -->
<p>
<a id="dbpedia-wikidata-comp-query" target="_blank">query</a>
</p>
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment