Skip to content
Snippets Groups Projects
Commit df5353d4 authored by Marvin Hofer's avatar Marvin Hofer
Browse files

Merge remote-tracking branch 'origin/master'

parents 1fe1edc9 a7c157a3
No related branches found
No related tags found
No related merge requests found
......@@ -23,6 +23,38 @@ TODO
TODO
## Run Databus-Derive (clone and parse)
On the respective server there is a user marvin-fetch, that has access to `/data/derive` containing the pom.xml of https://github.com/dbpedia/databus-maven-plugin/tree/master/dbpedia
```
# query to get all versions fro derive in xml syntax to paste directly into pom.xml
PREFIX dataid: <http://dataid.dbpedia.org/ns/core#>
SELECT distinct (?derive) WHERE {
?dataset dataid:group <https://databus.dbpedia.org/marvin/generic> .
?dataset dataid:artifact ?artifact .
?dataset dataid:version ?version .
?dataset dct:hasVersion "2019.08.30"^^xsd:string
BIND (CONCAT("<version>",?artifact,"/${databus.deriveversion}</version>") as ?derive)
}
order by asc(?derive)
```
#######
# This is still manual, will be a cronjob soon
#######
su marvin-fetch
tmux a -t derive
WHAT=mappings
NEWVERSION=2019.08.30
# prepare
cd /data/derive/databus-maven-plugin/dbpedia/$WHAT
git pull
mvn versions:set -DnewVersion=$NEWVERSION
# run
mvn -T 23 databus-derive:clone -Ddatabus.deriveversion=$NEWVERSION
```
## Move data to download server (internal)
run marvin-fetch.sh script in databus/dbpedia folder
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment