Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Menu
Open sidebar
asv-ml
mlmc
Commits
8b723b3b
Commit
8b723b3b
authored
Feb 18, 2021
by
Janos Borst
Browse files
stuff
parent
0652ef89
Pipeline
#45899
failed with stage
in 12 minutes and 1 second
Changes
3
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
mlmc/representation/debug.py
0 → 100644
View file @
8b723b3b
mlmc/representation/representations.py
View file @
8b723b3b
...
...
@@ -12,6 +12,7 @@ import tempfile
import
torch
from
io
import
BytesIO
from
transformers
import
*
import
pathlib
EMBEDDINGCACHE
=
Path
.
home
()
/
".mlmc"
/
"embedding"
...
...
@@ -228,7 +229,6 @@ def get_embedding(name, **kwargs):
tokenizer
=
get_white_space_tokenizer
(
vocabulary
)
return
e
,
tokenizer
import
pathlib
def
get_transformer
(
model
=
"bert"
,
**
kwargs
):
"""
...
...
requirements.txt
View file @
8b723b3b
...
...
@@ -18,5 +18,4 @@ datasketch
torch
>=1.5.0
beautifulsoup4
~=4.8.2
requests
~=2.23.0
dgl
~=0.5.2
apex
~=0.1
\ No newline at end of file
dgl
~=0.5.2
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment