Error when loading 'wiki.en.bin' pretrained FastText model

DL4J
1

I’m trying to load in Facebook’s pretrained ‘wiki.en.bin’ file using deeplearning4j’s FastText class. When doing so, I’m being hit with:

Exception in thread "main" java.lang.IllegalArgumentException: Model file's format is not compatible with this JFastText version!

However, according to this resolved topic, this error should only be thrown when trying to load ‘.vec’ files. As I’m trying to load in the binary file, I’m not sure why this exception is being thrown. Any help would be greatly appreciated!

My code looks like this:
private File wiki_file = new File(“path/to/wiki.en.bin”);
private FastText wiki_model = new FastText(wiki_file);

2

@abarbet can you give me a link to the exact file so I can reproduce this? Thanks!

3

@agibsonccc here’s a link to the FastText class I’m trying to build. The ‘wiki.en.bin’ file is too large to add to this repo, but you can find a link to it here.

4

Worth mentioning that I’m running this version of DL4J:

"org.deeplearning4j": {
    "deeplearning4j-nlp": "1.0.0-beta7",
},
5

@abarbet thanks let me run this on monday my time and see what the deal is. I’ll make sure the latest release works with it. Ping me if you don’t hear back.