How to build Idris-JVM from sources

[ska80]

Hi @mmhelloworld

Firstly, thanks a lot for your contribution :)

I am trying to build/bootstrap idris-jvm from sources with Maven but can't figure out how to do it properly.

mvn package invokes idris2 (already built with Chez), which in turn fails to proceed due to unknown %foreign jvm' ... pragmas.

What is the right way to bootstrap idris-jvm?

[mmhelloworld]

Hi,

Thank you for trying out idris-jvm!

To build from sources, we need to use idris2 that is built with JVM backend. We can't use the one built with Chez as the error you encountered indicates. Please install idris2 as per the instructions here https://github.com/mmhelloworld/idris-jvm#install. This would have idris2 built with JVM backend on the PATH then mvn commands should work. Please also make sure to clean first with mvn clean to remove the files built by Chez Idris 2.

[ska80]

we need to use idris2 that is built with JVM backend

Aha, it does totally make sense. lol, I don't know why I didn't try this 🤦‍♂️😅

Thanks, I will try ASAP.

[ska80]

Ok, I can build the compiler now, but running tests fails with the following error:

[INFO] --- exec-maven-plugin:3.0.0:exec (idris-test-compile) @ idris-jvm-tests ---
make[1]: Entering directory '/home/kamil/.local/idris/idris2-jvm'
make install-support PREFIX=/home/kamil/.local/idris/idris2-jvm/build/env
make[2]: Entering directory '/home/kamil/.local/idris/idris2-jvm'
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/docs
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/racket
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/gambit
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/js
install -m 644 support/docs/*.css /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/docs
install -m 644 support/racket/* /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/racket
install -m 644 support/gambit/* /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/gambit
install -m 644 support/js/* /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/js
make[3]: Entering directory '/home/kamil/.local/idris/idris2-jvm/support/c'
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/lib
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/include
install -m 755 libidris2_support.so /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/lib
install -m 644 libidris2_support.a   /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/lib
install -m 644 *.h            /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/include
make[3]: Leaving directory '/home/kamil/.local/idris/idris2-jvm/support/c'
make[3]: Entering directory '/home/kamil/.local/idris/idris2-jvm/support/refc'
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/refc
install -m 644 libidris2_refc.a *.h /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/refc
make[3]: Leaving directory '/home/kamil/.local/idris/idris2-jvm/support/refc'
make[3]: Entering directory '/home/kamil/.local/idris/idris2-jvm/support/chez'
mkdir -p /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/chez
install -m 644 *.ss /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/support/chez
make[3]: Leaving directory '/home/kamil/.local/idris/idris2-jvm/support/chez'
make[2]: Leaving directory '/home/kamil/.local/idris/idris2-jvm'
ln -sf /home/kamil/.local/idris/idris2-jvm/libs/prelude/build/ttc /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/prelude-0.5.1
ln -sf /home/kamil/.local/idris/idris2-jvm/libs/base/build/ttc    /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/base-0.5.1
ln -sf /home/kamil/.local/idris/idris2-jvm/libs/test/build/ttc    /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/test-0.5.1
ln -sf /home/kamil/.local/idris/idris2-jvm/libs/contrib/build/ttc /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/contrib-0.5.1
ln -sf /home/kamil/.local/idris/idris2-jvm/libs/network/build/ttc /home/kamil/.local/idris/idris2-jvm/build/env/idris2-0.5.1/network-0.5.1
make[1]: Leaving directory '/home/kamil/.local/idris/idris2-jvm'
make[1]: Entering directory '/home/kamil/.local/idris/idris2-jvm/tests'
/home/kamil/.local/idris/idris2-jvm/build/exec/idris2 --build tests.ipkg
Error: Module Prelude not found

(Interactive):1:1--1:1
 1 | module Main
     

make[1]: Leaving directory '/home/kamil/.local/idris/idris2-jvm/tests'
make[1]: *** [Makefile:13: testbin] Error 1
make: *** [Makefile:122: testenv] Error 2
[ERROR] Command execution failed.
org.apache.commons.exec.ExecuteException: Process exited with an error: 2 (Exit value: 2)
    at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:404)
    at org.apache.commons.exec.DefaultExecutor.execute (DefaultExecutor.java:166)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:982)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:929)
    at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:457)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Idris JVM 0.5.1-SNAPSHOT:
[INFO] 
[INFO] Idris JVM .......................................... SUCCESS [  0.001 s]
[INFO] Idris JVM Runtime .................................. SUCCESS [  2.267 s]
[INFO] Idris JVM Assembler ................................ SUCCESS [  0.998 s]
[INFO] Idris JVM Compiler ................................. SUCCESS [06:27 min]
[INFO] Idris JVM Tests .................................... FAILURE [  2.476 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  06:33 min
[INFO] Finished at: 2022-01-10T15:31:46+06:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:exec (idris-test-compile) on project idris-jvm-tests: Command execution failed.: Process exited with an error: 2 (Exit value: 2) -> [Help 1]

[mmhelloworld]

Did you set IDRIS2_PREFIX pointing to <EXTRACTED_DIRECTORY_ROOT>/lib?

[ska80]

Did you set IDRIS2_PREFIX pointing to <EXTRACTED_DIRECTORY_ROOT>/lib?

I did this only for the released compiler following instructions here: https://github.com/mmhelloworld/idris-jvm#install

Do I need to set IDRIS2_PREFIX as well before Maven runs the test goal using a freshly built compiler?

[mmhelloworld]

You are right, for tests it shouldn't be necessary. It should use the current folder. Could you please try running mvn install -Didris.tests="only=jvm"? Some Idris 2 maven goals are not bound to package phase but are bound to install phase.

[ska80]

You are right, for tests it shouldn't be necessary. It should use the current folder. Could you please try running mvn install -Didris.tests="only=jvm"? Some Idris 2 maven goals are not bound to package phase but are bound to install phase.

I just did a fresh rebuild from scratch with mvn install -Didris.tests="only=jvm" and it worked. But after installing it, its directory structure is different from the released one. And when I try to run it, it shows the following error:

Error: Could not find or load main class idris2.Main
Caused by: java.lang.ClassNotFoundException: idris2.Main

This is idris-jvm installed from the released package:

kamil@devbox:~/.idris2 % tree -L 3 .   
.
├── bin
│   ├── idris2
│   └── idris2.bat
└── lib
    ├── asm-9.0.jar
    ├── idris2-0.5.1
    │   ├── base-0.5.1
    │   ├── contrib-0.5.1
    │   ├── include
    │   ├── lib
    │   ├── network-0.5.1
    │   ├── prelude-0.5.1
    │   ├── refc
    │   ├── support
    │   └── test-0.5.1
    ├── idris-jvm-assembler-0.5.1-SNAPSHOT.jar
    ├── idris-jvm-compiler-0.5.1-SNAPSHOT.jar
    └── idris-jvm-runtime-0.5.1-SNAPSHOT.jar

And this is idris-jvm that I just built and then installed with mvn install -Didris.tests="only=jvm":

kamil@devbox:~/.idris2-dev % tree -L 2 .
.
├── bin
│   ├── idris2
│   └── idris2_app
│       ├── asm-9.0.jar
│       ├── idris-jvm-assembler-0.5.1-SNAPSHOT.jar
│       ├── idris-jvm-compiler-0.5.1-SNAPSHOT.jar
│       └── idris-jvm-runtime-0.5.1-SNAPSHOT.jar
├── idris2-0.5.1
│   ├── base-0.5.1
│   ├── contrib-0.5.1
│   ├── include
│   ├── lib
│   ├── network-0.5.1
│   ├── prelude-0.5.1
│   ├── refc
│   ├── support
│   └── test-0.5.1
└── lib
    └── libidris2_support.so

[mmhelloworld]

The archive that is uploaded as a release should be available at idris-jvm-compiler/target/idris2-0.5.1-SNAPSHOT.zip.

[ska80]

Thanks for the hint :)