views:

64

answers:

0

I'm trying to use JIT compilation in clojure to generate mapper and reducer classes on the fly. However, these classes aren't being recognized by the JobClient (it's the usual ClassNotFoundException.)

If I AOT compile the Mapper,Reducer and Tool, and run the job using RunJar, everything seems fine. After looking through the source, it seems that it's unpackaging the jar and creating a custom URLClassLoader that it uses to load the "main" implementation. What I'm not seeing is how the jar is distributed across nodes or even how it's getting used in a one-node cluster.

Any help would be much appreciated!