Custom MDP with RL4J

How do I implement a custom MDP with RL4J?