# DL4J to learn the task execution steps **URL:** \ **Category:** DL4J\ **Created:** [October 7, 2020, 1:52pm UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913 "2020-10-07T13:52:20Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![amarbanerjee23](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/amarbanerjee23/32/333_2.png) [@amarbanerjee23](https://community.konduit.ai/u/amarbanerjee23)\ **Post date:** [October 7, 2020, 1:52pm UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913/1 "2020-10-07T13:52:21Z")
Dear members, I am trying to model a network which can take :- 1. Input - A Target Goal (e.g. Go To Cinema Hall) 2. Output - A sequence of steps (e.g. Go To Bus Stop → Onboard A Bus → Drop at Location X → Walk 100 meters. My training data is a similar kind of Objective - Task Sequence Mappings. Can anyone please suggest a suitable approach using DL4J to address this problem and model suitable solutions? P.S. I am new to DL4J and just getting started with the framework. Thanks in advance, Cheers, Amar ---
**Author:** ![agibsonccc](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/agibsonccc/32/697_2.png) [@agibsonccc](https://community.konduit.ai/u/agibsonccc)\ **Post date:** [October 8, 2020, 11:00pm UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913/2 "2020-10-08T23:00:27Z")
HI Amar: Are you referencing any papers when attempting to do this? This doesn’t really sound like a well defined problem. Trying to just use supervised learning to tell a machine to pick an instruction to do doesn’t really sound appropriate to even try. You could look in to RL for this, but generally if it’s not a well defined simple problem like classifying something or predicting a value you’re not really going to make much progress. ---
**Author:** ![amarbanerjee23](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/amarbanerjee23/32/333_2.png) [@amarbanerjee23](https://community.konduit.ai/u/amarbanerjee23)\ **Post date:** [October 11, 2020, 1:54pm UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913/3 "2020-10-11T13:54:50Z")
Hi Adam, Thanks for replying to my post. My problem is that, I have an input data where I have gathered the steps to address a goal. E.g. Goal - Cook A Turkey , has steps 1. Marinate 2. Light\_Burner 3. Roast 4. Cut in Pieces Another goal could be Cook Chicken, has steps 1. Marinate 2. Light\_Burner 3. Boil 4. Fry and so on. Given such a set of a large amount of input comprising of Goals and steps mapping, can the system lean how to address a goal such as “Cook a duck”. My input data is in the form of a hierarchical eclipse EMF-based model, and I was wondering if the machine can learn the EMF model which has such goal and steps mapping. The reason I am looking at deeplearning is that I see that there is a possibility to represent a model (EMF model) as a neuron and then let the learning happen acorss multiple neurons. Could you please suggest if this sounds good ? Or you think there is a problem getting this done via dl4j ?? Thanks and cheers, Amar ---
**Author:** ![agibsonccc](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/agibsonccc/32/697_2.png) [@agibsonccc](https://community.konduit.ai/u/agibsonccc)\ **Post date:** [October 12, 2020, 12:50am UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913/4 "2020-10-12T00:50:32Z")
It sounds like we’re not really applying the fundamentals of machine learning here. If you’re not referencing a specific paper or something I would recommend sticking with a rules based approach. Your problem is not well defined enough to really go anywhere. There are limited forms of NLP you can do, but again you would need to implement a paper to do that. I would suggest going back to the drawing board and coming back with a more specific approach before I can make a recommendation on how to proceed. ---
**Author:** ![amarbanerjee23](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/amarbanerjee23/32/333_2.png) [@amarbanerjee23](https://community.konduit.ai/u/amarbanerjee23)\ **Post date:** [October 12, 2020, 5:35am UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913/5 "2020-10-12T05:35:59Z")
Thanks again Adam. This is the paper that I would like to refer. > **[1801.02294.pdf](https://arxiv.org/pdf/1801.02294.pdf)** > > 356.66 KB ---
**Author:** ![agibsonccc](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/agibsonccc/32/697_2.png) [@agibsonccc](https://community.konduit.ai/u/agibsonccc)\ **Post date:** [October 13, 2020, 9:00am UTC](https://community.konduit.ai/t/dl4j-to-learn-the-task-execution-steps/913/6 "2020-10-13T09:00:54Z")
@amarbanerjee23 This: [https://arxiv.org/pdf/1801.02294.pdf](https://arxiv.org/pdf/1801.02294.pdf) isn’t really good for actions though. It’s clearly targeting items. Those domains aren’t remotely close. The closest you might get is a session based recommendation: [Session-Based Recommendations | Papers With Code](https://paperswithcode.com/task/session-based-recommendations) Even then it’s a bit of a stretch. How big is your dataset? Have you built it yet?