Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GP tools point-in-polygon-aggregation-mr not working #19

Open
trumboosahil opened this issue Nov 20, 2014 · 12 comments
Open

GP tools point-in-polygon-aggregation-mr not working #19

trumboosahil opened this issue Nov 20, 2014 · 12 comments

Comments

@trumboosahil
Copy link

I followed your tutorial at gis-tools-for-hadoop / samples / point-in-polygon-aggregation-mr / gp / README.md but not Tool is not working and shows red X's on the GP Tools from the Hadoop Tools toolbox. However as suggested at same location to double click rectangle in the model and reset the location of the tool.

I acted accordingly after my double click it shows error dialog with "Unable to execute the selected tool." I tried to right click->edit on the "Run Sample Application" but nothing happens.

I'm using ArcGIS desktop 10.2 with Advances ArcInfo licenses

@climbage
Copy link
Member

The sample model requires the GP tools from https://github.com/Esri/geoprocessing-tools-for-hadoop. Put the model in the same folder as the tools.

@trumboosahil
Copy link
Author

I did this already and as a matter of fact the documentation of this subject is good but needs lot of improvement

@climbage
Copy link
Member

I agree that the documentation on the GP tools can be improved.

@smambrose
Copy link
Contributor

What error do you get when you view the toolbox in the Catalog window? (right click the toolbox, "check syntax")
image

@trumboosahil
Copy link
Author

Please check the screen shot in catalog window as under

catalog

Please see the screen shot in ArctoolBox and also when I double - click on "Run Sample Application"

arctool

@smambrose
Copy link
Contributor

Did you delete the files requests or webhdfs?

If not - are you able to view your model at all? (right click on model, edit).

@trumboosahil
Copy link
Author

I didn't delete the file from requests or webhdfs
when I right click on model at select edit option nothing happens

@smambrose
Copy link
Contributor

I am not able to reproduce this yet.

  1. Were you at any point able to edit and see the model? (like in image 1)
  2. Did you try and verify and/or run your model while you still had model builder open?
  3. Was the model coloured in when you tried to run it - like :
    image
    ?
  4. Did you save any settings in the ArcToolbox (either to file or default)?
  5. Have you been able to run the tools not in the model builder (just standalone)?

@trumboosahil
Copy link
Author

Thanks for your help I got it working

@trumboosahil
Copy link
Author

After running the Oozei Job in armap the Job runs and goes on running:

image

And in oozei Dashboard I found please check bold text

2014-11-30 02:27:14,481 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] Start action [0000000-141130021902027-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-11-30 02:27:14,482 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] [_0000000-141130021902027-oozie-oozi-W@:start:]Action status=DONE
2014-11-30 02:27:14,482 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] [_0000000-141130021902027-oozie-oozi-W@:start:
]Action updated in DB!
2014-11-30 02:27:15,846 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@eq-node] Start action [0000000-141130021902027-oozie-oozi-W@eq-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-11-30 02:47:30,833 WARN ActionStartXCommand:544 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W
"
@eq-node] Error starting action [eq-node]. ErrorType [TRANSIENT], ErrorCode [ JA006], Message [ JA006: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused]
org.apache.oozie.action.ActionExecutorException: JA006: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:392)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:980)
at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1135)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
at org.apache.oozie.command.XCommand.call(XCommand.java:281)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused"

@trumboosahil
Copy link
Author

And in continuation of above comment in oozei web console

image

@climbage
Copy link
Member

climbage commented Dec 3, 2014

Have you had any luck with this? This seems like an issue with the Oozie setup on your Cloudera VM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants