Skip to content

Killing oozie jobs from HUE, while in kerberos mode, on HDP cluster

by on April 30, 2015

Everything is written – just search in the right place :-)

We’ve followed all (or most) of the instruction to convert an HDP cluster into kerberos mode.

But when we tried to kill a job from the HUE interface, we got the following error:

Problem: Error performing kill on Oozie job 0000000-150430180450260-oozie-oozi-W:

HTTP Status 401 –

type Status report

message

description This request requires HTTP authentication.

Apache Tomcat/6.0.37

To solve it, we had to read this – https://oozie.apache.org/docs/3.2.0-incubating/AG_Install.html#User_Authorization_Configuration

If the parameter “oozie.service.AuthorizationService.security.enabled”  is set to true,
then one has to modify the file /etc/oozie/conf/adminusers.txt – add a list of permitted user, one at a line.

If it is true and the file is empty, then when trying to kill a job, one gets the error above.

I’ve added several users, as just adding oozie is not sufficient, and we still need to do a fine tuning for the list of users to be within this file.

Also – one can run example jobs in oozie –

The example tar is here – /usr/share/doc/oozie-4.0.0.2.1.3.0/oozie-examples.tar.gz

After extracting the jar change in the job.properties the “localhost” to the FQDN of the host.
Then the folder has to be copied to hdfs:
hdfs dfs -copyFromLocal examples /user/oozie/.

I used the following command

oozie job -oozie http://`hostname -f`:11000/oozie -config examples/apps/map-reduce/job.properties -run

And while the job ran (it gets suspend immediately), I killed it successfully from the HUE.

Bottom line – sababa. I can start the weekend now

Advertisements
Leave a Comment

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: