Skip to content

small bug when re-downloading Cloudera Parcels

by on May 12, 2015

I had an issue with uid of users on different servers so i had to delete and reinstall the cluster.

unfortunately – I kept the old parcels files with the old UID

ls -l /opt/cloudera/parcel-repo/CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel*
 -rw-r----- 1 cloudera-scm cloudera-scm 1558200266 May 12 14:51 /opt/cloudera/parcel-repo/CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel
 -rw-r----- 1 cloudera-scm cloudera-scm 848904192 May 12 14:52 /opt/cloudera/parcel-repo/CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel.part
 -rw-r----- 1 522 522 41 Apr 7 13:33 /opt/cloudera/parcel-repo/CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel.sha

note that the *.parcel.sha file is with the old UID of cloudera-scm account.

I saw that the parcels is being downloaded and redownloded in an endless loop.

in the log file i saw:
 2015-05-12 14:07:14,322 INFO MainThread:com.cloudera.parcel.components.PeriodicParcelTasks: Set up periodic parcel tasks every 60 minutes.
 2015-05-12 14:07:14,337 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files CDH-5.3.2-1.cdh5.3.2.p0.
 10-el6.parcel under /opt/cloudera/parcel-repo
 2015-05-12 14:07:14,352 WARN ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Error reading hash file: CDH-5.3.2-1
 .cdh5.3.2.p0.10-el6.parcel.sha
 java.io.FileNotFoundException: /opt/cloudera/parcel-repo/CDH-5.3.2-1.cdh5.3.2.p0.10-el6.parcel.sha (Permission denied)
 at java.io.FileInputStream.open(Native Method)
 at java.io.FileInputStream.(FileInputStream.java:146)
 at com.google.common.io.Files$FileByteSource.openStream(Files.java:124)
 at com.google.common.io.Files$FileByteSource.openStream(Files.java:114)
 at com.google.common.io.ByteSource$AsCharSource.openStream(ByteSource.java:287)
 at com.google.common.io.CharSource.openBufferedStream(CharSource.java:80)
 at com.google.common.io.CharSource.readFirstLine(CharSource.java:157)
 at com.google.common.io.Files.readFirstLine(Files.java:674)
 at com.cloudera.parcel.components.LocalParcelManagerImpl.readFirstLineFromFile(LocalParcelManagerImpl.java:392)
 at com.cloudera.parcel.components.LocalParcelManagerImpl.getParcelHash(LocalParcelManagerImpl.java:348)
 at com.cloudera.parcel.components.LocalParcelManagerImpl.processParcel(LocalParcelManagerImpl.java:182)
 at com.cloudera.parcel.components.LocalParcelManagerImpl.scanRepo(LocalParcelManagerImpl.java:142)
 at com.cloudera.parcel.components.LocalParcelManagerImpl$1.run(LocalParcelManagerImpl.java:155)
 at com.cloudera.parcel.components.LocalParcelManagerImpl$1.run(LocalParcelManagerImpl.java:152)
 at com.cloudera.cmf.persist.ReadWriteDatabaseTaskCallable.call(ReadWriteDatabaseTaskCallable.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)

Once i deleted the old sha file the downloding of the parcel ended and i could continue with the installation.

I’d think there should be some kind of warning to the screen that something is wrong so one won’t have to wait that long

This happend with CDH 5.4

Advertisements
Leave a Comment

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: