"could only be replicated to 0 nodes, instead of 1"

[jerrro]

I am trying to install/configure hadoop on a cluster with several computers. I followed exactly the instructions in the hadoop website for configuring multiple slaves, and when I run start-all.sh I get no errors - both datanode and tasktracker are reported to be running (doing ps awux | grep hadoop on the slave nodes returns two java processes). Also, the log files are empty - nothing is printed there. Still, when I try to use bin/hadoop dfs -put,
I get the following error:

# bin/hadoop dfs -put w.txt w.txt
put: java.io.IOException: File /user/scohen/w4.txt could only be replicated to 0 nodes, instead of 1

and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows it).

I couldn't find much information about this error, but I did manage to see somewhere it might mean that there are no datanodes running. But as I said, start-all does not give any errors. Any ideas what could be problem?

Thanks.

Jerr.

[Jason Venner-2]

This happens to me, when the dfs has gotten into an inconsistent state.

NOTE: you will lose all of the contents of your HDS file system.

What I hae to do, is stop dfs, remove the contents of the dfs
directories on all the machines, hadoop namenode -format on the
controller, then restart dfs.
That consistently fixes the problem for me. This may be serious overkill
but it works.

NOTE: you will lose all of the contents of your HDS file system.

jerrro wrote:

> I am trying to install/configure hadoop on a cluster with several computers.
> I followed exactly the instructions in the hadoop website for configuring
> multiple slaves, and when I run start-all.sh I get no errors - both datanode
> and tasktracker are reported to be running (doing ps awux | grep hadoop on
> the slave nodes returns two java processes). Also, the log files are empty -
> nothing is printed there. Still, when I try to use bin/hadoop dfs -put,
> I get the following error:
>
> # bin/hadoop dfs -put w.txt w.txt
> put: java.io.IOException: File /user/scohen/w4.txt could only be replicated
> to 0 nodes, instead of 1
>
> and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows it).
>
> I couldn't find much information about this error, but I did manage to see
> somewhere it might mean that there are no datanodes running. But as I said,
> start-all does not give any errors. Any ideas what could be problem?
>
> Thanks.
>
> Jerr.
>  

[jerrro]

I did this several times, while tuning the configuration in all kinds of way... But still, nothing helped -
Even when I stop everything, reformat and start it back again, I get this error whenever trying to use dfs -put.

Jason Venner-2 wrote:

This happens to me, when the dfs has gotten into an inconsistent state.

NOTE: you will lose all of the contents of your HDS file system.

What I hae to do, is stop dfs, remove the contents of the dfs
directories on all the machines, hadoop namenode -format on the
controller, then restart dfs.
That consistently fixes the problem for me. This may be serious overkill
but it works.

NOTE: you will lose all of the contents of your HDS file system.

jerrro wrote:
> I am trying to install/configure hadoop on a cluster with several computers.
> I followed exactly the instructions in the hadoop website for configuring
> multiple slaves, and when I run start-all.sh I get no errors - both datanode
> and tasktracker are reported to be running (doing ps awux | grep hadoop on
> the slave nodes returns two java processes). Also, the log files are empty -
> nothing is printed there. Still, when I try to use bin/hadoop dfs -put,
> I get the following error:
>
> # bin/hadoop dfs -put w.txt w.txt
> put: java.io.IOException: File /user/scohen/w4.txt could only be replicated
> to 0 nodes, instead of 1
>
> and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows it).
>
> I couldn't find much information about this error, but I did manage to see
> somewhere it might mean that there are no datanodes running. But as I said,
> start-all does not give any errors. Any ideas what could be problem?
>
> Thanks.
>
> Jerr.
>  

[Hairong Kuang]

Check http://namenode_host:50070/dfshealth.jsp to see if your cluster is
out of safemode or not and how many datanodes are up.

You could check .out/.log files under the log directory to see if there
is any error starting datanodes/namenode.

Hairong

-----Original Message-----
From: jerrro [mailto:jerrro@...]
Sent: Wednesday, December 05, 2007 9:29 AM
To: hadoop-user@...
Subject: Re: "could only be replicated to 0 nodes, instead of 1"


I did this several times, while tuning the configuration in all kinds of
way... But still, nothing helped - Even when I stop everything, reformat
and start it back again, I get this error whenever trying to use dfs
-put.


Jason Venner-2 wrote:
>
> This happens to me, when the dfs has gotten into an inconsistent
state.

>
> NOTE: you will lose all of the contents of your HDS file system.
>
> What I hae to do, is stop dfs, remove the contents of the dfs
> directories on all the machines, hadoop namenode -format on the
> controller, then restart dfs.
> That consistently fixes the problem for me. This may be serious
> overkill but it works.
>
> NOTE: you will lose all of the contents of your HDS file system.
>
> jerrro wrote:
>> I am trying to install/configure hadoop on a cluster with several
>> computers.
>> I followed exactly the instructions in the hadoop website for
>> configuring multiple slaves, and when I run start-all.sh I get no
>> errors - both datanode and tasktracker are reported to be running
>> (doing ps awux | grep hadoop on the slave nodes returns two java
>> processes). Also, the log files are empty - nothing is printed there.

>> Still, when I try to use bin/hadoop dfs -put, I get the following
>> error:
>>
>> # bin/hadoop dfs -put w.txt w.txt
>> put: java.io.IOException: File /user/scohen/w4.txt could only be
>> replicated to 0 nodes, instead of 1
>>
>> and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows
it).

>>
>> I couldn't find much information about this error, but I did manage
>> to see somewhere it might mean that there are no datanodes running.
>> But as I said, start-all does not give any errors. Any ideas what
>> could be problem?
>>
>> Thanks.
>>
>> Jerr.
>>  
>
>

--
View this message in context:
http://www.nabble.com/%22could-only-be-replicated-to-0-nodes%2C-instead-
of-1%22-tf4950939.html#a14176525
Sent from the Hadoop Users mailing list archive at Nabble.com.

[jerrro]

[I get an error that the message was not posted to the mailing list. I am sorry if you see
this message twice]

It says I have 0 live nodes... And DFS capacity is 0.
The logs are *all* empty (empty files of size 0).
I don't see why it says there are 0 live nodes - when I run start-all.sh,
it says "starting namenode" and "starting tasktracker" without any errors.
Also, when I log-in to the datanodes and do ps awux | grep hadoop
I get 2 processes of java running.

Hairong Kuang wrote:

Check http://namenode_host:50070/dfshealth.jsp to see if your cluster is
out of safemode or not and how many datanodes are up.

You could check .out/.log files under the log directory to see if there
is any error starting datanodes/namenode.

Hairong

-----Original Message-----
From: jerrro [mailto:[e-mail]]
Sent: Wednesday, December 05, 2007 9:29 AM
To: [e-mail]
Subject: Re: "could only be replicated to 0 nodes, instead of 1"


I did this several times, while tuning the configuration in all kinds of
way... But still, nothing helped - Even when I stop everything, reformat
and start it back again, I get this error whenever trying to use dfs
-put.


Jason Venner-2 wrote:
>
> This happens to me, when the dfs has gotten into an inconsistent
state.
>
> NOTE: you will lose all of the contents of your HDS file system.
>
> What I hae to do, is stop dfs, remove the contents of the dfs
> directories on all the machines, hadoop namenode -format on the
> controller, then restart dfs.
> That consistently fixes the problem for me. This may be serious
> overkill but it works.
>
> NOTE: you will lose all of the contents of your HDS file system.
>
> jerrro wrote:
>> I am trying to install/configure hadoop on a cluster with several
>> computers.
>> I followed exactly the instructions in the hadoop website for
>> configuring multiple slaves, and when I run start-all.sh I get no
>> errors - both datanode and tasktracker are reported to be running
>> (doing ps awux | grep hadoop on the slave nodes returns two java
>> processes). Also, the log files are empty - nothing is printed there.

>> Still, when I try to use bin/hadoop dfs -put, I get the following
>> error:
>>
>> # bin/hadoop dfs -put w.txt w.txt
>> put: java.io.IOException: File /user/scohen/w4.txt could only be
>> replicated to 0 nodes, instead of 1
>>
>> and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows
it).
>>
>> I couldn't find much information about this error, but I did manage
>> to see somewhere it might mean that there are no datanodes running.
>> But as I said, start-all does not give any errors. Any ideas what
>> could be problem?
>>
>> Thanks.
>>
>> Jerr.
>>  
>
>

--
View this message in context:
http://www.nabble.com/%22could-only-be-replicated-to-0-nodes%2C-instead-
of-1%22-tf4950939.html#a14176525
Sent from the Hadoop Users mailing list archive at Nabble.com.

[jasongs]

I get the same error when doing a put and my cluster is running ok

i.e. has capacity and all nodes are live.
Error message is
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /test/test.txt could only be replicated to 0 nodes, instead of 1
        at org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1127)
        at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:312)
        at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:901)

        at org.apache.hadoop.ipc.Client.call(Client.java:512)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:198)
        at org.apache.hadoop.dfs.$Proxy0.addBlock(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
        at org.apache.hadoop.dfs.$Proxy0.addBlock(Unknown Source)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:2074)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:1967)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.access$1500(DFSClient.java:1487)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:1601)
I would appreciate any help/suggestions

Thanks

jerrro wrote:

I am trying to install/configure hadoop on a cluster with several computers. I followed exactly the instructions in the hadoop website for configuring multiple slaves, and when I run start-all.sh I get no errors - both datanode and tasktracker are reported to be running (doing ps awux | grep hadoop on the slave nodes returns two java processes). Also, the log files are empty - nothing is printed there. Still, when I try to use bin/hadoop dfs -put,
I get the following error:

# bin/hadoop dfs -put w.txt w.txt
put: java.io.IOException: File /user/scohen/w4.txt could only be replicated to 0 nodes, instead of 1

and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows it).

I couldn't find much information about this error, but I did manage to see somewhere it might mean that there are no datanodes running. But as I said, start-all does not give any errors. Any ideas what could be problem?

Thanks.

Jerr.

[Arul Ganesh]

Hi,
If you are getting this in windows environment (2003 64 bit). We have faced the same problem. Now we tried the following steps and it started working.
1)Install cygwin and ssh.
2) Downloaded the stable version Hadoop - hadoop-0.17.2.1.tar.gz as on 13/Nov/2008
3) Untar it via cygwin (tar xvfz hadoop-0.17.2.1.tar.gz). please DONOT use WINZIP to untar.
4) We tried running the sudo distribution example provided in quickstart (http://hadoop.apache.org/core/docs/current/quickstart.html) and it worked.

Thanks
Arul and Limin
eBay Inc.,

jerrro wrote:

I am trying to install/configure hadoop on a cluster with several computers. I followed exactly the instructions in the hadoop website for configuring multiple slaves, and when I run start-all.sh I get no errors - both datanode and tasktracker are reported to be running (doing ps awux | grep hadoop on the slave nodes returns two java processes). Also, the log files are empty - nothing is printed there. Still, when I try to use bin/hadoop dfs -put,
I get the following error:

# bin/hadoop dfs -put w.txt w.txt
put: java.io.IOException: File /user/scohen/w4.txt could only be replicated to 0 nodes, instead of 1

and a file of size 0 is created on the DFS (bin/hadoop dfs -ls shows it).

I couldn't find much information about this error, but I did manage to see somewhere it might mean that there are no datanodes running. But as I said, start-all does not give any errors. Any ideas what could be problem?

Thanks.

Jerr.