CuBox Development Platform

Linux, Android based tiny, energy efficient development machine
It is currently Wed Oct 01, 2014 6:15 pm

All times are UTC




Post new topic Reply to topic  [ 26 posts ]  Go to page Previous  1, 2, 3  Next
Author Message
 Post subject: Re: CuBox NAS
PostPosted: Tue Oct 02, 2012 3:55 am 
Offline

Joined: Tue Dec 20, 2011 9:55 pm
Posts: 41
The current kernel 3.5 from rabeeh and vDorst miss the patch from 2.6.32.9
that turn off hardware checksum when the mtu is larger than 1600. When you
set mtu to 9000 using ifconfig or set it in /etc/network/interface, the throughput
will increase dramatically. With normal file transfer no encryption, I can get 70-90 MB/s.
For "benchmark" number, iperf can go over 100MB/s easily as a client or server with
the jumbo frame patch. Without jumbo frame patch, iperf can go around 77MB/s.

See the jumbo frame patch from wikipage:
http://www.solid-run.com/mw/index.php/L ... ic_patches

---oOo---

I have successfully run glusterfs on two cuboxes. Each box has this config:
* Latest kernel 3.5 from vDorst with jumbo frame patch
* Debian Wheezy armhf
* glusterfs 3.3 (compiled with gcc 4.7)
* 2 hard drives, one 1TB, one 2TB in Mediasonic Probox 4bay, connected to CuBox by esata cable.

What I observe is the throughput of each CuBox is around 28-35MB/s with 77-89 cpu utilization
from top command.

My client runs on an Intel IvyBridge box with Debian Wheezy.

Perhaps some fine-tuning in tcp buffer to avoid buffer bloat?

A faster CuBox, some sort of quad-core A9 1.2-1.5GHz? A fast enough cpu with SATA or eSata
AND Gigabit Ethernet will be an awesome storage solution. Think of low-power "cloud storage"
at home or for small business.


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Tue Oct 02, 2012 7:19 am 
Offline

Joined: Wed Feb 22, 2012 8:24 pm
Posts: 67
dung wrote:
the machine is idle and draws ~1.5W with the shipped power supply.

Interesting, do you have a stripped down kernel, because it's twice lower than what I have measured! May be, my measuring device is not very accurate at low consumption...

vongillus wrote:
I would only suggest Solid Run for a next version to add USB3

Actually, I wanted to say USB3 instead of USB2, keeping Esata would be much better...


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Tue Nov 06, 2012 10:15 pm 
Offline

Joined: Tue Nov 06, 2012 9:55 pm
Posts: 1
@neofob
could you post more details about your tuning and test setup/params?
i only get around 600mbit with iperf and around 500 via samba, with almost full cpu usage.

using the latest archlinux linux-cubox kernel and 9k mtu.


on a side note: with all these gazillion cheap arm boards i wonder why no one made one with decent network, some satas and a multicore cpu.


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Thu Nov 08, 2012 2:51 pm 
Offline

Joined: Wed Sep 19, 2012 11:26 am
Posts: 25
Quote:
A fast enough cpu with SATA or eSata
AND Gigabit Ethernet
Please don't blame the CPU to be too slow.. It's not true at this point. My values measured are limited by disk speed not CPU. If you say you can't get those speeds with SAMBA it's possibly a samba (or whatever u use as protocol) performance or configuration problem. no multicore cpu needed IMO. If the bottleneck is encryption It would make more sense to add support for the hardware crypto engine..


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Wed Nov 14, 2012 9:46 pm 
Offline

Joined: Tue Dec 20, 2011 9:55 pm
Posts: 41
Flooo wrote:
Quote:
A fast enough cpu with SATA or eSata
AND Gigabit Ethernet
Please don't blame the CPU to be too slow.. It's not true at this point. My values measured are limited by disk speed not CPU. If you say you can't get those speeds with SAMBA it's possibly a samba (or whatever u use as protocol) performance or configuration problem. no multicore cpu needed IMO. If the bottleneck is encryption It would make more sense to add support for the hardware crypto engine..


Well...on the cpu:
Yes and No:

With applications such as glusterfs, usually there are many processes running.
Multicore cpu with proper cpu-affinity stuff will help to reduce the context switching cost.

The problem with gluster, it could be with samba also, is that it uses a lot of md5sum calls
from openssl. The CuBox has the crypto engine to acceleration this. However, you need
to patch the kernel to support crypto-dev and recompile openssl to take advantage of this.
So there is some room to improve there.

On the speed,

I can get iperf over 100MB/s (1000 Megabit/s) easily on debian wheezy armhf, headless config,
jumbo frame enable...(see solid-run's wiki pages on how to set up debian wheezy armhf, headless
server...).

So, yes, if you only run iperf then the throughput goes over 100MB/s and the same is for
hdparm for hard drive (on my 1-2TB Western Digital hard drive). But with some calculations,
CuBox does come a bit short.


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Wed Dec 26, 2012 11:34 pm 
Offline

Joined: Sun Dec 23, 2012 5:14 am
Posts: 23
Note 2013/01/05: moved to Wiki, this post is not edited any more !!!

Goto : http://www.solid-run.com/mw/index.php/CuBox_as_NAS
Goto : http://www.solid-run.com/mw/index.php/CuBox_as_NAS_Part_II

Excuse some of the formatting, because i wrote the wikis on CuBox with DokuWiki and there are syntax differences.


one Goal is, that at the end everybody can rebuild my solution on his own. I also give usefull information, if one of the programs misbehave.


Note 2013/01/04: As last thing, i will show control with nut for the UPS. After this step you can build a full functional NAS with this howto. With 10,5W inclusive the UPS in harddrive standby i am pretty impressed with the overall powerusage. Expect an power bill increase for about 150 KW/h when you use it normally. In Europe this means about 2,5€ / month extra costs.

Remind one thing: a NAS doesn't replace a backup !!!!


Code:
All Tests made on Windows 7 64bit client, SSD harddrive, Testfile 1,5Gb,
copied with Total Commander:
Performance now is (no Jumbo frames):
Read from NAS: 32Mb/s
Write to NAS:    42Mb/s

Hard drive idle time: 10 minutes.
Overall Power Consumption now is (plugged to UPS Eaton 3S 550):
UPS Eaton 3S 550:   3,5W.
eSata drive active: 15,5W incl UPS.
eSata drive idle:     10,5W incl UPS.



--------------------------------------------------------------------------------------------
many thanx @michael.cubox,thirsty,rabeeh,dbsx,neofob


Last edited by chrisko on Sat Jan 05, 2013 6:10 am, edited 41 times in total.

Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Thu Dec 27, 2012 12:28 am 
Offline

Joined: Sat Dec 17, 2011 9:43 am
Posts: 217
Quote:
Best scenario would be to grant access from every device to the NAS with no hassle, if possible.

May help
http://www.spinifex.com.au/plugs/dphowtos.html#samba


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Thu Dec 27, 2012 4:12 am 
Offline

Joined: Tue Dec 20, 2011 9:55 pm
Posts: 41
@ chrisko: you can cross-compile with Linaro cross-compile tool.
It's very simple and fast. It takes about 2 minutes or less on my
machine with SSD.

The instruction for cross compilation is on solid-run wiki Building Linux
http://www.solid-run.com/mw/index.php/Building_Linux

To speed use more on machine with multicore, you can use -j[n], with
n is the number of cores. For my case, I use:
Code:
# make -j8


You can even speed up the process a bit with ccache (apt-get install ccache)
Code:
#export CROSS_COMPILE="ccache /usr/bin/arm-linux-gnueabi-"


To isolate the build environment, I use deboostrap and chroot to it to cross-compile
the kernel.

Some of this is on my blog at: http://blog.neofob.org/wordpress/?p=80


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Thu Dec 27, 2012 4:22 am 
Offline

Joined: Tue Dec 20, 2011 9:55 pm
Posts: 41
yawniek wrote:
@neofob
could you post more details about your tuning and test setup/params?
i only get around 600mbit with iperf and around 500 via samba, with almost full cpu usage.

using the latest archlinux linux-cubox kernel and 9k mtu.


on a side note: with all these gazillion cheap arm boards i wonder why no one made one with decent network, some satas and a multicore cpu.


I pushed my default config file on my github fork (branch CuBox-v3.5.7-neofob)

Pastebin:
http://pastebin.com/YY60Jfja

Save it to your linux src tree under "arch/arm/configs"
To generate the .config
Code:
#make cubox_neofob_defconfig


Top
 Profile  
 
 Post subject: Re: CuBox NAS
PostPosted: Fri Jan 04, 2013 1:11 pm 
Offline
User avatar

Joined: Mon Jan 02, 2012 5:34 pm
Posts: 110
Location: Czech Republic
nice guide chrisko. Please move it to solidrun wiki.

_________________
Please visit and update the Wiki
Use forum Search function


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 26 posts ]  Go to page Previous  1, 2, 3  Next

All times are UTC


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  


phpBB SEO