USB's lifetime

Re: USB's lifetime

Nikola204 — Tue, 30 Dec 2025 03:58:14 -0600

Thanks again for help.
I'll try to configure everything I want on my current USB drive ant will left it as a "golden image". And after will try that schema with 2 partitions.

Re: USB's lifetime

bodhi — Tue, 30 Dec 2025 03:54:36 -0600

> Thank you for the detailed explanation. One more
> thing, is it possible to create 2 partitions on
> one USB drive? Like this, first one - /boot, and
> the second one is / ?

Indeed. 2 partition USB drive is the ideal set up. After you've create 2 partitions, the process is basically the same, but with the following requirements.

- The BOOT (or whatever name you choose) partition must be the 1st partition formatted as Ext3.
- The rootfs partition should be the second patition and formatted with F2FS. Populate the rootfs partition with the tarball Debian-6.5.7-kirkwood-tld-1-rootfs-bodhi.tar.bz2 (or Debian-6.6.2-mvebu-tld-1-rootfs-bodhi.tar.bz2) as before.
- Copy the /boot folder from the rootfs parition to the BOOT partition.

In the future, when you upgrade the kernel, you'll to copy the /boot folder to the BOOT partition again.

Re: USB's lifetime

Nikola204 — Tue, 30 Dec 2025 01:32:24 -0600

bodhi Wrote:
-------------------------------------------------------
>
> Later, after the NAS already run with the F2FS
> rootfs, you can remove all other files from the
> USB drive, except the /boot folder. Only
> the /boot is needed for u-boot to boot the kernel

Thank you for the detailed explanation. One more thing, is it possible to create 2 partitions on one USB drive? Like this, first one - /boot, and the second one is / ? Or there is no other chance, then 2 USB drives usage?

Thanks.

Re: USB's lifetime

bodhi — Mon, 29 Dec 2025 22:55:40 -0600

To boot with kernel on and Ext3/Ext4 drive and rootfs on F2FS rootfs.

Assuming you've already booted the USB drive on the NAS (with instruction in this forum). Shutdown.

On another Linux host. Attach both USB drives. Assuming the USB rootfs is assigned /dev/sdc, and the F2FS rootfs drive is assigned /dev/sdb.

1. Create new rootfs on the F2FS drive /dev/sdb1 (like you did for the USB drive).
2. Remove or rename the label rootfs fom the USB rootfs /dev/sdc1. For example, rename it to BOOT

e2label /dev/sdc1 BOOT

3. Label the F2FS rootfs

e2label /dev/sdb1 rootfs

Sync and unmount both drives

sync

Attach these 2 drive to the NAS. Power up the NAS, this time u-boot will load the kernel from the USB drive. But when the kernel boots, it will mount the F2FS rootfs.

==========

Later, after the NAS already run with the F2FS rootfs, you can remove all other files from the USB drive, except the /boot folder. Only the /boot is needed for u-boot to boot the kernel

Re: USB's lifetime

Nikola204 — Fri, 26 Dec 2025 11:43:10 -0600

Hi guys.
Could anybody provide me with step by step manual, how to deploy Debian 12 on USB drive with 2 partitions?
From what I understood, I have to create 2 partitions:
- boot ext3 with rootfs mark
- / with f2fs

How to configure everything properly?

Thanks in advance.

Re: USB's lifetime

bodhi — Wed, 26 Sep 2018 17:04:20 -0500

jelabarre59 Wrote:
-------------------------------------------------------
> I've thought, as an alternative, have a backup
> script which runs periodically to save out your
> USB stick's files to another location (or an HDD
> if you're hosting storage off your Pogo v4). The
> major issue would be how would you create a new
> USB to replace one that is dead/dying? It seems
> you can only create the configurations on the
> device they would be installed in. I would think
> there would be some way to format/build one on
> your standard Linux desktop/laptop instead, and
> swap it in (cloning might be obvious, but by the
> time you're replacing the USB, the capacity will
> be double of the old one).
>
> This has been a particular concern of mine, as I
> had a Pogo I had converted to Linux, and when the
> USB died (it lost power too many times and got
> corrupted) I had trouble getting it back up &
> running (I might never have gotten it fixed, I
> don't remember). It isn't like your standard
> desktop/laptop/server where you can stick in a
> bootable DVD and reinstall.

I am running USB rootfs on many plugs. Basically:

1. Take it offline, backup once to a tarball.
2. Run rsync daily to back up the live rootfs to a network folder.

When you need to recreate the rootfs, untar the tarball to a formatted USB, and rsync the backup folder to this new USB.

Re: USB's lifetime

jelabarre59 — Wed, 26 Sep 2018 15:08:18 -0500

I've thought, as an alternative, have a backup script which runs periodically to save out your USB stick's files to another location (or an HDD if you're hosting storage off your Pogo v4). The major issue would be how would you create a new USB to replace one that is dead/dying? It seems you can only create the configurations on the device they would be installed in. I would think there would be some way to format/build one on your standard Linux desktop/laptop instead, and swap it in (cloning might be obvious, but by the time you're replacing the USB, the capacity will be double of the old one).

This has been a particular concern of mine, as I had a Pogo I had converted to Linux, and when the USB died (it lost power too many times and got corrupted) I had trouble getting it back up & running (I might never have gotten it fixed, I don't remember). It isn't like your standard desktop/laptop/server where you can stick in a bootable DVD and reinstall.

Re: USB's lifetime

bodhi — Sun, 02 Sep 2018 14:33:14 -0500

Hi Koen,

> Would it be OK to use
> this internal memory as swap space or does this
> suffer from wear like the USB drive?

Yes it is the same since it is SSD.

Re: USB's lifetime

Koen — Sun, 02 Sep 2018 11:29:19 -0500

Hi,

I've recently changed my pogoE02 to a HP T5325Z and I've also started working on getting a Dell Wyse T50 to run Debian. Both the HP T5325Z and T50 have relatively large internal memory which is not being used anymore now that the operating system runs from the USB stick. Would it be OK to use this internal memory as swap space or does this suffer from wear like the USB drive?

Koen

Re: USB's lifetime

enki — Tue, 07 Aug 2018 13:04:35 -0500

Hello Everyone,

It's been a while! These days I had to replace 2 out of 3 usb flash drives. It took me a while to get up to speed with everything.

I had what they claim to be SLC usb flash drives but I haven't seen any difference. The drives were Mach Extreme (MX-LX and MX-ES) expensive but no more reliable than others. Pity.

Looked up on the internet for '5 or 10 years warranty usb drives' and put a reminder on calendar around 2023 to replace them if don't fail earlier. I found Duracell Memory Professional or Sandisk Extreme drives family, so for 5 years Duracell is just cheaper. I shall update when they fail.

It is a pain to replace everything but now at least all is up-to-date. I use 2.5inch WD RED as hdds in RAID config with no spin-down for 4-5 years almost and happy about this.

I shall look into using Debian busybox syslogd to log /var/log/messages to RAM as Bodhi have said for one of the GFNs and see any difference in usb drive's lifetime and update here.

Kindest Regards,

Re: USB's lifetime

DonCharisma — Mon, 11 Jun 2018 13:35:13 -0500

Dear bodhi,

Makes perfect absolute sense, thanks for clarity :)

Re: USB's lifetime

bodhi — Sat, 09 Jun 2018 16:29:22 -0500

Don,

The reason I did not choose zram was because it takes up a fix amount of RAM. These plugs typically has 128MB or 256MB. Armbian or Ubuntu usually installed on systems that have a lot for RAM, typically 1GB.

I chose zswap becasue it uses memory as it required, so it helps the 128MB RAM plugs.

>
> log2ram looks pretty easy to install, but hasn't
> been adopted as a package yet in Debian or Ubuntu.
> So Github - https://github.com/azlux/log2ram I
> believe this is the source of the built in log2ram
> in Armbian. The creator has created install
> /uninstall script which helps, and documentation
> he has on Github is OK.
>
> I'm just about to install log2ram, so don't know
> of any issues yet.
>

I use Debian busybox syslogd to log /var/log/messages to RAM. This is preinstalled on the basic rootfs I released. I have not explored log2ram so don't know the advantage over syslogd.

Re: USB's lifetime

DonCharisma — Sat, 09 Jun 2018 07:14:27 -0500

wow, an oldie but goody thread, was actually here searching for info on how to reduce flash writes again ...

I noticed Armbian have adopted zram for helping reduce swapping by compressing memory for a swap space, and log2ram for logging to memory, with configurability of when logs are flushed out to disk/flash ... Unfortunately, neither is in a standalone package, they are built into Armbian ... however ...

Ubuntu universe has zram_config package (0.5), which source can be downloaded, compiled and create a .deb for Debian system. Then just enable the systemctl, and start it. Can confirm that it seems to work ok. (Official Debian site has a link to zram_config on Ubuntu for systemd Debian installs.)

log2ram looks pretty easy to install, but hasn't been adopted as a package yet in Debian or Ubuntu. So Github - https://github.com/azlux/log2ram I believe this is the source of the built in log2ram in Armbian. The creator has created install /uninstall script which helps, and documentation he has on Github is OK.

I'm just about to install log2ram, so don't know of any issues yet.

Also, given limited memory on some of these ARM boards, I think either (or both) solution should be carefully tweaked and tested before "putting into production". In particular, the amount of memory allocated to either zram or log2ram.

Anyway, hopefully above helpful ...

Re: USB's lifetime

bodhi — Mon, 16 Apr 2018 16:57:40 -0500

bennytheben Wrote:
-------------------------------------------------------
> How many of these recommended tweaks are already
> enabled in your debian rootfs?

None of them are. The rootfs is a very basic rootfs. It meant to be Linux learning vehicle, you have to install things you need.

Re: USB's lifetime

bennytheben — Mon, 16 Apr 2018 14:55:50 -0500

How many of these recommended tweaks are already enabled in your debian rootfs?

Re: USB's lifetime

haridsv — Thu, 07 Sep 2017 04:14:10 -0500

bodhi Wrote:
-------------------------------------------------------

> It is mainly for the flash drives to avoid swappin
> g to flash. However, it could be useful for hard d
> rives also, if swapping is small and infrequent. I
> OW, if there are little swapping, it will stay in
> compressed space in RAM. But it is a tradeoff betw
> een RAM and CPU power. You'll be the judge.
>
> In servers operations, zswap is not recommended if
> the swap space is in HDD (there are signifcant swa
> pping going on with lots of daemon running that us
> e lots of RAM).
>
> zswap does not slow down CPU much at all. For plug
> s that has no SATA interface such as Pogo E02, zsw
> ap is really helpful (even with USB HDD attached,
> because of the inherent disk thrashing of USB prot
> ocol). For plugs such as GoFlex Net, with swap fil
> e on the HDD, I don't use zswap because SATA is fa
> st and buffered.
>
> BTW, I have most of the Kirkwood boxes in my farm
> (about 20, with 10-12 always running), so these ar
> e real world examples.

Thank you, appreciate the details. I am convinced enough to enable it.

Re: USB's lifetime

bodhi — Thu, 07 Sep 2017 01:04:26 -0500

> Is zswap recommended only when using a flash stora
> ge for swap, or is it also useful when swap is set
> up on a hard drive? Also, does enabling zswap put
> a significant toll on the CPU that is in Pogoplug
> E02?

It is mainly for the flash drives to avoid swapping to flash. However, it could be useful for hard drives also, if swapping is small and infrequent. IOW, if there are little swapping, it will stay in compressed space in RAM. But it is a tradeoff between RAM and CPU power. You'll be the judge.

In servers operations, zswap is not recommended if the swap space is in HDD (there are signifcant swapping going on with lots of daemon running that use lots of RAM).

zswap does not slow down CPU much at all. For plugs that has no SATA interface such as Pogo E02, zswap is really helpful (even with USB HDD attached, because of the inherent disk thrashing of USB protocol). For plugs such as GoFlex Net, with swap file on the HDD, I don't use zswap because SATA is fast and buffered.

BTW, I have most of the Kirkwood boxes in my farm (about 20, with 10-12 always running), so these are real world examples.

Re: USB's lifetime

haridsv — Thu, 07 Sep 2017 00:03:25 -0500

bodhi Wrote:
-------------------------------------------------------
> zswap compresses the swap in memory before needing
> to swap to disk.

Is zswap recommended only when using a flash storage for swap, or is it also useful when swap is setup on a hard drive? Also, does enabling zswap put a significant toll on the CPU that is in Pogoplug E02?

Re: USB's lifetime

bodhi — Wed, 06 Sep 2017 17:44:33 -0500

haridsv,

> Isn't it a good idea to set vm.swappiness to 0 so
> that swap is used only when it is absolutely neces
> sary, instead of being used as a page cache?

Not really. If you use a desktop on your plug such as XFCE, LDE, KDE, ...

Quote
http://forum.doozan.com/read.php?2,23630
Debian Desktop

XFCE desktop Pogoplug Debian

then swapiness should be set to 0-10 to help the UI more responsive. But for a server, that would make the response time for other apps worse when you are close to running out of RAM. Servers should be balance in swapping to keep it running at a consistent rate.

zswap compresses the swap in memory before needing to swap to disk.

>
> Is zswap already enabled by default or do we need
> to do anything?

You need to activate it in the kernel bootargs:

zswap.enabled=1

In the new u-boot default envs there is a custom_params varaible already at the end of bootargs. So you can set it directly, or use the uEnv.txt to activate it.

In Debian:

fw_setenv custom_params 'zswap.enabled=1'

Or in uEnv.txt

custom_params=zswap.enabled=1

Re: USB's lifetime

haridsv — Wed, 06 Sep 2017 11:40:32 -0500

Isn't it a good idea to set vm.swappiness to 0 so that swap is used only when it is absolutely necessary, instead of being used as a page cache?

Is zswap already enabled by default or do we need to do anything?

admin@pogoplug:~$ cat /proc/cmdline
console=ttyS0,115200 root=LABEL=rootfs rootdelay=10 mtdparts=orion_nand:1M(u-boot),4M(uImage),32M(rootfs),-(data)
admin@pogoplug:~$ dmesg | grep zswap
[    9.886230] zswap: loaded using pool lzo/zbud
admin@pogoplug:~$ cat /sys/module/zswap/parameters/enabled
N

Re: USB's lifetime

TEN — Wed, 04 Jan 2017 14:18:55 -0600

joebob2000 Wrote:
-------------------------------------------------------
> Is there a practical way to watch for failing drives?
> Is there a good tool for Linux to spot the count going up to preemptively change the drive?

Not exactly, but unlike SMART,
to test the (remaining) free space both initially and occasionally,
there is http://oss.digirati.com.br/f3/
as a native (unixoid) remake
of Heise.de's H2test(w) for (Win)DOS.

Over the past decade at least, I have committed no USB or SD to "production" here without a full test cycle under one of the above, and (besides forgeries) caught many that were faulty fresh-from-factory.

Re: USB's lifetime

Termo — Thu, 01 May 2014 07:42:33 -0500

I to have thought a bit about this topic, and recently I fell over this small script:

http://www.nohl.eu/tech-resources/notes-to-linux/log-files-in-tmpfs-without-breaking-logging/

The last post is for debian. Maybe Bodhi could implement this in future rootfs builds?

Regards

Re: USB's lifetime

shv — Sun, 20 Oct 2013 02:06:26 -0500

There is an interessting discussion about flash memory wear out of SD cards with RaspberryPi: Link.. They recommend to use the fstrim command so that unused blocks become available for wear leveling.

It seams that there might be USB3.0 sticks available which support trim: Link. With the tool TRIMcheck it can be tested if a drive supports trim: Link. If you have a Windows PC where you know that trim is working e.g. with SSD you could try to test USB stick as well.

The problem is not just wearing out of USB flash memory drives but also slowing down write operations if each write needs an erase before.

Re: USB's lifetime

joebob2000 — Tue, 15 Oct 2013 09:17:11 -0500

Is there a practical way to watch for failing drives? Like SMART for flash? The wear leveling is entirely internal to the flash drive, but doesn't it report "bad" or "unusable" sectors to the OS? Is there a good tool for Linux to spot the count going up to preemptively change the drive? One thing that comes to mind in terms of partitioning swap and maybe all of /var/log (if a HDD isn't an option) is to just put a second small cheap flash drive in (we all have a dozen or so of those 1gb or less with no use anymore, amiright) and let it fail; when it fails just toss a new one in. But, if there is no good way to tell when the drive is failing it might be just as troubling to have the unit hang even if the main data is safe.

Re: USB's lifetime

eas — Thu, 10 Oct 2013 21:23:10 -0500

I have a couple Mushkin Mullholland 8GB USB sticks I've been using for two years without fail. I haven't babied them. I haven't bothered with having syslog write to RAM. I have SWAP on the stick. I don't even think I've totally disabled atime. What I did do though, is only use 50% of the storage space.

Re: USB's lifetime

funtoy1001 — Mon, 07 Oct 2013 09:43:26 -0500

Any personal experience on how long a life a USB stick lasts? I think mine is over a year or two already.

Re: USB's lifetime

shv — Sat, 05 Oct 2013 02:47:45 -0500

Maybe a flash stick with SLC flash cells is recommended even it is more expensive. Some additional hints need to be regarded. It is more or less the same as for SSD usage. To prevent wear out of certain flash areas only one partition over the complete Flash memory shall be used. The partition shall be aligned to the Flash sectors. I don't know how to find out the right alignment for Flash sticks. Moreover the Flash controller in the stick must have a good wear leveling function to prevent wear out of certain flash regions. Because just one partition is available a swap file must be used.
I am not sure if TRIM is supported with USB sticks. If not invalid flash pages are deleted with a garbage collection function of the flash stick.

Many problems with TRIM, garbage collection and wear leveling occured with certain SSDs in the past. Thay were sometimes resolved by firmware updates. Therefore we can expect that there such problems also occure with USB sticks. But I didn't see any firmware update for USB sticks.

- shv

Re: USB's lifetime

bodhi — Fri, 04 Oct 2013 16:56:48 -0500

Sandisk Fit is a real good choice! I've been using 4G Sandisk Fit ext3 rootfs for my 2 media NAS for about a year. Swap file is on an attached Ext3 HDD. So far it has survived about 5 power outages. Booted right backup as if nothing has happened.

Re: USB's lifetime

DonCharisma — Fri, 04 Oct 2013 16:10:29 -0500

enki,

bodhi I know is an "expert" in these parts, so I reckon he knows what he's talking about.

I've tried to install Ubuntu on SD memory card before and that didn't work out too well. I thought I'd broken the memory card, but when I formatted it back on FAT/FAT32 it was fine. I read somewhere that SD cards are designed to work FAT formatted and don't like other file systems. I've tried different SD cards and results were the same/similar. The only common factor was the reader/writer USB unit, it's possible that this is the problem and a different unit would work OK.

For USB sticks, I only have had Sandisk Cruzer and Cruzer fit, and they seem to work OK, although I'd err to the side of the standard Cruzer (not the Fit). There may well be other brands and models, but I just don't have any experience.

If you're going to use Flash stick persistently, then my suggestion would be get the install how you want it, then pull the stick and duplicate it on a Desktop machine (double sure take an image of the rootfs). Keep the backup stick handy for when it gives up. Obviously if you're making major changes then you need to do the copy procedure again.

Another option would be to go the Embeded Debian on your Pogoplug/Goflex, I think that built in flash is faster than the USB and it's more likely designed for heavier usage. There are posts on the forum about how to do this.

One last option I know there is a company in UK called linitx, they sell industrial flash drives, presumably those bad-boys will last a lot longer.

Cheers

Don Charisma
http://DonCharisma.com

Re: USB's lifetime

bodhi — Tue, 01 Oct 2013 00:39:26 -0500

To prolong the life of your rootfs USB thumb drive:

1. Use busybox-syslogd to log to RAM.
2. For each package you installed, either specify the log file in /tmp. Or overmount the log files to /tmp (mount -o bind).
3. Use a swap file so you can create it on an attached HDD. And create one on flash drive in case the HDD is not attached. Use a script to detect if the HDD is present during boot. If it is not then switch to the USB thumb swap (this should not happen, so it is just a precaution).
4. Watch the swap if it is on USB thumb. There should be no swap needed. If seeing swap actvities then always use the HDD to handle swap.
5. Use iotop command to watch frequent disk IOs (to figure out which log files needed to be moved or overmounted).
iotop -o -b -qqq
6. Use zswap if the kernel supports it.

With all these remedies, you can use Ext3 for the USB rootfs on a thumbdrive to prevent corruption during power outage.