Ask HN: Using 5-drive RAID 0 array as another cache layer
1 comments
You're way off the deep end here. An SSD would probably be faster and more reliable as a boot drive than your RAID-0. In fact, your RAID-0 is probably no faster than RAID-5 in most cases, but it's obviously more dangerous.
For your backup needs, it sounds like continuous data protection is what you're looking for.
There are two (announced) SSD cache drivers for Linux: http://github.com/facebook/flashcache and http://lkml.org/lkml/2010/4/30/496
For your backup needs, it sounds like continuous data protection is what you're looking for.
There are two (announced) SSD cache drivers for Linux: http://github.com/facebook/flashcache and http://lkml.org/lkml/2010/4/30/496
The RAID 0 I use for OS, applications and games while the RAID 5 I use as a more-permanent type storage (photos, projects, etc). Now I do realize that running the OS and applications on RAID 0 across 5 drives is very dangerous, which is what brings up the following question.
Is there a reliable freeware realtime backup application that can backup a set of folders from one drive to another drive (no online backups needed)? I've already tried a few (Mozy, Yadis, Comodo Backup, GFI Backup, Idoo, Crash Plan) but none meet my requirements:
- Low CPU and RAM usage.
- Realtime Backups: as soon as a file is modified in the source folder, it is added to the backup queue which will be processed with the lowest priority when the CPU is idle. This backup queue should persist in cases of computer restarts and crashes (ie: the source and destination folders should always have the same set of files, except for the ones waiting in the backup queue).
- Incremental Backups: if only 10 bytes changed in a 1GB file, the app should only copy those 10 new bytes.
- Ability to back up locked and opened files (some apps, like Yadis, can't back up critical files like browser favorites).
- Ability to run as a service (no need for any user to log-in to have the app started).
Optional requirements:
- Compression of the destination into a well-known format (RAR, Zip) that can be directly read without the use of the application.
- Preset source folders (such as Browser Favorites, Game Saves, Application Settings, etc).
The idea is to use RAID 0 array as "semi-persistent RAM-like" storage which in case of a failure can be quickly rebuilt by reinstalling the OS, apps, games and copying over the settings, saves, favorites from RAID 5. I'm also thinking of taking this RAID 0 as RAM idea to the extreme with SSDs (as soon as we get some nice 6Gb/s SATA III SSDs out there), where a couple of SSDs chained in RAID 0 will work as yet another semi-persistent cache layer sitting between the RAM and the HD and serving all file requests for the OS, games, apps, etc.
Ideally, I need an application (or a loopback driver) that would convert any disk volume into a write-back, read-through cache backed by another disk volume as permanent store. If such an application doesn't exist, I'm thinking of writing one.