Thanks again for sending the Lockerstor, Marco! I learned a lot while making these two videos.

@@JeffGeerling We learned a lot from you too!

I think the most important aspect for me is software support. Synology offer I believe 7 years, which is the benchmark for me.

@@UKpostsGlobalAdminstrator Hi! We've only begun to retire our oldest products this year due to hardware limitations as they are 32 bit. They are 10 years old.

I'm not surprised at all that Jeff found plusses and minuses of both approaches. I'm really intrigued by the app support of the Asusstor. My home NAS has 10 drives. Maybe Asus can/will accommodate larger home solutions? Bottom line? I want both :D

The self-awareness is gold

Very true! And ECC RAM. Oh wait...

ZFS over packet writing raid0 Universal Disk Format SCSI DVD's ^_~

Did you just heart your own comment 😂. Anyway zfs has a trade off that nobody seems to talk about, they are all quite happy to brush it under the carpet, also if you loose 1 vdev everything is lost. Anyway good video

Obviously a long term project but was looking at SNAP RAID and if you can get it running on a Pi with low enough overhead it could be the real deal for Pi NAS OMV type storage.

We do appreciate the compliment!

I came to see what hoops one needs to jump through for the Raspberry Pi.

Heh... the estimate is a bit low :)

Bingo, we have a winner !

What is omv?

Of course it was cheaper. FFS the ironwolf drives alone makes this a stupid comparison video. Like comparing a 1960's beat up van to a current mustang.

@@bobsmith-qu2oq oh were the HDD specs that much different? I didn't watch the pre-built NAS part of the video and just assumed he bought similar drives

@@bobsmith-qu2oq , I thought he used the exact same drives?

any recommendations for the 1? finding something trustable which doesn't cost much/monthly is pretty hard

Not paying monthly is probably cheaper overall but might cost more upfront. Some ideas: - Take an encrypted disk to work and leave it in a drawer. - Give a nas box to family/friend and backup over the internet.

@@iainwade simple and easy. Never thought of that, thanks

Praise is always appreciated!

I'm considering doing a more in-depth video on backup and talking about that script later this year.

Yes! Please do!

​@@JeffGeerling I would love to hear your experience with Rclone. My current setup for satisfying the "3" and "2" in 3-2-1 is "Jenkins + custom rsync scripts". I chose Jenkins for visibility around scheduling and to handle cross-platform backups with its various agents. I'm still missing an automated solution for "1" and tend to sneaker-net that every so often.

@@T3hBeowulf I definitely need to do a video on rclone, it sounds like. It's pretty simple if you are okay storing your '1' backup in Backblaze, S3, S3 Glacier, or the like.

Those pesky kids running around :)

Life is good! 2020 was super not-fun but at least I could share some fun projects on the channel with all of you!

@@JeffGeerling Keep it up my dude, you're providing great content and have a very friendly and marketable face. That smile screams you love what you're doing.

@@sixforks6543 I'm having the time of my life :) Glad it comes through in the videos.

Thank you! We appreciate the compliment!

True. One risk is you might forget to even apply the changes 😅

The ASUSTOR does offer folder-level encryption (AES 256-bit, it looks like, though with limitations) and a LUKS option for 'My Archive' volume encryption (but not the main storage volume), and there is a LUKS full disk encryption plugin you can use on OMV. I haven't covered either but will be exploring these at some point. Best to have multiple layers of security (in case someone walks off with my drives!).

@@JeffGeerling thanks! Looking forward to when you do so! :)

RAID10 *can* experience a complete data loss if two drives fail at the same time (RAID10 is kind of a compromise between RAID1 reliability and RAID0 performance) . RAID6/RAIDZ2 will protect against that scenario. Let's do the math. Assuming an AFR (annual failure rate) of 3%, the chances that any one of the 4 drives fail is 12% pa (per annum=per year). How long will it take for you to fix the drive? Do you have a spare at hand, or do you need to buy it first? Will the NAS alarm you at 2 o'clock in the morning while you are on a party, and how fast can you return to the NAS whilst heavily intoxicated 😉? Let's assume that it will take 3 days for you to fix the issue (a few hours to react, wait until the shops reopen after weekend, plus the rebuild/resilver). The chances that 1 specific drive fails within these 3 days is ~1:4000, the chances that any one of the 3 remaining drives fails is ~1:1300. In a RAID10 scenario, there is 1 in 3 chance that the 2nd failing drive is the wrong one and complete data loss occurs (total chance 1:4000). With RAID6/RAIDZ2, this chance is reduced to 0. Considering the time it takes to resilver: when the NAS is under heavy load, it needs to decide whether resilvering or regular use gets prioritized (bother resilvering and regular use read off the three (or two) remaining disks). If the NAS prioritizes resilvering, it might become unusable for regular work, if it prioritized normal use, resilvering might take much longer - ultimately, it depends on how much faster the disks are than the network interface. However, the performance impact of resilvering must be addresses when planning the NAS, as the NAS will have to perform periodic scrubs, which have a similar performance impact. The math above dealt only with complete drive failures, nut localized surface defects. The scrubbing reads all the disks to find corrupted data, which is then corrected (ideally also alarming the admin that it had to fix some data because of some surface defects; the issue may be benign, but if a lot of "weak blocks" begin to appear, it might hint to wards an imminent drive failure). Resilvering (and scrubbing) under ZFS only considers the actual data stored on the disks. On hardware RAIDs (and some software RAIDs), resilvering goes through the whole disks, regardless whether there is any data or not. Scrubbing can be done on a OS level (since the OS where data sits)...or it's done via the "whole disk" approach, or (quite popular, but dumb) not at all. Likewise, initializing a new RAID array finishes immediately under ZFS, while other solutions require hours for that trivial task. I prefer ZFS for these reasons. TrueNAS (formerly FreeNAS) is available for free and runs on x86 platforms (so no Raspberry Pi support). Another downside if the "ZFS tax" - a ZFS RAID drive should be filled only up to 80% (to run at optimum performance). Of course, when it's just used as a data archive where writes are infrequent, and some additional seek times (in the case of spinning disks) are tolerable, you can go up to nearly 100%. A ZFS NAS is not as simple as one of the ready-for-use things intended for the home user. It allows the user to specify priorities and timing of scrubs and resilver operations vs. normal use, which is nice for me, but too technical for the average home user. My own NAS uses some cheap "old junk" mainboard, a few SATA controller cards and a few SATA enclosures with port multiplier built-in. The 32 spinning disks are organized in various volumes, some consisting of 4 disks (RAIDZ1, for less important data) and others consisting of 8 drives (RAID2, for data which I consider a bit more important). I use ZFS snapshots (taking a snapshot of a volume finishes immediately) to protect against accidental file deletion; with a cron job taking the snapshots at regular intervals (interval depends on how much the data changes and its importance). And, yes, on one of my 8 disk RAIDZ2 volumes, I once had 2 drives fail within a few hours. I had one spare at hand and needed to order another one. So, no data loss, but maybe I should have gone for RAIDZ3... And, like you mentioned: offline backups for the real important data. Apart from disk failures, fires and burglary are also real life threats.

sounds like good how to UKposts content to me

@@kingmasterlord Not really, I had to deal with tons of security stuff like directory traversal, injections and XSS and 99.9% of people watching don't know anything about this stuff. If they were to expose some ports on their home routers with badly secured web app, then some hackers, or most likely bots wold easily get access to their home networks... There's always a risk they'll forget to patch stuff that might enable remote code execution... In short, unless you really know what you're doing, don't do it... Building complex APIs needed for login and permission systems isn't easy, and securing it is a nightmare...

Any idea where to start (maybe topics to read) and futher to have similar built like you? Thanks..

@@khairulihsan8417 I'd honestly first start by building a simple API for reading files from the server, some routes like API/file/get/pathToFile, reading the target file and then thinking of securing it, so things like dir traversal protection and possibly locking the server to a certain directory, that would be its root

Hey there! If you have any questions at all. Let me know!

@@ASUSTOR_YT Marco, appreciate you reaching out to Jeff to make this happen. Cheers.

@@sunsun221 No problem! We continue to learn lots from these collaborations and the feedback you guys give us. Keep 'em coming!

The Pi does make a great 'found parts' storage device, as long as you have modest needs and don't expect it to do everything under the sun. Nice job keeping some older parts in operation and useful!

I haven't tried aggregation yet, but plan too soon. Right now my Mac's 10 GbE network adapter is being replaced :(

@@JeffGeerling good lick doing that. And great footage again 👏. Love it when a RPI is involved. 👍

Will not help with single copy stream at all if that is what you are looking for. It could help with multiple clients though depending on the hashing type configured for LACP (just IPs or also ports)

Actually, try DigitalOcean Spaces. They have a $5/250GB/Month + 1 TB traffic plan and it is S3 compatible. Restic, rclone and others can talk to it. I stuffed about 2 TB of deduplicated backups in there using both backup and the SFTP translator built into rclone.

Definitely an option. I did the calculations and found that the S3 Glacier option ended up being about 1/4 the cost of any other standard S3-compatible storage plan, plus I put a lot of faith in Glacier's data storage reliability. I have had to restore a few times (usually for some giant project I accidentally deleted locally and didn't realize it until much later), and the costs aren't bad if you're okay waiting a day or two for the download to start, and at a kind of slow rate.

@@JeffGeerling really depends on how fast the recovery should be and how much data you will download in such a situation. Traffic from any of the big clouds is very expensive. If you mostly just send data in and want to keep them for a long time, S3 Glacier is really good and likely the most reliable option and quite cost effective.

​@@JeffGeerling Thanks! Probably they store it on tape and the wait time is for the queueing. By the way, interfacing an LTO drive with the Raspberry would be an interesting video. Technically not a challenge now that you have a SCSI card attached :) But I wonder if the Pi can cope with the transfer speeds this requires - as some kind of periodic backup agent.

Thanks!

You have a lot more faith in my audience's analytical abilities than I do ;) Not a knock on the audience, but I just have to acknowledge a lot of people watching these videos are just at the very beginning edge of learning about the topics I cover.

@@JeffGeerling I'm sure there is a distribution of experience and knowledge and some will be coming in from the cold - to learn. Perhaps a video on risk in relation to backups. Might be dry, but I'm sure red shirt Jeff can help with that :) Regardless, whatever you provide Jeff, I'm always grateful for your videos. You are one of a select few content creators that provides exacting information and not regurgitated opinion, and I for one value that greatly.

@@BenMitro Definitely considering doing at least one (maybe series) on backup and data retention (targeted at home/small business use case). And thanks for the compliment-I figure there are about 1000 people on youtube reviewing products and listing specs. If I don't learn something, and by extension, teach something new, in each of my videos, I count it as a failure. There are enough 'LTT clone' channels here :)

Tape drives are underrated. Having offline storage that's decently fast to write, easy to transport and store, and high capacity... is nice.

About 2 types of media: Never use SSDs for long-term backup storage :) Optical disks, HDDs and tapes are ok, SSDs are not. These lose the cell charge over time, so when you want to access your office document archive of 2020 in 2024, you’ll find that the SSD is completely empty…

@@luziferius3687 That is what I have heard also. SSDs would be tempting to use because of their size.

@@JeffGeerling BUT ... keep in mind that tapes have more stringent environmental storage requirements than other types of media.

SSDs still get quite hot, so you'd need a fan, but yes, not as hot as HDDs, at least not high powered ones like these from Seagate. Also, except for the highest end SSDs, most don't require nearly the same maximum power draw as an HDD.

Thanks Jeff. I agree with your point in the video about not being easy to power down OMV to save electricty. Also the bulk of either the Asustor or Pi setup isn’t great. Definitely think there is a gap in the market for a small SSD box / setup that is low powered. This would help reduce the power consumption of not being able to put OMV into a low power sleep type mode.

@@keithmiller9665 An SSD-based 2.5" array like what Wiretrustee is building seems like it could be an ideal SOHO solution. Silent, only needs a fan at very low speeds, pretty light on power consumption, and fast enough to saturate a 1 Gbps network. I'm considering-once the Wiretrustee is released-building a small 2-drive RAID 1 NAS that I drop at another family member's house and sync to my local NAS via rclone/rsync. Just need to find a willing family member who's okay with me dumping a few gigs every night :)