YottaByte Me

Big Data Computing on eBay:

There is an awful lot of data in need of storage. The U.S. Chamber of Commerce Foundation reported last May that 90 percent of the world’s data had been created in the previous two years. And…
Video Rating: 0 / 5

The ever competitive software product industry continues to witness new technologies like Big Data Analytics, Real Time Data Warehousing, Virtualization and Cloud computing, sweeping the market,…

Ajay Singh, Director of Technology Alliances at Hortonworks, talks with Ibby Rahmani from Nimble Storage about challenges in a big data environment. Learn mo…

This video illustrates how EMC Isilon scale-out network attached storage can solve Big Data challenges.
Video Rating: 5 / 5

Question by Metamatician: DAS, NAS, SAN – need help with increasing storage needs.?
First, a brief background. I’m only a regular guy and not a company! But I’ve been into computers all my life (since Apple II days) and worked for a decade after college in the IT field before I became disabled. Now I build PCs at home and like to try to stay up to date with ever-changing technology. Obviously, I don’t have an unlimited budget and it’s mostly a hobby, but it’s one of the things I most enjoy doing.

Ok, my question here. Lately I feel I’ve outgrown internal HDs, and that having multiple external HDs (even 1 or 2 TB models) is a bit cumbersome. I store a LOT of music, movies, television programs (mostly documentaries), and the like, in addition to my personal files like documents, programs, email, and so on. But the main space-consumer is video (Blu-ray quality or at least H.264, generally), and then audio (either Lossless or 320-bit CBR). Big libraries of video and audio chew through even large hard drives rather quickly.

Since “personal” class hard drives top out at 2TBs currently, I’ve just been adding more units… but at some point it becomes unwieldy and you run the risk of data loss with such a scheme, not to mention power management and performance. So lately I’ve been trying to learn about external boxes which house multiple drives, offer RAID 5 (say) redundancy+performance, give me the option to upgrade/expand as I go forward, and have their own power management and onboard processors to offload data management functions from my main machine, which I still use for games, the web, and productivity apps (mostly creative).

I’ve searched on terms like DAS, NAS, SAN, and so on, and I think I understand the basic players out there, in theory at least. What I don’t fully understand is what technologies/solutions are most appropriate to which price scale, and how easy or difficult they are to build and/or manage. Is it something I can keep at my home and is relatively easy to build partitions, configure RAID, replace faulty drives or PSUs? Or will it be offsite somewhere managed by a company and costing thousands of dollars?

The former is more what I’m after. I have about 10TB worth of external storage right now, but as mentioned before it’s a hodgepodge and not connected in any smart way. Backing up anything is up to me at the user level – not automated, no redundancy built in. I imagine a box of some sort which I can fill with off the shelf SATA drives from WD or Seagate, and that will power a single array which is both capacious and redundant enough to withstand drive failure. Bad drive is replaced, life goes on. Or, if I need to upgrade capacity, more OR bigger drives get inserted and the array can accommodate that dynamically.

I know I won’t have uber performance without some fiber setup or ultimate date protection without off-site hardware and fireproofing and so on, but I just can’t afford those types of “enterprise” setups. Like I said I’m a single dude just trying to manage a huge multimedia library – it’s my hobby and passion. I have a single powerful PC that I use and enough parts to make a few less-powerful ones, I use Windows 7 but I’m not stupid about Linux or any *nix, though I’m a bit out of date as I’ve not worked out in the field for approximately 6 years – a lifetime in computing, I know.

To sum up, I need to know where to start to educate myself and migrate into more robust and roomy data storage systems than what a typical PC user needs, yet I can’t afford the cost or manage the complexity of a full corporate, rack-mounted system like those I used to tend to back in the days from an IBM RS6000 running AIX and with full corporate support should I need it.

I need to be able to do this myself, to take that next step and protect my data from loss, index it for fast access, and all the rest, on not much more than a PC-user’s budget. I’d like to set things up as I said so that I can worry less about where everything is and whether it’s safe or not, and just have a relatively sizable vault of all my favorite movies, documentaries, tv shows, movies, concerts, and what have you at my fingertips, to enjoy when I want. The less fuss the better, and the cheaper the better, but NOT at the cost of compromising my data needlessly.

Sorry for such a long post but I don’t want an answer that is just a link or a wiki article about storage or something that doesn’t help me. Some actual good guides on how to proceed or answers from people who’ve made the transition I want to make are what I’m after.

Thank you very much ahead of time!
-Justin

Best answer:

Answer by Dangeroo
Justin – this from my experience. I went with a NAS box made by Infrant (now owned by Netgear). At the time I made my decision, I researched the hardware that was available at the time and the ReadyNAS NV+ was superior to everything out there at the time. I believe the NV+ set the bar. It was simple, robust, had very low power consumption, and shipped with Gigabit ethernet. Beefy power supply and a durable cooling fan.

There are a good number of competitors out now, but I would make the same choice today. The ReadyNas is still made and without drives, I’ve seen new ones for as little as $ 300. Same unit I paid $ 800 for 3 years ago.

Over time, I filled up NAS box and started swapping in drives that were 30% bigger, one at a time. It is time consuming and I wish I would have opted for an even bigger drive. This box WILL work with different size and brand drives, though I opted to keep the drives the same size and brand. Their X-Raid is pretty nice technology; very scalable. I use it with Macs, PCs and one Linux box.

The one caveat is to make sure you pick the drives from their compatibility list:
http://www.readynas.com/?cat=37

One of my brothers bought one of the cheaper knockoffs and he has had all kinds of data corruption problems.

Give your answer to this question below!

San Jose, CA (PRWEB) January 23, 2012

Infineta Systems, the first and only provider of WAN optimization systems for Big Traffic workflows, today announced that its Infineta Data Mobility Switch (DMS) was selected as a finalist for Storage Magazine and SearchStorage.coms annual Product of the Year award in the network equipment category. Infineta is one of six finalists to be selected by a panel of judges out of hundreds of entries.

Infineta Systems is the first networking company to develop and market commercial WAN optimization systems that accelerate inter-data center WANs running at up to 10Gbps wire speeds. Powered by its Velocity Dedupe Engine, the Infineta DMS delivers unrivaled levels of throughput and scalability. The DMS serves as a critical building block for enterprises grappling with Big Traffic workflows such as high speed replication and remote backup, and cross-site storage and server virtualization, and Big Data.

With enterprise data sets reaching aggregate volumes in the 100s of terabytes to petabytes, and storage needs doubling every year, there is a dire need for scalable WAN optimization solutions to accelerate the large volumes of data being transferred between data centers.

Unlike other WAN optimization solutions, Infinetas DMS can reduce traffic footprints at multi-Gigabit speeds while incurring only microseconds of processing latency. The DMS is the only WAN optimization solution capable of supporting the next generation of advanced data center architectures. With the DMS, for example, customers can easily turn a 1Gbps WAN into a virtual 5Gbps link, leading to increased network throughput and guaranteed bandwidth availability. Not only is the DMS able to significantly improve the performance for all Big Traffic workflows traversing enterprise WAN networks, it is also a financially sound investment, with a typical return on investment in a sub-year timeframe.

We are very proud and honored that Storage Magazine and SearchStorage.coms panel of judges have recognized Infinetas flagship product, the DMS, and its capabilities, stated Haseeb Budhani, Vice President of Products at Infineta Systems. This recognition underscores the leadership approach Infineta has taken in understanding how enterprise IT strategies around data protection, virtualization and Big Data are leading to Big Traffic issues on the WAN, and how next-generation WAN optimization solutions can address these Big Traffic challenges.

About Infineta Systems

Based in San Jose, California, Infineta Systems is a privately-held, leading provider of WAN optimization systems for Big Traffic. The companys patent-pending Velocity Dedupe Engine delivers unprecedented levels of throughput, scalability and bandwidth capacity to support critical machine-scale workflows across the data center interconnect. Its flagship product, the Infineta Data Mobility Switch, accelerates multi-gigabit BCDR (business continuity/disaster recovery), cross-site virtualization, and Big Data traffic. The company is backed by Rembrandt Venture Partners, Alloy Ventures and North Bridge Venture Partners. For more information, visit http://www.infineta.com.

Infineta, Infineta Systems, Data Mobility Switch, and Velocity Dedupe Engine are trademarks or registered trademarks of Infineta Systems, Inc., in the U.S. All other product and company names herein may be trademarks of their respective owners.

###

Find More Big Data Enterprise Press Releases