YottaByte Me

What's in Store for Big Data in 2016?
Spark will kill Map Reduce, but save Hadoop. Map Reduce is quite esoteric. Its slow, batch nature and high level of complexity can make it unattractive for many enterprises. Spark, because of its speed, is much more natural, mathematical, and …
Read more on ADT Magazine

Kudu and the Ongoing Evolution of Hadoop
In other words, Cloudera has a full-fledged alternative to the Hive/MapReduce/HDFS stack with Impala/Kudu, offering new capabilities, improved storage, improved performance, and a simplified architecture. This is huge, and just another indication how …
Read more on Data Informed

Data isn't going big, but AI is
According to Foote's survey of more than 200,000 IT workers in the U.S. and Canada, pay premiums for 31 noncertified big data skills (such as Hadoop, MapReduce, Hbase, Hive, NoSQL, data mining, and base SAS) fell an average of 3 percent in over the …
Read more on Tech Page One

Vormetric Partners with Hortonworks to Protect Enterprise Hadoop Big Data …
Vormetric enables application developers to encrypt sensitive data in order to have final granularity of security, Kamaraju said. “We offer our portfolio of solutions in the data security and protections space across a diverse set of applications for …
Read more on Database Trends and Applications

Cloudera Deepens Integration of Spark with Hadoop
Cloudera, focused on big data and Apache Hadoop, has announced that it has further matured Apache Spark integration within Hadoop environments. Spark and Hadoop are both flourishing on the big data scene. To further expand the enterprise capabilities …
Read more on OStatic (blog)

Spark speeds up SQL on Hadoop in Splice Machine 2.0
Also on InfoWorld: Apache Hive brings real-time queries to Hadoop as the perfect partner for an enterprise data warehouse. | Cut to the key news in technology trends and IT breakthroughs with the InfoWorld Daily newsletter, our summary of the top tech …
Read more on InfoWorld

Wikibon survey shows Hadoop making steady progress
The 2015 edition of the Wikibon Big Data survey shows companies making steady progress in adoption of Hadoop and associated technologies, writes Wikibon Big Data Analyst George Gilbert. In the 18 months since the last survey, the number of survey …
Read more on SiliconANGLE (blog)

Looking at Spark from a Hadoop Lens
Considering Hadoop and Spark is not an either-or question. Many companies use both frameworks, especially if there is an existing Hadoop installation. Spark is quite data agnostic as it can access data in HDFS, Cassandra, HBase, Hive, Tachyon, and any …
Read more on insideBIGDATA

IBM Secures Hadoop in Analytics Cloud
IBM has added end-to-end data protection to IBM Cloud Infrastructure for Analytics, its cloud-based offering designed to ease the significant investment burden required for implementing homegrown, on-premises Big Data solutions. Called Secure Hadoop …
Read more on ADT Magazine

Cloudera's Kudu: Like HDFS and HBase in one
Hadoop vendor Cloudera is preparing its own Apache-licensed Hadoop storage engine: Kudu is said to combine the best of both HDFS and HBase in a single package and could make Hadoop into a general-purpose data store with uses far beyond analytics.
Read more on InfoWorld

Harley-Davidson Given Consensus Recommendation of "Hold" by Brokerages (NYSE:HOG)
Harley-Davidson, Inc. is the parent company for the groups of companies doing business as Harley-Davidson Motor Company (NYSE:HOG) and Harley-Davidson Financial Services (HDFS). The Company operates in two segments: the Motorcycles & Related …
Read more on Dakota Financial News

MapR 5.0 Brings Real-Time to Hadoop Big Data Apps, Searches and More
MapR Technologies' latest update to its Hadoop distro delivers a new level of real-time capabilities to big data apps. Notably, MapR 5.0 supports access to transactional data by auto-synchronizing storage, database and search indices. IDN speaks with …
Read more on Integration Developers

LinkedIn open-sources its Groovy Gradle plugin for Hadoop
Hadoop has gotten itself another big-name contributor in the shape of business-oriented social network LinkedIn Corp., which has just made the LinkedIn Gradle Plugin for Apache Hadoop available on GitHub. LinkedIn's Gradle plugin was designed by the …
Read more on SiliconANGLE (blog)

Take measured steps to build a Hadoop cluster architecture
What's needed is a focused approach, with measured steps being taken to deploy and expand a Hadoop cluster architecture, according to Raheem Daya, director of product development and manager of the Hadoop platform at RelayHealth, a McKesson …
Read more on TechTarget

Just How Deep is the HPC, Hadoop Chasm?
There has been a great deal of investment and research into making HPC speak Hadoop over the last couple of years. The basic assumption is that if powerful high performance computing hardware can be harnessed to pull Hadoop and MapReduce …
Read more on The Platform

Does InfiniBand Have a Future on Hadoop?
Hadoop was created to run on cheap commodity computers connected by slow Ethernet networks. But as Hadoop clusters get bigger and organizations press the upper limits of performance, they're finding that specialized gear, such as solid state drives and …
Read more on Datanami

DataTorrent tackles complexity of Hadoop data ingestion
Working as a component within a Hadoop platform, dtIngest can work with both streaming and batch data. It can exchange data across a variety of file systems and protocols, including NFS, FTP, the Hadoop File System, Amazon Web Service's Simple Storage …
Read more on Computerworld

Yahoo struts its Hadoop stuff
We've heard a lot lately about how Hadoop has stalled. Matt Asay recently cited a Gartner report describing demand for Hadoop as "fairly anemic," while in March InfoWorld blogger James Kobielus pointed to a "puny adoption rate." The problem is, to get …
Read more on InfoWorld

Hadoop 101: Simplifying MapReduce Development
hadoop-101 Learning a new development framework takes time, and, as is well known, the Hadoop platform is no exception. MapReduce developers face a steep learning curve when first deploying and configuring a Hadoop cluster and later when verifying …
Read more on insideBIGDATA

Actian DataFlow, the Little Hadoop Engine That Could, But Probably Won't
In Hadoop's ecosystem of massively parallel cluster computing frameworks, Actian DataFlow is an anomaly. It's a powerful little engine that thinks it can take on any data processing problem, no matter the scale. The trouble is that unlike MapReduce …
Read more on Smart Data Collective

Spark 1.2 challenges MapReduce's Hadoop dominance
The first is to shed the straitjacket created by legacy dependencies on the MapReduce framework and move processing to YARN, Tez, and Spark. Gary Nakamura, CEO of data-application infrastructure outfit Concurrent, believes the "proven and reliable" …
Read more on InfoWorld

Pentaho Eyes Spark to Overcome MapReduce Limitations
Pentaho today announced it's supporting Apache Spark with its suite of data analytic tools. While supporting Spark gives Pentaho performance advantages over MapReduce when executing data transformations and running queries within Hadoop, the …
Read more on Datanami

The evolution of the big data platform at Netflix
It has also come a long way from a map-reduce execution engine to a resource management system that can host different data processing engines. My favorite Netflix OSS project in the big data space is Genie. Genie helps abstract the details of running …
Read more on opensource.com

Big Data: 6 Real-Life Business Cases
Here are six examples of how major enterprises are using data to improve their business models. … A 2014 Gartner survey found that 73% of respondents had invested in — or planned to invest in — big data in the next 24 months, up from 64% in 2013.
Read more on InformationWeek

HP Launches HPC & Big Data Global Business Unit
HPC will live within HP Enterprise, but perhaps surprisingly not by itself. Instead HPC is being combined with Big Data into a single global business unit, HPC & Big Data, created in March and led by longtime SGI executive and recent HP import, William …
Read more on HPCwire

Hadoop and Big Data Storage: The Challenge of Overcoming the Science Project
About two years ago, I started talking to Fortune 500 companies about their use of tools like Apache Hadoop and Spark to deal with big data in their organizations. I specifically sought out these large enterprises because I expected they would all have …
Read more on Data Center Knowledge

Healthcare Big Data Analytics Driving Billions in Market Growth
Healthcare is at the center of massive predicted growth for the big data analytics marketplace, according to a series of market reports, with cloud computing, mHealth, and computer assisted coding technologies fueling significant investment in the …
Read more on Health IT Analytics

Intel's eASIC partnership boosts custom Xeon chips for big data workloads
Intel has agreed a deal with eASIC to develop a new breed of customised Xeon chip designed for specific workloads like security and big data that can cut the time-to-market for chips in half. The collaboration is part of Intel's plan to get …
Read more on TechRadar