Big Data News – 05 May 2016

Today's Infographic Link: The 10 Commandments of Typography

Top Stories

The team that developed Apple's Siri has a new type of artificial intelligence ready to help us do just about everything.

IT as we know it is on the brink of massive disruption. Enterprise IT groups will struggle to rebalance skills while vendors struggle for survival. How will your organization fare in the new cloud-centric world?

R 3.3.0, a major annual update to the R Language, was released earlier this week and is now available from your local CRAN mirror for Windows, Mac (OSX 10.6 or later) and Linux systems. (Or as…

As Hadoop becomes the primary data repository in enterprises, EMC is clearly looking for ways to stay relevant in those environments.

Metal Manufacturer Worthington Industries modernized shipping and inventory management using mobile apps.

We've covered both IoT implementation and how IoT is revolutionizing the retail customer experience, now it's time to look at the impacts of IoT for logistics and transportation, an industry that is already implementing connected systems and will continue to do so at a rapid pace over the next few years.

Chris Rasmussen discusses NGA's open source strategy, how contributing to open source is changing government partnerships, and the agency's cultural pivot toward a more unclassified future. By Chris Rasmussen

Most surveyed organizations revealed their data is not highly integrated as it moves throughout key customer channels such as the Web, smartphones and mobile devices.

A "transformational shift" is happening that underlies the need for a lot of CIOs to reset their priorities.

minds.ai, developers of a revolutionary scalable deep neural network training platform with dramatic acceleration performance, announced that it has set a new record in the time taken to train AlexNet Neural Network (NN). Training AlexNet is a well-known task used for benchmarking NN training performance. The new minds.ai benchmark achieved a wall clock training time of just 2 hours and 15 minutes compared to the previous best time of 12.5 hours.

In this special guest feature, John Sharpe, Director of Product Management for Iron Mountain's Data Management business, identifies five key differences between data backup and archive.

Box is launching a new offering aimed squarely at government customers in an attempt to get more public agencies to use its file storage and collaboration service. On Thursday, the company launched Box for Government, designed to make it easier for government organizations to deploy Box for their employees. That announcement was timed with Box receiving provisional authority to operate under the Federal Risk and Authorization Management program (better known as FedRAMP), a sign that the company meets key requirements for handling government data.

After months of awaiting details about the NHS and Google DeepMind partnership InfoQ gains insights into recent claims of widespread patient data access. By Dylan Raithel

The further we continue into the future, the more innovation we see. In fact, every year boasts more innovation over the previous year, specifically in the technology field. Such examples of overwhelmingly important tech advances are automobiles, airplanes, and even smartphones. But, it has been quite some time until the last realgame changing idea was brought to life. There have been some false alarms though. For example, it is true that cloud computing, on a macro level, significantly upgraded IT professionals' efficiency across the board.

New tools allow IT organizations to monitor and analyze their performance and implement security policies limiting access to Node.js modules.

Adam Coates, the director of the Baidu Research's Silicon Valley AI Lab, says don't fear artificial intelligence. Instead, look to it to save lives. He spoke at the InformationWeek Elite 100 Conference this week.

Delivering broad access to data and analytics to a diverse base of users is an intimidating task, yet it is an essential foundation to becoming an insights-driven organization. To win and keep…

IoT — It's all about the Data Billions of devices including everything from cars, homes, airplanes, apparels, parking meters, factories, oil rigs, heavy machinery, and wearables will be connected to the internet and more importantly will be interconnected enabling businesses to work smarter, faster, and more profitably. According to recent research from IDC, about 32 billion things will be connected by 2020, helping enterprises drive efficiencies and launch new products and services. While a lot of attention and focus up until now has been on the things or objects, Internet of Things (IoT) isn't going about the things itself or connecting these things to the Internet. IoT is really going to be all about data. 

Google Slides — can it displace PowerPoint? La GOOG hopes so, especially in education. The new features — currently rolling out on Android, iOS and the Web app — aim to make slide presentations more interactive. Audience members can ask questions and vote for which questions should get answered. That should give the audience something useful to do with their smartphones, rather than Googling ways to kill boring presenters. In IT Blogwatch, bloggers point a <airquote>LASER</airquote>. Your humble blogwatcher curated these bloggy bits for your entertainment.

To become leaders in their industries, companies are now massively investing in algorithms. The rise of algorithm is part of the larger trend involving the digitization of businesses. whether you are currently using SAP Predictive Analytics or are investigating what SAP has to offer in this space, SAPPHIRENOW 2016 (May 17-19) is the place to…

On Tuesday, my company, Mammoth Data, released benchmarks on Google Cloud Dataflow and Apache Spark. The benchmarks were primarily for batch use cases on Google's cloud infrastructure. Last year, Google contracted us to implement some use cases and extract user experience data points from people experienced in this field. As a follow-on, we did a benchmark for Google to see how its technology stacked up. Benchmarks are often a black art of vendor-driven deception. I've never worked with a company more concerned with avoiding that.

Marketing professionals, such as yours truly, use social-listening analytics tools in the hope that they reveal whether customers are likely to stay loyal, buy more stuff, and say nice things about our companies and products. What these tools reveal is how people might or might not be leaning in the aggregate, under the questionable assumption that social media users are a cross-section of the target population you're trying to engage. Even if your entire target market were on social media, you'd be ill-advised to accept social intelligence as an indicator of how individuals truly feel about your brand.

When people talk about Node.js powering the back-end web, they're often actually talking about Express. Just as jQuery and other frameworks smooth over the XmlHttpRequest work in the browser, Express.js works to make the experience on the server just as easy. In this Q & A, author Evan Hahn provides more context on Express and where it's going.

Machine learning is revolutionising how companies are capitalising on Big Data to develop their marketing strategies. While the term encompasses a broad spectrum of technologies and approaches, in a marketing context it can be used to improve targeting, response rates and overall marketing ROI. To put it simply, machine learning involves the automated analysis of large volumes of data — such as consumer spending habits and purchasing behaviour, as well as demographic information — and using a mathematical algorithm and a computer to identify patterns and trends. The algorithm then tests predictions based on historical campaign data and learns from the predictions it gets right. With time, these algorithms become highly accurate as more data from campaign results is added.

News this morning that Wayin, a digital marketing software company, is acquiring U.K.-based interactive marketing platform EngageSciences. This would be a humdrum sort of an event, but for one thing — Wayin was co-founded and is currently run by Scott McNealy, the famed founder of Sun Microsystems. Have no doubt about this: Despite claims of Silicon Valley and the tech industry generally being a meritocracy, the fact is that when an entrepreneur has been hyper-successful before, the odds are fairly good that success will be repeated. And no matter when, the press is always keen to hear stories about "the next gig" of these individuals.

Hortonworks (NASDAQ: HDP), a much-analyzed stock as the only pure-play Hadoop distributor that's public, reported $41.3 million in revenue for the first quarter of 2016, an 85 percent increase over the same quarter last year. Support subscription revenue during the quarter was up sharply from $13.1 million to $27.6 million, an increase of 110 percent compared to the first quarter of 2015, which was Hortonworks' first quarter as a public company following an IPO in late 2014. Professional services revenue accounted for $13.7 million in revenue, a 49 percent increase. While revenue was up, so were expenses for HDP. The company reported total expenses of $90.3 million, a 74 percent increase from the same quarter a year ago. Spending on sales and marketing accounted for $42.1 million, a 52 percent increase from a year ago, while R&D spending rose 48 percent to $22.2 million.

Lots to see on the Big Data Blog in April! Please take a look at the summaries below for something that catches your interest. Exploring Geospatial Intelligence using SparkR on Amazon EMR The number of data sources that use location, such as smartphones and sensory devices used in IoT (Internet of things), is expanding rapidly. This explosion has increased demand for analyzing spatial data. Learn how to build a simple GEOINT application using SparkR that will allow you to appreciate GEOINT capabilities.

At the 2016 ng-conf, Jeff Whelpley and Patrick Stapleton showed off Angular Universal, the ability to render an Angular app on the server. Often, there are a few patterns that Angular Universal projects run into. Whelpley and Stapleton show off how to deal with three of those patterns.

"There is no evidence that anybody has been converted by a pie chart." So said Martin Palmer, secretary general of the Alliance of Religions and Conservation, on BBC's Beyond Belief. He went on to say, "People are converted by stories, by narrative, by emotion, by an appeal to the heart." This was a discussion about climate change and the Pope's encyclical on the issue. Palmer's opinion is a serious indictment against those of us who try to use data to make change. As Palmer states, data analysis often doesn't drive the change we hope it will. Consider also the terrible Syrian refugee crisis affecting the Middle East and Europe. This tragedy had received a lot of attention from data journalists (e.g.The Economist back in January 2013), but the public didn't truly engage until we saw the shocking photo of the drowned toddler on the beach.

Widespread changes to implement online sales taxes would be a big deal.

Outdated practices may mean missing out on top talent. If a company is stuck on archaic processes, they risk facing costly consequences.




Oracle extended its reach into the industrial and analytics sectors this week with the acquisition of Opower, an energy analytics company and provider of cloud services to utilities in a deal worth about $532 million. Oracle (NYSE: ORCL) said it would pay $10.30 per share in cash for Opower (NYSE: OPWR), which is based in Arlington, Va. The acquisition is expected to close later this year. Oracle said the transaction is subject to some regulatory approvals. Opower's big data platform stores and analyzes more than 600 billion meter readings from over 100 utilities that include Pacific Gas and Electric (NYSE: PCG), Exelon Corp. (NYSE: EXC) and National Grid (NYSE:NGG). Exelon recently completed a controversial merger with the Maryland and Washington, DC, utility Pepco.

Interactive notebooks are experiencing a rise in popularity. How do we know? They're replacing PowerPoint in presentations, shared around organizations, and they're even taking workload away from BI suites (more on that later). Even though they've become prominent in the past few years, they have a long history. First notebooks were available in packages like Mathematica and Matlab, used primarily in academia. More recently they've started getting traction in Python community with iPython Notebook. Today there are many notebooks to choose from: Jupyter (successor to the iPython Notebook), R Markdown, Apache Zeppelin, Spark Notebook, Databricks Cloud, and more. There are kernels/backends to multiple languages, such as Python, Julia, Scala, SQL, and others.

Financial technology, or FinTech, applies to any novation in the financial areas including investments, retail banking, lending and many other segments. With the internet and mobile revolution FinTech has turbulently grown. There has been an enormous breakthrough in nearly every single aspect of the financial technologies. It gets more investments, media coverage and adoption as never before. Today I would like to focus on the role of Big Data when it comes to innovating the financial sector and I am going to describe the three uses of the data from the companies I am mostly familiar with.

Here are some reflections and key takeaways. Please note this is not exhaustive! I did not see every presentation.  A sign of a great conference is how torn attendees are between concurrent presentations. Good to note that PAWWF had this key indicator. I thought about building a model to help me with that decision. Then… The post Predictive Analytics World For Workforce Reflections appeared first on Predictive Analytics Times.

Contributed by Amy(Yujing) Ma. She took NYC Data Science Academy 12 week full-time Data Science Bootcamp program  between Jan 11th to Apr 1st, 2016. The post was based on her second class project(due at 4th week of the program). Recently, Amy just acquired her Master degree in statistics from Rutgers University, and decided to move to New York City for her job. Finding a right place is a tough question to her. Thus, she applied her data science skills and reachable data to solve this question!   Why Airbnb? Visiting NYC?  Airbnb is  a good choice to book unique accommodations.

Organizations of all sizes are looking for ways to make innovation a central part of their business approach. In this episode of the Finance in Focus podcast series our guests–futurist and award-winning author Lisa Bodell, and IBM thought leader Doug Barton–provide practical insights into how business can drive innovation.

Sensitive information comes in many forms of nonpublic and personally identifiable information. How do organizations protect this information from attacks, fraud, threats and other nefarious activities? Get insights from cybersecurity expert, Erik Rasmussen, who offers details about the nature of these threats and how organizations can minimize them.

Guest blog post by Bill Vorhies Summary: Self Service Data Prep Platforms (SSDPPs) may offer some relief for BI and data workers who must deal with IT bottlenecks in getting data. But watch out for widely varying capabilities and the assumptions underlying some of their automated features. I admit it, I'm confused. There is a category of analytic platforms that Gartner calls "Self Service Data Preparation for Analytics" that seems to group fish-AND-fowl and simultaneously fish-OR-fowl. Since I try to keep ahead of these things so that I can explain them to my clients I'm struggling with what's in and what's out in this category as well as exactly who should be considering it. There are multiple overlapping categories and exclusions and I'll try here to sort it out. Let's start with a common frame of reference, the major components of a full-fledged Advanced Analytics Platform.

As Director of Program Management for Azure at Microsoft, Corey Sanders heads the compute team which is responsible for the VM-based offerings on Windows and Linux, the new microservices platform, and container services, among other things. Sanders joined the Azure team about six years ago, before which he was a developer in the Windows Serviceability team.  Network World Editor in Chief John Dix recently visited Sanders in his Redmond, WA, office to get a better sense of how Microsoft's cloud business is taking shape. Corey Sanders, Director of Program Management for Azure, Microsoft 

At the first Mob Programming Conference a group of authors experimented with mobbing to write a news item about working in this way. This is the result. By Stephane Wojewoda in a Mob

This entry was posted in News and tagged , , , , , , , , . Bookmark the permalink.