Big Data News – 9 Nov 2015

Top Stories
Giadha Aguirre DeCarcer saw the data powering big-money decisions to back private companies or consider public buyouts and wondered why there no one was doing the same for the legal cannabis industry. The one-time investment banker and consultant began attending the sector’s budding event circuit, pitching a Bloomberg for cannabis data. Her Washington D.C.-based startup, New Frontier Financial, began to publish reports assessing regional opportunities, upcoming legislation and the impact of looming price changes. Lawmakers, cannabis entrepreneurs and, increasingly, mainstream investors started to buy in to DeCarcer’s data. “We’ve been right enough times to build a solid reputation,” DeCarcer says.


The worldwide market for big data technology and services will grow to $48.6 billion by 2019, driven by wide adoption across industries, according to a new study from International Data Corp. (IDC).


Unlike defunct Flu Trends, the model is self-correcting and close to reality.


You may already know that every time you go online, your browsing history could be exposed to numerous advertisers and data brokers who then send you “targeted” advertisements. But what about visiting the news websites you trust most? Our current research finds that browsing news-related websites actually exposes you to over twice as much tracking as the rest of the web.


[Editor’s Note: BigDataScience.Info collects only non-indentifying statistical data. Our advertising comes from Google Adsense (which uses DoubleClick). We use no other third-party trackers. We are completely ad supported. We believe in privacy and will never sell any data about you.]


Every startup entrepreneur, at some point in the life cycle of their venture, dreams about franchising, having millions of customers and going public or going global. If those ideas are in your head — especially the part of having millions of customers — there are some marketing concepts and ideas you should be thinking about too.


As Nokia closes its acquisition of Alcatel-Lucent, Ericsson and Cisco this week announced a tight partnership to jointly address enterprise, service provider and Internet of Things opportunities. The companies outlined a broad, multi-faceted relationship that’s been 13 months in the making — perhaps around the time both companies caught wind of Nokia’s plans to acquire Alcatel-Lucent, two companies Ericsson and Cisco compete directly against. The deal comes as other mega-mergers consolidate the networking and IT industries, such as Dell’s plan to acquire storage titan EMC.


While public cloud adoption is expected to continue to grow at a rapid pace, it’s clear that many organizations still aren’t on board.


Microsoft announced Monday that it has made a deal to acquire Secure Islands, an Israeli company that focuses on protecting companies’ data. Neither company disclosed the terms of the deal. The acquisition will help Microsoft level up its Azure Rights Management Service, which lets companies protect files individually and in bulk with tools that ensure they aren’t opened or modified by people who are unauthorized to do so. Secure Islands’s services include data classification technology that automatically detects the creation of new files from a variety of sources and then applies a protection policy to it., the maker of a leading open source machine learning platform for building smarter applications, today announced the close of a $20 million Series B funding round.


Automated business intelligence can provide business users faster, more accurate insights into an increasingly overwhelming amount of data.


In yet another sign of the rise of machine learning, today announced the close of a $20 million series B round of funding, bringing its total funding to $34 million, and giving it additional capital to grow its sales, marketing, and customer support operations. H2O (which changed its name from 0xdata last year) is one of a number of software companies aiming to simplify how customers use machine learning technology.


Microsoft’s new facial recognition tool is out to judge your facial hair. The machine learning-based project comes just in time for Movember. The website, called, is designed to guess a person’s beard length. Facial hair is reviewed and rated as either “nostache,” “getting there,” or “ultimate mo.” Here’s how Microsoft describes the project: We started with a simple question, “What if we could use machine learning technology to detect the length of facial hair?” Many hallway jokes, brainstorming sessions, and mockups later, our early ideas have been realized far beyond our initial expectations. is run by the Microsoft Garage Project — the same group that brought us the meme-worthy website


Usage of containers and Kubernetes has been on the rise in app dev and testing environments. But work needs to be done to make them easier to consume.


Read about an algebraic equalizer that solves a big data analytics challenge.


Naturally, you wouldn’t refuse to collect $1,000 you’d already earned, would you? Then ask yourself, is your organization taking the opportunity to profit from its own accumulated Big Data? If you haven’t started leveraging your customer-facing, transactional, or operational data, now is an excellent time to start. The world of business has never been more competitive.


Business leaders should have access to all relevant information before making decisions. This ensures insightful, educated choices — not short-sighted mistakes. And in the twenty-first century, those insightful choices need to include data derived from the Internet. We just wrote a post explaining how open source intelligence (OSINT) solutions help companies around the world achieve…


List: MS CEO Satya Nadella will address a London audience on Tuesday – what can we expect?


Most organizations claim to support it, but actions speak louder than words


VB WEBINAR: This webinar is now available on demand. Watch right here for free. Trying to stay current with marketing strategies in a mobile-first world can make you feel like you’re running a marathon with no goal in sight. No wonder marketers are fatigued, especially in trying to nail the delivery of relevant and personalized experiences to users who are just as valuable to your competitors as they are to you.


John Schroeder, CEO and co-founder of MapR Technologies, and newly hired COO and president Matt Mills recently sat down for an interview with Datanami. Here’s part two of our chat. To read part one, see Datanami: So many big data roads point back to the need for better data governance. What is MapR’s strategy there? John Schroeder: We approach it more as a company issue, not a big data issue. They’ve got many terabytes, petabytes of data across platforms, new ones like MapR’s and legacy ones.


One Is Easy; a Trillion Is Rather More Difficult Not all data is equal. Event data has particular qualities that differentiate it. Specifically, the concepts of chronology and causality make it especially interesting for analysis. The challenge is that in order to definitively answer the question, “Why did X happen?” you will need to look at all the circumstantial data leading up to the event.


This is a calendar of special topics that will be covered on IT Business Edge in 2016. Our coverage will not be limited to these topics.


Three of four architects strive to make their firms data driven. But well-meaning technology managers only deal with part of the problem: How to use technology to glean deeper, faster insight from…


As IT environments become more complex to manage, IT organizations are overwhelmed by event alerts.


Tableau CEO Christian Chabot recently dismissed the threat of Amazon in the BI space. But, it’s very, very real.


Analytical data processing is arguably growing into one of the most important facets of the businesses world. The once esoteric world of “Big Data,” is quickly becoming commonplace, and companies of all shapes and sizes are harnessing the power of data analytics to glean insight and make better informed decisions about their business.


Startup Taste Analytics came out of stealth mode last week with a cloud-based, textual data analytics product called Taste Analytics Signals. It’s aimed squarely at data democratization – making both structured and unstructured data usable by just about anyone, without a data scientist’s intervention.


Betterment, the online automated investing service, uses R for modeling, analysis and reporting. In a recent blog post on the company website, data scientist Sam Swift suggests using R or Python as open data analysis platforms and goes on to reveal: Here at Betterment, we use both. We use Python more for data pipeline processes and R more for modeling, analyses, and reporting. But this article is not about the relative merits of these popular modern solutions.


Betterment, the online automated investing service, uses R for modeling, analysis and reporting. In a recent blog post on the company website, data scientist Sam Swift suggests using R or Python as open data analysis platforms and goes on to reveal: Here at Betterment, we use both. We use Python more for data pipeline processes and R more for modeling, analyses, and reporting.



Companies are looking beyond desktops and tablets


In an age when shareholders can’t see past this quarter’s returns, perhaps we shouldn’t be surprised that big data analytics are, by and large, focused only as far in the future as the end of our companies’ metaphorical noses.


Corporate elevators are awkward. What a good place to spark innovation!


IBM Cloud Services announced two new features for developers last week: Active Deploy and Event Hub services on IBM Bluemix. Active Deploy enables developers to update cloud-based apps with no service disruption. Event Hub is in beta and aggregates multiple event streams while also keeping the data organized separately.


The company’s Head of Innovation discusses how they are getting ready for the future


Unity, an academic cloud-based platform for collaboration in universities and research, has been informally referred to as the Facebook of Academia in certain circles. But that moniker is way off the mark as its capabilities are far beyond a mere Facebook connotation. While it is popular within university walls, now new features are tying those universities together into a giant global network of researchers and research data.


Analytics is making a big impact on the industry


We ask the International Tennis Federation about its uses


As more companies turn to cloud computing, and use the same applications available from a specific cloud provider, there could be danger of losing elements of competitive advantage wrought by technological advances.


We asked attendees at a conference on NoSQL databases about the challenges faced by software users. Their responses explored issues with scalability, data modeling and analytics.


In anticipation of the forthcoming Revised and Updated, paperback edition of Eric Siegel’s Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die (coming January 6, 2016–preorder today), read here its Foreword by Thomas Davenport, which reviews the book and puts a revealing perspective on the topic. Eric Siegel’s book–Predictive Analytics: The… The post Most Swans are White: Living in a Predictive Society appeared first on Predictive Analytics Times.


Lexalytics®, a leader in cloud and on-prem text analytics solutions, announced that it is simplifying customer experience management in the hospitality industry with its new Industry Packs. With the Hospitality and Restaurant Industry Packs, Lexalytics customers leading social media marketing, customer experience management, and voice of the customer campaigns in the hospitality and restaurant industries.


In this special guest feature, Denny Lee of Databricks, talks about the versatility of Spark – essentially comparing it to the Swiss Army Knife of on your camping tri”p, called” Big Data/Analytics.


Monday, Software AG announced the 9.9 release of its Apama Streaming Analytics platform. The new release comes packed with predictive analytics and new support for Internet of Things industry standards added.


In order to appeal to today’s consumers, marketers need to understand behaviors and preferences at an individual level. But with the continued proliferation of smartphones, tablets and other devices coupled with an explosion in the types of digital channels available, it’s becoming harder and harder for marketers to keep up.


This is a great time to be involved in the ever-changing world of data and analytics. It’s fast-paced and exciting, with new technologies and solutions continuing to alter the landscape. As database technology continues to experience dramatic and constant improvements, data warehousing responsibilities have undergone a similar evolution to keep pace. While a lot has been written about the role data scientists play in turning data insights into opportunities, database administrators (DBAs) also provide significant contributions to the business.


Draft Redpaper, last updated: Mon, 9 Nov 2015 Decision making is a critical function in any enterprise.


The company that made your smartphone is no longer a hardware manufacturer. It has become adept at harvesting and managing data from it users, too. Every device has a series of sensors, as well as a user login and an account where data is stored.


American Express Global Business Travel was saddled with 16 different legacy on-premises ERP systems. Rather than update, the $1.5 billion company ripped them out and replaced them all with simple cloud apps.


European cloud service providers may experience considerable growth


Predictive analytics is one of the biggest trends in business today. There are many companies investing time and money into this area of their business. However, there is also a lot of new technology coming out in this sector of technology. Predictive analytics takes big data one step further.


Gartner is well respected in the industry by most. Even people who dismiss traditional analyst firms concede (however grudgingly) that Gartner does a good job of describing the technology landscape. In the public cloud world, that credibility has been built, in part, through the respect that most in the industry have for Gartner’s VP and distinguished analyst, Lydia Leong. In a world of quick, knee-jerk reactions, hers is a steady and steely voice. The problem with Gartner’s work, however, is that most of it is behind a paywall.


During a break at a recently attended conference in the short walk between the finger food and the water cooler I bumped into an evangelist, an agnostic and a skeptic. No it wasn’t the interfaith dialogue session at an international ecumenical convocation, it was, you may be surprised to hear, a major data science and technology conference and my interlocutors were an analytics evangelist, a technology agnostic, and a big data skeptic.


Fortscale Security Ltd., a leader in the growing field of user behavior analytics for enterprise security, introduced Fortscale 2.0, the latest upgrade of its award-winning solution that results in an unparalleled ability to target and eliminate insider threats.


Microsoft updated its CRM and SQL offerings, and Intel showcased its IoT efforts. Meanwhile, the US Supreme Court is weighing questions about the liability companies have in ensuring the accuracy of consumer data. Learn about this and more in our Big Data Roundup for the week of Nov. 6.


With any large corporation comes data sets so large or complex that traditional data processing applications are inadequate. Tony Vaden, VP and Chief Information Officer at ABC Supply, needed to expand his traditional data archiving and find a Big Data management suite that could help ABC Supply take their data offline but still accessible.


From organizations to brands


VB WEBINAR: We’re talking real life robotics with experts from Qualcomm and Silicon Valley Robotics. Watch on demand now for free! Silicon Valley is at the center of the perfect storm of robotics. It’s at the center of the talent, the investment and the research, the center of the software and hardware industries — all key ecosystem components to build the robotics companies that need to rise to serve the world’s future.


ExtraHop, a leader in real-time wire data analytics for IT and business intelligence, announced the fifth generation of its platform. The company’s latest innovation positions ExtraHop as a pioneer in real-time stream analytics for all data-in-motion with market-leading dynamic discovery and universal observation capabilities.


Splice Machine, provider of the Hadoop RDBMS, announced that it is one of only three startups selected this fall for the Wells Fargo Startup Accelerator program. During the six-month, hands-on Startup Accelerator program, Wells Fargo mentors will provide guidance to Splice Machine.


Learn how to use Visual Studio to get started with programming in U-SQL against Azure Data Lake. This video walks you through the basics of finding and browsing your Azure subscriptions, creating new U-SQL projects, working with C# code extensions, and submitting jobs to run in the cloud. This is an essential quick-start video U-SQL tools.


Learn how to understand what happens to your U-SQL big data job after you submit it to Azure Data Lake. This video shows how to use the Visual Studio tools for viewing your job graph, using playback to understand execution and start debugging common errors and issues in your job.


This entry was posted in News and tagged , , , , , . Bookmark the permalink.