Big Data News – 24 Oct 2016

Today's Infographic Link: An Infographic Of Infographic Tips

Featured Article
In order to gain support and financial approval for your big data and analytics initiatives, you need to give busy senior managers a snapshot of how these efforts can pay off.

Top Stories
The launch of HPE Backup and Recovery Suite brings all HPE data protection offerings together under a common analytics framework.

At the Gartner Symposium and ITxpo, Gartner released its annual list of the top 10 strategic trends. Are you planning for the right technology in your organization?

The role of a marketer is to help leverage brands, products and overall awareness of a business' core mission. That means analyzing data has become increasingly valuable to marketers, giving them real-time insights into trends, current campaigns and failed initiatives. "Marketers today are more in tune to numbers, figures and metrics than ever before — they understand that the success of their marketing campaigns rely on the ability to analyze data and turn behaviors and actions of buyers and customers into actionable insight that can be used to optimize ongoing marketing efforts," says Michelle Huff, CMO at Act-On Software.

The phrase "digital transformation" is wearing a little thin, as marketers twist it into a pitch for whatever they're trying to sell. So let's settle on a broad yet simple meaning: The journey from inflexible platforms, products, and workflows to a "permanently agile" condition. InfoWorld Contributing Editor Dan Tynan and I make the argument for this definition in a new Deep Dive you can download here. Naturally, the details of transformation vary infinitely depending on the organization. Yet commonalities persist in nearly all cases, such as devops, cross-silo collaboration, and big data analytics.

For years, researchers at the MIT Media Lab have been developing a database of images captured at regular distances around several major cities. The images are scored according to different visual characteristics — how safe the depicted areas look, how affluent, how lively, and the like. In a paper they presented last week at the Association for Computing Machinery's Multimedia Conference, the researchers, together with colleagues at the University of Trento and the Bruno Kessler Foundation, both in Trento, Italy, compared these safety scores, of neighborhoods in Rome and Milan, to the frequency with which people visited these places, according to cellphone data.

Despite rigorous efforts, Apollo Hospitals was hardly immune to HAIs. But that was only until the CIO took it upon himself to fight this scourge.

This article discusses how big data can be misunderstood and misused, why it's prone to bias and what can be learned from the mistakes of big data. Keep on reading: Big data isn't always as helpful as we like to think

Bringing your visualizations from "good" to "great" takes time, patience, attention to detail, and some basic knowledge of visual analysis best practices. Luckily, Tableau has compiled an important list of techniques to get you started.

Dell EMC–now the world's largest vendor of enterprise IT solutions with the broadest portfolio–showcased some of its products and technologies.

AT&T making deals, Verizon and T Mobile facing trouble.

For the first time, cybersecurity strategy is an integral part of the platforms for US presidential candidates. Today, data breaches and cyber attacks are no longer just one-offs, but seemingly happen daily and impact both the private sector and government. What are we doing to minimize these data breaches and counter cyber attacks? What's the role of government in fighting cyber crime? Where does the public sector fit in the cyber crime puzzle? Cybersecurity experts Dan Lohrmann, Scott Schober, Shahid Shah, Eric Vanderburg and Morgan Wright address these questions.

This publication provides guidelines for establishing and participating in cyber threat information sharing relationships.

Cisco announced this week that it has acquired Heroik Labs to gain access to a set of Worklife meeting tools.

When will it be possible to run Google's TensorFlow deep learning system on Windows with full GPU support? The short answer is "soon." The real holdup, though, hasn't even been TensorFlow. It's been the lack of a working Windows version of Bazel, Google's in-house tool that delivers TensorFlow builds.

Data is widely seen as the new source of competitive advantage, driving smarter decisions and helping enterprises outthink their rivals. But opportunities are often missed. Getting the data needed from multiple underlying systems can take far too long for application developers, business analysts and data scientists challenged by cumbersome IT processes. See what Hernando Borda with the IBM Analytics team at IBM has to say about IBM Bluemix Data Connect and how it empowers data professionals to securely access, enhance and visualize data from multiple sources and prepare it for analysis.

While organizations do want to reduce their energy consumption, there are limits as to how far they are willing to go to achieve results.

Temperament has been a key issue in the 2016 presidential election between Hillary Clinton and Donald Trump, and an issue highlighted in the series of three debates that concluded this week. Quantifying "temperament" isn't an easy task, but The Economist used the Microsoft Emotion API to chart the anger, contempt, sadness and surprised expressed in the faces of the candidates during key sequences of the debates, like this from the third debate: Economist Data Journalist Ben Heubl explains how you can analyze emotions in a video file using Python and R. The Emotion API provides scores for eight attributes of emotion as expressed by a face in a still image or video clip.

For machine learning models created with the random forest algorithm, there is no obvious diagnostic to inform you which features are more important in the output of the model. Some straightforward but useful techniques exist revolving around removing a feature and measuring the decrease in accuracy or Gini values in the leaves. We broadly discuss these techniques in this episode.




The Fall IBM Chief Data Officer Summit brought together more thought leaders than ever before, with over 130 Chief Data Officers, Chief Analytics Officers, Chief Data Scientists and senior-level data executives convening to network, share experiences and discuss the latest technological developments.

Falkonry provides AI services to its industrial customers generating great volumes of IoT data. Here's why this company chose a bare metal cloud implementation for its operations.

Technology is transforming the financial services industry through advanced analytics, behavior finance, mobile computing, predictive analytics, robo advisors and now cognitive computing. Industry experts were recently asked to answer this question: "What is the most exciting change you anticipate for the financial services industry in the coming year?" Find out what they had to say.

Dark data projects can be a tough sell. Learn ways to explore dark data that can generate business insights and results.

It's easy to get all "cloud first" when you're talking about new, greenfield applications. But how do you get the core business applications running in your data center — so-called brownfield apps — easily and efficiently migrated to the cloud? That's the problem startup CloudVelox set out to solve, with the larger mission of helping CIOs build "boundaryless" hybrid data centers. IDG Chief Content Officer John Gallant spoke with CloudVelox CEO Raj Dhingra about how the company has automated the migration of complex, traditional applications to Amazon Web Services (and Microsoft Azure in the near future). Dhingra explained how companies are using CloudVelox's One Hybrid Cloud platform to not only migrate apps, but to build cloud-based disaster recovery capabilities and simplify a variety of test/dev chores.

Companies signed IT and business process outsourcing deals worth a record $9.5 billion in annual contract value, according to the quarterly outsourcing index produced Information Services Group (ISG). Traditional outsourcing contracts were up 5 percent to $5.8 billion, while the fast-growing as-a-service segment leapt 20 percent to $3.7 billion, according to ISG. "Most conversations we're having with clients are cloud-led," says John Keppel, ISG president, for Europe, Middle East and Africa. "Enterprise customers are first seeking to be more cost efficient so that they can redeploy funds into digital and cloud activities. But we're also seeing them pivot quickly to broader digital transformation initiatives that are focused on creating a customer-first environment that is intelligent and mobile. This is a very long game and we are in the early stages at this point."

Volumes of data generated from a variety of sources can be a challenge to wrangle. Take a look at the advanced Design Data Flow beta capability of IBM Bluemix Data Connect that enables consumption of large data volumes from disparate sources, which can then be curated for deriving insights and analysis.

While he didn't need CodeFights to get a job, landing a cool job in San Francisco would have been tough for a guy in Chattanooga without that lead.

Companies signed IT and business process outsourcing deals worth a record $9.5 billion in annual contract value, according to the quarterly outsourcing index produced Information Services Group (ISG). Traditional outsourcing contracts were up 5 percent to $5.8 billion, while the fast-growing as-a-service segment leapt 20 percent to $3.7 billion, according to ISG. "Most conversations we're having with clients are cloud-led," says John Keppel, ISG president, for Europe, Middle East and Africa. "Enterprise customers are first seeking to be more cost efficient so that they can redeploy funds into digital and cloud activities. But we're also seeing them pivot quickly to broader digital transformation initiatives that are focused on creating a customer-first environment that is intelligent and mobile. This is a very long game and we are in the early stages at this point."

When enterprises implement Hadoop, their top use-case was found to be business intelligence (BI). Now a new benchmark study shows which Hadoop SQL engines are best for which workloads. Here is a look at 7 key findings from that study.

Last year, MIT researchers presented a system that automated a crucial step in big-data analysis: the selection of a "feature set," or aspects of the data that are useful for making predictions. The researchers entered the system in several data science contests, where it outperformed most of the human competitors and took only hours instead of months to perform its analyses. This week, in a pair of papers at the IEEE International Conference on Data Science and Advanced Analytics, the team described an approach to automating most of the rest of the process of big-data analysis — the preparation of the data for analysis and even the specification of problems that the analysis might be able to solve. The researchers believe that, again, their systems could perform in days tasks that used to take data scientists months."

NEWS ANALYSIS: EMC'S data center technology held center stage at the first combined Dell EMC World conference, but Michael Dell says that appearances aside, "this is one company."

Life Sciences have been established and widely accepted as a foremost Big Data discipline; as such they are a constant source of the most computationally challenging problems. In order to provide efficient sol…

Predicting human mobility flows at different spatial scales is challenged by the heterogeneity of individual trajectories and the multi-scale nature of transportation networks. As vast amounts of digital trace…

Once upon a time, there was the original R Graph Gallery, by Romain François. Sadly, it's been unavailable for several years. Now there's a new R Graph Gallery to fill the void, created by Yan Holtz. It contains more than 200 data visualizations categorized by type, along with the R code that created them. You can browse the gallery by types of chart (boxplots, maps, histograms, interactive charts, 3-D charts, etc), or search the chart descriptions.

Google introduces its Coldline option for archiving rarely used data, as well as price cuts and refreshes across all storage services.

AI was mostly discussed by futurists and screenwriters just a few years ago. Now, it is at the center of many corporate and business functions.

Snowflake, the cloud-based data warehouse solution co-founded by Microsoft alumnus Bob Muglia, is lowering storage prices and adding a self-service option, meaning prospective customers can open an account with nothing more than a credit card. These changes also raise an intriguing question: How long can a service like Snowflake expect to reside on Amazon, which itself offers services that are more or less in direct competition — and where the raw cost of storage undercuts Snowflake's own pricing for same?

It's easy to forget about the ghosts of servers past, continuing to consume electricity and exposing organizations to potentially malicious attacks.

In just a few short days, World of Watson will be in full swing once again, bringing the very best in speakers, demonstrations, and networking opportunities with a cognitive flair. It's a perfect opportunity for Chief Data Officers to learn more about a variety of topics — from more traditional data management solutions to what's being created at the forefront of the cognitive edge.

The Internet of Things (IoT) is under attack, and really, it was only a matter of time.

It's India meets Indianapolis: Bangalore-based consulting firm Wipro is buying Appirio for $500 million to bulk up its cloud applications business. With more resources behind it, cloud services vendor Appirio will be in a better position to fight back against big consulting firms like Accenture and Deloitte, which "have garnered disproportionate market share" in the cloud services market in recent years, Appirio CEO Chris Barbin wrote in a blog post explaining the deal. Appirio, based in Indianapolis, offers a range of cloud applications integration services, many of them built around Salesforce.com — a logical fit since it grew out of Salesforce's AppExchange startup incubator.

The combination of Jupyter Notebooks, Apache Hadoop and Apache Spark has become a killer app for data practitioners. It unlocks the ability to explore, visualize and experiment with both structured and unstructured data sets with great ease and efficiency. We spoke recently with Chris Snow at IBM about unleashing the combination of Spark and Jupyter Notebooks on the terabytes or even petabytes of data stored in Hadoop clusters.

It's India meets Indianapolis: Bangalore-based consulting firm Wipro is buying Appirio for US$500 million to bulk up its cloud applications business. With more resources behind it, cloud services vendor Appirio will be in a better position to fight back against big consulting firms like Accenture and Deloitte, which "have garnered disproportionate market share" in the cloud services market in recent years, Appirio CEO Chris Barbin wrote in a blog post explaining the deal. Appirio, based in Indianapolis, offers a range of cloud applications integration services, many of them built around Salesforce.com

The NYU Stern MS in Business Analytics is the only premier global degree program of its kind designed for senior level professionals focused on the intersection of business strategy and data science. The program is designed for experienced professionals interested in gaining a competitive advantage through the predictive potential of data. The MS in Business Analytics Program is a one-year, part-time program divided into five on-site class sessions (modules). Two of the five modules occur outside of NYU Stern in global rotating locations, allowing you to expand your international network of valuable peers and contacts.




Dell is quietly working on integrating virtual reality with the Microsoft Skype for Business video conferencing cloud service.

Analytics is all the hype these days, and for good reason. Taking the power of analytics and applying it to the backup and recovery process will be a boon for the IT industry. Analytics will help deal with the data hoarding epidemic and ensure critical data is backed up, without financing storage space and data management for all those pictures of your aunt's cats.

Guest Author: Patti Mizulo, Senior Director, Big Data Partner Program, Dell EMC So close and yet so far. That is often what it's like when you're trying to wrangle big data trapped in siloes and extract valuable business insights. It can take weeks or months using traditional methods. Chances are, your data sits on multiple systems across your company or even outside your data center. It's probably in a variety of formats, both structured and unstructured. No wonder data analysts typically spend up to 80 percent of their time amassing and preparing data before they can focus on analytics. [1] Dell EMC™ has solved this vexing problem with the new Analytic Insights Module.

Instances of OpenStack managed by Mirantis will be hosted on IT infrastructure provided by NTT as a service.

Many of us might be surprised to learn that some of the most familiar brand names around started off with other names. IBM recently renamed IBM DataWorks–its flagship, self-service data preparation offering–to IBM Bluemix Data Connect. Get a glimpse of it in this brief overview, and discover how the DataWorks name lives on in a fresh IBM Watson initiative called Project DataWorks.

Though online interest in the presidential election has never been higher, social media sentiment about the candidates is in the basement.

The total number of ransomware attacks rose by 13 percent in September alone, say Check Point cybersecurity researchers.

Snowflake, a cloud data warehouse pure play, has decided to slash prices on storage, and make its money on compute resources and management. Will this force Amazon, Microsoft and Google to respond in kind?

Automation can be a great solution for highly manual processes, but its implementation has its detractors. Can robotic process automation be successful in providing an artificial intelligence solution that includes machine learning for further streamlining typically manually intensive processes?

From the impact of wearable technology to the potential for boosting cancer research, there's been a lot of buzz about big data in the healthcare space. However, the true vision of big data in healthcare lies not in individual data collection or disparate applications, but in the potential of combining healthcare data to create new resources for doctors.

When it comes to disaster preparedness, predicting disasters is one of the biggest problems governments have. That is where big data technology and predictive analytics step in and provide the solution. Over recent years, big data has been able to help scientists and disaster aid agencies narrow down to the hardest hit areas.

The driving force behind enterprise data analytics today is obtaining valuable insights more quickly from large, diverse data sets. A key issue blocking easier access for data scientists, business analysts and IT has been finding an alternative to the current data modeling process.

Those who attended the SHRM annual conference heard over and over again the three holy words of modern HR: culture, strategy, and analytics.

This entry was posted in News and tagged , , , , , , , , , . Bookmark the permalink.