Big Data News – 30 Jun 2016

Today's Infographic Link: A visual compendium of glowing creatures

Featured Article
IT professionals aged 18 to 34 are much more optimistic than their elders that "big data" analysis will fundamentally change how business is conducted in the next few years, according to an IDG Enterprise survey.

Top Stories
Change is inevitable. This is an undisputable fact of life. Businesses have constantly changed and adapted to the ever changing requirements of their customers and/or markets. Businesses who were resistant to change, or did not adapt to the changing landscape, have gone out of business. We see this constantly where big multinationals are putting a…

When building an analytics infrastructure, it's important to choose software that allows you to expand the types of job candidates you can consider.

Don't let your business come to a standstill as a result of technical debt. Discover how a decision debt approach to tools and analytics help overcome the quick-fix solutions that contribute to technical debt and its impact on business.

by Joseph Rickert Over the years I have seen several excellent tutorials at useR!conferences that were not only very satisfying "you had to be there" experiences but were also backed up with…

Hadoop distributor Hortonworks announced a deeper partnership with cloud giant Microsoft, a new consortium to create an open source genomics project for precision medicine, and new enterprise features in its Hortonworks Data Platform update at this week's Hadoop Summit.

The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren't yet translating into a true "cloud" experience within the enterprise. What is stopping the growth of the "private cloud" market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between what is available in the public cloud and the early private clouds?

Sai Sriparasa is a consultant with AWS Professional Services Customers commonly process and transform vast amounts of data with Amazon EMR and then transfer and store summaries or aggregates of that data in relational databases such as MySQL or Oracle. This allows the storage footprint in these relational databases to be much smaller, yet retain the ability to process larger, more granular datasets using the Hadoop ecosystem in Amazon EMR.

Juniper Networks unfurled cloud-based approach to SDN that lets IT centrally manage provisioning of networking services to branches.

Cloud Expo 2016 New York at the Javits Center New York was characterized by increased attendance and a new focus on operations. These were both encouraging signs for all involved in Cloud Computing and all that it touches. As Conference Chair, I work with the Cloud Expo team to structure three keynotes, numerous general sessions, and more than 150 breakout sessions along 10 tracks. Our job is to balance the state of enterprise IT today with the trends that will be commonplace tomorrow. Mobile Computing, Big Data and Analytics, the Internet of Things, Platforms and Microservices and Containers, DevOps, and WebRTC are all part and parcel of Cloud Computing today.

Fog Computing is being touted as the data communication solution our Internet of Things (IoT) devices are asking for by bringing the power of cloud computing closer to the end user. The fact is, the number of connected devices is going to continue to grow exponentionally. In fact, Gartner predicts that by 2020 IoT will include 26 billion connected things. Consider the impact that amount of data collected and processed will have.

One quality defines most successful executives: the ability to learn from mistakes.

Earlier today, we announced that Open Energi has tripled its investment in data analytics by adding Hortonworks DataFlow to its existing use of Hortonworks Data Platform to manage its data in motion. Open Energi is at the forefront of smart grids and the Internet of Things in the UK. Put simply, it allows its customers'… The post Data is the fuel for Open Energi's virtual power station with Hortonworks DataFlow appeared first on Hortonworks.

Attunity Ltd. (NASDAQ CM: ATTU), a leading provider of Big Data management software solutions, announced the latest release of Attunity Visibility for Hadoop with enhanced technology to enable comprehensive data usage analytics for large-scale and fast-growing Hadoop Data Lake environments.

Printing in 3D has become a practical reality that has changed the way people think about production and manufacturing. Now that the technology has matured, almost everything from smartphone cases to human organs can be 3D printed. Customized products and parts made by 3D printers have empowered entrepreneurs and sped repairs in many settings.

Data's impact on business is only gathering momentum. Key trends in business intelligence for this year include a focus on the Internet-of-Things (IoT), highly improved cognitive solutions and the rise of insight-driven organizations. With such growth in potential uses, sources and types of data, enterprises of all sizes are now facing increasing complexity when it comes to collection, management and analytics. Increased complexity, in turn, makes for new challenges for decision-makers and data scientists. The rapid rise of connected devices and business ecosystems has resulted in an increasing number of disparate data sources, coupled with a growing diversity of data types, all leading to the increasing complexity of data.

Mergers and acquisitions can be complicated. You're buried in spreadsheets and profit and loss reports, conducting interviews and trying to understand every aspect of how the business operates. Often an overlooked aspect of acquisition or mergers is technology. Because technology can make or break a business, it's an important consideration as you look at businesses to acquire.

In this special guest feature, Jeff Morris, Vice President of Data Monetization Strategy & Success at GoodData, explores a fundamental shift of the value of data within retail, and outlines solutions for various members of the retail community to utilize data for both internal and external use.

In this special technology white paper, Zero to Insight With the Snowflake Elastic Data Warehouse, you'll learn how to get started with tomorrow's data warehouse today. You can truly get from "zero" to "insight" without the pains of trying something new.

Businesses that want to get their files out of on-premises data centers and into the cloud now have a new option from Box. On Wednesday, the company launched Box Shuttle, which includes tools and consulting services to help businesses move potentially terabytes of data from legacy applications into the Box cloud. Box will work with customers to develop a migration plan for getting their data out of private data centers into its cloud service. It will help figure out what content customers should keep, archive and delete.

Microsoft appears to be building a business app store. The company put online a test version of a service called AppSource that's designed to help businesses find software that augments the Microsoft products they already use, such as Power BI and Dynamics AX. The AppSource site was available Tuesday night at appsource.microsoft.com, but is down now. A description on its homepage said that users would be able to use the site to find software-as-a-service offerings from Microsoft and selected partners that they could try for free before purchasing them. All of this appears to have come to light after someone developing the site at Microsoft accidentally made a test version of it available on the public Internet, where it was discovered by a prolific Microsoft leaker who goes by Walking Cat on Twitter.

Many so-called big data — really, Hadoop — projects have patterns. Many are merely enterprise integration patterns that have been refactored and rebranded. Of those, the most common is the mainframe pattern. Because most organizations run the mainframe and its software as a giant single point of failure, the mainframe team hates everyone. Its members hate change, and they don't want to give you access to anything. However, there is a lot of data on that mainframe and, if it can be done gently, the mainframe team is interested in people learning to use the system rather than start from the beginning. After all, the company has only begun to scratch the surface of what the mainframe and the existing system have available.

Just over a year ago, two job applicants filed a lawsuit against Google. They claimed they were rejected because of their age. Both were over 40. A federal court in San Jose, Calif., is now being asked to decide whether many others who sought jobs at Google and were also rejected can join this case. On Wednesday, a motion for conditional certification of collective action status was filed. This motion, similar to a class action, seeks to include "all individuals who interviewed in-person for any software engineer, site reliability engineer, or systems engineer position with Google in the United States during the time period from August 13, 2010 through the present; were age 40 or older at the time of the interview; and were refused employment by Google."

Following an extended preview period, Amazon's Elastic File System is now generally available in three geographical regions, with more on the way. Originally announced last year, EFS is a fully managed elastic file storage service for deploying and scaling durable file systems in the Amazon Web Services cloud. It's currently available in the U.S. East (northern Virginia), U.S. West (Oregon), and EU (Ireland) regions, the company announced Wednesday. [ Doing storage virtualization correctly is not simple. InfoWorld's expert contributors show you how to get it right in this "Storage Virtualization Deep Dive" PDF guide. | Get the latest insight on the tech news that matters from InfoWorld's Tech Watch blog. ] Customers can use EFS to create file systems that are accessible to multiple Amazon Elastic Compute Cloud (Amazon EC2) instances via the Network File System (NFS) protocol. They can also scale those systems up or down without needing to provision storage or throughput.

Machine learning is a loose term, it covers many activities. From a software engineering aspect it could be seen as an activity evolved from pattern recognition.

Microsoft appears to be building a business app store. The company put online a test version of a service called AppSource that's designed to help businesses find software that augments the Microsoft products they already use, such as Power BI and Dynamics AX. The AppSource site was available Tuesday night at appsource.microsoft.com), but is down now. A description on its homepage said that users would be able to use the site to find software-as-a-service offerings from Microsoft and selected partners that they could try for free before purchasing them. All of this appears to have come to light after someone developing the site at Microsoft accidentally made a test version of it available on the public Internet, where it was discovered by a prolific Microsoft leaker who goes by Walking Cat on Twitter.

The latest version of SQL-on-Hadoop specialist Actian Corp.'s Vector database tightens integration with Apache Spark to widen access to new data sources while adding enterprise features required to move Hadoop-based analytics to production. The database specialist said Tuesday (June 28) version 5.0 of its Vector in Hadoop (VectorH) database uses the same query engine as its Vector platform. The company claims a Transaction Processing Performance Council (TPC-H) benchmark record for non-clustered systems at the 3,000 Gb scale for its Vector platform.

Body-worn cameras are very likely to become part of a police officer's standard issue along with body armor, firearm and baton. But body-worn camera programs can be costly when it comes to storing, managing and redacting all that video footage data. See what several law enforcement experts have to say about both the benefits and challenges of body-worn cameras into today's policing environment.

MapR Technologies, Inc., provider of the Converged Data Platform, announced the Spyglass Initiative — a comprehensive, open, and extensible approach for increasing user and administrator productivity.

Advances in thin clients, desktop virtualization (VDI), cloud management services, and mobile delivery networks are allowing both increased security and edge applications performance gains. The next BriefingsDirect thought leadership panel discussion focuses on the heightened role of security in the age of global cloud and mobile delivery of apps and data. As enterprises and small to medium-sized businesses (SMBs) alike weigh the balance of apps and convenience with security — a new dynamic is emerging. Security concerns increasingly dwarf other architecture considerations. Yet advances in thin clients, desktop virtualization (VDI), cloud management services, and mobile delivery networks are allowing both increased security and edge applications performance gains.

IT professionals aged 18 to 34 are much more optimistic than their elders that "big data" analysis will fundamentally change how business is conducted in the next few years, according to an IDG Enterprise survey.

Customers expect every engagement to be timely, relevant and personalized. Use predictive customer intelligence to establish a dynamic view of customer behavior and foster brand loyalty.

This Microsoft PowerPoint 2016 Quick Reference covers the fundamentals of using the program and working with slides, keyboard shortcuts, and formatting.

The digital transformation imperative is becoming increasingly urgent for companies large and small, and SAP wants to help. On Wednesday, the ERP giant set its sights squarely on SMBs with an updated app that's been enriched with analytics and other key features. Originally announced last year, SAP Business One 9.2 is the latest version of SAP's ERP app for small and medium-size businesses, and it's now generally available both on-premises and in the cloud.

The pace of innovation, vendor lock-in, production sustainability, cost-effectiveness, and managing risk… In his session at 18th Cloud Expo, Dan Choquette, Founder of RackN, discussed how CIOs are challenged finding the balance of finding the right tools, technology and operational model that serves the business the best. He also discussed how clouds, open source software and infrastructure solutions have benefits but also drawbacks and how workload and operational portability between vendors and platforms give control back to the users and drives innovation.

CIOs and those charged with running IT Operations are challenged to deliver secure, audited, and reliable compute environments for the applications and data for the business. Behind the scenes these tasks are often accomplished by following onerous time-consuming processes and often the management of these environments and processes will be outsourced to multiple IT service providers. In addition, the division of work is often siloed into traditional "towers" that are not well integrated for cross-functional purposes. So, when traditional IT Service Management (ITSM) meets the cloud, and equally, DevOps, there is invariably going to be conflict.

The rollout of the 802.11ac family reached a milestone with the extension of the Wi-Fi Alliance's certification program to include Wave 2 features.

Companies need to be more proactive and take steps to reduce their cybersecurity risks, as well as establish procedures to take should a breach occur.

The initial debate is over: Any enterprise with a serious commitment to IT is migrating to the cloud. But things are not so simple. There is a complex mix of on-premises, colocated, and public-cloud deployments. In this power panel at 18th Cloud Expo, moderated by Conference Chair Roger Strukhoff, Randy De Meno, Chief Technologist – Windows Products and Microsoft Partnerships at Commvault; Dave Landa, Chief Operating Officer at kintone; William Morrish, General Manager Product Sales at Interoute; and Nara Rajagopalan, CEO at Accelerite; looked at the present state of cloud from the C-level view, and how great companies and rock star executives can use cloud computing to meet their most ambitious and disruptive business goals.

The most significant new feature in Apache Hive 2, to be included in the upcoming HDP 2.5 release is a technical preview of LLAP (Live Long and Process). LLAP enables as fast as sub-second SQL analytics on Hadoop by intelligently caching data in memory with persistent servers that instantly process SQL queries. Since LLAP is… The post Hive LLAP Technical Preview enables sub-second SQL on Hadoop and more appeared first on Hortonworks.

Here at MongoDB World in New York City, several providers of Internet of Things (IoT) solutions are sharing stories of how they use the NoSQL database. One of the most interesting IoT use cases involves Vivint, which is the largest provider of smart home solutions in the country. Before pivoting to the burgeoning smart home business in 2010, Vivint was a home security company with about 700,000 customers. It had key partnerships with two firms, one that supplied the in-home hardware devices and another that ran the SQL Server database that stored data from the devices.

Actian Corporation, a leader in enterprise-grade data analytics infrastructure, announced today the latest version of the Actian Vector in Hadoop (VectorH) database.

Thanks to ubiquitous mobile technology, field data is more readily accessible to ESRI's Survey123 for ArcGIS. A relief organization used the software to aid Syrian war refugees.

We hear on a daily basis that traditional media is dead. We see a regular occurrence of newspaper and magazine titles going to the wall and suffer an almost constant dumbing down of traditional media. While the internet has done amazing things for our ability to achieve outcomes, for media the only outcome seems to be a slow, chilling and painful death. So it's always interesting to see traditional media companies embrace new approaches in an effort to remain competitive. A case in point comes from Conde Nast, perhaps as traditional a media company as exists.

Tips for businesses and individuals on how to combat phishing attacks and prevent identity and tax fraud as financial losses.

Many organizations today have digital transformation at the center of their corporate strategy. At the heart of this transformation is the ability to develop actionable insights. The key is to gain smarter, more accurate insights faster than their competition and then translate that insight into action for the business.

Nearly 70 percent of IT pros don't have security certifications nor are the employers willing to invest in them, but they're responsible for security.

La Nina could result in larger hurricanes making U.S. landfall, having a significant impact on hundreds of thousands of businesses.

Companies like Uber have made it clear what will happen to organizations that do not embrace digital transformation.

The below blog has been co-authored by Vinay Shukla, Hortonworks, Moon So Lee, Apache Zeppelin PMC & NFLabs, Prabhjyot Singh, Apache Zeppelin PMC & Hortonworks" Recently the Apache Software Foundation (ASF) announced Apache Zeppelin as a top level project. This was a great milestone for both the Zeppelin and data science community. Since its' incubation in… The post Apache Zeppelin: The Road Ahead appeared first on Hortonworks.

Following an extended preview period, Amazon's Elastic File System is now generally available in three geographical regions, with more on the way. Originally announced last year, EFS is a fully managed elastic file storage service for deploying and scaling durable file systems in the Amazon Web Services cloud.

We talk a lot about the Deep Web which many people think is the same as the Dark Web. It is not. In this short video, we uncover what the Dark Web actually is and who should be monitoring Dark Web data. Interested in learning more about the Deep Web vs. the Dark Web? Download… The post VIDEO: What is the Dark Web? appeared first on BrightPlanet.

By offering a migration service, Box says it hopes to help enterprises with legacy baggage make a journey toward cloud computing.

The acquired technology is destined to become part of Cisco's Networking and Security Business Group.




Cleaning and joining large volumes of cloud data with other data sources is a tedious experience for many analysts. Alteryx in-database blending tools solve the often slow data blending process by leveraging Amazon Redshift – dramatically reducing the time to create the perfect dataset for analysis.

Kentik, the network traffic intelligence company, announced the release of significant enhancements to Kentik Detect, its big data network analytics solution.

A key specification for exchanging sensor data between vehicles has found a new sponsor, in a move that may help future drivers avoid dangers before they see them. New vehicles are increasingly laden with sensors — accelerometers, thermometers, radar and lidar (light detection and range) — and the best of them can use the streams of incoming data to warn of or even avoid hazards such as ice or obstacles. But what if they could share information about changes to a road since the map was last updated or even warn one another of a stopped vehicle hidden by a blind curve?

Many newcomers to R got their start learning the language with Computerworld's Beginner's Guide to R, a 6-part introduction to the basics of the language. Now, budding R users who want to take their…

Even if you aren't a data scientist, Datapalooza is definitely the way to go. See why you can expect to get a lot out of attending a Datapalooza event near you.

Evernote, the note-taking service that has become part of a large number of lives, has notified its users that it plans to increase the prices of its Plus (from $2.99/mo. to $2.99/mo.) and Premium (from $5.99/mo. to $7.99/mo.) tiers, and limit its Basic (free) customers to having the app on two devices. The usual pushback by annoyed and worried users has ensued. However, being one of those annoyed and worried users, while I can understand any company needing to increase its revenues during these uncertain times, I also am trying to figure out how to respond.

Larry Ellison doesn't do "cheap." The Oracle chairman isn't interested in selling the low-cost one- and two-socket servers that make up a huge slice of the server market but yield little profit for the companies that make them. Even if he did, that business is pretty much sewn up by Hewlett Packard Enterprise, Dell and the "white box" makers from China and Taiwan. But Ellison's also a realist, and he knows customers are gradually turning away from his pricey Unix systems in favor of x86 boxes to build scale-out private and hybrid clouds. So to keep customers interested in Sparc, Ellison needs to come downmarket and provide more affordable options.

Salesforce's Lightning add-in for Outlook's inbox lets users access, search, and sync Salesforce information without toggling between multiple applications.

Larry Ellison doesn't do "cheap." The Oracle chairman isn't interested in selling the low-cost one- and two-socket servers that make up a huge slice of the server market but yield little profit for the companies that make them. Even if he did, that business is pretty much sewn up by Hewlett Packard Enterprise, Dell, and the "white box" makers from China and Taiwan. But Ellison's also a realist, and he knows customers are gradually turning away from his pricey Unix systems in favor of x86 boxes to build scale-out private and hybrid clouds. So to keep customers interested in Sparc, Ellison needs to come downmarket and provide more affordable options.

This year, we were able to secure further funding, which allows us to offer 90 places accross 9 programmes in 7 Scottish universities. This means the 2016/17 cohort will more than double last year's group, providing Scotland with an even larger pool of talent to help reduce the skills gap in the Data Science industry. The broader range of programmes also means students can choose from different specialisms, including business applied skills. One of the main features of The Data Lab MSc is that it is developed in collaboration with industry to ensure students are equipped with the skills that organisations actually need; which will facilitate employability upon graduation.

Listening to music makes the everyday task of driving from A to B, a little bit less boring. Whether your music tastes lie with ACDC or Mozart, we all love to bop along to our favourite tunes whilst in the car. But just how does the music you listen to affect your performance at the wheel? We've come up with an infographic that explains how influential your music preferences are in relation to your driving. We've got it all covered, from song type to tempo and even volume!

Microsoft's Outlook software is used by countless businesses around the world, so it's only natural that Salesforce wants its own software to play nicely with it. On Tuesday, the CRM giant announced a big step in that direction. The latest in a series of integrations resulting from the two-year-old partnership between Salesforce and Microsoft, Lightning for Outlook is an add-in that promises to let salespeople tailor their inboxes with smooth access to customer relationship management (CRM) data whenever they need it. The average sales rep spends more than 70 percent of each week sending and responding to email, according to Salesforce. CRM and email software, meanwhile, have remained largely separate, meaning that reps have had to toggle between them.

European Union rules for electronic signatures change on Friday to make a clear distinction between the identity of the person signing, and that of the authority guaranteeing the integrity of the data, but the technology needs to be still simpler, vendors say. The new rules are intended to simplify the process of electronically signing contracts between businesses, or between businesses and persons, and across international borders where different and often incompatible electronic signature rules apply today. But while the new rules will simplify the legal environment, today's technical environment makes it too difficult to create and securely manage digital identities, according to the Cloud Signature Consortium.

This entry was posted in News and tagged , , , , , , , , , , , , , . Bookmark the permalink.