Big Data News – 31 Aug 2015

Top Stories
The humble search engine has retained a prominent place in the toolboxes of would-be data explorers. You see Solr and Lucene sitting at the Hadoop table, right alongside SQL and machine learning. But some search experts-including one who helped build Microsoft Bing-says traditional search engines are too long in the tooth for today's big data challenges. There's no doubt that Internet search engines, such as Google and Bing, have changed how we retrieve information, says Donald Thompson, the co-founder and CTO of Maana and a long-time Microsoft developer.

With my engineering background, I was always fascinated with SCADAs and PLCs. These are small devices and associated monitoring frameworks that give voices to machines and critical infrastructure. For years, these devices, along with sensors, actuators and relays, have been gathering data that is confined to what is traditionally called the Operation Technology (OT). OT was typically restricted to four walls of the plant or, on a protected network, on an electric grid. The data was locked in proprietary formats, had very specific limited use and was primarily used for reactive purpose.

VMware opens its VMworld event with additions to its vCloud Air public cloud, ties into the virtualized data center, and other enhancements.

VMware opens its VMworld event with additions to its vCloud Air public cloud, ties into the virtualized data center, and other enhancements.

Technological innovation has given Human Resources the ability to predict the future — and has moved HR into the boardroom. But it's up to data-savvy HR professionals to make that move permanent. "Why should I, as a managing director or a CEO, give as much credibility to HR as I do to finance, operations, procurement, […]

Allstate had to stretch its organizational muscles to bring Drivewise Mobile to market. In the process, the company brought together a cross-functional team that included assorted IT disciplines and business professionals with competencies in consumer relationships, insurance products, and user experience.

Allstate had to stretch its organizational muscles to bring Drivewise Mobile to market. In the process, the company brought together a cross-functional team that included assorted IT disciplines and business professionals with competencies in consumer relationships, insurance products, and user experience.

Chris McCord has released version 1.0 of the Phoenix web framework. Written in Elixir, Phoenix implements the server-side MVC pattern and aims to combine high developer productivity with high application performance.

The word "nebulous" fits big data perfectly. The patterns are there; the trends rippling;  the insights just waiting to be drawn.  But they are hazy… unclear… unformed.  Many, many trees.  Very big forest.  A lot of green.  OnlyBoth cuts through it. This benchmarking engine uses discovery algorithms to ferret out unique aspects of persons, places or things in a data base; compares them to others in the data base; then describes results in natural language. OnlyBoth is the AI-brainchild of Raul Valdes-Perez and Andre Lessa. They developed the discovery algorithms by studying the logic of certain tasks and noting which heuristics led to the best solutions.

The biggest change in the enterprise is a long-running trend: an ever more intense focus on customer needs. A decade ago, most of the grand IT initiatives I heard about involved optimizing internal business processes and reducing the cost of IT. But the direction of technology has shifted — to improving the customer experience and deploying new applications that are the public face of new and continually improving products. This redirection has had a profound effect on enterprise IT. Here are the four most obvious changes I've observed: Decentralization. Technologists, particularly developers and engineers, have become integrated into lines of business. IT no longer likes to be seen as a separate entity. Instead of remaining a static, isolated cost center, IT has spread itself into every corner of the business and associated itself with driving revenue.

Personal-statements-biz is an competent academic writing and consultancy service which has captured a huge number of devotees. Young peope across the globe delegate their college challenges to the…

Data is just data unless you have the marketing technology to "make the data talk." Marketers are increasingly in charge of marketing technology spend to drive better data outcomes. In fact, technology has become the core of marketing.

Rini van Solingen and Rob van Lanen wrote Scrum for Managers, a book providing answers for organizations that want to or are adopting Scrum. An interview on what managers can do to give teams enough space to self-organize, the possible ROI of implementing Scrum and how to measure ROI, defining teams and anchoring Scrum in the organizational structure and systems, and much more.

All companies and organizations face the challenge of extracting the maximum return from their capital investments. Flexible financing options can help minimize up-front payments and better align project outlays with the anticipated benefits. Use of optimum financing sources can help accelerate a project's cash flow break-even point, while helping to preserve cash and maintain existing lines of credit for other strategic initiatives. Big Data Challenges The amount of information available to organizations is ever expanding.

Our research into next-generation predictive analytics shows that along with not having enough skilled resources, which I discussed in my previous analysis, NGPA AP #4 image 1the inability to readily access and integrate data is a primary reason for dissatisfaction with predictive analytics (in 62% of participating organizations).

In the first part of this analysis, I turned a short list of movies into a database that could be used to answer basic questions about the list's contents. Now I'd like to broaden this…




This talk will present participants with both aspects of Jubula's personality: Dr Jekyll: writing tests with the Jubula actions in the ITE; Mr Hyde: writing Jubula tests in Java. We'll show how the steps to start AUTs, write tests and perform test execution can be done using both aspects of Jubula. The talk will show participants their way around the tool and its features from both perspectives.

Mark O'Neill presents a number of real-life case studies about how businesses worldwide are succeeding with APIs, enabling new business channels and revenue.

The folks profiled here are tackling data management for the Internet Age, helping us all understand what can be done with a mass of unstructured information. See how their work has transformed the way we handle databases.

The folks profiled here are tackling data management for the Internet Age, helping us all understand what can be done with a mass of unstructured information. See how their work has transformed the way we handle databases.

There are many vendors selling products classified as big data analytics software. However, it's challenging to differentiate these products based on functionality alone, as many of the tools share similar features and capabilities. Additionally, some of the tools exhibit extremely subtle differences.  That being said, your key differentiating factors will likely focus on balancing ease […]

We're all aware of what happened with the "data" stored at Ashley Madison, data that was supposed to be private and protected. This of course is not the first — nor will it be the last — data breach. In fact, it's safe to say that this will happen over and over again. Put another […]

The removal of sun.misc.Unsafe and other private APIs in Java 9 has in recent weeks divided the Java community perhaps as never before in its 20 year history. Even though a resolution has now been proposed and a migration path presented, the big question remains: What will a post sun.misc.Unsafe world look like?

Everybody is talking about Conway's Law these days – tear down organizational boundaries where they are not useful. Etsy did so in the space of mobile development: there are no longer dedicated mobile dev teams, but every developer is trained on mobile and every team is doing mobile development. We talk to Hannah Mittelstaedt about the benefits and drawbacks of such a transformation.

A few weeks ago, the BBC News produced a list of the top 100 greatest American films based on input from critics from around the world. Here are the top ten films presented in rank order: Citizen…

Ajit Jaokar discusses data science and IoT: sensor data, real-time processing, cognitive computing, integration of IoT analytics with hardware, IoT's impact on healthcare, automotive, wearables, etc.

Detlef Vollmann explores the performance and scalability issues of atomic and possible solutions to overcome them.

While major rules rarely change, everything else about professional sports is variable. From new stadiums and safety equipment to changing ownership and retiring players, the games we love are anything but static. But the culprit behind the most recent changes may surprise many. 3 Examples of Big Data Producing Big Changes Some of the most […]

Every developer knows the pain of incompatible software. By using Docker executable images developers can take advantage of container technology to better control their development environments.

Java has introduced a new option that enable generation of mixed-mode flame graphs in JDK versions 8 and 9. InfoQ speaks to Netflix performance engineer Brendan Gregg about how this option gives application developers a clearer, combined system and JVM profile of their applications than was possible before.

When it comes to building things, data is everything.  It improves production and supply chains, and creates new possibilities for custom products. Accordingly, manufacturers hire more analytics…

There hasn't really been a break-out Summer hit this season, but Macklemore's latest — an ode to mopeds, of all things — might just be it (some language NSFW): Loving the 70's styling and dance

Carl Hewitt keynotes on the Actor Model and ActorScript, providing examples of using them for large-scale datacenters and IoT.

Authors:  Erica J. Dominitz, Barry J. Fleishman and Jon Neiditz Contracts with tech vendors increasingly include requirements of cyber-risk insurance […]

Predictive talent analytics, which helps in predicting employee performance, attrition and cost using Big Data analysis, is the future of talent hunting, but only 7 per cent of companies employ it to find the right hire, a survey says. According to a TJinsite survey from TimesJobs.Com across industries, as much as 90 per cent companies […]

Using data in real-time used to be a challenge. Lengthy extraction, transformation and loading processes make analyzing data an activity more akin to glancing in a rearview window than reading road signs as you pass. And with excitement building around the Internet of Things many just assume that harnessing sensor technology is an IT budget breaker. However, that doesn't have to be the case. Event stream processing combines high throughput (millions of events per second) and low latency (delays undetectable by humans) to make it easier than ever to work with vast amounts of data.

Iordanis Giannakakis and Savvas Dalkitsis present how Shazam releases faster, more predictably and with more features by using BDD and automation testing, without slowing down or hindering the development process.

Do't let performance management get you down. Instead, learn how accelerated performance management is making today's companies agile enough for tomorrow, and discover why the cloud is making that acceleration possible.

With Chrome 45 only the main Flash content will be enabled, the rest being paused unless the user decides to manually start it.

Clearly, no organization is impenetrable when it comes to cyberattacks by hacker–not the US government's Office of Personnel Management, not major retailers, not Ashley Madison, and not even global enterprise technology vendors. The sinister realities of cyberattacks in today's world hit Jen hard recently, leaving her to ponder practical approaches in which data can be utilized to combat hackers.

Cortana Analytics Suite is Microsoft's cloud-based big data and advanced analytics suite. It includes a complete set of all the services need to build advanced analytics applications: from data…

As the US deals with ever-growing healthcare expenditures, the industry must somehow bring these expenses under control. Digitizing all aspects of healthcare is an excellent way to help slow down spiraling costs and improve processes.

With the US Government's Cloud First initiative, many of the new technologies brought into the Department of Defense have been cloud based. With so many high profile hacks happening each and everyday, the Pentagon has swiftly implemented rules that vendors must abide by in terms of disclosing a potential security breach.

In anticipation of his upcoming conference presentation, Challenges in Leveraging Predictive Analytics for Big Data in Oil and Gas, at Predictive Analytics World Boston, Sept 27-Oct 1, 2015, we asked Dr. Satyam Priyadarshy, Chief Data Scientist at Halliburton, a few questions about his work in predictive analytics. Q: In your work with predictive analytics, what behavior […]

Customer-centric banking is providing tangible benefits to banks that want to increase customer lifetime value. By understanding your customers as individuals, you can tailor your marketing offers according to their needs and preferences.

Companies are spending billions on tools and engineering to analyse big data, though many are hampered by one little problem: they still don't know what to do with all the data they collect. "This is the dirty little secret about big data: No one actually knows what to do with it," Jason Waxman, an Intel vice president and general manager of the company's cloud platforms group, said Thursday in a webcast for investors. [ Learn how to unlock the power of the Internet of things analytics with big data tools in InfoWorld's downloadable Deep Dive. | Explore the current trends and solutions in BI with InfoWorld's Extreme Analytics blog. ] "They think they know what to do with it, and they know they have to collect it, because you have to have a big data strategy. But deriving the insights from big data is a little harder to do," he said.

Companies are spending billions on tools and engineering to analyse big data, though many are hampered by one little problem: they still don't know what to do with all the data they collect. "This is the dirty little secret about big data: No one actually knows what to do with it," Jason Waxman, an Intel vice president and general manager of the company's cloud platforms group, said Thursday in a webcast for investors. "They think they know what to do with it, and they know they have to collect it, because you have to have a big data strategy. But deriving the insights from big data is a little harder to do," he said. Big data is all about collecting large amounts of sensor or process data, the analysis of which can lead to insights into customer behavior and point the way to improvements in operational efficiency.

Amongst the top IT trends of the moment is the development of Linux Containers. Financial and technical investors, Linux software programmers and customers believe that Linux Containers will transform the way organisations manage their Linux environments from deployment to maintenance.

This research question investigates which kanban practices are considered to deliver additional value when used next to agile practices from mainstream agile methods such as Scrum or XP.

OKR (Objectives and Key Results) is a goal setting framework adopted by Silicon Valley companies that can complement Agile and Lean, creating an agile approach for setting goals and measuring value. Used by Google, Twitter and LinkedIn, OKR can help evolve the Agile Community and the Agile Manifesto itself from a focus on outputs (delivering features) to a focus on outcomes (delivering results).

Companies are spending billions on tools and engineering to analyse big data, though many are hampered by one little problem: they still don't know what to do with all the data they collect. "This is the dirty little secret about big data: No one actually knows what to do with it," Jason Waxman, an Intel vice president and general manager of the company's cloud platforms group, said Thursday in a webcast for investors. "They think they know what to do with it, and they know they have to collect it, because you have to have a big data strategy. But deriving the insights from big data is a little harder to do," he said. Big data is all about collecting large amounts of sensor or process data, the analysis of which can lead to insights into customer behavior and point the way to improvements in operational efficiency.

Companies are spending billions on tools and engineering to analyse big data, though many are hampered by one little problem: they still don't know what to do with all the data they collect. "This is the dirty little secret about big data: No one actually knows what to do with it," Jason Waxman, an Intel vice president and general manager of the company's cloud platforms group, said Thursday in a webcast for investors. "They think they know what to do with it, and they know they have to collect it, because you have to have a big data strategy. But deriving the insights from big data is a little harder to do," he said. Big data is all about collecting large amounts of sensor or process data, the analysis of which can lead to insights into customer behavior and point the way to improvements in operational efficiency.

More than 70 percent of companies are not currently confident in their ability to restore data in the case of an outage. This new guide from Expedient outlines 6 Steps to Disaster Recovery Preparedness. With planning and testing, IT leaders can prepare for a disaster before it strikes.

Jearvon Dharrie discusses how ClojureScript stacks up against ES6. He demonstrates code examples in Javascript and ClojureScript.

Neha Narkhede discusses how companies are using Apache Kafka and where it fits in the Big Data ecosystem.

Kolton Andrus presents how Netflix, in order to harden their systems, designed "Failure as a Service" to allow anyone to test and validate how their systems handle failure.

Chipmaker Intel Corp. is expanding its push into big data with an equity investment and a technology partnership with BlueData, the startup that specializes in generating virtualized big data clusters. Along with the strategic technology alliance, BlueData, Mountain View, Calif., announced a $20 million funding round this week led by Intel Capital. Amplify Partners, Atlantic Bridge, Ignition Partners and an undisclosed investor joined the Series C funding round. The partnership calls for BlueData to tailor its big data infrastructure software for the Intel x86 architecture. Intel said it would focus on developing a joint engineering roadmap and customer acquisition.

The start of summer marks the beginning of an annual internal struggle. When the temperatures and humidity rise during the season's first heat wave, I reassess my energy consumption habits, specifically when I turn on the air conditioner (AC). This internal dispute pits personal comfort versus a tight budget and the desire to do what's right from an energy conservation perspective. The central AC unit in my home is at least 20 years old, so while it still pulls the warm air out of my house quite nicely, I am well aware that it also pulls the money out of my wallet just as fast.

Digital assistants are all the rage and Facebook's M is the latest in a market that includes Siri, Cortana, Google Now, and Amazon's Echo. However, Facebook is teaming up AI and humans.

Digital assistants are all the rage and Facebook's M is the latest in a market that includes Siri, Cortana, Google Now, and Amazon's Echo. However, Facebook is teaming up AI and humans.

Your telecommunications company has its big data strategy down to a science. You collect data, mine it and then use it to provide personalized service, design targeted marketing campaigns and create partnerships. But are you getting the most benefit possible from your data analytics program?

The world is churning out 2.5 quintillion bytes of data every day, with 90% of it created in the past two years. Most of this staggering volume comes from apps, social media sites, YouTube and other video sites, online searches, transactional data and, increasingly, machine-to-machine transactions. The challenge that organizations face with big data is […]

In chaos theory, the butterfly effect posits that seemingly small changes at one moment in time can result in large, dramatic changes at another. The subtle flap of a butterfly's wing can trigger a…

Now that I've: 1) defined individualization as the next generation of loyalty and customer engagement and 2) identified the five keys to individualized loyalty, I'd like to explore how a few leading brands are innovating and excelling with individualized loyalty and customer engagement programs. Disney Born out of a desire to reduce friction and deliver a "touch of magic" to the customer experience, MagicBands are quickly becoming an integral part of Disney vacations. These RFID-enabled bands are individualized to each guest and eliminate the need for paper tickets…

by Joseph Rickert I recently rediscovered the Timely Portfolio post on R Financial Time Series Plotting. If you are not familiar with this gem, it is well-worth the time to stop and have a look at it…

Upcoming changes to the lease accounting standard are expected to compel organizations to record recent and existing leases on balance sheets, which have traditionally been off balance sheet. Find out the latest word on the street about these changes, and how they are expected to impact organizations spanning a wide range of industries.

LinkedIn has recently open sourced QARK, a static analysis tool meant to discover potential security vulnerabilities existing in Android applications written in Java.

Technologies and Big Data continue to bombard our working lives. Discussions and debates continue to reinforce the fact that change is inevitable. No one disputes this premise as change is really the one constant in life. But the difference in today's current climate of change is the argument that the old approach and disciplines of […]

Software architecture is a process; a sequence of strategic design decisions mapping specification and business goals to architecture design, and a thing; a set of views produced by the process that address different stakeholders, Michael Stal states describing how to define a software architecture.

Predictive analytics can transform your organization by helping you compete more effectively, grow sales revenues, retain customers, discover new customers, prevent fraud, improve operations and much more–but to achieve these strategic impacts, it's best to think big, start small and act fast.

As data continues to grow at unprecedented speeds, organizations must embrace a data-driven mind-set to stay competitive. With the influx of bigger data and new types of data, companies of all sizes are increasingly dependent on large sets of information to make better business decisions.

A document classification model can join together with text analytics to categorize documents dynamically, determining their value and sending them for further processing. Learn how a quick, efficient solution can create business advantage.

Social media sources such as Twitter, Facebook, Instagram and Pinterest help CPG leaders listen to, learn from and connect with consumers. Here are three ways that CPG leaders are expanding their use of data and analytics to augment their social media strategies.

How is technology impacting your business? We've always delivered core processing technology to support our clients' clearing, settlement and custody needs, but now we are extending technology across the entire investment process. We're about to deliver an open-source, cloud-based digital ecosystem called NEXEN, which delivers capabilities from all parts of BNY Mellon through a single gateway to our clients. The platform includes an API store that lets clients co-develop and integrate with us, using their own applications. It also allows us to integrate with third-party service providers, and reduces our clients' vendor management and integration costs by making the integration process turnkey.

Owning and operating a small business comes with unavoidable hurdles that, if poorly navigated, have the potential to sink the business for good. One of these hurdles is the need for business efficiency, which can be challenging for up and coming organizations that lack the funds of larger companies to purchase the latest software programs for streamlining every operation. If you're a small business owner, there is plenty of hope for you and your employees to break through these challenges by incorporating seven key efficiency tips into your small business.

Mobility, cloud and big data all promise to help enterprises increase efficiency and productivity, improve decision-making and lower costs. The laudable goal is to make your business more competitive, but for your IT, legal and compliance teams, these new technologies often lead to increased complexity, loss of control and even increased costs as massive amounts of data now move to an ever-increasing number of endpoints, including mobile devices and third-party hosting services. These challenges can be overcome with a new approach to standardizing information metadata.

This entry was posted in News. Bookmark the permalink.