Intelligence Fusion is a Pain
Do you have “data integration frustration”? Believe me, you’re not alone. More and more, I am hearing from investigators and intelligence analysts the same pain, almost bordering on paralysis: They collect lots of new and relevant data from new sources – but the integration takes a lot of time. Our clients speak of recurrent challenging projects performed with proprietary BI solutions. Clues are left on the table. Crimes remain unsolved, threats are sensed but cannot be pinpointed.
Sure, it’s not always new sources that are the problem. Sometimes it’s simply an existing source with a new or realigned data field. For example, your Department of Motor Vehicles just began including eye color in the database: How long will it take you to adapt this new data set?
And there is so much data: Unstructured text, reports, government databases, SIGINT, OSINT, WEBINT, HUMINT, you invest precious time & resources to collect as much multiple source data as you can. But the data is a moving target. It takes time to sanitize, index and re-index data changes, and ultimately to translate your large data pool into coherent intelligence.
As the head of an intelligence fusion center project in a large European police force told me the other day, “We thought our priority is the application of Machine Learning to data mining and analytics, but discovered that what we really needed first – and still need – is simple and smart data integration.” I won’t repeat the exact words he used to describe how painful that integration process is.
Of course, you could always keep on your staff a large stable of PhDs and data scientists to keep your all-source investigations up to speed. Or you could have signed a never-ending contract with your system integration vendor.
Or not. Because it’s not easy to find, and keep, those data scientists. And you don’t want your System Integrator hanging around forever. That’s expensive, and beyond the money – what you really want is the independence and flexibility to add and amend data with speed and agility.
I’m here to tell you that building a data fusion center doesn’t have to be painful. There’s no reason to fear new data. In my next blog I will examine the inner workings of a healthy centralized investigation system – a.k.a. fusion – and how innovation in big data investigations and analysis can enable you to independently handle what you should always expect: unexpected data.
Author: Moranne Yaari
With Verint since 2008, Moranne Yaari is the Director of Strategic Product Marketing for Open Source Intelligence and Intelligence Fusion. Moranne has rich market knowledge and customer-facing experience. She was previously International Sales & Business Development Director and was responsible for greenfield markets. Moranne has eighteen years of experience in IT and in Government. She speaks English, French, Dutch and Hebrew fluently and holds a B.A in Architecture and an MBA in International Marketing.