Is it possible to do accurate predictive modeling in-house, or does it require outside expertise?

rousseau

Data analytics has been a great way for us to gain insight into our customers behavior, but it doesn't really tell us what they will do in the future. We are discussing a predictive modeling project, and there is some debate whether we can do this in-house, or whether we need to contract out for the project. Obviously, the downside of the second option is cost, which will run into six figures. On the other hand, using our internal resources only results in savings if the results are valid. How accurate has predictive modeling generally proven to be, and is it realistic to take on the task in-house, or does it really require outside experts to get it right?

Answer this Question

Answers

2 total
hughye
Vote Up (3)

One of my degrees is a B.S. in anthropology, and in that field agent based modeling, which is a type of predictive modeling, is sometimes used to objectively measure behaviors within populations.  I had a professor who utilized it extensively in his research and I gained some exposure to the methodology.  Basically, you have to create a mathematical model that predicts how a system or population will behave based on prior data.  It is not easy or simple in any way.  I hate to admit it, but when my professor was explaining some of the finer points of his modeling, I had difficulty follow the process.  Unless your company has some serious talent and experience with predictive modeling, I don't think it would be feasible to do it in house.  I would expect to pay mid six figures to bring in someone and develop a project for a company.  Maybe more.  If they know what they are doing, however, the investment can pay off.  Back at university, it was pretty amazing to see how closely actual behavior tracked the results of agent based modeling, but to get those sort of results you really have to know what you are doing.

jimlynch
Vote Up (8)

I suspect that the answer will vary, depending on the company. It might be a good idea to find out what specifically the outside company can do for you in terms of services. Then sit down with your internal group and find out if they can replicate everything on that list.

If they can't then the outside company might be your better bet if you really need accuracy as reflected in their list of services. But if your internal people can do it then have a go at it and see what happens.

Ask a question

Join Now or Sign In to ask a question.
A strong stock market could open the floodgates for more tech IPOs in the wake of Friday's solid debut of Marketo and Tableau, but not all segments of IT may be able to ride the wave.
Anyone remotely within the orbit of SAP lately knows that its number-one focus is the HANA in-memory database and development platform. At this week's Sapphire conference in Orlando, the vendor sought to show the progress it is making in both building out HANA's capabilities as well as attracting developers and partners to HANA.
If comparing Bing and Google on regular search results isn’t enough, try comparing them based on autocomplete suggestions
GE, Allstate try crowdsourcing contests where external brainiacs compete to produce the best answers to big-data analytics questions.
Making good on a promise made in December, VMware and parent company EMC have launched a new company, called Pivotal, to offer an enterprise-ready data analysis platform as a service (PaaS) based on software from both companies.
Infor is planning to offer customers a cloud-based data warehouse and analytics platform based on its own ION and Business Vault technology as well as Amazon's Redshift service.
IBM's reported interest in selling parts of its x86 server business to Lenovo may bring major changes to the global market.
The data is there, but according to IBM business analytics and optimisation leader, Graham Kittle, it is what we do with it that counts.
The IRS is scaring taxpayers silly this season with boasts about its Big Data prowess and 'robo audits.' But recent reports suggest the agency is struggling to keep its IT operations afloat.
Forty-eight percent of the CIOs surveyed expect to increase spending this year, up slightly from this time last year. Mobile, business intelligence, and cloud infrastructure and services are the most cited categories.