Posts

This article is part 8 of an 8-part series on evaluating the best CPM tools for your business. Part 8 focuses on why and when to use third-party rankings from analysts when evaluating the best CPM software applications.

 

While some companies don’t need to go through a detailed selection process to come up with a list of the top Corporate Performance Management (CPM) software solutions for their organization, others have their work cut out for them. If you belong to the latter category, here is a vendor evaluation tool that may be of help.

One of the key items on many CPM product evaluation checklists is to look at how third-party firms, usually referred to as analysts or analyst websites, review and rank vendors.

Below, we will discuss the use of analysts to help evaluate and score the best financial reporting and planning solutions for your business requirements. This type of third-party research can complement the findings and opinions from your internal team.

When analyst firms are of less importance

Before we go into detail about analyst firms, let’s briefly cover some situations where analyst reports with CPM vendor rankings are not as useful and, in some cases, cost extra time and money in the selection process. One such example is when there is already a leading CPM solution partnered with your ERP vendor and offering pre-built integrations and other benefits that outweigh other potential vendor differences.

Another example is when multiple people on your staff have deep knowledge of a leading CPM solution that they have used before, ideally while they worked at a company from the same industry to ensure that there is still a fit.

Which analyst firms should you use?

While there are a few firms with analysts that are CPM industry experts who do months of research every year to analyze trends and rank vendors, there are many more analysts that are a waste of time or are even directly misleading in their rankings.

  1. Examples of professional CPM analyst firms
    • Analyst and survey-driven rankings: Gartner and Dresner Advisory Services
    • User-driven rankings: G2
  2. Unqualified or misleading “analyst” firms
    • Clickbait websites that will come up with their own vendor lists with no proper research, purely to get ranked on a search engine in order to sell advertising or get “sponsorship” money vendors pay to be on (e.g., a “Top 10 CPM Vendors” list)
    • Websites owned by CPM vendors ranking themselves
    • “Research reports” from “analysts” paid for by a specific CPM vendor

So, if you consult analyst reports to help find the best CPM tool for your company, be conscious of who or what is proving the advice.

How do you know if analyst reports are biased or fair representations of vendors?

It is clear that almost all research performed by a human being is biased one way or another, either consciously (e.g., based on vendor sponsorships or who they speak with the most) or unconsciously (e.g., based on the knowledge of the analyst). Even a firm as well-known as Gartner arguably has some bias in their reports because they include analyst comments, and they include vendor revenue as one of the drivers in their “Magic Quadrants” – something which may or may not indicate who a “leader” should be in a specific industry. Especially with the pace of technology changes and acquisitions in the marketplace, the best CPM solution for your business 6 months ago may no longer be the top choice today.

Other analyst reports or vendor rankings are websites that are driven by user feedback as compared to analyst research. You could argue that these websites provide the most neutral feedback although not as detailed and analytical as the major reports produced by full-fledged analyst firms.

Then there are the countless firms that provide “awards” and rankings based on payments from vendors. These are highly biased and should be avoided. It is fairly easy to detect them by reviewing the firm’s website and observing the lack of depth in CPM research and content.

What professional analysts get right (and sometimes don’t)

The top CPM analyst firms typically do one major CPM report per year. All or parts of the data in the report is driven by customer surveys completed by each vendor’s customers. Because of all the work that goes into these reports and because customers don’t want to be constantly bombarded with surveys, the reports will represent data that is up to 15-16 months old. This lag is because customer surveys typically start 3-4 months before the report is released and then the report will be out on the market for a year until next year’s report is out.

Because many cloud software vendors have monthly releases, and new features arrive all the time, these reports could be missing important vendor features. Websites like G2 and others are starting to follow the same model; they are constantly updated whenever a customer decides to leave their feedback. However, they are less detailed and structured.

Examples of analyst firms that review CPM software

There are a number of companies that provide CPM vendor reviews and market research. Here are examples of three different categories of such firms:

  1. Gartner: Analyst + customer survey-driven vendor rankings. Also provides research reports across almost all categories of IT firms. A major CPM report is produced once per year.
  2. Dresner Advisory Services: Customer survey-driven vendor rankings. Also provides research reports. Almost exclusively focused on CPM (they refer to it as EPM, or Enterprise Performance Management). A major CPM report is produced once per year.
  3. G2: Customer feedback driven. Ranking reports are produced automatically on their website (g2.com). Rankings are continually updated as customers enter their feedback on the G2 website.

How much does it cost to use an analyst firm?

Some CPM vendor research reports are free while many are licensed by the CPM vendors themselves and shared with customers. However, be aware that vendors naturally will only license and share research reports that shed a good light on their product, so there is a bias here to be cognizant of.

Some analyst firms also provide selection services, either as paid calls with their CPM advisors or as full-blown gigs where they will lead or participate in the entire selection process as a “consultant.” In past years, they used to then provide clients with RFP templates with hundreds of pre-defined questions. These have become less popular in recent times as both vendors and internal evaluation teams dread lengthy narratives always shaped to sound good, or they can miss entire functionality areas that are up and coming.

In any case, it is almost always beneficial to do your own homework first by listing your current pain points in as much detail as possible and quantifying ($$) the cost and effort of running the current reporting and planning processes. This “homework” should also include the management team’s vision of the business benefits they want to achieve with a new CPM solution.

Conclusion

The leading cloud CPM software solutions have a lot of features and functionality, and changes and improvements are being released all the time. So, when you and your internal team are coming up with a shortlist of the best CPM solutions for the company’s needs, it is advisable to do your own research, review product demonstrations, and make sure the top candidates integrate easily with your ERP and other important systems. If you have special complexities or a lack of time and evaluation skills on your team, then an analyst firm can assist you in various ways.

Links to useful software research and evaluation assets

LOS ANGELES, CA. – August 20, 2020 – Solver, a global leader in cloud and web-based Corporate Performance Management (CPM) for mid-market ERP systems, today announced their recognition as an Experience Leader and a Trust Leader in Enterprise Performance Management in Dresner Advisory Services’ 2020 Industry Excellence Awards, based upon vendor ratings from the Customer Experience and Vendor Credibility models in their annual series of flagship Wisdom of Crowds® Market Studies.

“We are excited to receive this recognition from Dresner Advisory Services and it is a great motivation for our global teams to keep enhancing customer experiences in any area we see opportunities to excel,” says Nils Rasmussen, CEO at Solver.

“Our hallmark research, and by extension the Industry Excellence  awards, are based solely on the input of customers with first hand experience using the technology and interacting with suppliers on a regular basis,” said Howard Dresner, founder and chief research officer at Dresner Advisory Services. “We recognize the organizations who are highly regarded by their customers and offer our congratulations to Solver on their first year of inclusion in our annual award program”.

The annual Industry Excellence Awards go to vendors who have achieved a leadership position in the Dresner Advisory Services 2020 Wisdom of Crowds Business Intelligence (BI), Enterprise Performance Management (EPM), and/or Analytical Data Infrastructure (ADI) Market Studies.  The reports are based on data collected from end users and provide a broad assessment of each market including current usage, key drivers, technology priorities, and future intentions, as well as performance ratings of relevant vendors.

The Customer Experience model considers the real-world experience of customers as they work with a vendor’s technology solution on a daily basis, plotting the various customer touch points against sentiment surrounding product and technology. The Vendor Credibility Model considers a vendor’s relationship with customers, plotting perceived value for price paid against a calculated “confidence” score. Vendor ratings are based solely on voice of the customer.

Overall, Solver demonstrated high levels of sales and service as well as product/technology while Solver customers reflected a high level of confidence and sense of value for price paid.

 

About Solver

With a quickly growing community of thousands of global customers and hundreds of partners worldwide, Solver provides a leading cloud Corporate Performance Management suite for Microsoft Dynamics 365 Finance and Operations and Business Central, Acumatica, SAP Business One, SAP ByDesign, Sage Intacct, Sage 100, Sage 300, Sage 500, Sage X3, NetSuite and other ERPs. Solver is ranked in the leader quadrant in the Corporate Performance Management (CPM) Software Grid on G2, and as a Microsoft Gold ISV Partner, Solver has won countless awards, including Enterprise Performance Management 2020 Dresner Industry Excellence Award, Microsoft BI Partner of Year Award, recognition on the Gartner Group CPM Magic Quadrant, and Best Places to Work for a workplace culture that celebrates customer service, integrity, and innovation. Solver is sold through its 12 global offices and a worldwide network of partners. For any questions, visit www.solverglobal.com or contact Solver at info@solverglobal.com.

 

About Dresner Advisory Services

Dresner Advisory Services was formed by Howard Dresner, an independent analyst, author, lecturer, and business adviser. Dresner Advisory Services, LLC focuses on creating and sharing thought leadership for Business Intelligence (BI) and related areas.