Proposal Analyzer

Overview

Proposals submitted by law firms contain a ton of strategic, vital information for customers, but when comparing multiple proposals, it can be difficult to pick out and quickly understand the key differences between each.

We’re solving this with Proposal Analyzer, an automated, AI-generated proposal analysis feature that lets clients quickly understand the key differences between firms’ proposals without having to read through them line by line.

Proposal Analyzer leverages ChatGPT to summarize proposals to uncover strengths and weaknesses, and recommended questions to ask firms to help understand their responses better. Additionally, if a client includes written criteria in the scope of their request (i.e. importance of DEI or Price), Proposal Analyzer will also rank the proposals based on how well they reflect that criteria. If no criteria is listed, Proposal Analyzer is trained to look for most important factors like cost, diversity, and strategy when compiling its rankings.

In-App Highlights

When you go into the proposal comparison view, there are two main areas of Proposal Analyzer to focus on:

1. The button at the top left “Analyze with AI”
2. The button at the bottom right “Summarize with AI”

Analyze with AI

When clicking this button at the top left, Proposal Analyzer will compare each proposal line-by-line, across all items in a proposal. This is a huge efficiency boost to help clients quickly compare items across all firms. Below is an example of how it compares a sample questionnaire line item, Strategies for Success. What was once paragraphs of text in each proposal is now summarized in bullets for this line item. 

The highlights you need to know about each law firm’s proposed team, strategy, and more are curated for you line-by-line.

Summarize with AI

The ‘Summarize with AI’ button at the bottom right will provide an overarching summary of all proposals. Its main purpose is to provide a high level overview of the key differences between all proposals, providing the following information for each firm:

• Proposal summary
• Strengths and weaknesses of the proposal
• Recommended questions to ask firms to get better responses for specific sections
• Additionally, if a client includes written criteria in the scope of their request, Proposal Analyzer will also rank the proposals based on how well they reflect that criteria. If no criteria is listed, Proposal Analyzer is trained to look for most important factors like cost, diversity, and strategy when compiling its rankings.

These items will all appear in sequential order as the user scrolls down the widget, starting with proposal summaries:

FAQ

How can I get access to this? Is it automatically on my account?

• Proposal Analyzer is available to clients who wish to opt-in to leverage the benefits of these AI features on the PERSUIT application. 
• Please reach out to your Customer Success Manager about getting access.

Which roles can access this feature?

• Once enabled for your account, all users are able to enjoy the benefits of this feature for the requests for which they have access.

Is this available for all request types?

• Yes. However, if there are no qualitative questions and answers, the results are likely to be sparse/brief. If proposals contain attached documents, those attachments will not be part of the response. 

Does it work with non-English languages?

• Proposal Analyzer is able to understand the contents of non-English proposals that are submitted in a non-English language and performs better with widely spoken languages. However, it has been prompted to return its summary responses in English.

What improvements have been made to Proposal Analyzer since it was released?

• PERSUIT has leveraged the rapid advancement in LLM technology and now uses ChatGPT 4o as the engine behind Proposal Analyzer.
• Proposal Analyzer can now support a larger context window which means many more proposals are able to be compared than before.
• PERSUIT has switched over to a Microsoft hosted and managed ChatGPT for greater alignment with enterprise customer compliance requirements.
• Users are now able to re-run the proposal analysis using the new ChatGPT 4o LLM for greater insights!

Can you provide more information on data privacy / security?

• All data Proposal Analyzer sends to Microsoft hosted OpenAI ChatGPT is encrypted in transit and at rest ensuring that only the Proposal Analyzer interface is able to access this data. The data that is sent with the prompt is single-use only for that specific analysis task, and PERSUIT has configured its use of ChatGPT so that client data is not used to train OpenAI’s models or improve their service offerings.
• Microsoft will retain any data sent by Proposal Analyzer for a maximum of 30 days for monitoring purposes before being securely deleted. The monitoring period is only to ensure standard data privacy and prevent misuse. Only Microsoft can access this data during that 30 day period.
• Microsoft’s data privacy and security for its OpenAI services can be found in the following links, including the Data Protection Addendum that covers GDPR and CCPA:
  • https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy
  • https://www.microsoft.com/en-GB/trust-center
• The Microsoft Azure OpenAI ChatGPT services meet or exceed the security protection obligations that PERSUIT has with its clients.

Will information sent to ChatGPT be shared into the public domain?

• PERSUIT uses Microsoft hosted OpenAI’s ChatGPT 4o LLM. This is a private connection to the LLM and no PERSUIT client data will make it into the public domain through this service.
• PERSUIT has configured its use of the ChatGPT so that data is not used to improve Microsoft or OpenAI's AI models or services.

What is included in a Proposal Analyzer prompt sent to ChatGPT?

• PERSUIT’ Proposal Analyzer feature uses the request title, scope of work and firm proposals in the prompt.
  • We ask ChatGPT to:
    
    • Provide a summary of each proposal
    • Highlight strengths and weaknesses
    • Call out fundamental differences, identify if clarifying questions are needed, and provide the suggested clarifying questions to ask firms
    • Rank all proposals based on how well they address the scope of the request
    • Summarize why the top ranked proposal is the top
  • Further, we ask ChatGPT to consider the firm's answers to a single question to analyze the relative strengths and weaknesses of each firm. The analysis may include but is not limited to: strategy, legal expertise, cost-effectiveness, diversity and relevance to the scope of work. ChatGPT does not give general advice.
  • In considering the pricing items in the proposal, we ask ChatGPT to analyze the relative strengths and weaknesses of each firm. The analysis may include, but is not limited to: fee competitiveness, consistency with client's pricing model preference and the assumptions made by the firm.

Where is PERUIT's ChatGPT service hosted?

• PERSUIT migrated to a Microsoft hosted and managed OpenAI ChatGPT instance on Azure in the US.