Proposal Analyzer

Overview

Proposals submitted by law firms contain a ton of strategic, vital information for customers, but when comparing multiple proposals, it can be difficult to pick out and quickly understand the key differences between each.

We’re solving this with Proposal Analyzer, an automated, AI-generated proposal analysis feature that lets clients quickly understand the key differences between firms’ proposals without having to read through them line by line.

Proposal Analyzer leverages ChatGPT to summarize proposals to uncover strengths and weaknesses, and recommended questions to ask firms to help understand their responses better. Additionally, if a client includes written criteria in the scope of their request (i.e. importance of DEI or Price), Proposal Analyzer will also rank the proposals based on how well they reflect that criteria. If no criteria is listed, Proposal Analyzer is trained to look for most important factors like cost, diversity, and strategy when compiling its rankings.

In-App Highlights

When you go into the proposal comparison view, there are two main areas of Proposal Analyzer to focus on:

1. The button at the top left “Analyze with AI”
2. The button at the bottom right “Summarize with AI”

Analyze with AI

When clicking this button at the top left, Proposal Analyzer will compare each proposal line-by-line, across all items in a proposal. This is a huge efficiency boost to help clients quickly compare items across all firms. Below is an example of how it compares a sample questionnaire line item, Strategies for Success. What was once paragraphs of text in each proposal is now summarized in bullets for this line item. 

The highlights you need to know about each law firm’s proposed team, strategy, and more are curated for you line-by-line.

Summarize with AI

The ‘Summarize with AI’ button at the bottom right will provide an overarching summary of all proposals. Its main purpose is to provide a high level overview of the key differences between all proposals, providing the following information for each firm:

• Proposal summary
• Strengths and weaknesses of the proposal
• Recommended questions to ask firms to get better responses for specific sections
• Additionally, if a client includes written criteria in the scope of their request, Proposal Analyzer will also rank the proposals based on how well they reflect that criteria. If no criteria is listed, Proposal Analyzer is trained to look for most important factors like cost, diversity, and strategy when compiling its rankings.

These items will all appear in sequential order as the user scrolls down the widget, starting with proposal summaries:

FAQ

How can I get access to this? Is it automatically on my account?

• Proposal Analyzer will only be made available to clients who opt-in to use AI features on the PERSUIT application and provide written confirmation. It will automatically be turned off for all clients unless opted in.
• Please reach out to your Customer Success Manager about getting access.

Which roles can access this feature?

• This will not be restricted on a role basis for the current release.

Is this available for all request types?

• Yes. However, if there are no qualitative questions and answers, the results are likely to be sparse/brief. If proposals contain attached documents, those attachments will not be part of the response. 

Can you provide more information on data privacy / security?

• All data Proposal Analyzer sends to ChatGPT is encrypted in transit and at rest ensuring that only the Proposal Analyzer interface is able to access this data. The data that is sent with the prompt is single-use only for that specific analysis task, and PERSUIT has configured its use of ChatGPT so that client data is not used to train OpenAI’s models or improve their service offerings.
• OpenAI will retain any data sent by Proposal Analyzer for a maximum of 30 days for monitoring purposes before being securely deleted. The monitoring period is only to ensure standard data privacy and prevent misuse. Only OpenAI can access this data during that 30 day period.
• PERSUIT and OpenAI have executed a Data Processing Agreement that complies with GDPR and CCPA.
• ChatGPT runs on Microsoft Azure servers within the US only and OpenAI’s API is certified as being SOC 2 Type 2 and SOC3 compliant. OpenAI is compliant to the same security level that our clients have with PERSUIT.

Will information sent to ChatGPT be shared into the public domain?

• PERSUIT uses OpenAI’s API to access the ChatGPT 4 LLM. This is a private connection to the LLM and no PERSUIT client data will make it into the public domain through this service. PERSUIT has configured its use of the OpenAI API so that data is not used to improve OpenAI's or ChatGPT's AI models or services.

What is included in a Proposal Analyzer prompt sent to ChatGPT?

• PERSUIT’ Proposal Analyzer feature uses the request title, scope of work and firm proposals in the prompt.
  • We ask ChatGPT to:
    
    • Provide a summary of each proposal
    • Highlight strengths and weaknesses
    • Call out fundamental differences, identify if clarifying questions are needed, and provide the suggested clarifying questions to ask firms
    • Rank all proposals based on how well they address the scope of the request
    • Summarize why the top ranked proposal is the top
  • Further, we ask ChatGPT to consider the firm's answers to a single question to analyze the relative strengths and weaknesses of each firm. The analysis may include but is not limited to: strategy, legal expertise, cost-effectiveness, diversity and relevance to the scope of work. ChatGPT does not give general advice.
  • In considering the pricing items in the proposal, we ask ChatGPT to analyze the relative strengths and weaknesses of each firm. The analysis may include, but is not limited to: fee competitiveness, consistency with client's pricing model preference and the assumptions made by the firm.

I’m seeing an error - what should I do?

• There are a few issues that may interrupt Proposal Analyzer. As a result, there are two different types of error messages that may display:
  • “Error retrieving cached proposal comparison”
    • This means the connection to our server has been unsuccessful.
    • If this happens, the button to generate the summary will be unavailable.
    • You can close this error message or it may resolve itself if the connection is re-established.
  • “Error generating proposal comparison, please try again later”
    • This means the connection to OpenAI has been unsuccessful in some way (service is down, internet connection is patchy, etc.)
    • The user can close this error message and press the button to try again at any time.
• If either error persists, users should contact PERSUIT support.