Orby AI

Orby AI

Orby AI

Help financial operation specialists to review and process contract data more efficiently with AI automation.


Help financial operation specialists to review and process contract data more efficiently with AI automation.


Overview

Overview

Overview

Our client is working on a web-based AI-powered document automation product that aims to improve document handling productivity for non-tech background enterprise users.

For this version, the product team has been working closely with financial operation specialists at Google,to improve the contract processing workflows through AI document suggestion and validation functionalities.

Timeline

Timeline

Timeline

February - March 2023 (8 weeks)

User Need

User Need

User Need

Save time for financial data extracting process including invoice processing, contract processing, etc.

Business Need

Business Need

Business Need

Deliver MVP version to Google within a tight time frame to gain a long term big name customer, so that to expand business.

Team

Team

Team

Flora Wang
Xijia Zhang

Xianli Zeng
Wen

Impact

Impact

As a Design Associate, I solved the key usability issues and redesign the experience of the review and validation process. The new design led to a 75% reduction in document processing time and a 85% increase in productivity.

Solution 1

AI Training Mode

AI Training Mode

AI Training Mode

In the AI training mode, we provide a quick-start tutorial for new users to get familiar with Orby interface. At the same time, Orby AI observes and captures the training data as the user performs the process by reviewing documents and manually identifying term entities.

In the AI training mode, we provide a quick-start tutorial for new users to get familiar with Orby interface. At the same time, Orby AI observes and captures the training data as the user performs the process by reviewing documents and manually identifying term entities.

Solution 2

Review & Validation

Review & Validation

Review & Validation

Orby AI provides extraction suggestions for users to review. Users just need to check the extraction results one by one and choose to accept, reject or modify specific fields and export the results into Google Sheets.

Orby AI provides extraction suggestions for users to review. Users just need to check the extraction results one by one and choose to accept, reject or modify specific fields and export the results into Google Sheets.

Solution 3

Suggestion Panel

Suggestion Panel

Suggestion Panel

It’s an entry point to Orby experience. It gives the user suggestions for the new contracts in the queue in Google Drive. The users can also search in the list, expand to view more details, and manually add suggestions to the list.

It’s an entry point to Orby experience. It gives the user suggestions for the new contracts in the queue in Google Drive. The users can also search in the list, expand to view more details, and manually add suggestions to the list.

Problems

Problems

We summarized what we found and built our main persona:

Before we started the partnership with stakeholders, engineers had done a demo version which prioritized technical feasibility but lacking of enough consideration of user experience.

1. Unclear Guidance

The current design doesn't provide clear guidance and CTA, and cannot help users prioritize their tasks. Users didn’t know what would their current status or happen next.


  1. Low Efficiency

The current approach using color codes to indicate key terms does not make the review experience easier or more efficient; users still found it challenging to locate information between the suggestion list and the original content.

3. Edge Cases

Documents could have a wide range of formatting and layout variations, resulting in multiple types of terms to be extracted. Current design is not flexible enough to meet the needs of different use cases.

How might we build users’ trust and reduce the frictions in AI suggestion and validation user flows?

Challenges

Challenges

Challenges


  • How might we engage user during AI training?

  • How might we build user trust for Orby AI suggestion?

  • How might we optimize the key term suggestion and validation flows?

  • How to start the Orby experience?

Approach

Approach

Approach

Within the tight timeframe, we close worked with AI engineers and fast iterated. While we followed user centered design process, we offered flexibility to work on new use cases that were brought up by AI engineers during the process.

Design & Iteration

Design & Iteration

1.AI Training Mode

1.AI Training Mode

How might we engage users during AI training?

How might we engage users during AI training?

How might we engage users during AI training?

The process of AI training involves Orby learning from user actions like reviewing documents, identifying terms, and manually inputting them into sheets. As AI takes time to capture data and learn, it's important to consider engaging the user throughout the process. To address this, we came up with two solutions: Orby chatbot & Orby training mode editor.

Solution A - Orby Chatbot
Low-fi

Low-fi

Hi-fi

Hi-fi

The Orby logo serves as a chatbot to guide users through the process. We began by using the existing logo and developed a concept to symbolize the training procedure through water filling. The rising training score denotes that the model is progressively becoming more trustworthy and supportive.

Based on feedback from our clients, we made the chat box smaller to avoid interfering with the interface and reduced the opacity of previous dialogue boxes to create more space and improve visibility.

Solution B - Orby Training Mode Editor
Solution B - Orby Training Mode Editor
Original Way

Original Way

New Approach

New Approach

Users currently have to manually review documents through a PDF viewer and extract key terms. This process can be time-consuming and prone to errors.

We propose a training mode editor with an interface like Orby's review and validation interface. This interactive mode will help users familiarize themselves with the Orby AI interface and realize that Orby is constantly learning behind the scenes.

After receiving feedback on the need for a more engaging experience, we made three significant modifications to improve user engagement:

  1. 2 Training Options

reviewing in PDF format or through the Orby interface.

Guided Tutorial

Guided Tutorial
  1. Guided Tutorial

Instruct users step by step.

Congratulations Page

  1. Congratulations Page

Encourage users to complete the training process.

2. Review & Validation

2. Review & Validation

How might we optimize the key term suggestion and validation flows?

How might we build user trust for Orby AI suggestion?

To address these 2 questions, we analyzed user needs and incorporated the most useful functions and groupings that users most likely to use, and offered customized options such as sorting, search, and multiple filters. However, we received feedback stating that we had included too much information and hadn't considered the actual user flow, resulting in a disorganized hierarchy that made it difficult for users to find a starting point. These comments prompted us to reconsider :

How to create a Guided Experience?

Iteration

During the mid-fi stage, we prioritized the necessary features and developed two options and compared the pros and cons:

After evaluating the user experience and identifying the issues, we decided to merge the advantages of each into one. In the iteration, we separated the suggestion list and edit panel to allow users to avoid constantly looking left and right. Furthermore, by placing the most important information at the top, we can give users a quick overview of the contract.

Edge Cases

Though our clients are quite satisfied with the revised version, they also pointed out a few edge cases that we had not previously considered:

1.How to review long paragraphs?
2.How to review discrete information/cross-page terms?
3.How to add missing items to the suggestions?
1.How to review long paragraphs?

Our team has designed four floating cards that are of equal height but varying widths. This allows for easy customization to fit the length of different paragraphs while maintaining consistency.

2.How to review discrete information/cross-page terms?

Considering this use case, we add a plus button on the right corner, by clicking it, user can add another field and select content from the contract into the card, and by clicking “minus” button to remove.

3.How to add missing items to the suggestions?

When Orby cannot find the corresponding contents in the contract, this key term will move under the “not in doc” category.

3. Suggestion Panel

3. Suggestion Panel

How to start the Orby experience?

How to start the Orby experience?

How to start the Orby experience?

By analyzing the issue of the existing design and gathering feedbacks from users, we found out that the suggestion panel needs to fulfill three fundamental requirements:

1.Users should be also able to Quickly identify different files
2.Users need to manually add/remove files in here
3.Provide access to the Orby web app interfaces

In the first concept, we explored 2 options - V1/V2

We received feedback that the card view is the best option for scalability. We applied it during the iteration and solved design questions such as:

  • How to quickly locate the files the users want to review?

  • How do we determine the priority of the information displayed?


Lessons Learned

1. Root in user needs and get design ideas from real use cases.

2. Keep the information hierarchy clear and concise, avoiding unnecessary design elements.

3. Be mindful of edge cases and different scenarios to ensure the system is adaptable to various use cases.

4. Keep stakeholders in the design discovery. This can help ensure that everyone is on the same page from the beginning and that everything is clear when it comes to the final product.


Hi again!

I'm thrilled you're here.

Let's Connect!


Hi again!

I'm thrilled

you're here.

Let's Connect!