Lucidum | Redesign Query Experience

About Lucidum

Lucidum is a cybersecurity and IT management SaaS platform that is designed to secure, monitor, and manage organizations' sensitive data and critical assets across all endpoints in their network.

My Role

I led product design for Lucidum, which includes user research, design wireframes and prototypes, and QA. I collaborated with various teams - like C-level executives, engineers, and customer service representatives - to ensure our solutions effectively meet user needs and business goals.

Project Scope

This case study mainly focuses on the redesign process of the query experience, which is a core function of this platform. Other case studies, including the redesign of dashboards and the design system, will be presented separately.

Role

Product Designer

Time

Q2 2022

Company

Lucidum, Inc.

Team

1 AI Engineer, 1 Infra Engineer, 5 SDEs

Problem

As Lucidum's cornerstone, the query function - bridging data retrieval to action creation - sets users' first impression. Yet, shaped by early product evolution and diverse user needs, the function diversified, amassing significant technical debt and creating user confusion.

Lack of Intuitiveness

During usability testing, users, especially those without a data science background, indicated confusion about where to start. One user voiced his struggle in choosing the appropriate option from each dropdown list. Even domain experts perceived the complexity, with one remarking that the tool felt more like a "coding sandbox" rather than a straightforward query tool.

Cognitive Overload from Diverse Query Function Appearances

After deeply analyzing each flow with the help of domain experts, I realized that various functions, though they appear different, all operate based on the same query function logic with slight variations. However, their diverse appearances in the existing platform create an extra mental burden on users to learn, remember, and differentiate each one.

Excessive Navigation and Function Redundancies

In examining the query function, I observed considerable issues with the navigation system. Key query functions were buried deep within the system, necessitating additional, unnecessary steps for users to access them. Moreover, redundant functionalities across several pages further complicated the user journey. These complexities posed significant challenges to efficient navigation and usability.

Goal

With a focus on user-centric design, my goal is to enhance our query function's intuitiveness and efficiency by streamlining navigation, reducing redundancies, and simplifying the user interface.

Information Architecture: The Foundation of Effective Change

Information architecture forms the bedrock of all meaningful changes. Without addressing it, any alterations would be mere patchwork, failing to solve the underlying issues. Collaborating with stakeholders and domain experts, I established these goals:

  • Streamlined navigation and restructured information hierarchy align with user mental models, enhancing content findability and facilitating easier system traversal for optimized search.
  • Maintain system-wide consistency by standardizing information organization.

Elevate Query as the Central Interaction Point

After internal discussions and few rounds of think-aloud sessions with loyal customers, it became evident that the query functionality serves as the primary interaction for users across multiple pages and diverse use cases. Therefore, it's important to streamline and enhance the query experience.

Boosting Query Function's User-Friendliness and Intuitiveness

The focus is on enhancing the user-friendliness of the query function, especially for those without extensive data science knowledge. The aim is to transition from a 'coding sandbox' feel to an accessible, straightforward query tool. This includes:

  • Enhancing the presentation of query tools by applying a unified layout and design approach across the application.
  • Standardizing query patterns and interfaces across all pages to diminish the learning curve, reduce visual clutter, and promote consistency.

Final Design

One query experience across the platform: grouped filters, consistent results, and asset details you can drill through, so people without a data science background know where to start.

Impact

Onboarded 10+ Clients Successfully Resulting in an Additional $5M in Annual Revenue

After the release of the Query Builder, we noticed a significant improvement in the demo process, resulting in an increase of 10+ deals. The intuitive nature of the Query Builder allowed our team to showcase the capabilities of our product more effectively, leading to a higher conversion rate during demos. This success can be attributed to the ease of use and flexibility provided by the Query Builder, empowering our sales team to customize and present data in a way that resonates with potential clients.

Design Decisions

Design Philosophy - Embracing Simplicity

Informed by both competitor research and user feedback, I came to understand that for a professional tool clients interact with daily, simplicity is crucial. Thus, the philosophy of 'less is more' organically emerged as the guiding principle throughout the entire design process.

To optimize functionality, the query tool was strategically divided into three parts: filter, query result, and asset details. I will delve into the specifics of each section in the following discussion.

Filters

The filter part, being the first interaction point for users, necessitates some level of data science knowledge. Further complicating the matter is the relationship between different filters, which adds an additional learning curve. In the previous design, users often expressed confusion about whether Filter A and Filter B were related through an "and" or an "or" clause. The embedded filters further escalated this complexity.

In response, I applied principles of Gestalt Psychology, using visual cues to group filters, making them easier to understand at a glance. I also used placeholders to guide users on the type of content they should input in the dropdown list.

Additional changes include:

  • Finalized the dropdown list groupings to ensure alignment with the users' mental models based on several rounds of discussion with C-level executives, data scientists, AI engineers, and loyal customers. I also proposed using a mega menu to provide a broader view of all dropdown options and group them into different categories (favorites, by data science group, by alphabetical order).
  • Based on user requests, I introduced two new features: 'query from query library' and 'query from query history'. The 'query from query library' feature allows users to save frequently used queries for easy retrieval, while the 'query from query history' feature saves time on repetitive tasks. For example, if a user needs to create different charts using the same query but in different chart types.

Query Results

Upon setting all the filters, users can then review all asset information that meets the specified criteria. The query results also serve as a bridge connecting filters to asset details. However, slight variations exist across different pages. For example, in the previous design, the Explore page allowed users to upload images and add values to a data field within the query results. Conversely, the Dashboard page provided users with the option to click on a column title to drill down. These inconsistent presentations led to user confusion and increased cognitive load.

To address these issues and ensure consistency across all parts of the query tools, I adopted the following design strategies:

  • I reviewed each variant on different pages, working with domain experts to critically assess and unify or remove some of these variants.
  • I standardized the appearance and interaction of these variants. Previously, functions like hiding/showing fields, uploading images, and adding values were scattered in different places with various formats, requiring extra attention from users to learn and remember. I proposed using a 'more' button on the right side to house expanded functions and dynamically show/hide some buttons based on the variant.
  • I facilitated a seamless transition from filters to details by integrating a 'back' icon at the top for returning to filters, and standardized access to each asset's details via a right arrow icon situated on the right side of each asset.
  • I recognized that table content could contain different data types. Drawing insights from competitors, I formatted these in various ways. For instance, list type fields were grouped into labels, time fields displayed in date and time format, and binary fields showed 'yes' or 'no' instead of '1' or '0'.
  • I determined a string length limit to prevent excessively long table content, which could cause a table break.

Details

The 'details' part, which contains the most comprehensive information for each asset, is grouped into two categories: one based on the data sources the user integrated into Lucidum, and the other following Lucidum's grouping consistent with the filter part's dropdown list. Previously, the 'details' section was a dead-end. Users were unsure of the next steps after viewing the clusters of values.

After defining specific use cases with users and domain experts, I implemented the following changes:

  • I added a breadcrumb at the top for cross-search functionality, enabling users to drill down from asset information to user information. For instance, if an employee rents a company laptop and doesn't return it within the designated time, the IT manager could query the device, go to the details section, click to view the user details, scroll to their manager, and communicate with them regarding the situation.
  • I standardized the interaction within this section, including pagination, table scrolling, sorting logic, tab format, etc.

Design handoffs

Once the groundwork was laid, I developed a use case outlining various paths, including the optimal path, error paths, and potential edge cases. Interestingly, the number of edge cases grew throughout the development process, thanks to the collaborative contributions of team members, including stakeholders, developers, and quality assurance personnel.

Along with detailed Figma files demonstrating specific user journeys, I also collaborated with a frontend engineer to establish a standard for component handoff. We developed a document to set rules for naming conventions (Page_Function_Component). I adhered to these rules when creating components and their variants in the Figma Design System. The frontend engineers also followed this naming convention when creating corresponding components on their end. This approach made each implementation trackable and easily modifiable. Additionally, we utilized the auto layout feature to ensure strict adherence to specifications.

Design System

After defining several options, we began sharing prototypes with engineers for testing. When certain features were validated, I was able to refine the designs and initiate the construction of a more detailed design system for ongoing development.

As for the development pipeline, I partnered with the frontend developers to implement the components in Storybook - a workshop for building UI components and pages in isolation. The next step was to deploy these components on the platform. This strategy was designed to progressively shift our development towards a more systematic approach, aimed at reducing future technical debt.

Research Process

Gleaning Insights from Domain Experts: Grasping the Core Problems

To comprehend the problem landscape more holistically, I engaged with diverse teams to understand their unique pain points. Importantly, I tapped into the wealth of knowledge held by our AI engineers and Data Sciences to understand the logic behind data acquisition, deduplication, and related complexities.

Simultaneously, I liaised with the infrastructure engineer to explore potential solutions for restructuring the information architecture. These collaborations were essential in shaping a well-informed approach to tackling the core issues at hand.

Conducted an onsite UX workshop during the pandemic

Resourceful Usability Testing and Interviews

As a startup in the B2B sector, finding opportunities for user research presented some unique challenges due to a smaller customer base. However, I leveraged every available resource to gather valuable insights. With the help of our customer service team, I connected with our loyal customers and conducted several rounds of usability testing and interviews. These sessions, including think-aloud exercises, were instrumental in understanding their pain points and expectations across various features.

Additionally, I utilized employee onboarding as an opportunity for further usability testing, capitalizing on the fresh perspectives new team members brought to our product. Despite the inevitable turnover in a startup environment, I transformed it into a benefit for ongoing user research.

Conducted an onboarding session for a new employee, along with a think-aloud session.

Extensive Feature-Based Competitor Research

Though Lucidum operates within the niche market of cybersecurity with limited direct competitors, the broader industry is replete with products that offer similar features. To innovate effectively, I dissected Lucidum into individual features and delved into studying each feature as implemented in a variety of products. For instance, I drew insights about query experiences from data search products like Metabase and Trevor.io, and studied chart creation experiences from platforms like IBM, among others. This extensive competitor research has provided valuable lessons to inform our product development.

Prioritizing Agile Prototyping and Continuous Feedback

Aware of the potential risks involved in investing too much in one solution without verifying the product-market fit, I sought to bring as many diverse ideas to life as possible for testing, rather than prematurely building a comprehensive system.

To ensure that these ideas were viable and resonated with our reality, I regularly sought feedback from our engineers. For larger scope projects, I advocated for breaking them down into smaller, more manageable milestones. This approach has allowed me to effectively contribute to our rapid prototyping and testing initiatives during my design research.