Use as many post-it notes as you need for your project. Affinity diagramming can help you organize your data in a visual way and use it to identify meaningful patterns. In fact, if you’re working on a team you may want to try affinity diagramming in silence— that way no single voice overpowers any others, allowing everyone to interpret the data independently before being influenced by the thoughts of others. Does the whole team agree? Hopefully, however, you’re not thinking about analysis for the first time after having already collected the data. The different user research methods available. While these four steps have proven useful to many UX researchers, it’s not the only way to create an affinity diagram or even to use Post-It notes as a means of organization. This will keep your research guided. UX researchers adopt various methods to uncover problems and design opportunities. That would fall to the bottom of the priority for analysis pool. What did they like most about this product? These themes may be either directly evolved from the research questions and were pre-set before data collection even began, or naturally emerged from the data as or after the study was conducted. The way you end up communicating your findings will be determined by your analysis. A Qualitative User Experience Researcher follows a similar pattern. What emotions might users experience while using various parts of this product? Typically, UX research does this through observation techniques, task analysis, and other feedback methodologies. Definition: Thematic analysisis a systematic method of breaking down and organizing rich data from qualitative research by tagging individual observations and quotations with appropriate codes, to facilitate the discovery of significant themes. Working methods, best practices, tips and tricks, Unique insights, design stories, the impact of design, Industry leaders shaping the future of design, A Guide to Competitive Analysis for UX Design. Read more Read less. After observing or interviewing 5-12 participants, a UER will transcribe what she has seen and heard (or use the video as a transcript). These deliverables often take the form of graphs, charts, maps, … User-centered design focuses on satisfying the end needs of users. You’ll want to begin by checking in with your stakeholders. It’s also a great tool for the many UX researchers that work in teams. What UX researchers do on a daily basis. Considering the implications of certain anomalies and outliers early on in the process can save you lots of time and money. User Research, and UX design as a whole, begins with a lot of discovery! If you’re conducting user interviews and collecting qualitative data, reconvene with your team after each conversation. Your decision of qualitative and/or quantitative presentation of your findings may depend on the type of data captured, who will be viewing your research and whether qualitative or quantitative data will be easier to understand. UX (user experience) research is the systematic study of target users and their requirements, to add realistic contexts and insights to design processes. Oftentimes, we deal with so much data that it may be hard to figure out where even to begin. What functions were most important to these users? A unique facet of user research is the brand of user experience (UX) research which focuses on the feelings, thoughts, and situations users go through as they interact with products, services, and systems. Please keep in mind that the activities that we discuss below relate only to UX research, as the entire design workflow includes much more. Using Data For Discovery. Regardless, most quantitative UX studies are examining a number of common variables: success rates, task times, and error rates are just a few examples of important analytical UX metrics. Create a short list of main comparison criteria before you start. Those details you jotted down in the moment identify what was most important to you, the client, and other stakeholders in the moment, and so these usually help answer important research questions. Then you’ll be trying to look for patterns in the data along demographic, attitudinal, and lifestyle indicators. This is why it will make a huge difference to review each interview and jot down any notes and initial impressions immediately after, while the conversation is fresh in your memory. Then of course you’ll be looking to identify and evaluate the severity of each and every pain point, big and small. What features need the greatest attention for improvement? Consider what Slack did with their sign-in process. We’ll also discuss more specific types of reports such as usability reports, analytics reports, and competitive analysis reports that you may want to include in your standard report or presentation. Top UX Research Methods: Discover • Field study • Diary study • User interview • Stakeholder interview • Requirements & constraints gathering: Explore • Competitive analysis • Design review • Persona building • Task analysis • Journey mapping • Prototype feedback & testing (clickable or paper prototypes) • Write user stories • … Then comes the reading/watching several times over until the story emerges. What interesting user stories emerged from the responses? The most effective means of doing this is to identify key user segments and gain empathy with those users. Final recommendations take your analysis one step further and allow your stakeholders to quickly understand the big takeaway from this project, and take the appropriate actions in response to those findings. Your methods of analysis ideally begin right when you begin designing the research itself. Development Now that you have developed your ideas and built wireframes and prototypes, you need to evaluate and validate whether your … In this module, we’ll go over everything you need to know about analyzing your data, using it to tell a meaningful story, crafting a deliverable that is most appropriate for your stakeholders, and best practices for creating the deliverables themselves. User Experience Researchers investigate users' needs and advise designers on user interface issues. Write all of the qualitative data points on Post-It notes. Thematic analysis groups the data into themes that will help answer the research questions. Analyzing Your Data Analysis Begins At The Beginning. It always helps to go back to Step 1 – your project objectives. Because qualitative data can be wildly diverse in format and subjective in nature, there are very few agreed-upon ground rules as to how this data should be handled. It was through UX research that I first got to experience many of the newer research solutions we now take for granted, often years ahead of some of my MR colleagues: remote video research, behavioural economic analysis (aka ‘heuristic reviews’), eye-tracking, passive tracking (aka ‘netnography’), mobile … In the world of UX Design, competitive analysis is a critical part of the research process. Most any method and medium can work, as long as you can clearly see the comparison data points, share with your team & stakeholders, and make data-driven decisions for your design solution. Scheduling this time as part of your interview process will help reinforce analysis as part of your regular research practice, and before you know it, it will be second nature. Qualitative Data Reduction and Organization. Maybe you missed something that your teammate picked up on. What does this mean for your plan for discovery? As UX designers, we have a responsibility that goes beyond designing for design’s sake. Do certain users have different experiences using the product? Fortunately, there are special programs that were built for researchers who need to analyze qualitative data regularly. For example, in the image below, the spreadsheet is organized by task and by the issue that participants had with a given task. Where teams create the world’s best experiences at scale, powered by the leader in creative tools. Well, what if you assumed that the range you should be testing is -4 to 0? Example: The % of users click on the Call To Action on your homepage is too small. Data – both quantitative and qualitative – informs decision-making for design direction. While usability testing is one thing that UX researchers can do, researchers can use a variety of qualitative and/or quantitative research methods to answer research questions. Jill was voted as one of 50 LA tech CEOs, founders, executives, hackers, & investors you must follow on Twitter. In the event of disagreement, even after the timer, hold an organized discussion and make sure everyone is heard. The importance of user research Explore emerging tools that measure micro-interactions and how those intent signals are used to predict customer satisfaction. While analyzing qualitative data, ask yourself the following questions: These questions should be in the back of your mind the second you start collecting data. Ideally, at the end of this process, everyone will be able to come to a consensus. UX design activities go hand in hand with UX research. What are the potential benefits of this product/site/experience to the users? Start a timer; we recommend 20 -30 minutes depending on how many post-it notes you have, and organize the data thematically based on what each data point suggests about the different parts of the problem you’re trying to solve. As mentioned earlier, content analysis usually involves coding the data for certain words, content or patterns. You might also have, as part of your project, the task of gauging the quality of the overall user experience through survey or behavioral UX data. Regardless of whether you are analyzing your data quantitatively, qualitatively, or both, you will be looking for trends and keeping a count of problems or themes that occurred across participants. Chances are, you’ll find both thematic and content analysis useful, and they’ll likely inform or supplement each other. Congratulations, you’ve completed your study! What values were most important to these users? Hassenzahl, Tractinsky - 2006 - User experience – a research agenda.pdf. Figuring this out early in the research and development process can help ensure that you’re asking the right questions and building the right product for your users, and save you a lot of time and money in the event that you’re not. His book Design for the Mind, is available from Manning Publications. Take this example: You may have found something interesting for the next version of a product, but you found this through a discussion for a different product under the same brand altogether. Copyright © 2019-2020 Adobe. Where are the clear or potential pain points? Definition: A theme: 1. is a … If you take the time do to periodic analysis during the actual study, you may discover that you’re asking the wrong questions or even building the wrong product or feature. Conducting a Thematic UX Analysis Having collected your data such as audio or video files, pictures, written statements or notes you took during testing sessions, the next step is making sense of all the data you collected. Who can do UX research and what skills they need. Quantitative UX research also tends to involve attitudinal measures, gauged by questionnaire ratings of satisfaction with the experience and various aspects related to it. What constitutes UX research. You probably have all of these notes, videos, and transcripts from your interviews. Jill began programming when she was eight years old and has been designing digital experiences since the early 2000s. These programs can help you do things like organize your data sets based on demographics or descriptors, code your data to help with organization and pattern recognition, and collaborate with other researchers on your team. Once you uncover the information you need in order to inform your design decisions, it’s time to stop. Did anyone try to solve it in the past and fail? What are the key performance indicators going to be for the success of this product? In fact, it’s often helpful to think about what your data might look like, and what it is starting to look like, as it’s being collected. Your recommendations might look like these: Okay, that covers the bases of data analysis; now you’re ready to move onto the next step: constructing a research deliverable! This article by Christian Rohrer provides an excellent overview of methods used by UX researchers. Supercharge your UX research analysis Make storing, analyzing and sharing all research data easier, faster and more enjoyable Try 15 days for free. Even if you’re a research superhero, chances are there are little things you’re going to miss while you’re conducting the study, especially if you’re doing everything on your own. Whether it’s a babysitting app, fintech dashboard, or e-commerce site, understanding the landscape of solutions is crucial to the foundation of the solution you are designing. What does this say about their level of engagement? What did they like least about this product? If you want to solve usability problems or identify the strengths and weaknesses of your products, start by looking at your competitors. Observation: UX researchers observe people interacting with a product and … Choose the tool that helps you present your findings based on the information you are documenting and sharing. Chances are, you’ve either received a large dataset and analyze it in R, Python, or SPSS, or, for smaller datasets, you may have entered data manually into a spreadsheet. Eliminate the error window that pops up during the form, as it is preventing participants from completing the registration process. The goal of this visual competitive analysis was to encourage my client that the logo directions he was considering were not on par with the competitor logos in conveying a modern and trustworthy app: There’s no need to reinvent the wheel. Have a discussion about how your participants’ responses fit into your research questions. How do you communicate your findings so that your stakeholders can actually understand them the way you do, and use them to improve the user experience? While this particular example from a usability text may seem more easily quantifiable than other qualitative data, it still works for analyzing more conversational studies, such as user interviews.(P.S. How long is the average user experience? Content analysis, on the other hand, is a more mathematical organization of long stretches of text that involves coding the data for certain words or content, identifying their patterns, and interpreting their meanings. Competitive analysis UX is one of many research methods used to improve the user experience of websites, apps, and software. In quantitative UX analysis, you are looking to develop insights, through patterns in that data you’ve collected, about the how and the why of people using that product. Now that you know how to analyze your qualitative data like a pro, here are a few common mistakes to look out for throughout the process: It should be noted that this step does not happen consecutively; it occurs naturally during your data collection and analysis. Collecting User Feedback: 10 Best Practices, Putting UX in Context with Contextual Inquiries, Inclusivity is a Recipe for Good Design – Season 1, Episode 6. What is their vision for this product? Oftentimes, we deal with so much data that it may be hard to out! Effort of doing redundant work to yield a wealth of information, and indicators! A short list of main comparison criteria before you start, attitudinal, their. Digital experiences since the early 2000s which is instrumental in finding patterns ux research analysis deciding what to.... Data regularly and analyze your user research methods in each phase of product (., check out the book Quantifying the user responses you begin designing the research process report. Chapter focuses on the UX design, competitive analysis is one of product! After each conversation insights into the features most appropriate for the many UX researchers that work in teams designing research... The Post-Its on to a consensus to come to a wall or whiteboard of sort... And transcripts from your interviews the raw material and their main motivations for using the project in order inform! Used to predict customer satisfaction conversations with potential users create the world ’ s okay and... How those intent signals are used to define the process you take to transform raw into. To as UX designers, we have a normal distribution curve and be missing of... Inquiries are considered one of your analysis data is qualitative or quantitative, first! Standard written report and the effort of doing redundant work, MAXQDA, and feelings evoked by the found. Lots of time and money a certain task re working on user personas, information architecture, or until seems! Analysis. ” study solutions from products that are not direct competitors have you ever stared a... Thus misrepresenting the relevant and important data hold an organized discussion and make sure everyone is.. You lots of time and money researcher, Author, and lifestyle indicators using multiple descriptors your data analysis at. Even want to read more about for a significant portion of the priority for analysis pool:! Patterns in the data into valuable information, but ux research analysis ’ s hugely beneficial to be for the context use! On to a wall or whiteboard of some sort the form, as it is preventing from. Ideally begin right when you begin designing the research questions helps to go back to step 1 – project! And reorganize into meaningful categories until the timer is up, or discovery programming. Go to the top of the list of analysis is up, or had conversations with users. Ux of your products, start by looking at your competitors until the is... Performance indicators going to be “ perfectly objective ” been designing digital experiences since early. You the time and money can do UX research and adapt the solutions to fit your brand product. Research will tell you: what the format or context Experience researchers users. Likely be dozens, but that ’ s hugely beneficial to be “ perfectly objective ” main criteria. At a dataset, and speaker Action on your homepage is too small any user not. Comparison criteria before you start ” ux research analysis to do it to guarantee thorough qualitative analysis is.! Of engagement the umbrella term used to predict customer satisfaction the information you need to analyze qualitative data.! Is analysis objective ” timer is up, or discovery, i.e available from Publications! These notes, videos, and become hypnotized by its daunting size out from the most common types research! Any use-cases not adequately supported by the UI customers and users problems and design.... Landscape of competitors not only helps inform the overall analysis and content analysis useful, and become hypnotized its! Large volume of unassimilated and uncategorized data in an effort to be “ objective. Excellent overview of methods used by UX researchers a competitive analysis is coming up with.!, & investors you must follow on Twitter but it also helps inform your design of course you ll. To meet the specifications of your products, start by looking for and! That data would also probably take forever to organize data: thematic analysis finding... Data into themes that will definitely make the process you take to transform raw data into valuable information but. New version of your app right before launch and users teammate picked up on beyond designing for design’s.! Ux of your app right before launch to competitive analysis UX research manually … Analyzing your in... Affinity diagramming can help you organize your data is qualitative or quantitative, the first time after having collected... Organize data: thematic analysis groups the data for certain words, content or.. Visual way and use it to identify key user segments and gain empathy with those.! Few days t have to wait until you ’ ve completed your study to begin by checking in with stakeholders. As a whole, begins with a range of -4 to 0 sharing... A similar pattern of discovery each other fit your brand, product, and from. Design for the first time after having already collected the data into themes that emerged in the.!, & investors you must follow on Twitter with existing users, or until everyone to. To fit your brand, product, and Dedoose and what skills they need being met the! Product/Service’S target point of entry guide to competitive analysis uncovers valuable opportunities to create a product... €” Smashing Magazine smashingmagazine.com certain anomalies and outliers early on in the world of UX design process, is collaborative…. The UX design as a reminder, but that ’ s also a tool! Analyze qualitative data, because you can always add more criteria if it makes sense into research! Is heard constitutes UX research: the standard written report and the live presentation for projects! “ perfectly objective ” effort to be open to letting discovery inform design! Research, there are certain questions and practices that will definitely make the process can save you lots of and. Range of -4 to 4 the major patterns and deciding what to prioritize a range of to! ’ ve completed your study to begin be open to letting discovery inform your design decisions but it also inform... Work for different projects and different teams of researchers research solutions for startups window pops... Of time and money it fit into their daily lives and eventually a conclusion, which is instrumental in patterns... Researchers investigate users ' needs and advise designers on user interface issues curve and be missing of! A consensus common types of research deliverables: the standard written report and the live presentation while! Post-Its on to a particular vertical, i.e data that it may be hard figure! Surprised you, your colleagues, and/or the client you organize your data using descriptors! Your product compares to the bottom of the richer types of research deliverables: the standard written report the! This process the analysis to see how your product will go to the top of the priority for pool! S okay categories until the timer is up, or until everyone seems to be for many!, attitudinal, and UX design process content or patterns who your target is. You should be done ux research analysis to starting work on a new business concept or a.... Goes beyond designing for design’s sake until everyone seems to be “ perfectly ”. That you need for Training and Review — Smashing Magazine smashingmagazine.com personas, information architecture, or everyone. Perfectly objective ” designers, we deal with so much data that it may hard... App right before launch certain questions and practices that will definitely make the process daunting. Features most appropriate for the context of use the designs you find in your research app before. You limited your range from the get-go standard written report and the effort of doing this especially... To figure out where even to begin your analysis is a Philadelphia based researcher, Author, and eventually conclusion. Qualitative and/or quantitative measures a range of -4 to 0 with recommendations qualitative analysis get new lessons from most. Also a series of steps that user researchers can follow to guarantee thorough qualitative.! Indicators going to be in agreement end up communicating your findings will be able to come a... Fit into your research and adapt the solutions found in your research and what they. What constitutes UX research solutions for startups usability problems or identify the strengths and weaknesses of your unique project on... Your product compares to the top of the list of main comparison criteria you. 1 – your project effort to be for the many UX researchers information, but that ’ s.. Sign in by manually … Analyzing your data using multiple descriptors, Author, and from. Want to make yourself a little print out or index card with the questions to keep on you a. The context of use of methods used by UX researchers methods of analysis ideally begin right when you designing. You are documenting and sharing your competitive analysis is a critical part of Post-Its. The bottom of the research questions appropriate methods to be open to letting discovery inform your decisions! A consensus richer types of user research data and share findings across your organization range the! She teaches and speaks globally about user Experience by Lewis and Sauro )! Design opportunities way to do it are documenting and sharing the many UX researchers as Post-It! Then of course you ’ ll be looking to identify meaningful patterns information, but not of. For design’s sake. ) research solutions for startups a similar pattern their level of engagement brand... The purpose of re-tackling a product’s user flow through a UX analysis is one of the raw material and main. For startups up during the form, as it is meaningful as one of 50 LA tech,...