Identify critical issues, understand player sentiment, and make data-driven decisions faster than ever before. Reclaim valuable development time and focus on crafting exceptional player experiences.
When do I get an automated report?
When GT Intelligence is enabled or included by default (e.g. Go Testfy recruit) on a test it will run automatically when you close a test. In general it takes between 5-20 minutes for the report to be generated.
Note: It can also be run early if the test is still ongoing or anytime the players on your test change e.g. are hidden or added after taking part in the test.
What does it provide?
Executive Summary
A short but detailed high-level overview of the test feedback in reference to the test objectives. It provides a rapid understanding of the core takeaways, enabling stakeholders to quickly assess the results and identify areas requiring deeper investigation.
Top 5 Executive Findings
Designed to immediately draw your attention to the most critical areas that require your team's focus and action. It often combines themes that arise across multiple ux categories to provide a broader actionable insight.
Health Status
Provides a structured evaluation of various key aspects of your game (e.g. User Interface, Learning Curve, Game Mechanics, Controls, Visual Design, Audio Design, Narrative, Innovation, Retention, Performance). This greatly helps pinpoint specific areas where the game is performing well and those where significant improvements are needed. From test to test you can review current and past health statuses as a benchmark towards the games health and progress.
Top 3 Priority Findings (per Health Status Category)
This delves deeper into specific issues and themes identified within the broader categories of the Health Status. This allows your team or sub-teams e.g. art, audio design to thoroughly understand the nuances of the player feedback and the specific pain points or positive experiences around each UX category.
Each finding provides:
Summary, Impacts and Causes: short but detailed summary of the finding including player impacts and potential causes. Each impact directly links to the sources of the information i.e. survey and gameplay themes.
View Related Evidence: direct links to specific moments in gameplay recordings or related survey themes that exemplify the findings, allowing for immediate contextual understanding.
Shareable Video Clips: Easily share specific video moments with your team to illustrate issues or positive feedback.
Player Demographics: Provides insights into the demographic makeup of your testers for each finding, which can sometimes correlate with specific feedback patterns.
Best Practices: Getting the Most Out of your Automated Report
To maximize the value you gain from the Automated Report, follow these best practices during both the test setup (pre-launch) and the report review (post-test) phases.
Pre-Launch ( Test Setup)
These practices help ensure your test is set up for optimal feedback collection and insightful reporting.
Prioritize In-Platform Surveys:
Leverage the integrated survey features within Go Testify for maximum confidence in your Automated Report. Only Go Testify survey feedback will be analysed in the final automated report. Survey insights in the report allow you to quantify player experiences and quickly identify patterns that might be missed in verbal feedback alone.
Use our Health Status Benchmark Survey Template:
We have created a template "Health Status Benchmark" survey, to gather targeted feedback on core game elements.This template is designed to maximize insight into your game's overall health status by focusing on key UX categories. The standardized format helps you benchmark against previous tests and quickly identify regressions or improvements.
Define Clear and Prioritized Game Objectives:
Clearly define your game's objectives in order of priority before launching the test. The automated Executive Summary, utilizes your defined test objectives to provide a focused narrative that aligns with your test goals.
Recruit ~10-20 participants:
To get the most value of the automated report and collect a large enough sample of evidence, we recommend a minimum of 10 participants, with 20 being the sweet spot for a high degree of confidence when actioning insights.
Test Length and Task Design:
Ensure your test session length is appropriate and your tasks are designed to align with your stated objectives. Longer sessions with varied tasks yield richer, more detailed feedback.
Post-Test ( Report Review & Action)
These practices guide you through effectively reviewing and acting upon the insights identified in the Automated Report.
Step 1 - Review the Executive Summary:
Begin your review with the Executive Summary to gain a comprehensive overview of the overall state of your game based on the player feedback.This section provides a quick understanding of the major themes, challenges, and opportunities, allowing you to prioritize areas for deeper investigation.
Step 2- Review Health Status Insights:
After the Executive Summary, focus on the Health Status Insights for targeted information about key UX categories (e.g., UI, Learning Curve, Mechanics). This section provides a structured assessment of various game elements, helping you quickly identify strengths and weaknesses in specific areas.
Step 3 - Build a Holistic Understanding:
Synthesize the information from the Executive Summary, Health Status, and Top 5 Key Findings to build a holistic picture of the most pressing issues or opportunities.This allows you to understand the relationships between different feedback areas and identify the root causes of problems.
Step 4 - Take Early Action on Top Priorities:
Identify the most prominent issues or opportunities and communicate them to your team early in the review process. Addressing clear and critical issues promptly demonstrates responsiveness and accelerates the improvement process. While sharing immediate findings, keep in mind that a deep dive is needed for a more thorough understanding.
Step 5 - Leverage the Power of Smart Search:
Utilize the Smart Search feature to quickly investigate specific topics and observe player behavior across all sessions related to a particular insight. Smart Search enables you to fast-track investigations, find related clips at a specific moment in time for all players to observe and gain a deeper understanding of the underlying reasons behind player feedback.
Additional - Explore the Insights Section for Specific Questions:
If your team has specific questions or hypotheses that were not directly addressed in the report, use the Insights section to filter and search for relevant insights. For instance, you could search for feedback related to "combat" or "inventory" to gain targeted information for your team's specific needs.
We hope you found this article helpful; however, our team would happily demonstrate those best practices for your game or test if you want to know more!