Changelog

Update Logs

v3.6
Latest

2025-03-05

  • Implemented Sample Ratio Mismatch (SRM) detection in A/B Test Calculator

    Added a feature to detect potential issues with randomization in A/B tests by checking if the traffic split between variations is significantly different from expected.

  • Improved A/B test calculator recommendation logic for negative lifts

    Enhanced the calculator to provide more accurate advice when the variation performs worse than the control.

  • Added Logs page to track updates and future features

    Introduced a new section to keep users informed about recent changes and upcoming improvements.

  • Reorganized navigation with clear categories

    Restructured the sidebar menu to group similar tools together, improving user experience and discoverability.

  • Removed Radar Chart from navigation and functionality

    Streamlined the toolkit by removing the Radar Chart feature to focus on core A/B testing and analysis tools.

v3.4

2024-02-03

  • Improved A/B test calculator recommendation logic for negative lifts

    Enhanced the calculator to provide more accurate advice when the variation performs worse than the control.

  • Added Logs page to track updates and future features

    Introduced a new section to keep users informed about recent changes and upcoming improvements.

  • Reorganized navigation with clear categories

    Restructured the sidebar menu to group similar tools together, improving user experience and discoverability.

v3.3

2024-01-15

  • Introduced AOV Calculator with Mann-Whitney U test

    Added a new calculator for Average Order Value (AOV) analysis, utilizing the Mann-Whitney U test for statistical significance.

  • Added support for CSV data upload in AOV Calculator

    Users can now import their data from CSV files directly into the AOV Calculator.

  • Enhanced error handling and validation in calculators

    Improved error messages and input validation across all calculators for a smoother user experience.

v3.2

  • Launched Waterfall Chart generator

    Added a new tool to generate Waterfall Charts for visualizing data changes over time.

  • Implemented Sankey Diagram generator

    Introduced a Sankey Diagram generator to visualize flows and relationships between different data points.

  • Added zoom and drag controls for diagrams

    Improved interactivity for charts and diagrams with zoom and drag functionalities.

v3.1

  • Added Duration Calculator

    A new calculator to determine the duration of events or processes.

  • Implemented weekly MDE table

    Added a table to display Mean Daily Engagement (MDE) data on a weekly basis.

  • Enhanced sample size calculations

    Improved the accuracy and efficiency of sample size calculations for statistical analysis.

v3.0

  • Major UI overhaul with new design system

    Completely redesigned the user interface with a new design system for improved aesthetics and usability.

  • Introduced Revenue Calculator

    Added a new calculator to project and analyze revenue based on various factors.

  • Added seasonality adjustments

    Implemented adjustments for seasonality in calculations to account for fluctuations throughout the year.

  • Implemented decay modeling

    Added decay modeling capabilities to account for the decline in the effect of certain variables over time.

v2.2

  • Enhanced A/B test visualization

    Improved the visual representation of A/B test results for better understanding.

  • Added confidence interval displays

    Added clear displays of confidence intervals to provide a range of plausible values for the results.

  • Improved statistical power calculations

    Enhanced the accuracy and reliability of statistical power calculations.

v2.1

  • Added demo mode for all calculators

    Introduced a demo mode to allow users to try out the calculators without needing to input their own data.

  • Improved mobile responsiveness

    Optimized the user interface for better performance and usability on mobile devices.

  • Enhanced error messaging

    Improved error messages to be more informative and user-friendly.

v2.0

  • Complete rewrite in Next.js

    The application was completely rewritten using Next.js for improved performance and scalability.

  • Introduced new statistical methods

    Added new statistical methods to enhance the accuracy and robustness of the analysis.

  • Added comprehensive FAQ sections

    Added a comprehensive FAQ section to address common user questions and concerns.

v1.0

  • Initial release

    The initial release of the Henkan Toolkit.

  • Basic A/B test calculator

    The initial release included a basic A/B test calculator.

  • Simple statistical analysis

    Basic statistical analysis capabilities were included in the initial release.

Upcoming Features

  • Bayesian A/B test calculator with prior distribution support

    A new calculator that uses Bayesian statistics, allowing users to incorporate prior knowledge into their A/B test analysis.

  • Integration with Google Analytics and other analytics platforms

    Ability to import data directly from popular analytics tools, streamlining the data input process.

  • Custom report generation with PDF export

    Users will be able to create and download personalized PDF reports of their A/B test results and analyses.

  • Mobile app for on-the-go analysis

    A dedicated mobile application to perform A/B test calculations and view results from smartphones and tablets.

  • Advanced multivariate testing support

    Expand capabilities to analyze tests with multiple variables, allowing for more complex experimental designs.

  • Real-time collaboration features

    Introduce tools for teams to work together on A/B test analysis in real-time, facilitating better communication and decision-making.

  • Custom dashboard creation

    Allow users to build personalized dashboards with their most-used calculators and visualizations for quick access.

  • API access for programmatic calculations

    Provide an API for developers to integrate Henkan Toolkit's calculations directly into their own applications or workflows.