_bug008 >> DocWebSed >> DocTables >> raw_html_test >> Regression_Test 

TB Wiki

Login

Regression Test

cat_content='This data goes into a temp file, which is cat'ed back out. '
Here is some data for regression testing the wiki:

See test:Regression_Test for information on managing tests, skiplists, expected results, and transform pages.

Click here Regression Test Debug to get debug data while processing pages. This is very useful for determining which page is generating a python exception.

Results [edit section]

Expected results [edit section]

On 2026-09-14 with tbwiki version shown below:

    Now, with tbwiki version 2.0.0 (v2.0.0-13-g148232d)
    
    Number of OK pages: 195
    Pages missing output: 0
    Number of bad pages: 1
    Number of skipped pages: 25

Skipped pages: ['TestProcessorSiteStatus', 'TestMacroSiteStatus', 'TestSpreadsheetGetBlock', 'RecentChanges', 'Regression_Test', 'Regression_Test_for_often_wrong_pages', 'Regression_Test_omitting_expected_failures', 'Regression_Test_just_problematic_pages', 'TestProcessorPageManager', 'TestProcessorSnapshot', 'TestProcessorTrigger', 'TestMacroENV', 'TestMacroRecentChanges']

Results [edit section]

NOTE: check below for pages that are sometimes or always wrong - due to code or wiki content changes, or due to unfixed bugs, respectively. The pages listed under "Often wrong" can usually be updated without examining them, unless the related code has been changed.

Now, with tbwiki version 2.0.1 (v2.0.0-32-ga9cbfc3)

---

Number of OK pages: 91
Pages missing output: 0
Number of bad pages: 39
Number of skipped pages: 4

Skipped pages: ['Wiki_Status_Page', 'Regression_Test']

Page Status Show Diff Update Saved Output Render Duration Transforms
Admin_Usersmismatch with expected output
starting at: "<p> <font color" != "<p> <table bord"
diff save 0.001 screate
ArticleIndexmismatch with expected output
starting at: "ower_m">m</a> |" != "ower_k">k</a> |"
diff save 0.000 screate
Blog_Layouts_and_Featurespage is OK diff save 0.001 screate
BugListmismatch with expected output
starting at: "able.query_form" != "able.add_record"
diff save 0.013 screate
BugListConfpage is OK diff save 0.000 screate
BugListLongQuerypage is OK diff save 0.000 screate
Categoriespage is OK diff save 0.003 screate
CodeFixthisListmismatch with expected output
starting at: "able.query_form" != "able.add_record"
diff save 0.168 screate
Development_Notespage is OK diff save 0.000 screate
DocAttachmentsmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.000 screate
DocBasicSyntaxmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.002 screate
DocBlocksmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
DocCommandLineClientmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.000 screate
DocConfigurationmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
DocDebugmismatch with expected output
starting at: " <p> The debug " != " <p> <h3><a nam"
diff save 0.001 screate
DocImagesmismatch with expected output
starting at: "g" > <p> <p> " != "g" > "
diff save 0.000 screate
DocInternalAPImismatch with expected output
starting at: " <p> FIXTHIS - " != " <p> <h1><a nam"
diff save 0.001 screate
DocLinksmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
DocMacrosmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.002 screate
DocMarkupVariablesmismatch with expected output
starting at: "e is Wed Sep 16" != "e is Sat Sep 5"
diff save 0.001 screate
DocParsedTablesmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
DocProcessorsmismatch with expected output
starting at: "lt; %(timer)s " != "lt; {{HTML(&lt"
diff save 0.002 screate
DocSpreadsheetExamplesmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.005 screate
DocTablesmismatch with expected output
starting at: "pages, or it ca" != "pages. [FIXTHIS"
diff save 0.006 screate
DocTablesInternalsmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.002 screate
DocThemesmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
DocUsersmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
DocWebSedmismatch with expected output
starting at: "<p> <p> </b>" != "<p> </b>"
diff save 0.002 screate
Feature:Blogpage is OK diff save 0.000 screate
Feature:Categorypage is OK diff save 0.000 screate
Feature:Soundpage is OK diff save 0.000 screate
Feature:Themespage is OK diff save 0.000 screate
Feature:Triggerspage is OK diff save 0.000 screate
FeatureListpage is OK diff save 0.000 screate
File_Managermismatch with expected output
starting at: "h</a></li> <li>" != "h</a>&nbsp;&nbs"
diff save 0.000 screate
FlaskResearchmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.000 screate
FrontPagepage is OK diff save 0.000 screate
HowTo_make_a_new_databasepage is OK diff save 0.000 screate
ItemNotesmismatch with expected output
starting at: " <p> <p> " != " <p> "
diff save 0.001 screate
Multipage_Blog_Dev_Notespage is OK diff save 0.002 screate
PageFixthisListmismatch with expected output
starting at: "able.query_form" != "able.add_record"
diff save 0.024 screate
Page_Managermismatch with expected output
starting at: "wiki/mobile.css" != "wiki/kdocbug_1""
diff save 0.000 screate
RecentChangesmismatch with expected output
starting at: "-09-16 05:10 - " != "-09-14 19:47 - "
diff save 0.009 screate
Regression_Test_Dev_Notespage is OK diff save 0.000 screate
RelatedProjectspage is OK diff save 0.000 screate
Sandboxmismatch with expected output
starting at: "f="#test_bullet" != "f="#table_with_"
diff save 0.018 screate
Site_UP-chartmismatch with expected output
starting at: " <table align="" != "<h2><a name="bi"
diff save 0.700 screate
Sound_Board_Testpage is OK diff save 0.000 screate
Sound_Testspage is OK diff save 0.000 screate
SystemInfomismatch with expected output
starting at: "0.0-32-ga9cbfc3" != "0.0-30-g25a0e63"
diff save 0.067 screate
TBWikiDocumentationmismatch with expected output
starting at: "res <ul><li>abo" != "res </ul> <p> "
diff save 0.001 screate
TBWikiToDomismatch with expected output
starting at: "h1> <p> <ul><li" != "h1> <ul><li>add"
diff save 0.007 screate
Table_Architecturepage is OK diff save 0.002 screate
TimBirdpage is OK diff save 0.000 screate
TimsBlogmismatch with expected output
starting at: "</ul> <p> " != "</ul>"
diff save 0.002 screate
TimsBlogSidebarpage is OK diff save 0.000 screate
Tims_blog_2025-11-12_12:21:30.16page is OK diff save 0.001 screate
Tims_blog_2025-11-29_14:23:12.40page is OK diff save 0.000 screate
Tims_blog_2026-04-25_16:01:26.25page is OK diff save 0.000 screate
UP-triggermismatch with expected output
starting at: "hart:birdcloud_" != "hart:s1</li> "
diff save 0.000 screate
Web_Resourcespage is OK diff save 0.000 screate
_bug0001page is OK diff save 0.000 screate
_bug0002page is OK diff save 0.000 screate
_bug0003page is OK diff save 0.000 screate
_bug0004page is OK diff save 0.000 screate
_bug0005page is OK diff save 0.000 screate
_bug0006page is OK diff save 0.000 screate
_bug0007page is OK diff save 0.000 screate
_bug0008page is OK diff save 0.000 screate
_bug0009page is OK diff save 0.000 screate
_bug001page is OK diff save 0.000 screate
_bug0010page is OK diff save 0.000 screate
_bug0011page is OK diff save 0.000 screate
_bug0012page is OK diff save 0.000 screate
_bug0013page is OK diff save 0.000 screate
_bug0014page is OK diff save 0.000 screate
_bug0015page is OK diff save 0.000 screate
_bug0016page is OK diff save 0.000 screate
_bug0017page is OK diff save 0.000 screate
_bug0018page is OK diff save 0.000 screate
_bug0019page is OK diff save 0.000 screate
_bug002page is OK diff save 0.000 screate
_bug0020page is OK diff save 0.000 screate
_bug0021page is OK diff save 0.000 screate
_bug0022page is OK diff save 0.000 screate
_bug0023page is OK diff save 0.000 screate
_bug0024page is OK diff save 0.000 screate
_bug0025page is OK diff save 0.000 screate
_bug0026page is OK diff save 0.000 screate
_bug0027page is OK diff save 0.000 screate
_bug0028page is OK diff save 0.000 screate
_bug0029page is OK diff save 0.000 screate
_bug003page is OK diff save 0.000 screate
_bug0030page is OK diff save 0.000 screate
_bug0031page is OK diff save 0.000 screate
_bug0032page is OK diff save 0.000 screate
_bug0033page is OK diff save 0.000 screate
_bug004page is OK diff save 0.000 screate
_bug005page is OK diff save 0.000 screate
_bug006page is OK diff save 0.000 screate
_bug007page is OK diff save 0.000 screate
_bug008page is OK diff save 0.000 screate
_bug009page is OK diff save 0.000 screate
_bug010page is OK diff save 0.000 screate
_bug011page is OK diff save 0.000 screate
_bug012page is OK diff save 0.000 screate
_bug013page is OK diff save 0.000 screate
_bug014page is OK diff save 0.000 screate
_bug015page is OK diff save 0.000 screate
_bug016page is OK diff save 0.000 screate
_bug017page is OK diff save 0.000 screate
_bug018page is OK diff save 0.000 screate
_bug019page is OK diff save 0.000 screate
_bug020page is OK diff save 0.000 screate
_bug021page is OK diff save 0.000 screate
_bug9HuMcJvzpage is OK diff save 0.000 screate
data_scan_bug_notespage is OK diff save 0.000 screate
garage_door_openerpage is OK diff save 0.000 screate
mobile.csspage is OK diff save 0.002 screate
mobile.footermismatch with expected output
starting at: "user.loginform"" != "user.editform"&"
diff save 0.000 screate
mobile.headermismatch with expected output
starting at: "wiki/Help"&gt;H" != "wiki/Portals"&g"
diff save 0.000 sview/edit
printable.csspage is OK diff save 0.001 screate
printable.footerpage is OK diff save 0.000 screate
printable.headerpage is OK diff save 0.000 screate
raw_html_testpage is OK diff save 0.000 screate
tbwiki.csspage is OK diff save 0.001 screate
tbwiki.footerpage is OK diff save 0.000 screate
tbwiki.headermismatch with expected output
starting at: "user.loginform"" != "user.editform"&"
diff save 0.000 sview/edit
tbwiki_engine_Fixthis_Listpage is OK diff save 0.033 screate
timpage is OK diff save 0.000 screate

Manually-maintained exception list [edit section]

Often wrong [edit section]

  • ArticleIndex - changes when pages are added or removed
  • RecentChanges - page names, last page edit dates, and page edit counts are always changing
  • SystemInfo - number of pages is wrong when pages are added

Always wrong [edit section]

  • none, that don't currently have transform pages

Wrong, just not fixed yet [edit section]

  • none listed

Categories: Features|Blog
TBWiki engine 2.0.1 by Tim Bird