Bug 88947

Summary: nrwt: implement the actual cascade of TestExpectations
Product: WebKit Reporter: Dirk Pranke <dpranke>
Component: New BugsAssignee: Dirk Pranke <dpranke>
Status: RESOLVED FIXED    
Severity: Normal CC: abarth, eric, ojan, tony
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: Unspecified   
OS: Unspecified   
Bug Depends on: 88946    
Bug Blocks: 65834, 88948    
Attachments:
Description Flags
Patch ojan: review+

Dirk Pranke
Reported 2012-06-12 19:43:45 PDT
nrwt: implement the actual cascade of TestExpectations
Attachments
Patch (9.72 KB, patch)
2012-06-12 19:46 PDT, Dirk Pranke
ojan: review+
Dirk Pranke
Comment 1 2012-06-12 19:46:14 PDT
Ojan Vafai
Comment 2 2012-06-13 09:39:13 PDT
Comment on attachment 147218 [details] Patch View in context: https://bugs.webkit.org/attachment.cgi?id=147218&action=review > Tools/ChangeLog:15 > + There is an actual semantic change in this patch, in that > + setting an expectation on a directory in one file will override > + the expectations on any individual tests set in prior files. The > + test_overrides__directory() unit test verifies this. I really think we should simplify the logic of test_expectations entirely (in a separate patch obviously) to last one wins. Even within the same expectations file. The "more specific wins" is more confusing than the benefit it brings. > Tools/Scripts/webkitpy/layout_tests/models/test_expectations.py:597 > + if prev_expectation_line.filename != expectation_line.filename: Clever!
Dirk Pranke
Comment 3 2012-06-13 10:11:09 PDT
(In reply to comment #2) > I really think we should simplify the logic of test_expectations entirely (in a separate patch obviously) to last one wins. Even within the same expectations file. The "more specific wins" is more confusing than the benefit it brings. Yeah, as we've discussed before, it's hard to say what the right answer is here. Once we get chromium moved to a world where long-standing expectations are checked in and the file becomes much shorter, you're probably right. In the meantime, I think allowing duplicates in the file might just make it less maintainable. Hopefully the checked-in-failures world is not far away and we'll be able to test this theory.
Dirk Pranke
Comment 4 2012-06-13 13:43:26 PDT
Note You need to log in before you can comment on or make changes to this bug.