Last modified: 2014-10-10 19:30:42 UTC

Wikimedia Bugzilla is closed!

Wikimedia migrated from Bugzilla to Phabricator. Bug reports are handled in Wikimedia Phabricator.
This static website is read-only and for historical purposes. It is not possible to log in and except for displaying bug reports and their history, links might be broken. See T56393, the corresponding Phabricator task for complete and up-to-date bug report information.
Bug 54393 - Add Sikuli to the machines that run browser tests
Add Sikuli to the machines that run browser tests
Status: RESOLVED WONTFIX
Product: Wikimedia
Classification: Unclassified
Quality Assurance (Other open bugs)
wmf-deployment
All All
: Unprioritized enhancement (vote)
: ---
Assigned To: Nobody - You can work on this!
: i18n
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-09-20 18:26 UTC by Amir E. Aharoni
Modified: 2014-10-10 19:30 UTC (History)
11 users (show)

See Also:
Web browser: ---
Mobile Platform: ---
Assignee Huggle Beta Tester: ---


Attachments

Description Amir E. Aharoni 2013-09-20 18:26:15 UTC
Sikuli ( http://www.sikuli.org ) is a tool for testing desktop interactions, such as mouse clicks and keyboard typing.

This tool is needed for testing typing in different languages, because the usual WebDriver tests are not able to generate proper keyboard events that completely emulate typing in advanced input methods for Japanese, Chinese and Indic scripts. We have many bugs in this area in the VisualEditor (e.g. Bug 52716), so we need proper regression testing.

This week I worked with Željko in the WMF office and we built a prototype test that uses Sikuli to test typing in Japanese:
https://gerrit.wikimedia.org/r/#/c/83966/

This works on Željko's laptop. The next step is to get it working on the virtual clients that run our continuous integration tests.

Thank you!
Comment 1 Antoine "hashar" Musso (WMF) 2013-09-20 20:30:08 UTC
Moving from CI to QA
Comment 2 Gerrit Notification Bot 2013-12-17 13:55:09 UTC
Change 83966 had a related patch set uploaded by Zfilipin:
[WIP] [Browser test] Testing typing in VisualEditor

https://gerrit.wikimedia.org/r/83966
Comment 3 Antoine "hashar" Musso (WMF) 2013-12-17 14:09:34 UTC
Good news: sikuli has been packaged for Debian/Ubuntu. There is a package libsikuli-script-java which seems to provide the needed material:

http://packages.ubuntu.com/precise/all/libsikuli-script-java/filelist

I have no clue how to launch the tests though. Maybe we just have to use /usr/bin/sikuli ?
Comment 4 Gerrit Notification Bot 2013-12-17 14:14:15 UTC
Change 102141 had a related patch set uploaded by Hashar:
contint: install libsikuli-script-java for browser tests

https://gerrit.wikimedia.org/r/102141
Comment 5 Antoine "hashar" Musso (WMF) 2013-12-17 14:21:53 UTC
I have deployed the package libsikuli-script-java on the integration-selenium-driver.pmtpa.wmflabs instance.  The script is available as /usr/bin/sikuli

Could you craft a simple change that would attempt to run a single browser test using sikuli ?
Comment 6 Gerrit Notification Bot 2013-12-17 14:27:52 UTC
Change 102141 merged by ArielGlenn:
contint: install libsikuli-script-java for browser tests

https://gerrit.wikimedia.org/r/102141
Comment 7 matanya 2014-01-26 13:36:06 UTC
Amir, this patch was merged, can this be closed?
Comment 8 Amir E. Aharoni 2014-01-26 13:42:21 UTC
No, it is not really active yet.
Comment 9 Željko Filipin 2014-04-03 15:05:15 UTC
After further investigation with Amir today, looks like Sikuli does not work with headless machines: "The system running Sikuli scripts or any apps using SikuliX features must have a real screen connected. So called headless systems are not supported (Java restriction)."

1: http://www.sikulix.com/quickstart.html
Comment 10 Željko Filipin 2014-06-28 20:53:38 UTC
Resolving. See comment #9 for details. Please reopen if you think Sikuli is the way to go.
Comment 11 Gerrit Notification Bot 2014-07-29 12:49:19 UTC
Change 83966 abandoned by Zfilipin:
[WIP] [BrowserTest] Testing typing in VisualEditor

Reason:
Sikuli is not the way to go. We will investigate another tool.

https://gerrit.wikimedia.org/r/83966
Comment 12 Gerrit Notification Bot 2014-10-07 14:32:59 UTC
Change 165204 had a related patch set uploaded by Zfilipin:
contint: Sikuli is no longer used anywhere

https://gerrit.wikimedia.org/r/165204
Comment 13 Gerrit Notification Bot 2014-10-10 19:30:42 UTC
Change 165204 merged by Dzahn:
contint: Sikuli is no longer used anywhere

https://gerrit.wikimedia.org/r/165204

Note You need to log in before you can comment on or make changes to this bug.


Navigation
Links