25th Meeting for Automated Testing working Group
Meeting was attended by: Javier Gomez, Niels Braczek, Yves Hoppe, Allon Moritz, Prital Patel, Tito Alvarez, Kshitij Sharma, Puneet Kala, David Jardin,
Absent: Roger Abt, Tristan Bailey, Viktor Vogel, Marc Widmann, Michiel Verhoef, Jack Raknailuang, Valerie Isaksen, Dalpat Singh, Victor Escobar, Milton Bryant, Roland Dalmulder, Ashan Fernando, Davide Messia, Yannick Gaultier, Ruchiranga Wickramasinghe, Krys Nuvadga, Jelle Kok, Guido de Gobbis, Robert Deutz
Previous meeting report:
Topics Covered in the Meeting:
## Welcomes and See you laters
We welcome David Neukirchen
## Weblinks tests updates
as mentioned yesterday in the PLT meeting report (https://volunteers.joomla.org/reports/296-plt-meeting-july-26-2016): Weblinks component (Chris): A release is almost ready. New PRs received during last month. A beta version will be published soon.
We still have several open pull requests related to tests https://github.com/joomla-extensions/weblinks/pulls that should not prevent the release. Still they need attention when possible
Also worth to mention: the work done by Yves regarding the automation of the release, in pulls like: https://github.com/joomla-extensions/weblinks/pull/243, https://github.com/joomla-extensions/weblinks/pull/245, https://github.com/joomla-extensions/weblinks/pull/242,...
Yves: A thing i would like to propose is running weblinks tests as extension test in Joomla! core itself against any PR done there.. (Maybe just with PHP 5.5 as sample to not take too much time). The testing value on core itself is only related to login, install extensions, menu and categories. But it would also test a bit of B/C compatibility for existing 3rd party extensions. It's not a big deal adding this to the .travis.yml in core..
In general there is agreement of the participants. We decide to work on a proof of concept to be implemented in Prital’s GSoC project repository at https://github.com/joomla-projects/gsoc16_browser-automated-tests/ .
## Google Summer of Code 2016 Testing projects
- Browser automated testing: last update available at https://volunteers.joomla.org/working-groups/gsoc-browser-tests#reports
We are on track for that project, and for the middle of August we will much probably have the tests for com_users and com_content.
They are initial versions, and they are there to be improved, so anyone that wants to check the code and add ideas of improvement are invited.
The video and a small documentation can be found in the readme, the longer one here: https://docs.google.com/document/d/1ZTzJiXwh4lNI9pPT38WqBy28nCd1duAD5fQakxZRm7s/edit?usp=sharing (Feel free to comment and give feedback on how it could be improved and made even more understandable
https://packagist.org/packages/joomla-projects/joomla-browser (23 863 installs) about 1500 more than last meeting.
## Selenium server standalone:
We have updated to latest Selenium 2.53.1 https://github.com/joomla-projects/selenium-server-standalone/releases
## Running system tests on Docker Containers (Tito, Robert, Niels, Yannick)
Robert: I got contacted by 1&1, we have a new contact person and he will talk with me about the sponsoring they doing. This will include the servers we have.
Great updates by Prital at https://docs.joomla.org/Testing_Joomla_Extensions_with_Codeception#BDD_Testing_using_Gherkin_and_Codeception
We have a new chapter 8 about BDD
## Current system tests in travis not working in PHP7
Tito is assigned to the issue: https://github.com/joomla-extensions/weblinks/issues/114
work in progress
## Unit Tests status
## Tests in Joomla X
The current work is focussed on the refactoring of the ORM (PR#115 in the pythagoras repo), which is done test driven, so there is a pretty good coverage (currently ~400 tests with ~700 assertions). The tests are implemented as unit tests, although some of them could be considered being integration tests. Nevertheless, as they don’t need a certain setup, this works fine.
When the ORM is stable (some issues with relation handling are left), development of the frontend starts, which then will need acceptance tests with a docker setup.
## QA Scripts (Code Style) and others at Jorobo project
There is one PR to test: https://github.com/joomla-projects/jorobo/pull/21
## Vagrant testing box (Yves)
No updates on https://github.com/joomla-projects/vagrant-joomla-testing , still running.
## Contributors needed!
There are open tasks for writing
Joomla! System tests:
Tasks for Web Links
We need testers for the open pull requests! And we have a big issue with smart search tests, which make Travis fail.
Tasks for Joomla-Browser
We need to finish this: https://github.com/joomla-projects/joomla-browser/pull/40, any takers? is linked to: https://github.com/joomla-projects/joomla-browser/pull/83
There are also multiple other open issues which need investigation and your help!
Tasks for Selenium
Investigate on Marionette and Chrome Webdriver and on how we can use it.
Tasks for JoRobo
- Migrate most of the code of the RoboFiles (in Weblinks / joomla) to it.
- Update coding standards (deprecated warning)
- Build system for Joomla core itself (replace Phing scripts, add minifying of JS / CSS, XML replacements, many other nice features. Talk with @rdeutz)
Tasks for Vagrant Box
We need testers: Jelle had a strange bug in Windows (not showing up for other win users).
## Next meeting
26th Automated Testing Team Meeting
Date & Time
Wed, August 24th at http://www.timeanddate.com/worldclock/fixedtime.html?iso=20160824T16&ah=1