By Javier Gomez on 2016-07-27 00:00 in Automated Testing Team


Meeting was attended by: Javier Gomez, Niels Braczek, Yves Hoppe, Allon Moritz,  Prital Patel, Tito Alvarez, Kshitij Sharma, Puneet Kala, David Jardin,



Absent: Roger Abt, Tristan Bailey, Viktor Vogel, Marc Widmann, Michiel Verhoef, Jack Raknailuang, Valerie Isaksen, Dalpat Singh, Victor Escobar, Milton Bryant, Roland Dalmulder, Ashan Fernando, Davide Messia, Yannick Gaultier, Ruchiranga Wickramasinghe, Krys Nuvadga, Jelle Kok, Guido de Gobbis, Robert Deutz



Previous meeting report:  




Topics Covered in the Meeting: 



## Welcomes and See you laters

We welcome David Neukirchen



## Weblinks tests updates

as mentioned yesterday in the PLT meeting report ( Weblinks component (Chris): A release is almost ready. New PRs received during last month. A beta version will be published soon.



We still have several open pull requests related to tests   that should not prevent the release. Still they need attention when possible



Also worth to mention: the work done by Yves regarding the automation of the release, in pulls like:,,,... 



Yves: A thing i would like to propose is running weblinks tests as extension test in Joomla! core itself against any PR done there.. (Maybe just with PHP 5.5 as sample to not take too much time).  The testing value on core itself is only related to login, install extensions, menu and categories. But it would also test a bit of B/C compatibility for existing 3rd party extensions. It's not a big deal adding this to the .travis.yml in core.. 


In general there is agreement of the participants. We decide to work on a proof of concept to be implemented in Prital’s GSoC project repository at


Issue created:  


## Google Summer of Code 2016 Testing projects

- Browser automated testing: last update available at 

We are on track for that project, and for the middle of August we will much probably have the tests for com_users and com_content.

They are initial versions, and they are there to be improved, so anyone that wants to check the code and add ideas of improvement are invited.


- GSoC 16 JavaScript Tests:  last update available at  


JavaScript tests are almost ready, only some small libraries are missing. We are currently preparing everything to do a pull request for core in the next couple of weeks (hopefully even this week). And Ruchiranga already prepared a long documentation + youtube videos etc. for it. His JCM article will focus on why that should be merged asap. (


The video and a small documentation can be found in the readme, the longer one here:  (Feel free to comment and give feedback on how it could be improved and made even more understandable


## JoomlaBrowser  (23 863 installs) about 1500 more than last meeting.


## Selenium server standalone:

We have updated to latest Selenium 2.53.1  


## Running system tests on Docker Containers (Tito, Robert, Niels, Yannick) 

Robert: I got contacted by 1&1, we have a new contact person and he will talk with me about the sponsoring they doing. This will include the servers we have. 


## Documentation

Great updates by Prital at  

We have a new chapter 8 about BDD 



## Current system tests in travis not working in PHP7

Tito is assigned to the issue:  

work in progress


## Unit Tests status

No updates


## Tests in Joomla X

The current work is focussed on the refactoring of the ORM (PR#115 in the pythagoras repo), which is done test driven, so there is a pretty good coverage (currently ~400 tests with ~700 assertions). The tests are implemented as unit tests, although some of them could be considered being integration tests. Nevertheless, as they don’t need a certain setup, this works fine.

When the ORM is stable (some issues with relation handling are left), development of the frontend starts, which then will need acceptance tests with a docker setup.



## QA Scripts (Code Style) and others at Jorobo project

There is one PR to test: 


## Vagrant testing box (Yves)

No updates on , still running.


Easily running Weblinks + JavaScript tests would be an great addition


## Contributors needed!



There are open tasks for writing

Joomla! System tests:


Tasks for Web Links

We need testers for the open pull requests! And we have a big issue with smart search tests, which make Travis fail. 


Tasks for Joomla-Browser

We need to finish this:, any takers? is linked to:


There are also multiple other open issues which need investigation and your help!


Tasks for Selenium

Investigate on Marionette and Chrome Webdriver and on how we can use it.


Tasks for JoRobo

- Migrate most of the code of the RoboFiles (in Weblinks / joomla) to it.

- Update coding standards (deprecated warning)

- Build system for Joomla core itself (replace Phing scripts, add minifying of JS / CSS, XML replacements, many other nice features. Talk with @rdeutz)


Tasks for Vagrant Box

Add shell scripts to easily set up testing additionally Web Links and GSoC JavaScript project



We need testers: Jelle had a strange bug in Windows (not showing up for other win users).



## Next meeting

26th Automated Testing Team Meeting

Date & Time

Wed, August 24th at