Coming up on May 28: Bug Hunting Session for LibreOffice 6.1 Beta 1

LibreOffice 6.1 is being developed by our worldwide community, and is due to be released in early August – see the release notes describing the new features here. You can help us to test it, and make it super reliable!

After the first Bug Hunting Session for LibreOffice 6.1, which was held on April 27th 2018, we’re glad to announce the Second Bug Hunting Session on May 28th – this time being held on a Monday.

In order to find, report and triage bugs, the tests during the Second Bug Hunting Session will be performed on the first Beta version of LibreOffice 6.1, which will be available on the pre-releases server on the day of the event. Builds will be available for Linux (DEB and RPM), macOS and Windows, and can be run in parallel with the production version – so you can test without affecting your existing stable installation.

Mentors will be available on May 28th 2018, from 8AM UTC to 8PM UTC for questions or help in the IRC channel: #libreoffice-qa and its Telegram bridge. Of course, hunting bugs will be possible also on other days, as the builds of this particular Beta release (LibreOffice 6.1.0 Beta1) will be available until the beginning of July.

During the day there will be two dedicated sessions focus on two of the tenders implemented in LibreOffice 6.1: The first to test the improvements on the image handling between 10AM UTC and 12AM UTC, and the second to test the HSQLDB import filter for firebird between 14PM UTC and 16PM UTC.

What happened during the first Bug Hunting Session ?

Since LibreOffice 6.1 Alpha 1 was released on week 17 of 2018, 91 bugs have been reported against Alpha 1 by more than 30 people, of which 26 have been already closed.

In total, 8 of these bugs have been categorized as critical, and 4 already fixed by the development team.

Base and Writer are the components with more reports, both having 18 each.

Many thanks to the top 5 reporters: Drew Jensen, Emil Tanev, Xisco Faulí, Telesto and Pander.

So join us on Monday, and we look forward to – and appreciate – your help!

Coming up on April 27: First Bug Hunting Session for LibreOffice 6.1

LibreOffice 6.1 is due to be released in mid August 2018, with many new features (those already implemented are summarized on the release notes page, with much more still to come).

In order to find, report and triage bugs, the Quality Assurance (QA) community is organizing the first Bug Hunting Session for LibreOffice 6.1 on Friday, April 27, 2018. All details are available on the specific wiki page.

In order to find, report and triage bugs, the tests during the First Bug Hunting Session will be performed on the first Alpha version of LibreOffice 6.1, which will be available on the pre-releases server on the day of the event. Builds will be available for Linux (DEB and RPM), macOS and Windows, and can be run in parallel with the production version – so you can test without affecting your existing stable installation.

Mentors will be available on April 27th 2018, from 8AM UTC to 8PM UTC for questions or help in the IRC channel: #libreoffice-qa (connect via webchat) and its Telegram bridge. Of course, hunting bugs will be possible also on other days, as the builds of this particular Alpha release (LibreOffice 6.1.0 Alpha1) will be available until the end of May.

During the day there will be two dedicated sessions focus on two of the tenders implemented in LibreOffice 6.1: The first to test the improvements on the image handling between 10AM UTC and 12AM UTC, and the second to test the HSQLDB import filter for firebird between 14PM UTC and 16PM UTC.

And the Month of LibreOffice is starting!

Throughout May we will be running the Month of LibreOffice, awarding cool stickers to contributors across the project. The Bug Hunting Session is your chance to get involved with the LibreOffice QA project, and grab a sticker during May – so get involved and help us make LibreOffice 6.1 the best release yet! See here for all the details.

LibreOffice 6.0: Exploring the QA statistics

By Xisco Faulí, Quality Assurance (QA) engineer

LibreOffice 6.0 was released on January 31 and this is what happened during its development in LibreOffice’s Bugzilla, which started when the 5.4 branch was branched off from master on May 18 2017.

Note: This blog post has been created based on bugs in Bugzilla that have the whiteboard ‘target:6.0.0’, which means a commit for that bug is included in the release. Other commits referring to other bug trackers (ofz, coverity, rhbz, bnc, etc…) are not covered here, as well as others commits not having a reference to our bug tracker (ie refactoring commits).

In LibreOffice 6.0, a total number of 926 bugs and 88 enhancements were worked on, of which 747 were reported during 2017 (73%), and 267 (27%) between October 2010 and December 2016. July 2017 and August 2017 were the months with more reports, 104 and 108 respectively.

284 reports are related to Writer, 175 to Calc, 134 to LibreOffice in general and 112 to Impress.

This is all thanks to 382 users who reported them.

TOP 10 Reporters

Xisco Faulí ( 74 )

Yousuf Philips (jay) ( 69 )

Telesto ( 59 )

Tamás Zolnai ( 44 )

Aron Budea ( 38 )

Gabor Kelemen ( 26 )

Regina Henschel ( 23 )

Samuel Mehrbrodt (CIB) ( 22 )

Mike Kaganski ( 18 )

Olivier Hallot ( 17 )

Once a report has been created in Bugzilla, a third person needs to jump in, triage and confirm it in order to set it to NEW. This is a very important step as it helps the QA Team to deal with the hundreds of bug reports we receive every week.

Doing it in a short period of time after the bugs are reported guarantees those with more priority get fixed more quickly.

67% of the reports were confirmed within the first day, 84% within the first week and 93% within the first month.

Comparing when the reports were created and when they were confirmed gives a similar chart.

This is all thanks to 113 users who confirmed them.

Top 10 Confirmers

Xisco Faulí ( 225 )

Buovjaga ( 92 )

Yousuf Philips (jay) ( 48 )

Aron Budea ( 42 )

Julien Nabet ( 38 )

raal ( 37 )

Tamás Zolnai ( 28 )

Heiko Tietze ( 28 )

Alex Thurgood ( 25 )

V Stuart Foote ( 23 )

Finally, once the reports have been confirmed and triaged, the developers need to investigate and fix them. Sometimes, it can be trivial fix that takes a few minutes to get fixed – sometimes it takes several man days.

10% of the reports got fixed within one day, 51% within one month and 80% within one year.

Taking a closer look at the period between 2017-05-18 and the final release, 111 bugs were fixed in average a month, being August 2017, September 2017 and October 2017 the highest, with 147, 147 and 139 reports fixed respectively.

This is all thanks to 100 developers who fixed them.

Top 10 fixers

Caolán McNamara ( 105 )

Tamás Zolnai ( 57 )

Julien Nabet ( 48 )

Eike Rathke ( 46 )

Miklos Vajna ( 43 )

Michael Stahl ( 41 )

Adolfo Jayme ( 41 )

Yousuf Philips (jay) ( 39 )

Justin L ( 31 )

Heiko Tietze ( 28 )

For more QA statistics, please watch my recent talk at FOSDEM 2018:
https://fosdem.org/2018/schedule/event/ode_overview/

Join in, and help our QA community to polish future LibreOffice releases! We’re a friendly and growing project, and there are many ways to get involved: https://wiki.documentfoundation.org/QA/GetInvolved

Sunday Marketing #6

Last week, we have published the crash report chart just two days after the announcement of LibreOffice 6.0.1, to show the impact of the new version on the issues reported by Windows users.

Ten days after the announcement the impact is even more visible, and the chart on the left shows that the situation is now under control.

The trend shows how important is for LibreOffice users to quickly update to the last available version to reduce the number of potential issues.

LibreOffice community focus: QA (quality assurance)

With LibreOffice 6.0 due to be released at the end of the month, we’ve been talking to various communities involved in the project. In the last couple of weeks, we’ve chatted with the localisation and documentation teams, and today it’s the turn of QA (quality assurance), which is coordinated by Xisco Fauli

What has the QA community been working on in preparation for LibreOffice 6.0?

During the development of LibreOffice 6.0, three Bug Hunting Sessions were held (6.0 Alpha1, 6.0 Beta1 and RC1), the last one just two weeks ago. There was also a parallel event organized by Muhammet Kara in Ankara, where volunteers gathered to test LibreOffice 6.0 RC1. Besides that, the QA team is constantly testing the latest daily builds, testing new features, and triaging the bugs reported on Bugzilla.

What are your favourite new features in this release?

That’s a difficult question, especially taking into account all the improvements done in this release to LibreOffice Android Viewer, to LibreOffice Online or the work done by the Google Summer of Code students among others. But if I had to choose one, I think I’d go for the characters dialog refactoring done by Akshay Deep and the UX (user experience) team, as this is probably the feature I will use the most in the near future. Here’s how it looks:

What tools and services do you use in the QA community?

A very handy tool recently completed by Markus Mohrhard is the automated updater for Windows and Linux, which allows the QA team to test daily builds without having to manually download the latest build every time.

This is very practical as testers no longer need to worry about constantly updating to the latest build, and can focus more on testing the program instead, assured that they are testing changes done to the code just the day before.

This tool was presented at the beginning of the LibreOffice 6.0 development cycle, and I believe it will have a very positive impact on the quality of 6.0 as it shortens the time between a problem being introduced in the code, and the time it’s found.

Another tool we’ve been using for some time now is the bibisect repositories, which allow us to find the exact code commit where a bug was introduced, increasing the chances that the bug gets fixed and reducing the time until it gets fixed.

Another tool which is fulling working now is a set of scripts called office-interoperability-tools that we use to automatically find document layout regressions in the master code branch compared to other office suites (in our case we use MS Office). Right now we use it with 8,450 files, and I believe it will also have a positive impact on the quality of LibreOffice 6.0.

Finally, it’s important to mention the main tool used in QA, Bugzilla, the place where all bugs are reported and triaged. Then there’s the wiki page where the QA documentation can be found, and testlink, the application to manage manual tests.

Finally, how can people get involved with the QA community?

The’re many ways one can help LibreOffice QA. Probably the simplest one would be: download the latest pre-release build (LibreOffice 6.0 RC2 as of today), install it and use it as you would use LibreOffice in your daily basis (but take into account it’s still a pre-release, so it’s not recommended to use it with important documents). If you find anything working incorrectly, please report it to Bugzilla.

On the other hand, if you prefer to follow a set of manual tests, you can use testlink (see the documentation for that. We also need help to triage bugs that are not-yet-confirmed, or retest old bugs to see if they might have been fixed.

Lastly, if you’re looking for something especially exciting things to do, you can help us to test daily builds, bisect bugs or write UI-tests. Don’t hesitate to join the #libreoffice-qa channel and say hello. We’ll be grateful to help you with any question or problem you have!

Much gratitude to Xisco and the diligent QA community for helping to make LibreOffice 6.0 a solid release. Their efforts are appreciated by users across the world. Next up, we talk to the design and development communities – more on this blog very soon…

Coming up on December 22: Bug Hunting Session for LibreOffice 6.0 RC1

2017 is coming to a close, but our community is still busy preparing for the release of LibreOffice 6.0, which is due in late January 2018. Many new features have been added to this version, and to make it as reliable as possible, we want your help!

On December 22 we will have an international Bug Hunting Session (BHS), testing the RC1 (first release candidate) of LibreOffice 6.0. You can download, try out and test this RC1 version – and if you spot any bugs, let our QA (Quality Assurance) community know.

Mentors will be available to help you file bugs from 11:00 UTC to 15:00 UTC on that day. All assistance is greatly appreciated – together we can make LibreOffice 6.0 the best release ever, for millions of people around the world! For full details on the Bug Hunting Session, and how to get involved, see our wiki:

Click here for full details about the Bug Hunting Session

In addition, there will be a local event in Ankara, organised by the Turkish LibreOffice community. Here are the details:

  • Date: Dec 22 Friday
  • Time: 14:00-17:00 (UTC+3)
  • Location: TUBITAK ULAKBIM, 7th Floor, Meeting Room 2
  • Registration form: https://goo.gl/forms/paVTg3ExZDn0Oytj1
  • Attendees will bring their own laptops. Registration until Thursday 17:00 (UTC+3) is required. There will be snacks, tea, and some swag!