FreeBSD OpenOffice.org porting status page : Quality Assurance

$Id: QA.html,v 1.21 2005/12/01 07:19:41 maho Exp $

by OpenOffice.org porting team and NAKATA, Maho

Quality Assurance

Once porting has been done, it means that the OOo source is buildable. The next step should be to perform Quality Assurance of the FreeBSD ported OpenOffice.org. This consists of several parts. Automated QA testing is also available. Other testcases are always needed.

Automated QA

Basic functionality of OpenOffice.org can be tested via automated GUI tools. The testtool connects OOo via TCP/IP, and does partial testing. Before proceeding, you should read Automated GUI Testing, Introduction to Automated GUI Testing, and OpenOffice.org TestTool CookBook.

Testing OpenOffice.org 2.0

• Install OpenOffice.org 2.0 via port:

  # cd /usr/ports/editors/openoffice.org-2.0
  # make install
  

• Prepare some directory (this affects .testtoolrc)

  % mkdir /work/ooo/2.0
  

• Checkout QA test scripts

  % cd /work/ooo/2.0
  % cvs -d:pserver:anoncvs@anoncvs.services.openoffice.org:/cvs co qa/qatesttool
  

  CAUTION: you must checkout appropreate qa/qatesttool otherwise meaningless. Please refer qa/qatesttool cvs tags and branches. If you want to test OOo 2.0.0, check out by:

  % cd /work/ooo/2.0
  % cvs -d:pserver:anoncvs@anoncvs.services.openoffice.org:/cvs co -r OOO200final qa/qatesttool
  

  2.0.1 (currently in the works until it will out)

  % cd /work/ooo/2.0
  % cvs -d:pserver:anoncvs@anoncvs.services.openoffice.org:/cvs co -r OOO201 qa/qatesttool
  

• Write .testtoolrc
  Just copying and pasting this section into ~/.testtollrc is enough. You can change some directories/profile/hardcoded names, etc., if you'd like.
  The following part is the most important:

  [OooProgramDir]
  Current=/usr/local/openoffice.org2.0/
  All=/usr/local/openoffice.org2.0/
  

  You must change to another directory if you installed the newer port (RC2 or 2.0 or 2.0.1 or developer version). you can check by typing:

  %cd /usr/ports/editors/openoffice.org-2.0-devel
  % make -V INSTALLATION_BASEDIR
  openoffice.org2.0m140
  

  for example and you can download from here testtoolrc2. please rename to .testtoolrc and change appropreately before using it.
• Install bash via ports

  % su
  Password:
  # cd /usr/ports/shells/bash
  # make install clean
  

• Apply following patch to qa/qatesttool/script/unix/OOoTestRun_unix.sh (just setting sLocation, LD_LIBRARY_PATH and sTestTool appropriately)

  --- qa/qatesttool/script/unix/OOoTestRun_unix.sh        Thu Sep  8 17:51:36 2005
  +++ qa/qatesttool/script/unix/OOoTestRun_unix.sh  Thu Oct 13 11:30:26 2005
  @@ -43,11 +43,12 @@
  
   # set location of testscripts
   # (the directory, where directory 'qatesttool' exists)
  -sLocation=/testtool
  +sLocation=/work/ooo/2.0/qa/
  
   # set location of TestTool
   # (full path including executable 'testtool')
  -sTestTool=/testtool/linux/testtool
  +sTestTool=/usr/local/openoffice.org2.0.RC1/program/testtool.bin
  +LD_LIBRARY_PATH=/usr/local/openoffice.org2.0.RC1/program; export LD_LIBRARY_PATH
  
   # set location of close-office file
   # (see cvs)
  
  

• Run OOoTestRun_unix.sh

  % cd /work/ooo/2.0/
  % bash qa/qatesttool/script/unix/OOoTestRun_unix.sh
  

• running VCL testtool in background

  if you are running testtool, you cannot do anything other than QA. you cannot run OOo, you need X terminal dedicated to QA, etc. to QA in background, I wrote a shell script. this does clean test, removing user settings and logs everytime. oooqa20.sh. You should create a new user like oooqa20, then

  login: oooqa20
  ...
  % bash oooqa20.sh
  

  Of course, I assume you are QA expert :)

• Diagnostics: Logs are accumulated in qa/qatesttool/errorlog/maho/*res

---

Testing OpenOffice.org 1.1.5

You need the GNU/Linux version of qatesttool to run. Currently, my FreeBSD build of the testtool are broken and I don't know how to fix it...

• Activate linux ABI via ports

  # cd /usr/ports/emulators/linux_base-rh-9/
  # make install
  

• Install OpenOffice.org 1.1.5 via port: (do not delete the work directory!!) and copy the necessary library named libsts645fi.so to /usr/local/OpenOffice.org1.1.5/program/.

  # cd /usr/ports/editors/openoffice.org-1.1
  # make install
  # cp /usr/ports/editors/openoffice.org-1.1/work/OOo_1.1.5/solver/645/unxfbsd.pro/lib/libsts645fi.so /usr/local/OpenOffice.org1.1.5/program/
  

• Make sure OpenOffice.org 1.1.5 user installation has been completed

  % openoffice.org-1.1.5
  ...
  

  Do you have ~/.sversionrc and ~/OpenOffice.org1.1.5?

  % ls ~/.sversionrc
  /home/maho/.sversionrc
  % ls ~/OpenOffice.org1.1.5/
  LICENSE                         setup@
  LICENSE.html                    setup.log
  README                          share/
  README.html                     soffice@
  THIRDPARTYLICENSEREADME.html    spadmin@
  instdb.ins                      user/
  program/
  

  If so, then you're okay.
• Prepare the qa directory

  % mkdir /work/ooo/1.1.5
  

• Download the testtool (linux version)

  % cd /work/ooo/
  % fetch http://www.openoffice.org/qa/qatesttool/11beta/tt_645m5_linux.tar.gz
  % tar xvfz tt_645m5_linux.tar.gz
  

• Checkout QA test scripts for 1.1.5 (tag is ooo115)

  % cd /work/ooo/1.1.5
  % cvs -d:pserver:anoncvs@anoncvs.services.openoffice.org:/cvs co -r ooo115 qa/qatesttool
  

  for 1.1.4 and 1.1.3 please use branch (tag) ooo114, ooo113, respectively.
• Write ~/.testtoolrc (do not mix with 2.0s one) you can also download from here testtoolrc1.
  please rename to .testtoolrc and change appropreately before using it.
• Apply qa_ooo115_fbsd.diff this patch to qa/qatesttool
• Run OOoTestRun_unix.sh

  % cd /work/ooo/1.1.5
  % bash qa/qatesttool/script/unix/OOoTestRun_unix.sh
  

• running VCL testtool in background

  if you are running testtool, you cannot do anything other than QA. you cannot run OOo, you need X terminal dedicated to QA, etc. to QA in background, I wrote a shell script. this does clean test, removing user settings and logs everytime. oooqa11.sh. You should create a new user like oooqa11, then

  login: oooqa11
  ...
  % bash oooqa11.sh
  

  Of course, I assume you are QA expert :)

• Diagnostics: Logs are accumulated at qa/qatesttool/errorlog/maho/*res

---

Some pitfalls
• [OooProgramDir]

  If you install different version of OOo, you must change this.

• [Communication]

  if you want to run QA 1.1.5 and 2.0 at the same time, you must change the port number, and port numbers are arbitrary, but never be the same.

---

Links

• Quality assurance project
• QA for localized builds
• OpenOffice.org 1.1.4 Localization Status
• qa/qatesttool cvs tags and branches

---