Contents

Overview

This page is for the Orca team and other developers to keep track of the current state of the Orca regression tests, track/compare the results obtained using AT-SPI versus AT-SPI2, etc., etc. To learn more about how to create tests and/or run tests, please see the Orca Regression Testing page.

Please note: Each testing area specifies a 'Current basis for tests'.

  • This will change frequently as new development versions of the software being tested get released.
  • Previous, but relatively recent, results should remain available for comparison.
  • If you run the tests using some other version, your mileage may vary. At the moment, new results obtained for older releases are not of interest and should not, therefore, be added to the tables below.

Gtk Demo 2

Current basis for tests:

  • Orca from git master
  • Gtk Demo version 2.21.2
  • Approximate run time: 45 minutes

Date

Distro

Version(s)

CORBA
or D-Bus

Tests
Passed

Tests
Failed

Unexpected
Failures

Initials

Output

18-Jul-2010

Ubuntu Maverick

2.21.2

CORBA

278

9

0

jd

Results

27-Jul-2010

Ubuntu Maverick

2.21.2

D-Bus

168

119

110

jd

Results

Gtk Demo 3

(Needs to be created)

OOo Writer 3.3

Current basis for tests:

  • Orca from git master
  • OOo Writer DEV300m84 (Build:9512)

  • Approximate run time: 20 minutes

Date

Distro

Version(s)

CORBA
or D-Bus

Tests
Passed

Tests
Failed

Unexpected
Failures

Initials

Output

18-Jul-2010

Ubuntu Maverick

DEV300m84 (Build:9512)

CORBA

164

11

0

jd

Results

OOo Calc 3.3

Current basis for tests:

  • Orca from git master
  • OOo Calc DEV300m84 (Build:9512)

  • Approximate run time: 5 minutes

Date

Distro

Version(s)

CORBA
or D-Bus

Tests
Passed

Tests
Failed

Unexpected
Failures

Initials

Output

18-Jul-2010

Ubuntu Maverick

DEV300m84 (Build:9512)

CORBA

42

3

0

jd

Results

Java

Current basis for tests:

  • Orca from master
  • java-atk-wrapper from master
  • jdk-6u21 from Sun/Oracle
  • Approximate run time: 15 minutes

Date

Distro

Version(s)

CORBA
or D-Bus

Tests
Passed

Tests
Failed

Unexpected
Failures

Initials

Output

18-Jul-2010

Ubuntu Maverick

jdk-6u21;
java-atk-wrapper from master

CORBA

117

22

0

jd

Results

Firefox

(Coming soon. I hope.)

Projects/Orca/RegressionTestingData (last edited 2013-11-22 19:22:24 by WilliamJonMcCann)