🧑‍🌾 CmdLine tests failing in gz-sim7, ign-gazebo6 and ign-gazebo3 Homebrew

[Crola1702]

Environment

• OS Version: MacOS Bigsur
• Binary build - Garden and Citadel

Description

• Expected behavior: Test should pass
• Actual behavior: CmdLine Tests are failing

Steps to reproduce

1. Run a build in gz-sim7-homebrew, ign-gazebo6-homebrew or ign-gazebo3-homebrew
2. See 5 test regressions

Output

Reference builds:

• gz-sim7
• ign-gazebo3
• ign-gazebo6

Failing tests:

• CmdLine.Server
• CmdLine.CachedFuelWorld
• CmdLine.GazeboServer
• CmdLine.Gazebo
• CmdLine.ResourcePath

Gz-sim7 log output:

The following tests FAILED:
	 53 - UNIT_gz_TEST (Failed)
	263 - testFixture_TEST (Failed)

Test 53 - UNIT_gz_TEST:

test 53
        Start  53: UNIT_gz_TEST

53: Test command: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/bin/UNIT_gz_TEST "--gtest_output=xml:/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/test_results/UNIT_gz_TEST.xml"
53: Working Directory: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/src
53: Environment variables: 
53:  GZ_CONFIG_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/test/conf
53:  GZ_SIM_SYSTEM_PLUGIN_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib
53: Test timeout computed to be: 240
53: Running main() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/gtest_vendor/src/gtest_main.cc
53: [==========] Running 7 tests from 1 test suite.
53: [----------] Global test environment set-up.
53: [----------] 7 tests from CmdLine
53: [ RUN      ] CmdLine.Server
53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s  -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf]
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: Running command [GZ_SIM_RESOURCE_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds /usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s  -r -v 4 --iterations 5  plugins.sdf]
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: [  FAILED  ] CmdLine.Server (1522 ms)
53: [ RUN      ] CmdLine.CachedFuelWorld
53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s  -r -v 4 --iterations 5 https://fuel.gazebosim.org/1.0/openroboticstest/worlds/test%20world]
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:111: Failure
53: Expected: (output.find("Cached world found.")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: [  FAILED  ] CmdLine.CachedFuelWorld (294 ms)
53: [ RUN      ] CmdLine.GazeboServer
53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s  -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf]
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: [  FAILED  ] CmdLine.GazeboServer (295 ms)
53: [ RUN      ] CmdLine.Gazebo
53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s  -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf]
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure
53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: [  FAILED  ] CmdLine.Gazebo (295 ms)
53: [ RUN      ] CmdLine.ResourcePath
53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:156: Failure
53: Expected: (output.find("Unable to find or download file")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib.
53: 
53: [  FAILED  ] CmdLine.ResourcePath (888 ms)
53: [ RUN      ] CmdLine.GazeboHelpVsCompletionFlags
53: [       OK ] CmdLine.GazeboHelpVsCompletionFlags (155 ms)
53: [ RUN      ] CmdLine.ModelHelpVsCompletionFlags
53: [       OK ] CmdLine.ModelHelpVsCompletionFlags (147 ms)
53: [----------] 7 tests from CmdLine (3599 ms total)
53: 
53: [----------] Global test environment tear-down
53: [==========] 7 tests from 1 test suite ran. (3599 ms total)
53: [  PASSED  ] 2 tests.
53: [  FAILED  ] 5 tests, listed below:
53: [  FAILED  ] CmdLine.Server
53: [  FAILED  ] CmdLine.CachedFuelWorld
53: [  FAILED  ] CmdLine.GazeboServer
53: [  FAILED  ] CmdLine.Gazebo
53: [  FAILED  ] CmdLine.ResourcePath
53: 
53:  5 FAILED TESTS
 53/263 Test  #53: UNIT_gz_TEST ............................................***Failed    3.73 sec

Test 263 - testFixture_TEST:

test 263
        Start 263: testFixture_TEST

263: Test command: /usr/local/Frameworks/Python.framework/Versions/3.11/bin/python3.11 "/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/python/test/testFixture_TEST.py"
263: Working Directory: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/python
263: Environment variables: 
263:  PYTHONPATH=/usr/local/Cellar/gz-sim7/HEAD/lib/python/
263:  LD_LIBRARY_PATH=/usr/local/Cellar/gz-sim7/HEAD/lib:
263: Test timeout computed to be: 1500
263: Traceback (most recent call last):
263:   File "/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/python/test/testFixture_TEST.py", line 21, in <module>
263:     from gz.math7 import Vector3d
263: ModuleNotFoundError: No module named 'gz.math7'
263/263 Test #263: testFixture_TEST ........................................***Failed    0.43 sec

Ign-gazebo3 output:

The following tests FAILED:
	 13 - UNIT_ign_TEST (Failed)

Test 13 - UNIT_ign_TEST

test 13
        Start  13: UNIT_ign_TEST

13: Test command: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/bin/UNIT_ign_TEST "--gtest_output=xml:/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/test_results/UNIT_ign_TEST.xml"
13: Working Directory: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/src
13: Environment variables: 
13:  IGN_CONFIG_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/test/conf
13:  IGN_GAZEBO_SYSTEM_PLUGIN_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib
13: Test timeout computed to be: 240
13: Running main() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/gtest/src/gtest_main.cc
13: [==========] Running 7 tests from 1 test suite.
13: [----------] Global test environment set-up.
13: [----------] 7 tests from CmdLine
13: [ RUN      ] CmdLine.Server
13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s  -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf]
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: Running command [IGN_GAZEBO_RESOURCE_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds /usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s  -r -v 4 --iterations 5  plugins.sdf]
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: [  FAILED  ] CmdLine.Server (1413 ms)
13: [ RUN      ] CmdLine.CachedFuelWorld
13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s  -r -v 4 --iterations 5 https://fuel.gazebosim.org/1.0/OpenRobotics/worlds/Test%20world]
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:107: Failure
13: Expected: (output.find("Cached world found.")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: [  FAILED  ] CmdLine.CachedFuelWorld (375 ms)
13: [ RUN      ] CmdLine.GazeboServer
13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s  -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf]
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: [  FAILED  ] CmdLine.GazeboServer (377 ms)
13: [ RUN      ] CmdLine.Gazebo
13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s  -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf]
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure
13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: [  FAILED  ] CmdLine.Gazebo (373 ms)
13: [ RUN      ] CmdLine.ResourcePath
13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:152: Failure
13: Expected: (output.find("Unable to find or download file")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615
13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib.
13: 
13: [  FAILED  ] CmdLine.ResourcePath (1120 ms)
13: [ RUN      ] CmdLine.GazeboHelpVsCompletionFlags
13: [       OK ] CmdLine.GazeboHelpVsCompletionFlags (151 ms)
13: [ RUN      ] CmdLine.ModelHelpVsCompletionFlags
13: [       OK ] CmdLine.ModelHelpVsCompletionFlags (144 ms)
13: [----------] 7 tests from CmdLine (3953 ms total)
13: 
13: [----------] Global test environment tear-down
13: [==========] 7 tests from 1 test suite ran. (3953 ms total)
13: [  PASSED  ] 2 tests.
13: [  FAILED  ] 5 tests, listed below:
13: [  FAILED  ] CmdLine.Server
13: [  FAILED  ] CmdLine.CachedFuelWorld
13: [  FAILED  ] CmdLine.GazeboServer
13: [  FAILED  ] CmdLine.Gazebo
13: [  FAILED  ] CmdLine.ResourcePath
13: 
13:  5 FAILED TESTS
 13/174 Test  #13: UNIT_ign_TEST ........................................***Failed    4.10 sec

Ign-launch2 has a similar issue, and is reported here: gazebosim/gz-launch#208

[scpeters]

I wonder if it's a DYLD_LIBRARY_PATH issue? I'll see if I can reproduce on my machine

Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib

[scpeters]

I have a fix for some of the tests in #1884 targeting gz-sim7. We can backport to ign-gazebo3 if it works

[Crola1702]

We can backport to ign-gazebo3 if it works

Actually, it works fine. We don't have any new test regressions. I see backport to gazebo3. Do we have one for gazebo6?

[scpeters]

We can backport to ign-gazebo3 if it works

Actually, it works fine. We don't have any new test regressions. I see backport to gazebo3. Do we have one for gazebo6?

we'll forward port from ign-gazebo3 to ign-gazebo6 after #1885 is merged

[Crola1702]

Closing as this problem was solved with the PRs mentioned on previous comments