OSWorld: Error Starting VM on Linux

I downloaded VMware Workstation Pro for Personal Use (For Linux) 17.5.1 from the official website, and installed it on my Linux machine. It was successfully installed and vmrun was added to my PATH. But when I try to run the test code from your README, I get this error: Warning: program compiled against libxml 210 using older 209

Any idea what’s going wrong?

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 39 (21 by maintainers)

Most upvoted comments

Things are working! Thanks for bearing with me, and for all of the help. It seems that VMware is just quite susceptible to zombie processes or something staying alive in the background, which prevented me from successfully running the agent two times in a row.

That doesn’t seem to work. I made sure there were not processes related to vmware, stopped the vms, deleted the vm_data folder, and started the quick start code. Pretty soon after I start it, it thinks there is a VM running. But the code doesn’t get to the point of “Virtual machine started” and the getIP call does not work.

I guess I could try uninstalling vmware completely and reinstalling, but weird that it would require all of that. update: Tried completely uninstalling and reinstalling vmware and starting from scratch. The quick start code is still taking a while, but will leave it for a few hours to see if it works this time. Not sure if there could be something else hiding on my machine preventing it from working now?

Okay, awesome, thank you! I successfully ran the baseline agent code.

But adding the headless arg to the quickstart code and trying to run that now results in:

An error occurred while trying to send the request: HTTPConnectionPool(host='172.16.96.128', port=5000): Max retries exceeded with url: /setup/execute (Caused by NewConnectionError('<urll
ib3.connection.HTTPConnection object at 0x7f610d5b8340>: Failed to establish a new connection: [Errno 111] Connection refused'))
Traceback (most recent call last):
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/connection.py", line 198, in _new_conn
    sock = connection.create_connection(
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/util/connection.py", line 85, in create_connection
    raise err
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/connectionpool.py", line 793, in urlopen
    response = self._make_request(
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/connectionpool.py", line 496, in _make_request
    conn.request(
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/connection.py", line 400, in request
    self.endheaders()
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/http/client.py", line 1250, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/http/client.py", line 1010, in _send_output
    self.send(msg)
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/http/client.py", line 950, in send
    self.connect()
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/connection.py", line 238, in connect
    self.sock = self._new_conn()
  File "/home/piperw/anaconda3/envs/osworld/lib/python3.9/site-packages/urllib3/connection.py", line 213, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f610d5b8340>: Failed to establish a new connection: [Errno 111] Connection refused

I tried stopping the vm and then running it, but no luck.

edit: Okay also trying to run the baseline agent is resulting in HTTP Connection errors. I broke it. 😦

Oh, almost done!!! I swear I will write clear doc later somewhere.

It is because if you run it on a server, you should run it in headless mode, so that you need to make a bit change in the quick strat code into:

from desktop_env.desktop_env import DesktopEnv

example = {
    "id": "94d95f96-9699-4208-98ba-3c3119edf9c2",
    "instruction": "I want to install Spotify on my current system. Could you please help me?",
    "config": [
        {
            "type": "execute",
            "parameters": {
                "command": [
                    "python",
                    "-c",
                    "import pyautogui; import time; pyautogui.click(960, 540); time.sleep(0.5);"
                ]
            }
        }
    ],
    "evaluator": {
        "func": "check_include_exclude",
        "result": {
            "type": "vm_command_line",
            "command": "which spotify"
        },
        "expected": {
            "type": "rule",
            "rules": {
                "include": ["spotify"],
                "exclude": ["not found"]
            }
        }
    }
}

env = DesktopEnv(action_space="pyautogui", headless=True)

obs = env.reset(task_config=example)
obs, reward, done, info = env.step("pyautogui.rightClick()")

Then it should work!

After the installation is done, I think the QuickStart code takes ~20s to set up and finish.

Ah, I see. Thank you! So rerunning the QuickStart code will likely solve my problem. How long does it take for you to run that code?

Ok thanks for the complete info, then could you paste the log file here for me to trace the error? Normally it is specific to the machine you used.