Too many open files: 'p/NL_CL.raw.txt' #17

Open
opened 3 years ago by decentral1se · 2 comments
Owner
 Traceback (most recent call last):
    File "/Users/joanachicau/Documents/Project/VARIA_ZONE/mapp/etherpump/etherpump/commands/pull.py", line 365, in handle_pad
      async with await trio.open_file(ver["path"], "w") as f:
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_file_io.py", line 158, in open_file
      io.open, file, mode, buffering, encoding, errors, newline, closefd, opener
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_threads.py", line 205, in to_thread_run_sync
      return await trio.lowlevel.wait_task_rescheduled(abort)
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_core/_traps.py", line 166, in wait_task_rescheduled
      return (await _async_yield(WaitTaskRescheduled(abort_func))).unwrap()
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/outcome/_sync.py", line 111, in unwrap
      raise captured_error
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_threads.py", line 155, in do_release_then_return_result
      return result.unwrap()
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/outcome/_sync.py", line 111, in unwrap
      raise captured_error
    File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_threads.py", line 168, in worker_fn
      ret = sync_fn(*args)
  OSError: [Errno 24] Too many open files: 'p/NL_CL.raw.txt'
``` Traceback (most recent call last): File "/Users/joanachicau/Documents/Project/VARIA_ZONE/mapp/etherpump/etherpump/commands/pull.py", line 365, in handle_pad async with await trio.open_file(ver["path"], "w") as f: File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_file_io.py", line 158, in open_file io.open, file, mode, buffering, encoding, errors, newline, closefd, opener File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_threads.py", line 205, in to_thread_run_sync return await trio.lowlevel.wait_task_rescheduled(abort) File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_core/_traps.py", line 166, in wait_task_rescheduled return (await _async_yield(WaitTaskRescheduled(abort_func))).unwrap() File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/outcome/_sync.py", line 111, in unwrap raise captured_error File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_threads.py", line 155, in do_release_then_return_result return result.unwrap() File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/outcome/_sync.py", line 111, in unwrap raise captured_error File "/Users/joanachicau/Library/Caches/pypoetry/virtualenvs/etherpump-LOsPIH0d-py3.6/lib/python3.6/site-packages/trio/_threads.py", line 168, in worker_fn ret = sync_fn(*args) OSError: [Errno 24] Too many open files: 'p/NL_CL.raw.txt' ```
Poster
Owner

https://github.com/python-trio/trio/issues/527#issuecomment-389468738 shows that there it is necessary to place some sort of limit wrapper on the task runner because you apparently run into this file opening issue frequently.

https://github.com/python-trio/trio/issues/527#issuecomment-389468738 shows that there it is necessary to place some sort of limit wrapper on the task runner because you apparently run into this file opening issue frequently.
Poster
Owner

https://github.com/psf/requests/issues/239#issuecomment-3710254 seems the point to the idea that there is a bunch of code hanging out and waiting around to close the handle on the file but it still hasn't done it. This might make more sense here since we probably didn't take care to cleanup for the various types of failures.

https://github.com/psf/requests/issues/239#issuecomment-3710254 seems the point to the idea that there is a bunch of code hanging out and waiting around to close the handle on the file but it still hasn't done it. This might make more sense here since we probably didn't take care to cleanup for the various types of failures.
Sign in to join this conversation.
No Label
No Milestone
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.