Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] WSL-ubuntu + NVIDIA docker 安装 #9

Open
lovegaoshi opened this issue Dec 9, 2023 · 0 comments
Open

[docs] WSL-ubuntu + NVIDIA docker 安装 #9

lovegaoshi opened this issue Dec 9, 2023 · 0 comments

Comments

@lovegaoshi
Copy link
Owner

lovegaoshi commented Dec 9, 2023

先装WSL + docker + NVIDIA:
https://learn.microsoft.com/en-us/windows/ai/directml/gpu-cuda-in-wsl
https://docs.nvidia.com/cuda/wsl-user-guide/index.html#getting-started-with-cuda-on-wsl
??? https://zhuanlan.zhihu.com/p/558821366
然后

git clone -b inaseg-cloud https://github.com/lovegaoshi/ipynb.git
cd ipynb
sudo docker build -t ipynb-inaseg -f Dockerfile-gpu .
sudo docker run -v "$(pwd)":/inaseg -u 1000:1000 --gpus all ipynb-inaseg python /inaseg/inaseg.py --shazam --shazam_multithread=2 --cleanup --outdir=/inaseg --aria=8 --media=https://www.bilibili.com/video/BV1PQ4y157GK/

全部log:

ubuntu@TirionFordring:~/github$ git clone -b inaseg-cloud https://github.com/lovegaoshi/ipynb.git
cd ipynb
Cloning into 'ipynb'...
remote: Enumerating objects: 349, done.
remote: Counting objects: 100% (149/149), done.
remote: Compressing objects: 100% (86/86), done.
remote: Total 349 (delta 66), reused 118 (delta 49), pack-reused 200
Receiving objects: 100% (349/349), 4.45 MiB | 11.45 MiB/s, done.
Resolving deltas: 100% (165/165), done.
ubuntu@TirionFordring:~/github/ipynb$ ls
BiliWatcher.py  Dockerfile-gpu    configs             docker-compose.yml  inacelery.py  initialize.py  requirements.txt
Dockerfile      biliupWrapper.py  cookieformatter.py  inaConstant.py      inaseg.py     readme.md      wbi.py
ubuntu@TirionFordring:~/github/ipynb$ sudo docker build -f Dockerfile-gpu .
[+] Building 275.8s (12/12) FINISHED                                                                                                                                docker:default
 => [internal] load build definition from Dockerfile-gpu                                                                                                                      0.0s
 => => transferring dockerfile: 246B                                                                                                                                          0.0s
 => [internal] load .dockerignore                                                                                                                                             0.0s
 => => transferring context: 2B                                                                                                                                               0.0s
 => [internal] load metadata for docker.io/tensorflow/tensorflow:2.13.0-gpu                                                                                                   1.8s
 => [internal] load build context                                                                                                                                             0.1s
 => => transferring context: 4.78MB                                                                                                                                           0.0s
 => [1/7] FROM docker.io/tensorflow/tensorflow:2.13.0-gpu@sha256:b4676741c491bff3d0f29c38c369281792c7d5c5bfa2b1aa93e5231a8d236323                                           118.8s
 => => resolve docker.io/tensorflow/tensorflow:2.13.0-gpu@sha256:b4676741c491bff3d0f29c38c369281792c7d5c5bfa2b1aa93e5231a8d236323                                             0.0s
 => => sha256:b4676741c491bff3d0f29c38c369281792c7d5c5bfa2b1aa93e5231a8d236323 4.08kB / 4.08kB                                                                                0.0s
 => => sha256:6bdca089cc382c11ef5675cf72232e58fbad3a8c7758b34ef03855f566ca1e84 11.79kB / 11.79kB                                                                              0.0s
 => => sha256:56e0351b98767487b3c411034be95479ed1710bb6be860db6df0be3a98653027 27.51MB / 27.51MB                                                                              1.2s
 => => sha256:20d547ab5eb53128ec992abaae1d1f5a15bfe39d7a18ac0e5e265b383ebf71bc 7.94MB / 7.94MB                                                                                1.3s
 => => sha256:ece84004a3cd8e7689a2ff0b1a1856a941e6cc31f7ec1eedc39073035a7adddd 56.23MB / 56.23MB                                                                              2.7s
 => => sha256:b08eef4b90c81de27f73f4aa3522ac14ee1e1146db910e97e17d9d25a969a292 186B / 186B                                                                                    1.5s
 => => sha256:aa315b7808f0b5e5badf02398e1f7ce1780952eda559defa9fb204e4f19c54c4 6.88kB / 6.88kB                                                                                1.5s
 => => extracting sha256:56e0351b98767487b3c411034be95479ed1710bb6be860db6df0be3a98653027                                                                                     1.5s
 => => sha256:de96f27d948755d7ed0557a21364768e9d85eeabdd8ea7f9ae5de986dcdaef54 977B / 977B                                                                                    1.8s
 => => sha256:0d0dce5452b7074590ad5dc15e49d40ea82eb5c2304ec6d7861178c57b239fe6 768B / 768B                                                                                    1.9s
 => => sha256:780a8581227d0b3707efa2d1327690624bd8e4aeb1f4ec87b3429796c20865d6 32.19MB / 32.19MB                                                                              3.7s
 => => sha256:5a1e96a5c562cfcd77e326f0822fe6ba9b7540a3041e4802ba64b24fa74c233d 435B / 435B                                                                                    2.1s
 => => sha256:18e62fb4b02bf94f08abbe9c472441cb487f759cc15f25c781f06089c13e3360 2.52GB / 2.52GB                                                                               74.6s
 => => sha256:1eb5af93509e197319fe2b95e0ecc382af70353a19e370c13ea68fb0fe108a48 971B / 971B                                                                                    2.9s
 => => extracting sha256:20d547ab5eb53128ec992abaae1d1f5a15bfe39d7a18ac0e5e265b383ebf71bc                                                                                     0.4s
 => => sha256:2e482ebc3ac75f8549fcda5398d339c473b0b2513df3490db6a177c9a1018d64 128B / 128B                                                                                    3.2s
 => => sha256:1b05b9c327ea3c1ab594685cbc6a2e81762def76f5a8cafe95e910d14b0bcb43 22.07MB / 22.07MB                                                                              5.0s
 => => extracting sha256:ece84004a3cd8e7689a2ff0b1a1856a941e6cc31f7ec1eedc39073035a7adddd                                                                                     1.2s
 => => sha256:38fe50d989691442c8c2504bac7940994904fbded380b01d9290e3280b05f53b 604.67MB / 604.67MB                                                                           51.6s
 => => extracting sha256:b08eef4b90c81de27f73f4aa3522ac14ee1e1146db910e97e17d9d25a969a292                                                                                     0.0s
 => => extracting sha256:aa315b7808f0b5e5badf02398e1f7ce1780952eda559defa9fb204e4f19c54c4                                                                                     0.0s
 => => extracting sha256:de96f27d948755d7ed0557a21364768e9d85eeabdd8ea7f9ae5de986dcdaef54                                                                                     0.0s
 => => extracting sha256:0d0dce5452b7074590ad5dc15e49d40ea82eb5c2304ec6d7861178c57b239fe6                                                                                     0.0s
 => => extracting sha256:5a1e96a5c562cfcd77e326f0822fe6ba9b7540a3041e4802ba64b24fa74c233d                                                                                     0.0s
 => => extracting sha256:780a8581227d0b3707efa2d1327690624bd8e4aeb1f4ec87b3429796c20865d6                                                                                     0.4s
 => => sha256:ac042b037de7062fda11dbfb03be0a430305d912d14daf4aacac5b73e496bd79 809B / 809B                                                                                    5.2s
 => => sha256:2009c4c4e2d5daeff2f37140e3885fc80ab003d778c5b1d58adff23cc3f3f16f 7.81kB / 7.81kB                                                                                5.5s
 => => sha256:b1c3a97d184ade58e969736e2883b029917f5ce1d5d31ab38fffb10a54a5a5e4 1.13kB / 1.13kB                                                                                5.8s
 => => sha256:fe5937c77f3eb80423ea3bfdab80dcb93bf7f4063a12c5fddac9a77baf0f7f31 1.13kB / 1.13kB                                                                                6.0s
 => => extracting sha256:18e62fb4b02bf94f08abbe9c472441cb487f759cc15f25c781f06089c13e3360                                                                                    28.5s
 => => extracting sha256:1eb5af93509e197319fe2b95e0ecc382af70353a19e370c13ea68fb0fe108a48                                                                                     0.0s
 => => extracting sha256:2e482ebc3ac75f8549fcda5398d339c473b0b2513df3490db6a177c9a1018d64                                                                                     0.0s
 => => extracting sha256:1b05b9c327ea3c1ab594685cbc6a2e81762def76f5a8cafe95e910d14b0bcb43                                                                                     0.9s
 => => extracting sha256:38fe50d989691442c8c2504bac7940994904fbded380b01d9290e3280b05f53b                                                                                    14.2s
 => => extracting sha256:ac042b037de7062fda11dbfb03be0a430305d912d14daf4aacac5b73e496bd79                                                                                     0.0s
 => => extracting sha256:2009c4c4e2d5daeff2f37140e3885fc80ab003d778c5b1d58adff23cc3f3f16f                                                                                     0.0s
 => => extracting sha256:b1c3a97d184ade58e969736e2883b029917f5ce1d5d31ab38fffb10a54a5a5e4                                                                                     0.0s
 => => extracting sha256:fe5937c77f3eb80423ea3bfdab80dcb93bf7f4063a12c5fddac9a77baf0f7f31                                                                                     0.0s
 => [2/7] COPY . /inaseg                                                                                                                                                      0.8s
 => [3/7] WORKDIR /inaseg                                                                                                                                                     0.0s
 => [4/7] RUN pip install -r /inaseg/requirements.txt                                                                                                                        60.7s
 => [5/7] RUN apt update                                                                                                                                                     57.7s
 => [6/7] RUN apt -y install ffmpeg aria2 wget nano                                                                                                                          27.5s
 => [7/7] RUN python /inaseg/initialize.py                                                                                                                                    2.3s
 => exporting to image                                                                                                                                                        6.1s
 => => exporting layers                                                                                                                                                       6.1s
 => => writing image sha256:16ab9ac3535bb8896417d19e74013b06b3a8ce6445525de6b9a8916213f35640                                                                                  0.0s

What's Next?
  1. Sign in to your Docker account → docker login
  2. View a summary of image vulnerabilities and recommendations → docker scout quickview
ubuntu@TirionFordring:~/github/ipynb$ git pull
remote: Enumerating objects: 8, done.
remote: Counting objects: 100% (8/8), done.
remote: Compressing objects: 100% (2/2), done.
remote: Total 5 (delta 3), reused 5 (delta 3), pack-reused 0
Unpacking objects: 100% (5/5), 743 bytes | 743.00 KiB/s, done.
From https://github.com/lovegaoshi/ipynb
   2ba5c98..0dcbc87  inaseg-cloud -> origin/inaseg-cloud
Updating 2ba5c98..0dcbc87
Fast-forward
 constants.py   |  3 +++
 inaConstant.py | 11 ++++-------
 wbi.py         | 20 ++++++++++++++------
 3 files changed, 21 insertions(+), 13 deletions(-)
 create mode 100644 constants.py
ubuntu@TirionFordring:~/github/ipynb$ nvidia-smi
Sat Dec  9 09:48:13 2023
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 545.33.01              Driver Version: 546.29       CUDA Version: 12.3     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce GTX 1070        On  | 00000000:09:00.0  On |                  N/A |
| 31%   52C    P0              43W / 151W |   3306MiB /  8192MiB |      9%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|    0   N/A  N/A        22      G   /Xwayland                                 N/A      |
+---------------------------------------------------------------------------------------+
ubuntu@TirionFordring:~/github/ipynb$ sudo docker images
REPOSITORY   TAG       IMAGE ID       CREATED              SIZE
<none>       <none>    16ab9ac3535b   About a minute ago   8.4GB
ubuntu@TirionFordring:~/github/ipynb$ sudo docker tag 16ab9ac3535b ipynb-inaseg
ubuntu@TirionFordring:~/github/ipynb$ id
uid=1000(ubuntu) gid=1000(ubuntu) groups=1000(ubuntu),4(adm),20(dialout),24(cdrom),25(floppy),27(sudo),29(audio),30(dip),44(video),46(plugdev),116(netdev),1001(docker)
ubuntu@TirionFordring:~/github/ipynb$ sudo docker run -v "$(pwd)":/inaseg -u 1000:1000 --gpus all ipynb-inaseg python /inaseg/inaseg.py --shazam --shazam_multithread=2 --cleanup -
-outdir=/inaseg --aria=8 --media=https://www.bilibili.com/video/BV1PQ4y157GK/
2023-12-09 17:50:47.858774: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-12-09 17:50:49,531 INFO     ['yt-dlp', 'https://www.bilibili.com/video/BV1PQ4y157GK/', '-o', '/inaseg/[%(uploader)s] %(title)s %(upload_date)s.%(ext)s', '--cookies', 'ytdlp_cookies.txt', '--external-downloader', 'aria2c', '--external-downloader-args', '-x 8 -s 8 -k 1M', '-f', 'bestaudio']
WARNING: External Downloader arguments given without specifying name. The arguments will be given to aria2c
2023-12-09 17:50:49,980 INFO     [BiliBili] Extracting URL: https://www.bilibili.com/video/BV1PQ4y157GK/

2023-12-09 17:50:49,980 INFO     [BiliBili] 1PQ4y157GK: Downloading webpage

2023-12-09 17:50:51,022 INFO     [BiliBili] BV1PQ4y157GK: Extracting videos in anthology

2023-12-09 17:50:51,392 INFO     [BiliBili] Format(s) 720P 高清, 1080P 高清, 1080P 60帧 are missing; you have to login or become premium member to download them. Use --cookies-from-browser or --cookies for the authentication. See  https://github.com/yt-dlp/yt-dlp/wiki/FAQ#how-do-i-pass-cookies-to-yt-dlp  for how to manually pass cookies

2023-12-09 17:50:51,392 INFO     [BiliBili] 706992421: Extracting chapters

2023-12-09 17:50:51,882 INFO     [info] BV1PQ4y157GK: Downloading 1 format(s): 30280

2023-12-09 17:50:51,898 INFO     [download] Destination: /inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a

2023-12-09 17:51:17,354 INFO     [#563a64 4.0MiB/199MiB(2%) CN:8 DL:15MiB ETA:12s]

2023-12-09 17:51:17,354 INFO     [#563a64 22MiB/199MiB(11%) CN:8 DL:18MiB ETA:9s]

2023-12-09 17:51:17,354 INFO     [#563a64 40MiB/199MiB(20%) CN:8 DL:18MiB ETA:8s]

2023-12-09 17:51:17,354 INFO     [#563a64 75MiB/199MiB(37%) CN:8 DL:23MiB ETA:5s]

2023-12-09 17:51:17,354 INFO     [#563a64 86MiB/199MiB(43%) CN:8 DL:20MiB ETA:5s]

2023-12-09 17:51:17,354 INFO     [#563a64 92MiB/199MiB(46%) CN:8 DL:17MiB ETA:6s]

2023-12-09 17:51:17,354 INFO     [#563a64 97MiB/199MiB(49%) CN:8 DL:15MiB ETA:6s]

2023-12-09 17:51:17,354 INFO     [#563a64 103MiB/199MiB(51%) CN:8 DL:14MiB ETA:6s]

2023-12-09 17:51:17,354 INFO     [#563a64 108MiB/199MiB(54%) CN:8 DL:13MiB ETA:6s]

2023-12-09 17:51:17,354 INFO     [#563a64 113MiB/199MiB(57%) CN:8 DL:12MiB ETA:6s]

2023-12-09 17:51:17,355 INFO     [#563a64 119MiB/199MiB(59%) CN:8 DL:10MiB ETA:7s]

2023-12-09 17:51:17,355 INFO     [#563a64 124MiB/199MiB(62%) CN:8 DL:9.9MiB ETA:7s]

2023-12-09 17:51:17,355 INFO     [#563a64 130MiB/199MiB(65%) CN:8 DL:6.9MiB ETA:9s]

2023-12-09 17:51:17,355 INFO     [#563a64 135MiB/199MiB(68%) CN:8 DL:5.4MiB ETA:11s]

2023-12-09 17:51:17,355 INFO     [#563a64 140MiB/199MiB(70%) CN:8 DL:5.4MiB ETA:10s]

2023-12-09 17:51:17,355 INFO     [#563a64 146MiB/199MiB(73%) CN:8 DL:5.4MiB ETA:9s]

2023-12-09 17:51:17,355 INFO     [#563a64 152MiB/199MiB(76%) CN:8 DL:5.4MiB ETA:8s]

2023-12-09 17:51:17,355 INFO     [#563a64 157MiB/199MiB(79%) CN:8 DL:5.4MiB ETA:7s]

2023-12-09 17:51:17,355 INFO     [#563a64 162MiB/199MiB(81%) CN:8 DL:5.4MiB ETA:6s]

2023-12-09 17:51:17,355 INFO     [#563a64 168MiB/199MiB(84%) CN:8 DL:5.4MiB ETA:5s]

2023-12-09 17:51:17,355 INFO     [#563a64 173MiB/199MiB(87%) CN:8 DL:5.4MiB ETA:4s]

2023-12-09 17:51:17,355 INFO     [#563a64 179MiB/199MiB(90%) CN:8 DL:5.4MiB ETA:3s]

2023-12-09 17:51:17,355 INFO     [#563a64 184MiB/199MiB(92%) CN:8 DL:5.4MiB ETA:2s]

2023-12-09 17:51:17,355 INFO     [#563a64 190MiB/199MiB(95%) CN:8 DL:5.5MiB ETA:1s]

2023-12-09 17:51:17,356 INFO     [#563a64 198MiB/199MiB(99%) CN:2 DL:5.7MiB]

2023-12-09 17:51:17,356 INFO

2023-12-09 17:51:17,356 INFO     [download] 100% of  199.24MiB in 00:00:25 at 7.83MiB/s

2023-12-09 17:51:17,412 INFO     ['mathcing', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a']
2023-12-09 17:51:17.578669: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:17.583257: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:17.583602: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:17,583 INFO     [PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]
2023-12-09 17:51:17,624 INFO     ('/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'total seconds', '2:52:27')
2023-12-09 17:51:17,624 DEBUG    filelength 10347 is larger than thres 800, triggering a segmentation.
2023-12-09 17:51:17,625 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', 'infinity', 'to', '0:13:20']
Downloading data from https://github.com/ina-foss/inaSpeechSegmenter/releases/download/models/keras_speech_music_cnn.hdf5
5885888/5885888 [==============================] - 0s 0us/step
2023-12-09 17:51:18,425 DEBUG    Creating converter from 3 to 5
2023-12-09 17:51:18.432937: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:18.433287: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:18.433596: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:18.629284: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:18.629759: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:18.629796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1726] Could not identify NUMA node of platform GPU id 0, defaulting to 0.  Your kernel may not have been built with NUMA support.
2023-12-09 17:51:18.630129: I tensorflow/compiler/xla/stream_executor/cuda/cuda_gpu_executor.cc:981] could not open file to read NUMA node: /sys/bus/pci/devices/0000:09:00.0/numa_node
Your kernel may have been built without NUMA support.
2023-12-09 17:51:18.630189: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1639] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6731 MB memory:  -> device: 0, name: NVIDIA GeForce GTX 1070, pci bus id: 0000:09:00.0, compute capability: 6.1
2023-12-09 17:51:25.399724: I tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:432] Loaded cuDNN version 8600
956/956 - 3s - 3s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:51:29,636 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '0:13:20', 'to', '0:26:40']
974/974 - 3s - 3s/epoch - 3ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:51:37,802 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '0:26:40', 'to', '0:40:00']
974/974 - 4s - 4s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:51:48,264 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '0:40:00', 'to', '0:53:20']
1049/1049 - 4s - 4s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:52:01,015 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '0:53:20', 'to', '1:06:40']
1060/1060 - 4s - 4s/epoch - 3ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:52:12,034 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '1:06:40', 'to', '1:20:00']
841/841 - 3s - 3s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:52:22,934 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '1:20:00', 'to', '1:33:20']
691/691 - 2s - 2s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:52:34,152 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '1:33:20', 'to', '1:46:40']
948/948 - 3s - 3s/epoch - 3ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:52:46,408 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '1:46:40', 'to', '2:00:00']
923/923 - 3s - 3s/epoch - 3ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:52:59,648 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '2:00:00', 'to', '2:13:20']
1003/1003 - 4s - 4s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:53:14,850 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '2:13:20', 'to', '2:26:40']
995/995 - 4s - 4s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:53:30,550 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '2:26:40', 'to', '2:40:00']
1040/1040 - 4s - 4s/epoch - 4ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:53:48,351 INFO     ['segmenting', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', 'from', '2:40:00', 'to', 'infinity']
939/939 - 3s - 3s/epoch - 3ms/step
/usr/local/lib/python3.8/dist-packages/inaSpeechSegmenter/segmenter.py:80: RuntimeWarning: invalid value encountered in subtract
  data = (data - np.mean(data, axis=1).reshape((len(data), 1))) / np.std(data, axis=1).reshape((len(data), 1))
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:236: RuntimeWarning: invalid value encountered in subtract
  x = asanyarray(arr - arrmean)
2023-12-09 17:54:04,997 INFO     ['extracted timestamps', ['0:35:56 - 0:40:03', '0:47:07 - 0:51:31', '0:51:59 - 0:55:55', '0:56:11 - 1:0:22', '1:2:39 - 1:4:29', '1:40:39 - 1:43:39', '1:52:38 - 1:57:11', '1:58:56 - 2:2:42', '2:7:06 - 2:10:22', '2:24:51 - 2:29:07', '2:31:08 - 2:35:01', '2:38:21 - 2:42:23', '2:43:59 - 2:47:14', '2:49:01 - 2:52:30']]
2023-12-09 17:54:04,998 INFO     00: 0:35:56 - 0:40:03
2023-12-09 17:54:04,998 INFO     01: 0:47:07 - 0:51:31
2023-12-09 17:54:04,998 INFO     02: 0:51:59 - 0:55:55
2023-12-09 17:54:04,999 INFO     03: 0:56:11 - 1:0:22
2023-12-09 17:54:04,999 INFO     04: 1:2:39 - 1:4:29
2023-12-09 17:54:04,999 INFO     05: 1:40:39 - 1:43:39
2023-12-09 17:54:04,999 INFO     06: 1:52:38 - 1:57:11
2023-12-09 17:54:04,999 INFO     07: 1:58:56 - 2:2:42
2023-12-09 17:54:04,999 INFO     08: 2:7:06 - 2:10:22
2023-12-09 17:54:04,999 INFO     09: 2:24:51 - 2:29:07
2023-12-09 17:54:04,999 INFO     10: 2:31:08 - 2:35:01
2023-12-09 17:54:04,999 INFO     11: 2:38:21 - 2:42:23
2023-12-09 17:54:04,999 INFO     12: 2:43:59 - 2:47:14
2023-12-09 17:54:04,999 INFO     13: 2:49:01 - 2:52:30
2023-12-09 17:54:05,001 INFO     ('calling', ['ffmpeg', '-ss', '0:35:56', '-to', '0:40:03', '-i', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208.m4a', '-vn', '-ab', '320k', '/inaseg/[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_00.mp3'], 'in terminal:')
...
2023-12-09 17:57:03,594 INFO     ['[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_04', 'shazam found to be', ['pick up the phone', 'Henry Moodie']]
2023-12-09 17:57:04,424 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:04,618 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/E59DCE67-722D-444C-B9A7-DBD62E26D284/4B033203-BBF3-40D1-B1F3-FDBE6850A325?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:06,586 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:06,865 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/1382B06D-160A-493A-B599-8DE938EF0EDE/E30409F6-1336-4C34-81E2-A543C3E8F6B1?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:08,846 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:09,212 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/9D4733E2-0E0E-42C1-8172-6CBCE430077C/3A2066AE-73E9-421C-9DF8-0F9299EEBE9D?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:11,171 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:11,548 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/3CC26A5C-ADF4-4957-A7A5-EEF2B014772F/BDA57298-9E6E-48E2-A5A9-3924424C0986?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:13,503 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:13,786 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/003F6C68-75EF-48FE-A464-DD823318F46B/85AE1AD0-9788-400F-A89E-19B46F99E539?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:15,766 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:16,087 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/7B852303-2334-422C-A0A2-D7934ED38EA5/7F28E33E-48F2-4E46-8E58-4ADCFEDD6DC5?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:18,045 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:18,323 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/3468F4D6-7AD7-471C-9D4D-6848BF4BC627/D1D123B5-AD23-4B36-813D-ADC905297C24?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:20,258 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:20,435 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/A8AC7F09-B3B9-4A84-A037-104273748EC4/D184125C-C79A-4CE1-989B-516D87777DCF?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 76
2023-12-09 17:57:20,659 DEBUG    Starting new HTTPS connection (1): amp.shazam.com:443
2023-12-09 17:57:20,797 DEBUG    https://amp.shazam.com:443 "POST /discovery/v5/ru/RU/iphone/-/tag/B595E243-0B23-4D61-AE17-3A8D8F565AE3/86AD630F-6E13-41EA-B67E-E415DFC83B95?sync=true&webv3=true&sampling=true&connected=&shazamapiversion=v3&sharehub=true&hubv5minorversion=v5.1&hidelb=true&video=v3 HTTP/1.1" 200 143
2023-12-09 17:57:20,835 ERROR    ['[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_10', 'shazam failed']
ubuntu@TirionFordring:~/github/ipynb$ ls
 BiliWatcher.py
 Dockerfile
 Dockerfile-gpu
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_00_春擬き by yanaginagi.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_01_Lose Yourself by Original Cartel.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_02_Love Will Keep Us Alive by Eagles.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_03.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_04_pick up the phone by Henry Moodie.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_05_Top of the World (In the Style of Carpenters) [Performance Track with Demonstration Vocals] by Done Again.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_06_ユキトキ by yanaginagi.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_07_Matsuri by Fujii Kaze.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_08_Cynical Night Plan by  irai.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_09_Beths Theme by Ólafur Arnalds.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_10.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_11_Falling Slowly by Cory Nugent.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_12_Good Riddance (feat. Ashley Barrett) by Darren Korb.mp3'
'[诺莺Nox] 【直播回放】啊? 2023年12月8日23点场 20231208_13_History by 88rising & Rich Brian.mp3'
 __pycache__
 biliupWrapper.py
 configs
 constants.py
 cookieformatter.py
 docker-compose.yml
 inaConstant.py
 inacelery.py
 inaseg.py
 inaseg_inst.log
 initialize.py
 readme.md
 requirements.txt
 save.yaml
 save.yaml.old
 wbi.py
 ytdlp_cookies.txt
ubuntu@TirionFordring:~/github/ipynb$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant