| Life In 19x19 http://prod.lifein19x19.com/ |
|
| Installing Lizzie, Leela-zero and KataGo on a new PC. http://prod.lifein19x19.com/viewtopic.php?f=18&t=19457 |
Page 1 of 1 |
| Author: | thirdfogie [ Wed Jun 19, 2024 4:04 am ] |
| Post subject: | Installing Lizzie, Leela-zero and KataGo on a new PC. |
I have a new PC, bought for the purpose of running KataGo. The CPU is an i7-14700K and the GPU is a GeForce RTX 4060. Once again, my son built the PC and we installed Debian 12 together. (I was previously stuck on Debian 11.) Video output goes through the GPU and everything seems to be working. The current build instructions are very different to what I used before. The advice (forgotten where it is) was to build leela-zero, then lizzie and finally KataGo, so I tried that. I believe all the required Debian packages were installed. The attempt to build leela-zero resulted in various incomprehensible errors, of which the last is shown below. A leelaz binary is left behind, but cannot be tested. Code: In file included from /home/john/leela-zero/gtest/googletest/src/gtest-all.cc:43: /home/john/leela-zero/gtest/googletest/src/gtest-death-test.cc: In function ‘bool testing::internal::StackGrowsDown()’: /home/john/leela-zero/gtest/googletest/src/gtest-death-test.cc:1012:24: error: ‘dummy’ may be used uninitialized [-Werror=maybe-uninitialized] 1012 | StackLowerThanAddress(&dummy, &result); | ~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ /home/john/leela-zero/gtest/googletest/src/gtest-death-test.cc:1002:13: note: by argument 1 of type ‘const void*’ to ‘void testing::internal::StackLowerThanAddress(const void*, bool*)’ declared here 1002 | static void StackLowerThanAddress(const void* ptr, bool* result) { | ^~~~~~~~~~~~~~~~~~~~~ /home/john/leela-zero/gtest/googletest/src/gtest-death-test.cc:1010:7: note: ‘dummy’ declared here 1010 | int dummy; | ^~~~~ cc1plus: all warnings being treated as errors gmake[2]: *** [gtest/googlemock/gtest/CMakeFiles/gtest.dir/build.make:76: gtest/googlemock/gtest/CMakeFiles/gtest.dir/src/gtest-all.cc.o] Error 1 gmake[1]: *** [CMakeFiles/Makefile2:309: gtest/googlemock/gtest/CMakeFiles/gtest.dir/all] Error 2 gmake: *** [Makefile:156: all] Error 2 -bash: ./tests: No such file or directory The attempt to build lizzie got nowhere. The current instructions are Code: git clone --recursive --branch next http://github.com/gcp/leela-zero.git mvn package It is unclear in which directory to issue the mvn (Maven) command. It is also unclear whether 'package' is to be interpreted literally or is a place-holder for an input or output name. Running the command as it stands caused Maven to complain about a missing BOM (Bill of Materials?) and give up. I haven't tried to build KataGo. I may now be too old and sick to succeed in the installation. I can no longer play over a real board, but do not seem to have lost any strength playing online. Reverting to Debian 11 is not an option because it predates the introduction of the GeForce 4060 and is unlikely to have the correct drivers. I retried importing the binaries from Debian 11 for lizzie, leela-zero and KataGo. Lizzie runs and can load Leela-zero, but the engine fails to analyse anything. KataGo does not run. This is no surprise because the old engines probably embed GPU libraries that do not work for the 4060. I then built build KataGo afresh using these instructions and placed it under lizzie/target. Code: git clone https://github.com/lightvector/KataGo.git cd KataGo/cpp # If you get missing library errors, install the appropriate packages using your system package manager and try again. # -DBUILD_DISTRIBUTED=1 is only needed if you want to contribute back to public training. cmake . -DUSE_BACKEND=OPENCL make -j 4 This worked, and the analysis now runs 3 times faster than on the old PC, without any explicit optimisation. Eventually the number of threads was doubled in setting numSearchThreads = 24 in file gtp_custom.cfg. EDITED TWICE TO REFLECT "IMPORT OLD BINARIES". EDITED AGAIN FOR FUTURE REFERENCE AND TYPOS. 22 June 2024 Issuing the following command watch -n 1 nvidia-smi generates a display like the following. Code: Every 1.0s: nvidia-smi Sat Jun 22 00:26:32 2024 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 525.147.05 Driver Version: 525.147.05 CUDA Version: 12.0 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 NVIDIA GeForce ... On | 00000000:01:00.0 On | N/A | | 32% 58C P2 111W / 115W | 784MiB / 8188MiB | 99% Default | | | | N/A | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 1164 G /usr/lib/xorg/Xorg 222MiB | | 0 N/A N/A 1709 G xfwm4 2MiB | | 0 N/A N/A 5008 G ...b/firefox-esr/firefox-esr 120MiB | | 0 N/A N/A 5761 C ./katago 434MiB | +-----------------------------------------------------------------------------+ The aim is to monitor the temperature of the GPU. In practice, it does not exceed 60 Celsius when analysing at 100% GPU loadm which is good. The bottom right corner shows memory used in the GPU's other role of driving the display. When first running KataGo under lizzie, some memory was also taken by leelaz, which is not doing anything. It may not matter much, but killing that instance of leelaz removed it from the list. A better solution is to use the Settings/Engine menu item in lizzie to blank the engine parameters for leelaz in lizzie/target/config.txt so that leelaz never starts. I used Code: kata1-b18c384nbt-s9996604416-d4316597426.bin.gz notCode: kata1-b28c512nbt-s7168446720-d4316919285.bin.gz I don't need the super strength, and the b28 model runs much slower on my PC. Whether b28 at 3000 visits would be stronger than b18 at 7000 is not a question I can answer. I always used 7000 visits with the old installation. |
|
| Author: | pwaldron [ Wed Jun 19, 2024 6:04 am ] |
| Post subject: | Re: Installing Lizzie, Leela-zero and KataGo on a new PC. |
If you're wedded to leela-zero and lizzie I can't help you. If you're just interested in getting some AI going, I had fairly quick success with katrain (https://github.com/sanderland/katrain). I ended up having to build katago from source on an Ubuntu system, but that was without difficulty. Good luck! |
|
| Author: | kvasir [ Wed Jun 19, 2024 11:41 am ] |
| Post subject: | Re: Installing Lizzie, Leela-zero and KataGo on a new PC. |
There are binaries available on github for KataGo but maybe not Leela zero. Maybe you should try those binaries? The error that you have with compiling Leela zero is really something simple. You are compiling with a newer (or different) compiler than the code was tested with. These are actually warnings but the build is configured to treat them as errors. You could try to disable this feature of triggering an error if the compiler finds a warning. Normally later compiler options override earlier ones which means it can be tricky to disable this behavior. New versions of CMake have --compile-no-warning-as-error flag to do just that, but this might not have any effect if the project isn't set up to respect this flag (for example it could predate the addition of the flag to CMake). Btw you appear to be building the tests, maybe you won't have this error if you only build the release target? |
|
| Author: | thirdfogie [ Wed Jun 19, 2024 3:47 pm ] |
| Post subject: | Re: Installing Lizzie, Leela-zero and KataGo on a new PC. |
pwaldron wrote: If you're wedded to leela-zero and lizzie I can't help you. If you're just interested in getting some AI going, I had fairly quick success with katrain (https://github.com/sanderland/katrain). I ended up having to build katago from source on an Ubuntu system, but that was without difficulty. Good luck! Thanks for the heads up. I should have realised that Lizzie is now abandonware. The reason for keeping the same software is that the data from analysis sessions is saved and passed to extensive scripts written by me that reformat the numbers into human-readable comments for insertion into the SGF file. The data is probably written directly by KataGo, but things might be different with another GUI in place. As a check, I analysed some old SGF files with the old and new KataGo, but with the old Lizzie and the same network in both cases. Evaluations differ by a few points in some cases, but are broadly compatible. I can now continue with GPU optimisation and newer networks, while always having a working setup available. |
|
| Author: | zakki [ Sun Jun 23, 2024 7:32 pm ] |
| Post subject: | Re: Installing Lizzie, Leela-zero and KataGo on a new PC. |
thirdfogie wrote: The attempt to build leela-zero resulted in various incomprehensible errors, of which the last is shown below. A leelaz binary is left behind, but cannot be tested. Disable Werror in /gtest/googletest/cmake/internal_utils.cmake Code: # set(cxx_base_flags "-Wall -Wshadow -Werror") thirdfogie wrote: The attempt to build lizzie got nowhere. The current instructions are Code: git clone --recursive --branch next http://github.com/gcp/leela-zero.git mvn package It is unclear in which directory to issue the mvn (Maven) command. It is also unclear whether 'package' is to be interpreted literally or is a place-holder for an input or output name. Running the command as it stands caused Maven to complain about a missing BOM (Bill of Materials?) and give up. Perhaps jar files are created in "target" directory by maven's default setting. Code: git clone https://github.com/featurecat/lizzie
cd lizzie git clone --recursive --branch next http://github.com/gcp/leela-zero.git mvn package ls target/*.jar target/lizzie-0.7.4-shaded.jar target/lizzie-0.7.4.jar |
|
| Page 1 of 1 | All times are UTC - 8 hours [ DST ] |
| Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group http://www.phpbb.com/ |
|