[CMake] Scanning dependencies of target slowness weirdness.
Amine Chadly
amine.chadly at gmail.com
Thu Sep 6 05:56:44 EDT 2012
Hi,
I am no CMake expert, but I would test on an identical file system types...
I am pretty sure that ntfs and ext3fs don't have the same read-write access
latency and this might explain your time difference.
You could additionally launch a strace on the two settings and see if there
are major differences that could explain the performance hit...
Good luck.
On Sat, Sep 1, 2012 at 5:22 PM, Carlo Wood <carlo at alinoe.com> wrote:
> Hello all.
>
> Apart from that I think that needing 7 seconds is too long
> for generating dependencies for source files that can be
> read in 1 second (and 1 second to write the result to disk),
> I ran into something that I cannot explain :/.
>
> I recently bought a new PC: 8 cores, 32 GB ram -- each core
> is faster than the 4 cores machine with 4 GB that I had;
> They run the same OS, same linux kernel, same software
> versions.
>
> SUMMARY OF RESULTS
> ------------------
>
> The old 4 core machine (Intel QX6700 @2.6 GHz), generates the
> dependencies for this project in
>
> (OLD machine)
>
> real 0m7.601s
> user 0m2.488s
> sys 0m4.164s
>
> Which is annoying slow, but
> the new 8 core machine (AMD FX-8150 @3.6 GHz), generates
> the same dependencies for this project in
>
> (NEW machine)
>
> real 0m32.653s
> user 0m2.512s
> sys 0m10.385s
>
> which is unacceptably slow :/
>
> DETAILS
> -------
>
> $ cat /etc/debian_version
> OLD: wheezy/sid
> NEW: wheezy/sid
>
> $ uname -a
> OLD: Linux hikaru 3.2.0-3-amd64 #1 SMP Mon Jul 23 02:45:17 UTC 2012 x86_64
> GNU/Linux
> NEW: Linux malatos 3.2.0-3-amd64 #1 SMP Mon Jul 23 02:45:17 UTC 2012
> x86_64 GNU/Linux
>
> $ ldd /usr/bin/cmake
> OLD:
> linux-vdso.so.1 => (0x00007fff48372000)
> libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007fabcd035000)
> libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1
> (0x00007fabcce0b000)
> libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007fabccbf3000)
> libarchive.so.12 => /usr/lib/x86_64-linux-gnu/libarchive.so.12
> (0x00007fabcc957000)
> libcurl-gnutls.so.4 =>
> /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4 (0x00007fabcc6f3000)
> libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6
> (0x00007fabcc3eb000)
> libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007fabcc169000)
> libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1
> (0x00007fabcbf53000)
> libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007fabcbbcb000)
> libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0
> (0x00007fabcb9af000)
> /lib64/ld-linux-x86-64.so.2 (0x00007fabcd276000)
> libacl.so.1 => /lib/x86_64-linux-gnu/libacl.so.1
> (0x00007fabcb7a6000)
> libattr.so.1 => /lib/x86_64-linux-gnu/libattr.so.1
> (0x00007fabcb5a0000)
> liblzma.so.5 => /lib/x86_64-linux-gnu/liblzma.so.5
> (0x00007fabcb37d000)
> libbz2.so.1.0 => /lib/x86_64-linux-gnu/libbz2.so.1.0
> (0x00007fabcb16d000)
> libxml2.so.2 => /usr/lib/x86_64-linux-gnu/libxml2.so.2
> (0x00007fabcae0d000)
> libnettle.so.4 => /usr/lib/x86_64-linux-gnu/libnettle.so.4
> (0x00007fabcabe6000)
> libidn.so.11 => /usr/lib/x86_64-linux-gnu/libidn.so.11
> (0x00007fabca9b2000)
> libssh2.so.1 => /usr/lib/x86_64-linux-gnu/libssh2.so.1
> (0x00007fabca788000)
> liblber-2.4.so.2 => /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2
> (0x00007fabca579000)
> libldap_r-2.4.so.2 => /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2
> (0x00007fabca328000)
> librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007fabca11f000)
> libgssapi_krb5.so.2 =>
> /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2 (0x00007fabc9ee0000)
> libgnutls.so.26 => /usr/lib/x86_64-linux-gnu/libgnutls.so.26
> (0x00007fabc9c20000)
> libgcrypt.so.11 => /lib/x86_64-linux-gnu/libgcrypt.so.11
> (0x00007fabc99a1000)
> librtmp.so.0 => /usr/lib/x86_64-linux-gnu/librtmp.so.0
> (0x00007fabc9787000)
> libresolv.so.2 => /lib/x86_64-linux-gnu/libresolv.so.2
> (0x00007fabc9570000)
> libsasl2.so.2 => /usr/lib/x86_64-linux-gnu/libsasl2.so.2
> (0x00007fabc9355000)
> libkrb5.so.3 => /usr/lib/x86_64-linux-gnu/libkrb5.so.3
> (0x00007fabc9081000)
> libk5crypto.so.3 => /usr/lib/x86_64-linux-gnu/libk5crypto.so.3
> (0x00007fabc8e57000)
> libcom_err.so.2 => /lib/x86_64-linux-gnu/libcom_err.so.2
> (0x00007fabc8c53000)
> libkrb5support.so.0 =>
> /usr/lib/x86_64-linux-gnu/libkrb5support.so.0 (0x00007fabc8a4a000)
> libkeyutils.so.1 => /lib/x86_64-linux-gnu/libkeyutils.so.1
> (0x00007fabc8845000)
> libtasn1.so.3 => /usr/lib/x86_64-linux-gnu/libtasn1.so.3
> (0x00007fabc8634000)
> libp11-kit.so.0 => /usr/lib/x86_64-linux-gnu/libp11-kit.so.0
> (0x00007fabc8422000)
> libgpg-error.so.0 => /lib/x86_64-linux-gnu/libgpg-error.so.0
> (0x00007fabc821e000)
> NEW:
> linux-vdso.so.1 => (0x00007fffe5800000)
> libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007fbd2bec0000)
> libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1
> (0x00007fbd2bc90000)
> libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007fbd2ba78000)
> libarchive.so.12 => /usr/lib/x86_64-linux-gnu/libarchive.so.12
> (0x00007fbd2b7d8000)
> libcurl-gnutls.so.4 =>
> /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4 (0x00007fbd2b570000)
> libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6
> (0x00007fbd2b268000)
> libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007fbd2afe0000)
> libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1
> (0x00007fbd2adc8000)
> libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007fbd2aa40000)
> libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0
> (0x00007fbd2a820000)
> /lib64/ld-linux-x86-64.so.2 (0x00007fbd2c0e8000)
> libacl.so.1 => /lib/x86_64-linux-gnu/libacl.so.1
> (0x00007fbd2a610000)
> libattr.so.1 => /lib/x86_64-linux-gnu/libattr.so.1
> (0x00007fbd2a408000)
> liblzma.so.5 => /lib/x86_64-linux-gnu/liblzma.so.5
> (0x00007fbd2a1e0000)
> libbz2.so.1.0 => /lib/x86_64-linux-gnu/libbz2.so.1.0
> (0x00007fbd29fd0000)
> libxml2.so.2 => /usr/lib/x86_64-linux-gnu/libxml2.so.2
> (0x00007fbd29c70000)
> libnettle.so.4 => /usr/lib/x86_64-linux-gnu/libnettle.so.4
> (0x00007fbd29a48000)
> libidn.so.11 => /usr/lib/x86_64-linux-gnu/libidn.so.11
> (0x00007fbd29810000)
> libssh2.so.1 => /usr/lib/x86_64-linux-gnu/libssh2.so.1
> (0x00007fbd295e0000)
> liblber-2.4.so.2 => /usr/lib/x86_64-linux-gnu/liblber-2.4.so.2
> (0x00007fbd293d0000)
> libldap_r-2.4.so.2 => /usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2
> (0x00007fbd29178000)
> librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007fbd28f70000)
> libgssapi_krb5.so.2 =>
> /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2 (0x00007fbd28d30000)
> libgnutls.so.26 => /usr/lib/x86_64-linux-gnu/libgnutls.so.26
> (0x00007fbd28a70000)
> libgcrypt.so.11 => /lib/x86_64-linux-gnu/libgcrypt.so.11
> (0x00007fbd287f0000)
> librtmp.so.0 => /usr/lib/x86_64-linux-gnu/librtmp.so.0
> (0x00007fbd285d0000)
> libresolv.so.2 => /lib/x86_64-linux-gnu/libresolv.so.2
> (0x00007fbd283b8000)
> libsasl2.so.2 => /usr/lib/x86_64-linux-gnu/libsasl2.so.2
> (0x00007fbd28198000)
> libkrb5.so.3 => /usr/lib/x86_64-linux-gnu/libkrb5.so.3
> (0x00007fbd27ec0000)
> libk5crypto.so.3 => /usr/lib/x86_64-linux-gnu/libk5crypto.so.3
> (0x00007fbd27c90000)
> libcom_err.so.2 => /lib/x86_64-linux-gnu/libcom_err.so.2
> (0x00007fbd27a88000)
> libkrb5support.so.0 =>
> /usr/lib/x86_64-linux-gnu/libkrb5support.so.0 (0x00007fbd27878000)
> libkeyutils.so.1 => /lib/x86_64-linux-gnu/libkeyutils.so.1
> (0x00007fbd27670000)
> libtasn1.so.3 => /usr/lib/x86_64-linux-gnu/libtasn1.so.3
> (0x00007fbd27458000)
> libp11-kit.so.0 => /usr/lib/x86_64-linux-gnu/libp11-kit.so.0
> (0x00007fbd27240000)
> libgpg-error.so.0 => /lib/x86_64-linux-gnu/libgpg-error.so.0
> (0x00007fbd27038000)
>
> $ cmake --version
> OLD: cmake version 2.8.9-rc1
> NEW: cmake version 2.8.9-rc1
>
> The executed commands in this case are:
> 1) Remove the whole build directory.
> 2) Reconfigure the project.
> 3) Run the command that was timed above:
>
> OLD:
>
> time (cd /SSD/singularity/viewer-linux-x86_64-release; /usr/bin/cmake -E
> cmake_depends
> "Unix Makefiles"
> /usr/src/secondlife/viewers/singularity/SingularityViewer/linden/indra
>
> /usr/src/secondlife/viewers/singularity/SingularityViewer/linden/indra/newview
> /SSD/singularity/viewer-linux-x86_64-release
> /SSD/singularity/viewer-linux-x86_64-release/newview
>
> /SSD/singularity/viewer-linux-x86_64-release/newview/CMakeFiles/secondlife-bin.dir/DependInfo.cmake
> --color=)
>
> NEW:
>
> time (cd /SSD2/singularity/viewer-linux-x86_64-release; /usr/bin/cmake -E
> cmake_depends
> "Unix Makefiles"
> /opt-ntfs/secondlife/viewers/singularity/SingularityViewer/linden/indra
>
> /opt-ntfs/secondlife/viewers/singularity/SingularityViewer/linden/indra/newview
> /SSD2/singularity/viewer-linux-x86_64-release
> /SSD2/singularity/viewer-linux-x86_64-release/newview
>
> /SSD2/singularity/viewer-linux-x86_64-release/newview/CMakeFiles/secondlife-bin.dir/DependInfo.cmake
> --color=)
>
> (all on one line)
>
>
> The /SSD on the OLD machine is a mount to
> Filesystem Size Used Avail Use% Mounted on
> /dev/sdf1 127G 22G 105G 18% /SSD
> where
> $ ls -l /dev/disk/by-id | grep sdf1 | grep scsi
> lrwxrwxrwx 1 root root 10 Aug 30 20:40
> scsi-SATA_Corsair_Perform1101810001000341012E-part1 -> ../../sdf1
> which is a 128 GB SSD.
> $ sudo hdparm -t -T /dev/sdf1
> gives 241.82 MB/sec read speed.
>
> The /SSD2 on the NEW machine is a mount to
> Filesystem Size Used Avail Use% Mounted on
> /dev/sdb3 60G 5.3G 51G 10% /SSD2
> where
> $ ls -l /dev/disk/by-id | grep sdb3 | grep scsi
> lrwxrwxrwx 1 root root 10 Aug 30 22:06
> scsi-SATA_OCZ-VERTEX4_OCZ-A58A63H04CI286B9-part3 -> ../../sdb3
> which is a better 128 GB SSD.
> $ sudo hdparm -t -T /dev/sdb3
> gives 433.44 MB/sec read speed.
>
> The write speed a (a lot) faster too.
>
> I ran 'valgrind --tool=callgrind' on both commands, and they look the same.
>
> The output file size is:
>
> NEW:
> -rw-r--r-- 1 carlo carlo 22078131 Sep 1 05:08
> /SSD2/singularity/viewer-linux-x86_64-release/newview/CMakeFiles/secondlife-bin.dir/depend.make
> OLD:
> -rw-r--r-- 1 carlo carlo 21944265 Sep 1 07:07
> /SSD/singularity/viewer-linux-x86_64-release/newview/CMakeFiles/secondlife-bin.dir/depend.make
>
> where the difference is caused by the difference in paths (see above).
>
>
> So, if there is ANY difference at all, it has to be this you'd think:
>
> On the OLD machine /usr/src is a mount to:
> Filesystem Size Used Avail Use% Mounted on
> /dev/md7 60G 52G 5.0G 92% /usr/src
> where md7 is a RAID 5 of three HDD's: sdb, sdc and sdd, which
> are 10,000rpm WD Raptors's of 74.4 GB
> and md7 has an ext3 fs.
> hdparm -t -T /dev/md7 reports 152.17 MB/sec
>
> On the NEW machine /opt-ntfs is a mount to:
> Filesystem Size Used Avail Use% Mounted on
> /dev/sdd3 301G 2.3G 298G 1% /opt-ntfs
> lrwxrwxrwx 1 root root 10 Aug 30 22:03
> scsi-SATA_WDC_WD5000AAKX-_WD-WCAYUJX25063-part3 -> ../../sdd3
> which is a WD Caviar Blue 500 GB 7200rpm 16MB SATA3
> and has a NTFS.
> hdparm -t -T /dev/sdd3 reports 117.77 MB/sec
>
> Reading all source files (using cat, and after running hdparm -f on all
> drives)
> and writing them to /dev/null gives:
>
> OLD: 0.133 seconds
> NEW: 0.333 seconds
>
> Also note that pre-caching the source files
> by reading them all prior to running the cmake command makes
> hardly a difference in the timings of the latter.
>
> In other words, this can't have anything to do with reading
> the source code from disk.
>
> Any ideas what else I can test?
>
> --
> Carlo Wood <carlo at alinoe.com>
> --
>
> Powered by www.kitware.com
>
> Visit other Kitware open-source projects at
> http://www.kitware.com/opensource/opensource.html
>
> Please keep messages on-topic and check the CMake FAQ at:
> http://www.cmake.org/Wiki/CMake_FAQ
>
> Follow this link to subscribe/unsubscribe:
> http://www.cmake.org/mailman/listinfo/cmake
>
--
Amine
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.cmake.org/pipermail/cmake/attachments/20120906/beaf0045/attachment-0001.htm>
More information about the CMake
mailing list