- luv-main - luv.asn.au

NVMe benchmark results (Was: Re: [MLUG] Next meeting - 26th March)
by Duncan Roe 28 Mar '18

28 Mar '18

On Tue, Mar 27, 2018 at 02:02:33PM +1100, Michael Pope wrote: [...] > Duncan, > Thanks for sharing your NVMe experiences at the meeting last night. Would > you be able to run some benchmarks using 'bonnie++' please and post the > results? > from > Michael > Hi Michael, I ran a pair. For sda2 (ext3) I made the mistake of testing random creates / stat / delete which ran all night and then some, just soaking up CPU. So I didn't run that for nvme0n1p2 (ext4). > 18:07:37$ bonnie++ -d /sda2/bonnie -s 16g -n 1024 > Writing with putc()...done > Writing intelligently...done > Rewriting...done > Reading with getc()...done > Reading intelligently...done > start 'em...done...done...done... > Create files in sequential order...done. > Stat files in sequential order...done. > Delete files in sequential order...done. > Create files in random order...done. > Stat files in random order...done. > Delete files in random order...done. > Version 1.03e ------Sequential Output------ --Sequential Input- --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP > dimstar 16G 27653 53 27340 16 9023 3 18208 33 20106 3 136.6 0 > ------Sequential Create------ --------Random Create-------- > -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP > 1024 57 99 932164 99 51223 56 58 99 175 99 105 66 > dimstar,16G,27653,53,27340,16,9023,3,18208,33,20106,3,136.6,0,1024,57,99,932164,99,51223,56,58,99,175,99,105,66 > 10:20:25$ bonnie++ -d /nvme0n1p2/bonnie -s 16g -n 0 > Writing with putc()...done > Writing intelligently...done > Rewriting...done > Reading with getc()...done > Reading intelligently...done > start 'em...done...done...done... > Version 1.03e ------Sequential Output------ --Sequential Input- --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP > dimstar 16G 63069 71 332703 41 142806 19 71545 75 375326 25 +++++ +++ > dimstar,16G,63069,71,332703,41,142806,19,71545,75,375326,25,+++++,+++,,,,,,,,,,,,, > 10:33:31$ > Per Chr Sequential Output is 2.26 times faster Block Sequential Output is 12.17 times faster Rewrite Sequential Output is 15.83 times faster Per Chr Sequential Input is 3.93 times faster Block Sequential Input is 18.67 times faster NVMe Random Seeks completed too quickly for bonnie++ to report a result (<0.5s) Bear in mind this is probably with only a PCIe version 2 bus, Cheers ... Duncan.

2 1

Re: [luv-announce] LUV Main April 2018 Meeting: Write docs like a software developer using the Linux toolchain
by Duncan Roe 25 Mar '18

25 Mar '18

On Sat, Mar 24, 2018 at 10:53:48PM +1100, luv-announce wrote: > https://luv.asn.au/2018/04/03 > > *PLEASE NOTE NEW LOCATION* > > Tuesday, April 3, 2018 > > 6:30 PM to 8:30 PM > Kathleen Syme Library, 251 Faraday Street Carlton VIC 3053 > > Speakers: > > * Alec Clews, Write docs like a software developer using the Linux > toolchain > > This talk is about public API documentation and what useful developer > documentation should look like. The bulk of the presentation will > demonstrate various UNIX/Linux style CLI tools (M4, Make, Plantuml, > Pandoc, Graphviz, ...) and how they can be part of a build chain to keep > your docs up to date and relevant. There will also be a discussion on > why this toolchain is used, instead of tools like Javadoc or Swagger. > > The material is based on a short talk given at LCA 2018 'Using "old > skool" Free tools to easily publish API documentation' > > *Alec Clews* founded Melbourne Raspberry Jam. He can be found online as > alecthegeek in to many places. He drinks too much espresso, uses Linux > as much as possible and wishes he was a better Go programmer. > > Linux Users of Victoria is a subcommittee of Linux Australia > <https://www.linux.org.au/>. > Not too far from Maria's eh? Anyone else care to comment? Cheers ... Duncan.

2 1

disk usage in perl without modules or /bin/df
by Tim Connors 20 Mar '18

20 Mar '18

I have a very minimal system where I can't use df because I want an extended output df can't do, and I can't install CPAN modules (there isn't Filesys::Df, Filesys::Statfs, etc) I want it to take args of a given file/directory. stat()'s first returned arg is st_dev. What's a system call that can return current usage and total size of a dev? stracing df shows it does a stat then a statfs, but I can't seem to access the statfs system call from perl without Filesys::Statfs. Sigh, embedded (very large) systems. -- Tim Connors

2 1

Re: quotas and reservations (was Re: Looking at RAID)
by Craig Sanders 11 Mar '18

11 Mar '18

On Fri, Mar 09, 2018 at 07:49:48PM +1100, Russell Coker wrote: > Unlike BTRFS, you can expect every feature of ZFS to just work. It may be > a total PITA to get it working, it may not be something you even want to ZFS just works, and I've never found it to be a PITA at all. I've been using it since around 2010. * `apt-get install zfs-dkms zfsutils-linux` (and optionally zfs-zed and zfsnap) is no big deal. It's no more trouble than installing anything else. * non-rootfs storage just works - no hassle, no fuss, no drama. Couldn't be easier...certainly a lot less work/hassle than LVM and/or mdam + ext4 or xfs. * getting linux to boot from ZFS requires some work (unless your distro supports it natively, like Ubuntu). A few hours of reading and about the same of careful, methodical work the first time you do it. IMO it's worth the effort just for snapshots & zfs send backups of the rootfs. All the other ZFS features are just gravy. > use (EG ZFS control of Samba configuration), but it will work if you do the > right thing. I've never used that. Or the auto-NFS stuff. I Never saw any need to try it since I was already running NFS and Samba - continuing to use what I already had was no trouble at all :) I don't really care about samba, but one of these days I should look into doing NFS exports just by setting an attribute on a dataset in zfs. For now, editing /etc/exports is easy enough. craig -- craig sanders <cas(a)taz.net.au>

2 2

Re: Looking at RAID
by Paul Dwerryhouse 08 Mar '18

08 Mar '18

On 2018-03-07 11:44, Craig Sanders via luv-main wrote: > BTW, it's not always a good idea to follow install instructions from > developers. Many of them are focused exclusively on their pride and > joy and > don't give a damn about the operating system it runs on....and many see > the > OS as an obstacle to be worked around. Oh, so you mean that best practice for production installs *isn't* to run curl-pipe-sudo-bash that pulls something from the head of a random github repo and then runs npm to splatter it across your filesystem? ;)

3 6

host name - domain name
by Nic Baxter 07 Mar '18

07 Mar '18

Hi All I host a number of domains on a Centos 7 VPS. Now I am setting up a VPS with only one domain hosted. I am trying to get my head around issues with naming especially regarding RDNS and a mail server. Should I name the server host.domain.com or just domain.com? Cheers Nic

4 4

March 2018 Workshop: Comparing window managers
by Andrew Pam 07 Mar '18

07 Mar '18

Thanks to an excellent suggestion at yesterday's very successful March main meeting, this month's workshop on Saturday week (17 March) will be a comparison of Linux window managers. We're still looking for more people who can talk about the window manager they are using, what they like and dislike about it, and maybe demonstrate a little. Please email me with the name of your window manager if you think you could help! Thanks, Andrew

1 0

Linux Distro for photographers.: Sony Alpha SLR/SLT A-mount Talk Forum: Digital Photography Review
by Andrew McGlashan 07 Mar '18

07 Mar '18

Hi Andrew, Thought this would be better in it's own thread. https://www.dpreview.com/forums/post/50166906 I can't vouch for the above, but a quick DDG search found it and it looks suitable (also based on OpenSuSE). Cheers A.

1 0

Re: Looking at RAID
by Russell Coker 06 Mar '18

06 Mar '18

On Tuesday, 6 March 2018 6:29:11 PM AEDT Craig Sanders via luv-main wrote: > On Mon, Mar 05, 2018 at 10:54:10PM +1100, Andrew Pam wrote: > > [ ... ] it's also possible to set up mirroring using LVM, btrfs or ZFS > > if you prefer. > > With btrfs or ZFS it's easy to add additional drives for more space later. With ZFS you only add them one RAID set at a time and after adding that RAID set can't be changed. You can't just add a disk at a time as you do with BTRFS. Last time I checked BTRFS RAID-5 and RAID-6 wasn't reliable IMHO. > Also, both btrfs and ZFS support transparent compression - which can > greatly increase effective capacity if most of your data is uncomressed or > poorly-compressed. Not video or audio files, for example. The last time I ran a medium size mail server on ZFS I didn't see a lot of compression. I think it was something like 40%. Usually large amounts of data means video files though. > There are so many other benefits to using either btrfs or ZFS (snapshots, > error-detection and correction, sub-volumes aka datasets, and much more), > that IMO there's little reason to use a plain RAID-1 + ext4 partition for > anything except a separate /boot. Particularly as the most common errors are silent corruption which can't be detected by a plan RAID and can only be stopped by BTRFS or ZFS. Sucks for people who don't use Unix. > ZFS has the advantage of more features, and greater reliability. It's not > built in to the kernel, but most distros have the kernel module packaged as > a dkms package (ubuntu and a few others take the legally dubious stance > that the CDDL vs GPL license conflict isn't a problem, so include ZFS > pre-compiled with their kernels already). I don't think it's legally dubious. Oracle know exactly what they are doing, if Oracle thought it was bad they would have let them know. -- My Main Blog http://etbe.coker.com.au/ My Documents Blog http://doc.coker.com.au/

2 4

Re: Looking at RAID
by Russell Coker 06 Mar '18

06 Mar '18

On Tuesday, 6 March 2018 10:52:35 PM AEDT Andrew Greig via luv-main wrote: > Sorry about that digression. So is there a platform that handles RAID > really well? I went to OpenSuse for mapping. But now photography is my > main work, so maybe I should be looking at installing the distro which > is preferrred by developers of the GIMP and also Darktable. If you want to have root on a ZFS RAID then Ubuntu is likely to be the best option. But I recommend not doing that, it's more pain than you want IMHO. > I just can't afford to fiddle for two weeks to get a result. And the > OpenSuse and Ubuntu fora have freaked me out, somewhat. Setup a mdadm RAID-1 for /boot (and root in the case of ZFS) and then use ZFS or BTRFS for the rest. -- My Main Blog http://etbe.coker.com.au/ My Documents Blog http://doc.coker.com.au/

1 0