Skip to Content.
Sympa Menu

sm-commit - Re: [SM-Commit] GIT changes to master grimoire by Vlad Glagolev (e541968349f5b85e4be5bfc9ba8e65bf4534d827)

sm-commit AT lists.ibiblio.org

Subject: Source Mage code commit list

List archive

Chronological Thread  
  • From: flux <flux AT sourcemage.org>
  • To: sm-commit AT lists.ibiblio.org
  • Subject: Re: [SM-Commit] GIT changes to master grimoire by Vlad Glagolev (e541968349f5b85e4be5bfc9ba8e65bf4534d827)
  • Date: Mon, 10 Nov 2008 13:07:11 -0500

Remko van der Vossen (wich AT yuugen.jp) wrote [08.11.10 12:50]:
> On Mon, Nov 10, 2008 at 12:21:47PM -0500, flux wrote:
> No, this is not a bug in pipes, processes are supposed to run in
> parallel, that't the whole idea. Think of a very very big input stream
> that you want to run grep over, you really don't want the pipe blocking
> until the process providing the input stream has finished, you might not
> even have enough memory to hold the entire stream. And waiting for the
> first bits of data through the stream hardly helps either, because that
> just means that the file will be overwritten when the process providing
> the input stream has only read it partly. So, yep, a pipe dream. ;)
>
> Remko.

Running grep by itself on large enough files may exhaust memory,
particularly depending on the regexp (a regexp with backreferences over
a sufficiently complicated search space, for example). You don't need a
pipe to cause that problem. ;)

As for the file being partially overwritten, according to the tests that
Jaka ran that is what can actually happen anyway (since it's not
necessarily synchronous).

<sarcasm>
Pipes are useless! Just do everything in subshells!
</sarcasm>

--
Justin "flux_control" Boffemmyer
Cauldron wizard and general mage
Source Mage GNU/Linux
http://www.sourcemage.org

Attachment: pgp02sRP5rWo6.pgp
Description: PGP signature




Archive powered by MHonArc 2.6.24.

Top of Page