Re: [GSOC] Introduction to HAMMER2 compression feature

[Daniel Flores <daniel5555@xxxxxxxxx>]

--001a11c376aa21420204defaabf7
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Thank you for feedback!


On Wed, Jun 12, 2013 at 6:08 PM, Freddie Cash <fjwcash@gmail.com> wrote:

> You might want to consider LZ4 [1].  It was just recently added to ZFS
> [2].  It's multi-threaded-aware, extremely fast for both compression and
> decompression, and gives very good compression ratios.  It also includes =
a
> short-circuit design to prevent wasting time trying to compress already
> compressed blocks or highly incompressible blocks.  It's also OSS and
> several reference implementations are available in various languages.
>
> [1] http://code.google.com/p/lz4/
> [2] http://wiki.illumos.org/display/illumos/LZ4+Compression
>

Thank you! This looks really awesome. I=92ll definitely include it in a lis=
t
of candidate algorithms.

On Wed, Jun 12, 2013 at 6:38 PM, Alokat MacMoneysack <mailing@alokat.org>wr=
ote:

> Im looking forward to use this feature.
> What about a compression like gzip e.g. for log file compression or LZJB?
>

I think this goes beyond the scope of my proposal, but it=92s an interestin=
g
idea. Maybe someone else can look into this or I may consider this after I
finish my initial proposal.

On Wed, Jun 12, 2013 at 6:38 PM, Alokat MacMoneysack <mailing@alokat.org>wr=
ote:

> Will you make it possible to let the user choose the compression algorith=
m
> or do you just looking for the "best" one?
>

Well, my initial proposal is only about implementing one algorithm, but if
the project goes smoothly and there will be some time left, I=92ll definite=
ly
try to add more than one algorithm and let the user choose it.


Daniel

--001a11c376aa21420204defaabf7
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Thank you for feedback!<br><div class=3D"gmail_extra"><br>=
<br><div class=3D"gmail_quote">On Wed, Jun 12, 2013 at 6:08 PM, Freddie Cas=
h <span dir=3D"ltr">&lt;<a href=3D"mailto:fjwcash@gmail.com"; target=3D"_bla=
nk">fjwcash@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-=
left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div cla=
ss=3D"gmail_extra"><div class=3D"gmail_quote"><div>You might want to consid=
er LZ4 [1].=A0 It was just recently added to ZFS [2].=A0 It&#39;s multi-thr=
eaded-aware, extremely fast for both compression and decompression, and giv=
es very good compression ratios.=A0 It also includes a short-circuit design=
 to prevent wasting time trying to compress already compressed blocks or hi=
ghly incompressible blocks.=A0 It&#39;s also OSS and several reference impl=
ementations are available in various languages.<br>


</div></div><br>[1] <a href=3D"http://code.google.com/p/lz4/"; target=3D"_bl=
ank">http://code.google.com/p/lz4/</a><br>[2] <a href=3D"http://wiki.illumo=
s.org/display/illumos/LZ4+Compression" target=3D"_blank">http://wiki.illumo=
s.org/display/illumos/LZ4+Compression</a><span class=3D""><font color=3D"#8=
88888">
</font></span></div></div>
</blockquote></div><br>Thank you! This looks really awesome. I=92ll definit=
ely include it in a list of candidate algorithms.<br><br>On Wed, Jun 12, 20=
13 at 6:38 PM, Alokat MacMoneysack <span dir=3D"ltr">&lt;<a href=3D"mailto:=
mailing@alokat.org" target=3D"_blank">mailing@alokat.org</a>&gt;</span> wro=
te:<br>
<blockquote style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204=
,204,204);padding-left:1ex" class=3D"gmail_quote">Im looking forward to use=
 this feature.<br>
What about a compression like gzip e.g. for log file compression or LZJB?<b=
r></blockquote>
<br>I think this goes beyond the scope of my proposal, but it=92s an intere=
sting idea. Maybe someone else can look into this or I may consider this af=
ter I finish my initial proposal.<br><br>On Wed, Jun 12, 2013 at 6:38 PM, A=
lokat MacMoneysack <span dir=3D"ltr">&lt;<a href=3D"mailto:mailing@alokat.o=
rg" target=3D"_blank">mailing@alokat.org</a>&gt;</span> wrote:<br>
<blockquote style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204=
,204,204);padding-left:1ex" class=3D"gmail_quote">
Will you make it possible to let the user choose the compression algorithm =
or do you just looking for the &quot;best&quot; one?<br></blockquote><div><=
br>Well, my initial proposal is only about implementing one algorithm, but =
if the project goes smoothly and there will be some time left, I=92ll defin=
itely try to add more than one algorithm and let the user choose it.<br>
<br><br></div><div>Daniel<br></div></div></div>

--001a11c376aa21420204defaabf7--