controlling histogram from h5stat

Hi All,

The h5stat tool with the -d option outputs information on datasets and
number of datasets of various sizes, 0...9, 10...99, 100...999.

Thats great. Love it! Is there any option for user to set the bin
widths? If not, I'd request that as enhancement.

Mark

···

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

Hi Mark,

···

On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:

Hi All,

The h5stat tool with the -d option outputs information on datasets and
number of datasets of various sizes, 0...9, 10...99, 100...999.

Thats great. Love it! Is there any option for user to set the bin
widths? If not, I'd request that as enhancement.

  No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.

  Quincey

Hi Quincey,

Ok, I've used this histogram-like feature over weekend now and I think I
am actually fine with it as is. So, I rescind this enhancement request.

I am using it to study I/O performance I think the bin widths used by
default are actually very useful in this respect.

Mark

···

On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:

Hi Mark,

On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:

> Hi All,
>
> The h5stat tool with the -d option outputs information on datasets and
> number of datasets of various sizes, 0...9, 10...99, 100...999.
>
> Thats great. Love it! Is there any option for user to set the bin
> widths? If not, I'd request that as enhancement.

  No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.

  Quincey

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

Is it possible to enhance h5stat's 'histogram' to also include for each
bin the total bytes that all datasets in that bin account for as well as
percent of total bytes? I think this would be very easy to compute and
very useful to include in the output

···

On Mon, 2010-02-08 at 08:46, Mark Miller wrote:

Hi Quincey,

Ok, I've used this histogram-like feature over weekend now and I think I
am actually fine with it as is. So, I rescind this enhancement request.

I am using it to study I/O performance I think the bin widths used by
default are actually very useful in this respect.

Mark

On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:
> Hi Mark,
>
> On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:
>
> > Hi All,
> >
> > The h5stat tool with the -d option outputs information on datasets and
> > number of datasets of various sizes, 0...9, 10...99, 100...999.
> >
> > Thats great. Love it! Is there any option for user to set the bin
> > widths? If not, I'd request that as enhancement.
>
> No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.
>
> Quincey
>
>
> _______________________________________________
> Hdf-forum is for HDF software users discussion.
> Hdf-forum@hdfgroup.org
> http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

Hi Mark,

Hi Quincey,

Ok, I've used this histogram-like feature over weekend now and I think I
am actually fine with it as is. So, I rescind this enhancement request.

  OK, I've left it in, but mentioned that the priority can be low.

I am using it to study I/O performance I think the bin widths used by
default are actually very useful in this respect.

  Good. :slight_smile:

  Quincey

···

On Feb 8, 2010, at 10:46 AM, Mark Miller wrote:

Mark

On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:

Hi Mark,

On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:

Hi All,

The h5stat tool with the -d option outputs information on datasets and
number of datasets of various sizes, 0...9, 10...99, 100...999.

Thats great. Love it! Is there any option for user to set the bin
widths? If not, I'd request that as enhancement.

  No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.

  Quincey

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

Hi Mark,

Is it possible to enhance h5stat's 'histogram' to also include for each
bin the total bytes that all datasets in that bin account for as well as
percent of total bytes? I think this would be very easy to compute and
very useful to include in the output.

  Yes, that would be useful, I've added another enhancement request for it. :slight_smile:

  Quincey

P.S. - I'm not expecting that we'll be able to work on these enhancements in the near future, without some funding for them. :-/

···

On Feb 8, 2010, at 11:57 AM, Mark Miller wrote:

On Mon, 2010-02-08 at 08:46, Mark Miller wrote:

Hi Quincey,

Ok, I've used this histogram-like feature over weekend now and I think I
am actually fine with it as is. So, I rescind this enhancement request.

I am using it to study I/O performance I think the bin widths used by
default are actually very useful in this respect.

Mark

On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:

Hi Mark,

On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:

Hi All,

The h5stat tool with the -d option outputs information on datasets and
number of datasets of various sizes, 0...9, 10...99, 100...999.

Thats great. Love it! Is there any option for user to set the bin
widths? If not, I'd request that as enhancement.

  No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.

  Quincey

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

Hi Quincey,

Will you accept a patch from me?

Mark

···

On Mon, 2010-02-08 at 10:09, Quincey Koziol wrote:

Hi Mark,

On Feb 8, 2010, at 11:57 AM, Mark Miller wrote:

> Is it possible to enhance h5stat's 'histogram' to also include for each
> bin the total bytes that all datasets in that bin account for as well as
> percent of total bytes? I think this would be very easy to compute and
> very useful to include in the output.

  Yes, that would be useful, I've added another enhancement request for it. :slight_smile:

  Quincey

P.S. - I'm not expecting that we'll be able to work on these enhancements in the near future, without some funding for them. :-/

> On Mon, 2010-02-08 at 08:46, Mark Miller wrote:
>> Hi Quincey,
>>
>> Ok, I've used this histogram-like feature over weekend now and I think I
>> am actually fine with it as is. So, I rescind this enhancement request.
>>
>> I am using it to study I/O performance I think the bin widths used by
>> default are actually very useful in this respect.
>>
>> Mark
>>
>> On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:
>>> Hi Mark,
>>>
>>> On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:
>>>
>>>> Hi All,
>>>>
>>>> The h5stat tool with the -d option outputs information on datasets and
>>>> number of datasets of various sizes, 0...9, 10...99, 100...999.
>>>>
>>>> Thats great. Love it! Is there any option for user to set the bin
>>>> widths? If not, I'd request that as enhancement.
>>>
>>> No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.
>>>
>>> Quincey
>>>
>>>
>>> _______________________________________________
>>> Hdf-forum is for HDF software users discussion.
>>> Hdf-forum@hdfgroup.org
>>> http://**mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
> --
> Mark C. Miller, Lawrence Livermore National Laboratory
> ================!!LLNL BUSINESS ONLY!!================
> miller86@llnl.gov urgent: miller86@pager.llnl.gov
> T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851
>
>
> _______________________________________________
> Hdf-forum is for HDF software users discussion.
> Hdf-forum@hdfgroup.org
> http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

Hi Mark,

Hi Quincey,

Will you accept a patch from me?

  Sure, but will you be able to assign ownership of your IP to the HDF Group? Also, if you decide to go this direction, let's work on a short "RFC" to describe the feature and the user interface changes you'd like to make (input & output), before you start coding. :slight_smile:

  Quincey

···

On Feb 8, 2010, at 12:11 PM, Mark Miller wrote:

Mark

On Mon, 2010-02-08 at 10:09, Quincey Koziol wrote:

Hi Mark,

On Feb 8, 2010, at 11:57 AM, Mark Miller wrote:

Is it possible to enhance h5stat's 'histogram' to also include for each
bin the total bytes that all datasets in that bin account for as well as
percent of total bytes? I think this would be very easy to compute and
very useful to include in the output.

  Yes, that would be useful, I've added another enhancement request for it. :slight_smile:

  Quincey

P.S. - I'm not expecting that we'll be able to work on these enhancements in the near future, without some funding for them. :-/

On Mon, 2010-02-08 at 08:46, Mark Miller wrote:

Hi Quincey,

Ok, I've used this histogram-like feature over weekend now and I think I
am actually fine with it as is. So, I rescind this enhancement request.

I am using it to study I/O performance I think the bin widths used by
default are actually very useful in this respect.

Mark

On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:

Hi Mark,

On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:

Hi All,

The h5stat tool with the -d option outputs information on datasets and
number of datasets of various sizes, 0...9, 10...99, 100...999.

Thats great. Love it! Is there any option for user to set the bin
widths? If not, I'd request that as enhancement.

  No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.

  Quincey

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://**mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

Hi Quincey,

I was about to answer 'yes' but I honestly don't know what kind of legal
issues I am faced with if I do the work on LLNL's dime. Let me do some
research. And, yes, its fine to do an RFC. But, lets make sure is kosher
for me do do work on HDF5 proper and 'give' it to you guys.

Mark

···

On Mon, 2010-02-08 at 14:20, Quincey Koziol wrote:

Hi Mark,

On Feb 8, 2010, at 12:11 PM, Mark Miller wrote:

> Hi Quincey,
>
> Will you accept a patch from me?

  Sure, but will you be able to assign ownership of your IP to the HDF Group? Also, if you decide to go this direction, let's work on a short "RFC" to describe the feature and the user interface changes you'd like to make (input & output), before you start coding. :slight_smile:

  Quincey

> Mark
>
> On Mon, 2010-02-08 at 10:09, Quincey Koziol wrote:
>> Hi Mark,
>>
>> On Feb 8, 2010, at 11:57 AM, Mark Miller wrote:
>>
>>> Is it possible to enhance h5stat's 'histogram' to also include for each
>>> bin the total bytes that all datasets in that bin account for as well as
>>> percent of total bytes? I think this would be very easy to compute and
>>> very useful to include in the output.
>>
>> Yes, that would be useful, I've added another enhancement request for it. :slight_smile:
>>
>> Quincey
>>
>> P.S. - I'm not expecting that we'll be able to work on these enhancements in the near future, without some funding for them. :-/
>>
>>> On Mon, 2010-02-08 at 08:46, Mark Miller wrote:
>>>> Hi Quincey,
>>>>
>>>> Ok, I've used this histogram-like feature over weekend now and I think I
>>>> am actually fine with it as is. So, I rescind this enhancement request.
>>>>
>>>> I am using it to study I/O performance I think the bin widths used by
>>>> default are actually very useful in this respect.
>>>>
>>>> Mark
>>>>
>>>> On Mon, 2010-02-08 at 08:13, Quincey Koziol wrote:
>>>>> Hi Mark,
>>>>>
>>>>> On Feb 4, 2010, at 6:36 PM, Mark Miller wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> The h5stat tool with the -d option outputs information on datasets and
>>>>>> number of datasets of various sizes, 0...9, 10...99, 100...999.
>>>>>>
>>>>>> Thats great. Love it! Is there any option for user to set the bin
>>>>>> widths? If not, I'd request that as enhancement.
>>>>>
>>>>> No, there's currently no way to adjust the bin widths. I've filed it as an enhancement request.
>>>>>
>>>>> Quincey
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Hdf-forum is for HDF software users discussion.
>>>>> Hdf-forum@hdfgroup.org
>>>>> http://***mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
>>> --
>>> Mark C. Miller, Lawrence Livermore National Laboratory
>>> ================!!LLNL BUSINESS ONLY!!================
>>> miller86@llnl.gov urgent: miller86@pager.llnl.gov
>>> T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851
>>>
>>>
>>> _______________________________________________
>>> Hdf-forum is for HDF software users discussion.
>>> Hdf-forum@hdfgroup.org
>>> http://**mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
>>
>>
>> _______________________________________________
>> Hdf-forum is for HDF software users discussion.
>> Hdf-forum@hdfgroup.org
>> http://**mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
> --
> Mark C. Miller, Lawrence Livermore National Laboratory
> ================!!LLNL BUSINESS ONLY!!================
> miller86@llnl.gov urgent: miller86@pager.llnl.gov
> T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851
>
>
> _______________________________________________
> Hdf-forum is for HDF software users discussion.
> Hdf-forum@hdfgroup.org
> http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://*mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org

--
Mark C. Miller, Lawrence Livermore National Laboratory
================!!LLNL BUSINESS ONLY!!================
miller86@llnl.gov urgent: miller86@pager.llnl.gov
T:8-6 (925)-423-5901 M/W/Th:7-12,2-7 (530)-753-851