What happen to mailing list archives?

Discussion:

Steve Kargl

2021-06-05 22:52:17 UTC

It seems someone has tried to migrate the mailing list archives
from mailman to some new fangle code. This has broken the archives
for at least freebsd-numerics@, freebsd-office@, freebsd-net@

As a comparison, simply go to

https://lists.freebsd.org/mailman/listinfo

and follow the links to freebsd-numerics and freebsd-toolchain.

Can this be fixed?

--
Steve

Michael Gmelin

2021-06-05 23:00:40 UTC

Permalink

ï»¿It seems someone has tried to migrate the mailing list archives
from mailman to some new fangle code. This has broken the archives
As a comparison, simply go to
https://lists.freebsd.org/mailman/listinfo
and follow the links to freebsd-numerics and freebsd-toolchain.
Can this be fixed?

New archives are here:
https://lists.freebsd.org/archives/

e.g., https://lists.freebsd.org/archives/freebsd-net/2021-June/index.html

As we still have mailman archives and https://docs.freebsd.org/mail/, merging or cross linking would certainly be useful.

Michael

Michael Gmelin

2021-06-05 23:04:46 UTC

Permalink

Post by Michael Gmelin
ï»¿

https://lists.freebsd.org/archives/
e.g., https://lists.freebsd.org/archives/freebsd-net/2021-June/index.html
As we still have mailman archives and https://docs.freebsd.org/mail/, merging or cross linking would certainly be useful.
Michael

p.s. If you go to https://lists.freebsd.org/mailman/listinfo, click FreeBSD-net and then "Archives from mailmanâs time", you get to a list that brings you to https://lists.freebsd.org/pipermail/freebsd-net/. So the old archives are still reachable that way. (I still find the docs.FreeBSD.org/mail page to be confusing).

Post by Michael Gmelin

Steve Kargl

2021-06-05 23:28:34 UTC

Permalink

p.s. If you go to https://lists.freebsd.org/mailman/listinfo, click FreeBSD-net and then "Archives from mailman’s time", you get to a list that brings you to https://lists.freebsd.org/pipermail/freebsd-net/. So the old archives are still reachable that way. (I still find the docs.FreeBSD.org/mail page to be confusing).

There isn't an "Archives from mailman's time" link on freebsd-numerics.

Hundreds of emails from me are now gone or sufficiently hidden that
I cannot find them. More importantly, Bruce Evans often replied
with reviews of libm patch's I sent the list. Those reviews and
his detailed analysis of the libm code are now gone or sufficiently
hidded that I cannot find them.

--
Steve

Warner Losh

2021-06-05 23:43:01 UTC

Permalink

Post by Michael Gmelin

Post by Michael Gmelin
p.s. If you go to https://lists.freebsd.org/mailman/listinfo, click

FreeBSD-net and then "Archives from mailmanâs time", you get to a list that
brings you to https://lists.freebsd.org/pipermail/freebsd-net/. So the
old archives are still reachable that way. (I still find the
docs.FreeBSD.org/mail page to be confusing).
There isn't an "Archives from mailman's time" link on freebsd-numerics.
Hundreds of emails from me are now gone or sufficiently hidden that
I cannot find them. More importantly, Bruce Evans often replied
with reviews of libm patch's I sent the list. Those reviews and
his detailed analysis of the libm code are now gone or sufficiently
hidded that I cannot find them.

Bapt was working on this stuff today. He said something about the archive
regenerating with the new software on IRC..

Warner

Michael Gmelin

2021-06-05 23:46:05 UTC

Permalink

ï»¿

Post by Steve Kargl

Post by Michael Gmelin
p.s. If you go to https://lists.freebsd.org/mailman/listinfo, click FreeBSD-net and then "Archives from mailmanâs time", you get to a list that brings you to https://lists.freebsd.org/pipermail/freebsd-net/. So the old archives are still reachable that way. (I still find the docs.FreeBSD.org/mail page to be confusing).

There isn't an "Archives from mailman's time" link on freebsd-numerics.
Hundreds of emails from me are now gone or sufficiently hidden that
I cannot find them. More importantly, Bruce Evans often replied
with reviews of libm patch's I sent the list. Those reviews and
his detailed analysis of the libm code are now gone or sufficiently
hidded that I cannot find them.

Bapt was working on this stuff today. He said something about the archive regenerating with the new software on IRC..

In the meantime, maybe this helps:

https://lists.freebsd.org/pipermail/freebsd-numerics/

Baptiste Daroussin

2021-06-06 08:53:49 UTC

Permalink

Post by Warner Losh

Post by Michael Gmelin
p.s. If you go to https://lists.freebsd.org/mailman/listinfo, click

FreeBSD-net and then "Archives from mailman’s time", you get to a list that
brings you to https://lists.freebsd.org/pipermail/freebsd-net/. So the
old archives are still reachable that way. (I still find the
docs.FreeBSD.org/mail page to be confusing).
There isn't an "Archives from mailman's time" link on freebsd-numerics.
Hundreds of emails from me are now gone or sufficiently hidden that
I cannot find them. More importantly, Bruce Evans often replied
with reviews of libm patch's I sent the list. Those reviews and
his detailed analysis of the libm code are now gone or sufficiently
hidded that I cannot find them.

Bapt was working on this stuff today. He said something about the archive
regenerating with the new software on IRC..
Warner

What has happended:
plan A: we migrated everything off mailman/pipermail seamlessly with redirection
and so on. We patched the new archiver to produce the same file names has
pipermail

Plan A worked fine up to a limit, there was plenty of hand edition in the past,
we we decided to move to plan B which is what is happening now.

Plan B: We keep a frozen version of the archives up to the migration date under
the pipermail directory and have the new archives created in the archives
directory.

All the pipermail archives have been restored as they were. The new archives
receives in their index a new link to point people to the pipermails archive if
looking for older archives.

this has been done a couple of hours ago (before Steve emails) during a window,
of ~ 10 hours, the mailing lists which slow traffic aka the one which didn't
received any email since the migration ended up with an empty "archives"
directory (aka a 404), a file with explanation and redirection to pipermail has
been installed there.

Some work is still needed for the mailing lists which has been transformed as
readonly, this will be done in the next couple of days

Bapt

Graham Perrin

2021-06-06 07:48:06 UTC

Permalink

Post by Steve Kargl
Hundreds of emails from me are now gone or sufficiently hidden that
I cannot find them. More importantly, Bruce Evans often replied
with reviews of libm patch's I sent the list. Those reviews and
his detailed analysis of the libm code are now gone or sufficiently
hidded that I cannot find them.

256182 – lists.freebsd.org/pipermail/… redirections to
lists.freebsd.org/archives/…: sometimes to the wrong content, sometimes
not found (404)

<https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=256182>

Steve Kargl

2021-06-05 23:13:36 UTC

Permalink

Post by Michael Gmelin

Post by Steve Kargl
It seems someone has tried to migrate the mailing list archives
from mailman to some new fangle code. This has broken the archives
As a comparison, simply go to
https://lists.freebsd.org/mailman/listinfo
and follow the links to freebsd-numerics and freebsd-toolchain.
Can this be fixed?

https://lists.freebsd.org/archives/

If I go to https://www.freebsd.org/community/mailinglists/

I see the lines

Mailing list archives

You can search or browse the mailing list archives at www.FreeBSD.org.
It is also possible to browse the mailing lists via the Mailman Web
interface.

Both instances of the word "browse" are hyperlinks. If I click of the
second "browse" link, then I end up at

https://lists.freebsd.org/mailman/listinfo

which presents a list of archives, you'll see freebsd-numerics
is a hyperlink (as well as many others). If I click on freebsd-numerics,
this takes me to

https://lists.freebsd.org/subscription/freebsd-numerics

which displays

Subscription for freebsd-numerics

Browse the archives: here
(and 6 hyperlinks for subscribing and unsubscribing).

If I click on "here", I get

404 Not Found

Ergo, the freebsd-numerics archive is unreachable from the "here" link.
Shouldn't this redirect to the new fangle way?

--
Steve

Rainer Hurling

2021-06-06 13:34:26 UTC

Permalink

Hi Steve,

Post by Steve Kargl

Post by Michael Gmelin

https://lists.freebsd.org/archives/

If I go to https://www.freebsd.org/community/mailinglists/
I see the lines
Mailing list archives
You can search or browse the mailing list archives at www.FreeBSD.org.
It is also possible to browse the mailing lists via the Mailman Web
interface.
Both instances of the word "browse" are hyperlinks. If I click of the
second "browse" link, then I end up at
https://lists.freebsd.org/mailman/listinfo
which presents a list of archives, you'll see freebsd-numerics
is a hyperlink (as well as many others). If I click on freebsd-numerics,
this takes me to
https://lists.freebsd.org/subscription/freebsd-numerics
which displays
Subscription for freebsd-numerics
Browse the archives: here
(and 6 hyperlinks for subscribing and unsubscribing).
If I click on "here", I get

When I click on "here" I also get a "404 Not Found" at first, but only
for about 5 seconds. This is followed by a redirect to the archive list.
Maybe try it again?

If that doesn't work for you: I have saved some threads with Bruce Evans
locally. I could provide them, hoping that there is something useful?

Regards,
Rainer

Post by Steve Kargl
404 Not Found
Ergo, the freebsd-numerics archive is unreachable from the "here" link.
Shouldn't this redirect to the new fangle way?

grarpamp

2021-06-06 05:19:22 UTC

Permalink

There is also this useful and efficient form of archive/mirror to include
in the update so that it does not remain broken for too long...

https://lists.freebsd.org/pipermail/freebsd-questions/2021-June/294104.html
https://lists.freebsd.org/archives/freebsd-hubs/2021-June/000000.html

Mark Millard via freebsd-current

2021-06-06 20:25:14 UTC

Permalink

Baptiste Daroussin <bapt_at_FreeBSD.org> wrote on

Post by Baptiste Daroussin
plan A: we migrated everything off mailman/pipermail seamlessly with redirection
and so on. We patched the new archiver to produce the same file names has
pipermail
Plan A worked fine up to a limit, there was plenty of hand edition in the past,
we we decided to move to plan B which is what is happening now.
Plan B: We keep a frozen version of the archives up to the migration date under
the pipermail directory and have the new archives created in the archives
directory.
All the pipermail archives have been restored as they were. The new archives
receives in their index a new link to point people to the pipermails archive if
looking for older archives.
this has been done a couple of hours ago (before Steve emails) during a window,
of ~ 10 hours, the mailing lists which slow traffic aka the one which didn't
received any email since the migration ended up with an empty "archives"
directory (aka a 404), a file with explanation and redirection to pipermail has
been installed there.
Some work is still needed for the mailing lists which has been transformed as
readonly, this will be done in the next couple of days

It is too bad that a reference to a "no examples yet"
month, such as, (at the time I write this):

https://lists.freebsd.org/archives/freebsd-toolchain/2021-June/date.html

does not show at least (Date view specific example):

• Other periods:[ Previous, Date view ] [ List of Folders ]
• Other: [ Actives mailing lists ] [ Archives from mailman's time ]

when there are prior months available in
https://lists.freebsd.org/archives/ or show at least just:

• Other: [ Actives mailing lists ] [ Archives from mailman's time ]

when no prior months are available there.

===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)

Mark Millard via freebsd-current

2021-06-07 07:30:46 UTC

Permalink

Post by Mark Millard via freebsd-current
Baptiste Daroussin <bapt_at_FreeBSD.org> wrote on

It is too bad that a reference to a "no examples yet"
https://lists.freebsd.org/archives/freebsd-toolchain/2021-June/date.html
• Other periods:[ Previous, Date view ] [ List of Folders ]
• Other: [ Actives mailing lists ] [ Archives from mailman's time ]
when there are prior months available in
• Other: [ Actives mailing lists ] [ Archives from mailman's time ]
when no prior months are available there.

Looks like there are missing months.

Using freebsd-hackers as an example:

https://lists.freebsd.org/archives/freebsd-hackers/index.html
shows the oldest month being "May 2021".

But . . .

https://lists.freebsd.org/pipermail/freebsd-hackers/
shows the most recent month being "September 2020".

So: 2020-Oct through 2021-Apr are completely missing.

Then, going for more detail for 2020-Sep and 2021-May . . .

https://lists.freebsd.org/archives/freebsd-hackers/2021-May/date.html
shows "Starting Tue May 18 2021 - 21:07:44 UTC".

https://lists.freebsd.org/pipermail/freebsd-hackers/2020-September/date.html
shows "Ending: Tue Sep 15 14:12:20 UTC 2020".

So there are about 2 more half-months missing.

Some other lists have other date ranges, some similar,
some not.

===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)

Baptiste Daroussin

2021-06-07 20:35:20 UTC

Permalink

Post by Mark Millard via freebsd-current

Post by Mark Millard via freebsd-current
Baptiste Daroussin <bapt_at_FreeBSD.org> wrote on

Looks like there are missing months.
https://lists.freebsd.org/archives/freebsd-hackers/index.html
shows the oldest month being "May 2021".
But . . .
https://lists.freebsd.org/pipermail/freebsd-hackers/
shows the most recent month being "September 2020".
So: 2020-Oct through 2021-Apr are completely missing.
Then, going for more detail for 2020-Sep and 2021-May . . .
https://lists.freebsd.org/archives/freebsd-hackers/2021-May/date.html
shows "Starting Tue May 18 2021 - 21:07:44 UTC".
https://lists.freebsd.org/pipermail/freebsd-hackers/2020-September/date.html
shows "Ending: Tue Sep 15 14:12:20 UTC 2020".
So there are about 2 more half-months missing.
Some other lists have other date ranges, some similar,
some not.

This missing month are being populated right now

Best regards,
Bapt