Borrow the scoring mechanism from securethe.news

[inputsh]

Freedom of the Press Foundation already made quite good ranking in their "Secure the News" project, so it might be useful to base the project upon their methodology:

They've also implemented a "naming and shaming" mechanism via a Twitter bot that might be a useful idea for this project as well. For example, see this: https://twitter.com/SecureTheNews/status/968569323114586112

And finally, they do have an open source code base licensed under AGPL, so you might want to consider adopting it instead of re-inventing the wheel for different types of organizations: https://github.com/freedomofpress/securethenews

[chartgerink]

@Aleksandar-Todorovic thanks for this 💯 Sounds like a good project to build on indeed. My python is rusty, but I'll check it out once I have the list of websites to check.

Do you think it's tough to deploy this? It might be worth considering a... CO-FELLOWS PROJECT! :)

[inputsh]

I've been interested in forking it for other purpose (track the Bosnian government's HTTPS adoption) for quite some time (a year at least), but I have never tried deploying it on my infrastructure (yet). I'm also not familiar with anyone else who has tried deploying it for other purposes, so we would either have a nice experience (if other people have already tried), or we might help out Freedom of the Press if we discover some weird issues about deploying it on a different kind of an infrastructure. In any case, I think that deploying their tool would be a win-win situation for all the parties involved.

…

---- On Wed, 28 Feb 2018 10:38:57 +0100 notifications@github.com wrote ---- @Aleksandar-Todorovic thanks for this 💯 Sounds like a good project to build on indeed. My python is rusty, but I'll check it out once I have the list of websites to check. Do you think it's tough to deploy this? It might be worth considering a... CO-FELLOWS PROJECT! :) — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[chartgerink]

Let's tag @freddymartinez9 and see whether he might have some inside-insight on this, given he's at FotP. :)

EDIT: It seems like he changed his handle? I'll ping him on the slack channel.

[inputsh]

Seems like his new GitHub handle matches his Twitter handle: @b-meson

[b-meson]

Hi all,

One thing that FPF found is that the project grew too quickly and lots of news sites wanted to get added to the tracker. Then they started competing fiercely over half of a start. It becomes hard to separate them out a A+ from an A when the news orgs are in different regions of the world. So I would recommend separating these out by geographic, or even topics. You will probably find a physics journal is more likely to compete with another physics publication that it is with a neuroscience journal.

[thisisparker]

Hi all! Parker from FPF here. I didn't work on Secure The News but I did develop the Twitter bot, which is also free software and available in (for now) a personal repo. If there's interest in deploying something similar, I'm happy to clean that up a bit.

Splitting out "verticals" is a long-requested feature and we've got it almost implemented. It's not high-priority over here, but we've got some work done on it if that is a direction y'all want to go. Not that anybody asked for my advice, but I'd see about deploying as-is, for now.

Depending on what you need, you may be interested in looking directly at the upstream pshtt project, which STN relies on to gather the information for our grading system.

[chartgerink]

@thisisparker thanks for these links! It seem like pshtt is a perfect place for me to start compiling a database. I am a scriptkid so I am not comfortable deploying things right now 🌲 Just ran it for sciencemag.org and works gloriously!

Domain	Base Domain	Canonical URL	Live	Redirect	Redirect To	Valid HTTPS	Defaults to HTTPS	Downgrades HTTPS	Strictly Forces HTTPS	HTTPS Bad Chain	HTTPS Bad Hostname	HTTPS Expired Cert	HTTPS Self Signed Cert	HSTS	HSTS Header	HSTS Max Age	HSTS Entire Domain	HSTS Preload Ready	HSTS Preload Pending	HSTS Preloaded	Base Domain HSTS Preloaded	Domain Supports HTTPS	Domain Enforces HTTPS	Domain Uses Strong HSTS	Unknown Error
sciencemag.org	sciencemag.org	http://www.sciencemag.org	True	False	None	True	False	False	False	False	False	False	False	False	None	None	False	False	False	False	False	True	False	False	False

@b-meson I think we won't have this problem with scholarly publishers, because a set of five provide >50% (at least) of all journals. Most journals don't have their own pages, because they live within the same domain under the publisher's portal 😄