11 comments

  • jammcq 2 hours ago
    I like how the article describes how certificates work for both client and server. I know a little bit about it but what I read helps to reinforce what I already know and it taught me something new. I appreciate it when someone takes the time to explain things like this.
    • MattJ100 36 minutes ago
      Thanks! I didn't intentionally write this for a broader audience (I didn't expect to see it while casually opening HN!). Our user base is quite diverse, so I try to find the balance between being too technical and over-explanatory. Glad it was helpful!
  • agwa 32 minutes ago
    Is there a reason why dialback isn't the answer?

    I would think it's more secure than clientAuth certs because if an attacker gets a misissued cert they'd have to actually execute a MitM attack to use it. In contrast, with a misissued clientAuth cert they can just connect to the server and present it.

    Another fun fact: the Mozilla root store, which I'd guess the vast majority of XMPP servers are using as their trust store, has ZERO rules governing clientAuth issuance[1]. CAs are allowed to issue clientAuth-only certificates under a technically-constrained non-TLS sub CA to anyone they want without any validation (as long as the check clears ;-). It has never been secure to accept the clientAuth EKU when using the Mozilla root store.

    [1] https://www.mozilla.org/en-US/about/governance/policies/secu...

    • MattJ100 14 minutes ago
      > Is there a reason why dialback isn't the answer?

      There are some advantages to using TLS for authentication as well as encryption, which is already a standard across the internet.

      For example, unlike an XMPP server, CAs typically perform checks from multiple vantage points ( https://letsencrypt.org/2020/02/19/multi-perspective-validat... ). There is also a lot of tooling around TLS, ACME, CT logs, and such, which we stand to gain from.

      In comparison, dialback is a 20-year-old homegrown auth mechanism, which is more vulnerable to MITM.

      Nevertheless, there are some experiments to combine dialback with TLS. For example, checking that you get the same cert (or at least public key) when connecting back. But this is not really standardized, and can pose problems for multi-server deployments.

      > It has never been secure to accept the clientAuth EKU when using the Mozilla root store.

      Good job we haven't been doing this for a very long time by now :)

  • RobotToaster 2 hours ago
    Why did LE make this change? It feels like a rather deliberate attack on the decentralised web.
    • ameliaquining 2 hours ago
      Google has recently imposed a rule that CA roots trusted by Chrome must be used solely for the core server-authentication use case, and can't also be used for other stuff. They laid out the rationale here: https://googlechrome.github.io/chromerootprogram/moving-forw...

      It's a little vague, but my understanding reading between the lines is that sometimes, when attempts were made to push through security-enhancing changes to the Web PKI, CAs would push back on the grounds that there'd be collateral damage to non-Web-PKI use cases with different cost-benefit profiles on security vs. availability, and the browser vendors want that to stop happening.

      Let's Encrypt could of course continue offering client certificates if they wanted to, but they'd need to set up a separate root for those certificates to chain up to, and they don't think there's enough demand for that to be worth it.

      • notepad0x90 41 minutes ago
        Why can't Let's Encrypt push-back on this for their users' sake? What is Google going to do? distrust LE certs?
        • agwa 18 minutes ago
          Google Chrome (along with Mozilla, and eventually the other root stores) distrusted Symantec, despite being the largest CA at the time and frequently called "too big to fail".
      • kej 2 hours ago
        >when attempts were made to push through security-enhancing changes to the Web PKI, CAs would push back on the grounds that there'd be collateral damage to non-Web-PKI use cases

        Do you (or anyone else) have an example of this happening?

        • agwa 1 hour ago
          After the WebPKI banned the issuance of new SHA-1 certificates due to the risk of collisions, several major payment processors (Worldpay[1], First Data[2], TSYS[3]) demanded to get more SHA-1 certificates because their customers had credit card terminals that did not support SHA-2 certificates.

          They launched a gross pressure campaign, trotting out "small businesses" and charity events that would lose money unless SHA-1 certificates were allowed. Of course, these payment processors did billions in revenue per year and had years to ship out new credit card terminals. And small organizations could have and would have just gotten a $10 Square reader at the nearest UPS store if their credit card terminals stopped working, which is what the legacy payment processors were truly scared of.

          The pressure was so strong that the browser vendors ended up allowing Symantec to intentionally violate the Baseline Requirements and issue SHA-1 certificates to these payment processors. Ever since, there has been a very strong desire to get use cases like this out of the WebPKI and onto private PKI where they belong.

          A clientAuth EKU is the strongest indicator possible that a certificate is not intended for use by browsers, so allowing them is entirely downside for browser users. I feel bad for the clientAuth use cases where a public PKI is useful and which aren't causing any trouble (such as XMPP) but this is ultimately a very tiny use case, and a world where browsers prioritize the security of ordinary Web users is much better than the bad old days when the business interests of CAs and their large enterprise customers dominated.

          [1] https://groups.google.com/g/mozilla.dev.security.policy/c/RH...

          [2] https://groups.google.com/g/mozilla.dev.security.policy/c/yh...

          [3] https://groups.google.com/g/mozilla.dev.security.policy/c/LM...

      • xg15 1 hour ago
        This sounds a lot like the "increasing hostility for non-web usecases" line in the OP.

        In theory, Chrome's rule would split the CA system into a "for web browsers" half and a "for everything else" half - but in practice, there might not be a lot of resources to keep the latter half operational.

      • ge0rg 56 minutes ago
        It is really great how they write "TLS use cases" and in fact mean HTTPS use cases.

        CA/Browser Forum has disallowed the issuance of server certificates that make use of the SRVName [0] subjectAltName type, which obviously was a server use case, and I guess the only reason why we still are allowed to use the Web PKI for SMTP is that both operate on the server hostname and it's not technically possible to limit the protocol.

        It would be perfectly fine to let CAs issue certificates for non-Web use-cases with a different set of requirements, without the hassle of maintaining and distributing multiple Roots, but CA/BF deliberately chose not to.

        [0] https://community.letsencrypt.org/t/srvname-and-xmppaddr-sup...

      • detourdog 2 hours ago
        I’m disappointed that a competitor doesn’t exist that uses longevity of IP routing as a reputation validator. I would think maintaining routing of DNS to a static IP is a better metric for reputation. Having unstable infrastructure to me is a flag for fly by night operations.
        • ocdtrekkie 2 hours ago
          Well, be prepared for certificates that change every 7 to 47 days, as the Internet formally moves to security being built entirely on sand.
          • webstrand 1 hour ago
            I wonder if this is a potential "off switch" for the internet. Just hit the root ca so they can't hand out the renewed certificates, you only have to push them over for a week or so.
            • gus_massa 1 hour ago
              People will learn to press all the buttons with scarry messages to ignore the wrong certificates. It may be a problem for credit cards and online shopping.
              • ocdtrekkie 22 minutes ago
                HSTS was specifically designed to block you from having any ignore buttons. (And Firefox refuses to implement a way to bypass it.)

                But this is also why the current PKI mindset is insane. The warnings are never truly about a security problem, and users have correctly learned the warnings are useless. The CA/B is accomplishing absolutely nothing for security and absolutely everything for centralized control and platform instability.

      • RobotToaster 1 hour ago
        Isn't LE used for half the web at this point?

        Calling Google's bluff and seeing if they would willingly cut their users off from half the web seems like an option here.

        • bawolff 1 hour ago
          That's not how this would work.

          Based on previous history where people actually did call google's bluff to their regret, what happens is that google trusts all current certificates and just stops trusting new certs as they are issued.

          Google has dragged PKI security into the 21st century kicking and screaming. Their reforms are the reason why PKI security is not a joke anymore. They are definitely not afraid to call CA companies bluff. They will win.

          • xg15 1 hour ago
            How is "client certificates forbidden" in any way an improvement?
            • Avamander 39 minutes ago
              Not forbidden, just not going to be a part of WebPKI.

              It's one of those things that has just piggybacked on top of WebPKI and things just piggybacking is a bad idea. There have been multiple cases in the past where this has caused a lot of pain for making meaningful improvements (some of those have been mentioned elsewhere in this thread).

              • xg15 37 minutes ago
                What exactly do you mean with "WebPKI"?

                The PKI system was designed independently of the web and the web used to be one usecase of it. You're kind of turning that around here.

                • Avamander 10 minutes ago
                  The idea of a PKI was of course designed independently, there are many very large PKIs beyond WebPKI. However the one used by browsers is what we call WebPKI and that has its own CAs and rules.

                  You're trying to make it sound like there has ever been some kind of an universal PKI that can be used for everything and without any issues.

    • duskwuff 2 hours ago
      Not precisely an answer, but there's some related discussion here:

      https://cabforum.org/2025/06/11/minutes-of-the-f2f-65-meetin...

      The real takeaway is that there's never been a lot of real thought put into supporting client authentication - e.g. there's no root CA program for client certificates. To use a term from that discussion, it's usually just "piggybacked" on server authentication.

    • mhurron 2 hours ago
      No, it feels like the standard 'group/engineer/PM' didn't think anyone did anything different from their own implementation.

      Lets Encrypt is just used for like, webservers right, why do this other stuff webservers never use.

      Which does appear to be the thinking, though they blame Google, which also seems to have taken the 'webservers in general don't do this, it's not important' - https://letsencrypt.org/2025/05/14/ending-tls-client-authent...

    • pseudalopex 2 hours ago
      Google forced separate client and server PKIs.[1]

      [1] https://letsencrypt.org/2025/05/14/ending-tls-client-authent...

  • PunchyHamster 2 hours ago
    Shame LE didn't give people option to generate client and client+server auth certs
    • forty 2 hours ago
      Yes, but then the lack of pragmatism shown by the XMPP community is a bit disconcerting
      • SahAssar 1 hour ago
        What is the lack of pragmatism you are talking about?
        • forty 52 minutes ago
          The refusal to accept server only certificate as client certificate for server
          • MattJ100 28 minutes ago
            There might be some confusion here, as there is no refusal at all.

            As stated in the blog post, we (Prosody) have been accepting (only) serverAuth certificates for a long time. However this is technically in violation of the relevant RFCs, and not the default behaviour of TLS libraries, so it's far from natural for software to be implementing this.

            There was only one implementation discovered so far which was not accepting certificates unless they included the clientAuth purpose, and that was already updated 6+ months ago.

            This blog post is intended to alert our users, and the broader XMPP community, about the issue that many were unaware of, and particularly to nudge server operators to upgrade their software if necessary, to avoid any federation issues on the network.

          • kokx 35 minutes ago
            The article literally talks about how one of the server implementations does exactly that:

            > Does this affect Prosody?

            > Not directly. Let’s Encrypt is not the first CA to issue server-only certificates. Many years ago, we incorporated changes into Prosody which allow server-only certificates to be used for server-to-server connections, regardless of which server started the connection. [...]

      • superkuh 2 hours ago
        It is not pragmatic to design your protocol for web use cases when it's not the web.
        • bawolff 1 hour ago
          Unless im missing something, this is a poor design full stop. How are they validating SAN on these client certificates?
          • agwa 1 hour ago
            XMPP identifiers have domain names, so the XMPP server can check that the DNS SAN matches the domain name of the identifiers in incoming XMPP messages.

            I've seen non-XMPP systems where you configure the DNS name to require in the client certificate.

            It's possible to do this securely, but I agree entirely with your other comment that using a public PKI with client certs is a recipe for disaster because it's so easy and common to screw up.

  • benjojo12 1 hour ago
    For those wondering if ejabberd Debian systems will be impacted, it seems like for now there no fix, the issue is being tracked here: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1127369
    • Avamander 52 minutes ago
      Code can just ignore the EKU, if it's already using the certificate in an odd way.
  • jauntywundrkind 9 minutes ago
    I really fail to understand or sympathize with Let's Encrypt limiting their certs so. What is gained by slamming the door on other applications than servers being able to get certs?

    In this case I do think it makes sense for servers to accept certs even as marked by servers, since it's for a s2s use case. But this just feels like such an unnecessary clamping down. To have made certs finally plentiful, & available for use... Then to take that away? Bother!

  • nickf 1 hour ago
    Client authentication with publicly-trusted (i.e. chaining to roots in one of the major 4 or 5 trust-store programs) is bad. It doesn't actually authenticate anything at all, and never has.

    No-one that uses it is authenticating anything more than the other party has an internet connection and the ability, perhaps, to read. No part of the Subject DN or SAN is checked. It's just that it's 'easy' to rely on an existing trust-store rather than implement something secure using private PKI.

    Some providers who 'require' public TLS certs for mTLS even specify specific products and CAs (OV, EV from specific CAs) not realising that both the CAs and the roots are going to rotate more frequently in future.

    • ajross 1 hour ago
      A client cert can be stored, so it provides at least a little bit of identification certainty. It's very hard to steal or impersonate a specific client cert, so the site has a high likelihood of knowing you're the same person you were when you connected before (even though the initial connection may very well not have ID'd the correct person!). That has value.

      But it also doesn't involve any particular trust in the CA either. Lets Encrypt has nothing to offer here so there's no reason for them to try to make promises.

      • nickf 1 hour ago
        Eh, it's pretty easy to impersonate if the values in the certificate aren't checked, and you could get one from any of a list of public CAs.

        If you're relying on a certificate for authentication - issue it yourself.

        • ajross 35 minutes ago
          Point being that if you get a valid TLS connection from a client cert, and then you get another valid connection from the same cert tomorrow, you can be very certain that the entity connecting is either the same software environment that connected earlier, or an attacker that has compromised it. You can be cryptographically certain that it is not an attacker that hasn't effected a full compromise of your client.

          And there's value there, if you're a server. It's why XMPP wants federated servers to authenticate themselves with certificates in the first place.

  • bawolff 1 hour ago
    I feel like using web pki for client authentication doesn't really make sense in the first place. How do you verify the common name/subject alt name actually matches when using a client cert.

    Using web pki for client certs seems like a recipe for disaster. Where servers would just verify they are signed but since anyone can sign then anyone can spoof.

    And this isn't just hypothetical. I remember xmlsec (a library for validating xml signature, primarily saml) used to use web pki for signature validation in addition to specified cert, which resulted in lot SAML bypasses where you could pass validation by signing the SAML response with any certificate from lets encrypt including the attackers.

    • xg15 1 hour ago
      > How do you verify the common name/subject alt name actually matches when using a client cert.

      This seems exactly like a reason to use client certs with public CAs.

      You (as in, the server) cannot verify this at all, but a public CA could.

      • nickf 55 minutes ago
        A public CA checks it one-time, when it's being issued. Most/all mTLS use-cases don't do any checking of the client cert in any capacity. Worse still, some APIs (mainly for finance companies) require things like OV and EV, but of course they couldn't check the Subject DN if they wanted to.

        If it's for auth, issue it yourself and don't rely on a third-party like a public CA.

        • ge0rg 43 minutes ago
          A federated ecosystem of servers that need to verify each other based on their domain name as the identity is the prime use-case for a public CA to issue domain-verified client certificates. XMPP happens to be this ecosystem.

          Rolling out a private PKI for XMPP, with a dedicated Root CA, would be a significant effort, essentially redoing all the hard work of LetsEncrypt, but without the major funding, thus ending up with an insecure solution.

          We make use of the public CAs, that have been issuing TLS certificates based on domain validation, for quite a few years now, before the public TLS CAs have been subverted to become public HTTPS-only CAs by Google and the CA/Browser Forum.

          • Avamander 37 minutes ago
            > Rolling out a private PKI for XMPP, with a dedicated Root CA, would be a significant effort

            Rolling out a change that removes the EKU check would not be that much effort however.

            • xg15 33 minutes ago
              That's exactly what prosody is doing, but it's a weird solution. Essentially, they're just ignoring the missing EKU flag and pretend it would be there, violating the spec.

              It seems weird to first remove the flag and then tell everyone to update their servers to ignore the removal. Then why remove it in the first place?

              • Avamander 16 minutes ago
                I think you're confusing different actors here. The change was made by the CA/B Forum, the recommendation is just how it is if you want to use a certificate not for the purposes intended.
            • ge0rg 24 minutes ago
              Yes, this is what is happening. It isn't happening fast enough, so some implementations (especially servers that don't upgrade often enough, or running long-term-support OS flavors) will still be affected. This is the impact that the original article is warning about.

              My point was that this is yet another change that makes TLS operations harder for non-Web use cases, with the "benefit" to the WebPKI being the removal of a hypothetical complexity, motivated by examples that indeed should have used a private PKI in the first place.

        • xg15 44 minutes ago
          > A public CA checks it one-time, when it's being issued.

          That's the same problem we have with server certs, and the general solution seems to be "shorter cert lifetimes".

          > Worse still, some APIs (mainly for finance companies) require things like OV and EV, but of course they couldn't check the Subject DN if they wanted to.

          Not an expert there, but isn't the point of EV that the CA verified the "real life entity" that requested the cert? So then it depends on what kind of access model the finance company was specifying for its API. "I don't care who is using my API as long as they are a company" is indeed a very stupid access model, but then I think the problem is deeper than just cert validation.

    • nickf 1 hour ago
      You are correct, and the answer is - no-one using publicly-trusted TLS certs for client authentication is actually doing any authentication. At best, they're verifying the other party has an internet connection and perhaps the ability to read.

      It was only ever used because other options are harder to implement.

      • xg15 1 hour ago
        It seems reasonable for server-to-server auth though? Suppose my server xmpp.foo.com already trusts the other server xmpp.bar.com. Now I get some random incoming connection. How would I verify that this connection indeed originates from xmpp.bar.com? LE-assigned client certs sound like a good solution to that problem.
        • Avamander 47 minutes ago
          Which is almost exactly why WebPKI doesn't want to support such use-cases. Just this EKU change alone demonstrates how it can hinder WebPKI changes.
          • ge0rg 35 minutes ago
            Can you point out, at which point in time exactly, the public TLS PKI infrastructure has been reduced to WebPKI?
            • Avamander 30 minutes ago
              Can you point out at which point in time exactly it was designed to serve every use-case?
              • ge0rg 10 minutes ago
                The public TLS PKI was never supposed to serve every use case and you know it. But let me point out when it was possible to get a public CA certificate for an XMPP server with SRVname and xmppAddr:

                  Certificate:
                    Data:
                        Version: 3 (0x2)
                        Serial Number: 1096750 (0x10bc2e)
                        Signature Algorithm: sha256WithRSAEncryption
                        Issuer: C = IL, O = StartCom Ltd., OU = Secure Digital Certificate Signing, CN = StartCom Class 1 Primary Intermediate Server CA
                        Validity
                            Not Before: May 27 16:16:59 2015 GMT
                            Not After : May 28 12:34:54 2016 GMT
                        Subject: C = DE, CN = chat.yax.im, emailAddress = hostmaster@yax.im
                        X509v3 extensions:
                            X509v3 Subject Alternative Name: 
                                DNS:chat.yax.im, DNS:yax.im, xmppAddr:chat.yax.im, dnsSRV:chat.yax.im, xmppAddr:yax.im, dnsSRV:yax.im
                
                Ironically, this was the last server certificate I obtained pre-LetsEncrypt.
                • Avamander 2 minutes ago
                  So you understand that there are different purposes as well. Are you saying that you can't get a client auth certificate any more?
          • xg15 39 minutes ago
            Huh? The entire purpose of that EKU change was to disallow that usecase. How did that demonstrate problems for WebPKI?
            • Avamander 31 minutes ago
              This post here is the demonstration, that some non-WebPKI purpose is causing issues and complaints. This has happened before with SHA-1 deprecation. WebPKI does not want this burden and should not have this burden.
              • xg15 24 minutes ago
                Ok, so this is an official split of "WebPKI" and "everything else PKI" then?

                Last time I checked, Let's Encrypt was saying they provide free TLS certs, not free WebPKI certs. When did that change?

                • Avamander 20 minutes ago
                  That's being overly pedantic. PKIs for different purposes have been separate for a while, if not from the start. LE is still giving you a "TLS cert".
  • abnormalitydev 1 hour ago
    Is there any reason why things gravitate towards being web-centric, especially Google-centric? Seeing that Google's browser policies triggered the LE change and the fact that most CAs are really just focusing on what websites need rather than non-web services isn't helpful considering that browsers now are terribly inefficient (I mean come on, 1GB of RAM for 3 tabs of Firefox whilst still buffering?!) yet XMPP is significantly more lightweight and yet more featureful compared to say Discord.
    • xg15 1 hour ago
      > Is there any reason why things gravitate towards being web-centric, especially Google-centric?

      Yes, the reason is called "Chrome" and "90% market share"...

  • everfrustrated 2 hours ago
    From https://letsencrypt.org/2025/05/14/ending-tls-client-authent...

    "This change is prompted by changes to Google Chrome’s root program requirements, which impose a June 2026 deadline to split TLS Client and Server Authentication into separate PKIs. Many uses of client authentication are better served by a private certificate authority, and so Let’s Encrypt is discontinuing support for TLS Client Authentication ahead of this deadline."

    TL;DR blame Google

    • bawolff 1 hour ago
      Google didn't force lets encrypt to totally get out of the client cert business, they just decided it wasn't worth the effort anymore.
      • nickf 1 hour ago
        Publicly-trusted client authentication does nothing. It's not a thing that should exist, or is needed.
      • everfrustrated 1 hour ago
        Feel free to start your own non-profit to issue client certs signed by a public authority.

        As LE says, most users of client certs are doing mtls and so self-signed is fine.

      • josephcsible 1 hour ago
        > they just decided it wasn't worth the effort anymore

        That seems disingenuous. Doesn't being in the client cert business now require a lot of extra effort that it didn't before, due entirely to Google's new rule?

        • Avamander 44 minutes ago
          No, not really. Unless you consider basic accountability "extra effort".