• dan@upvote.au
    link
    fedilink
    arrow-up
    3
    ·
    3 months ago

    A single click in the software can often generate 500 SQL queries, so if you go from 0.05 ms to 1 ms latency you add half a second to clicks

    Those queries don’t all have to be executed sequentially though, do they? Usually if you have that many queries, at least some of them are completely independent of the others and thus can execute concurrently.

    You don’t even need threading for that, just non-blocking IO and ideally an event loop.

    • tias
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      3 months ago

      The catch is that they all need to run in the same transaction to be unaffected by other things going on in the database and to make updates atomic. A single transaction means a single connection, and ODBC/JDBC has no way of multiplexing or pipelining queries over a single connection.

      It’s probably theoretically possible to run some things in different transactions. But with all the different layers and complexity of the code (including third party components and ORMs like Hibernate), understanding all the failure modes and possible concurrency issues becomes intractable.