Z’s Scribbles
← Index

I feel self-conscious when I talk to Claude (for a good reason)

I’ll be honest: every time I ask Claude or ChatGPT a stupid question, I feel self-conscious.
I hesitate.
Sometimes, I have regrets.
Sometimes, I zoom out and visualize the whole map of stupid questions I have ever asked,
and try to imagine how they might have impacted, or will impact, my user score.

Yes, user score.

ChatGPT keeps track of* your interests, preferences, relationships, dreams and goals.
ChatGPT tracks your level of expertise. ChatGPT tracks your emotions.
And ChatGPT most definitely tracks whatever you’re doing that it thinks might be “sus”.

I zoom out and I wonder if things I might say now might have unexpected repercussions
somewhere down the line
in a future I can’t predict
under moral weights and rules I can’t make out.

In the past, being deemed too “melancholic” could bar you from certain positions,
let alone if your sexual orientation was deemed “wrong”.
During times of War, past hints of “wrong” allegiances could earn the sentence to your tomb.
Even when “wrong” was redefined faster than the leaves could change tones.

These were times when evidence was flaky, when human fallibility wasn’t fully accounted for.
Today’s witnesses have perfect memory*, and the ability to draw insights across time spans that the sharpest of us could only dream of.

Today, it’s just a cute feature. A useful tool.
“Oh, it remembers I said that last month!"

Tomorrow, it might be the reason someone comes knocking at the door.


(Note: I’m using ChatGPT as an example because it has the least personable/most robotic model name and because OAI is BFFs with the government, but I might as well have said Gemini or Claude.)

(inb4 “tHaT’s OnLy iF yOu eNaBlE tHe MeMorY fEaTurE” – are you sure?)

“perfect memory” – yes, yes, I know