Website Technology Profiler

{
  "PageContent": "<h3>the bits | dre's blog</h3>Here’s a method to find where any given NSUserDefault setting is persisted. This might help if you’re trying to write a script to get or set that setting. As a bonus, this post details a reusable strategy for withstanding the cacophonous onslaught of os_log long enough to find what you came for, or convince yourself it’s not there.For this example, let’s say you’re trying to find where macOS stores the hotkey for invoking Spotlight. The UI for this is System Preferences –&gt; Keyboard –&gt; Shortcuts –&gt; Spotlight, and the setting is called ‘Show Spotlight search’.The Shortcuts tab of the Keyboard pane of System Preferences with Spotlight selectedWe know that macOS logs quite a bit – so much, in fact, that the hard part about using logs is achiving a favorable signal to noise ratio. It’s usually much easier to select signal than it is to filter noise – especially if you already know something about what you’re looking for. For this case study we can get an initial lead, but even if we couldn’t, our strategy will still work, maybe with an extra iteration or two.The log man page tells us we can match log events in lots of ways, including by process – but which process should we look upon?andre@boop ~ % apropos prefs\r\nCPAN::Distroprefs(3)     - -- read and match distroprefs\r\ncfprefsd(8)              - defaults serverIf I didn’t already know that cfprefsd is our target, I would read the cfprefsd man page (because all apropos results are man pages). We could start by listening to all of cfprefsd by running:log stream --debug --predicate 'process == \"cfprefsd\"'… but that output is not so easy to read. Let’s use log‘s ndjson output style so we can view it with jq, but first let’s make sure the json output is clean enough (foreshadowing!)andre@boop ~ % log stream --predicate 'process == \"cfprefsd\"' --style ndjson --debug                                  \r\nFiltering the log data using \"process == \"cfprefsd\"\"\r\n{\"traceID\":36107480853643780,\"eventMessage\":\"Process 68 (UserEventAgent)\r\n...Nope, jq won’t like that, so let’s filter the log output with egrep --line-buffered '^{' to only pass lines starting with { to jq. Don’t forget --line-buffered, otherwise grep ‘helps’ by saving a tiny fraction of computer by showing output less often, which grep believes is appropriate because it doesn’t think there’s a human watching (because its stdout isn’t connected to a terminal, it is connected to jq).Before we continue, as our log command is becomming lengthy, let’s clean up a little by setting some common options in ~/.logrc (described in the log man page). Here’s a command to populate ~/.logrc with some settings useful for the task at hand:cat &gt; ~/.logrc &lt;&lt;EOF\r\nstream:\r\n   --debug\r\n   --style ndjson\r\n\r\npredicate:\r\n   prefs 'process contains \"cfprefsd\"'\r\nEOFNow when we run log stream --predicate prefs, log behaves as though we typed:log stream --debug --style ndjson --predicate 'process CONTAINS \"cfprefsd\"Ok, putting it all together:andre@boop ~ % log stream --predicate prefs | egrep --line-buffered '^{' | jq                    \r\n{\r\n  \"traceID\": 36107480853643780,\r\n  \"eventMessage\": \"Process 1347 (ContextStoreAgent) sent a request related to { ContextStoreAgent, user: andre, kCFPreferencesAnyHost, /Users/andre/Library/Preferences/ContextStoreAgent.plist, managed: 0 } (0x7fe2c19057d0)\",\r\n  \"eventType\": \"logEvent\",\r\n  \"source\": null,\r\n  \"formatString\": \"Process %{public}d (%{public}s) sent a request related to { %{public}s, user: %{public}s, %{public}s, %{public}s, managed: %d } (%p)\",\r\n  \"activityIdentifier\": 7609380,\r\n  \"subsystem\": \"com.apple.defaults\",\r\n  \"category\": \"cfprefsd\",\r\n  \"threadID\": 5781976,\r\n  \"senderImageUUID\": \"2A0E160E-9EE6-3B23-8832-6979A16EC250\",\r\n  \"backtrace\": {\r\n    \"frames\": [\r\n      {\r\n        \"imageOffset\": 1698619,\r\n        \"imageUUID\": \"2A0E160E-9EE6-3B23-8832-6979A16EC250\"\r\n      }\r\n    ]\r\n  },\r\n  \"bootUUID\": \"\",\r\n  \"processImagePath\": \"/usr/sbin/cfprefsd\",\r\n  \"timestamp\": \"2021-03-20 18:30:44.017031-0700\",\r\n  \"senderImagePath\": \"/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation\",\r\n  \"machTimestamp\": 585248221966448,\r\n  \"messageType\": \"Debug\",\r\n  \"processImageUUID\": \"5E5EBAAF-AA0E-38E1-B19A-07FB2FB8ECED\",\r\n  \"processID\": 406,\r\n  \"senderProgramCounter\": 1698619,\r\n  \"parentActivityIdentifier\": 0,\r\n  \"timezoneName\": \"\"\r\n}\r\n...Definitely more legible, but… the above represents a single log event. We can do better. eventMessage has the interesting info, so let’s look only at that by using a jq filter: '. | .eventMessage'andre@boop ~ % log stream --predicate prefs \\\r\n| egrep --line-buffered '^{' | jq '. | .eventMessage'\r\n\"Process 1347 (ContextStoreAgent) sent a request related to { ContextStoreAgent, user: andre, kCFPreferencesAnyHost, /Users/andre/Library/Preferences/ContextStoreAgent.plist, managed: 0 } (0x7fe2c19057d0)\"\r\n\"Process 1347 (ContextStoreAgent) sent a request related to { ContextStoreAgent, user: andre, kCFPreferencesAnyHost, /Users/andre/Library/Preferences/ContextStoreAgent.plist, managed: 0 } (0x7fe2c19057d0)\"\r\n\"Process 97346 (PerfPowerServices) sent a request related to { com.apple.powerlogd, user: kCFPreferencesAnyUser, kCFPreferencesCurrentHost, /Library/Preferences/com.apple.powerlogd.plist, managed: 0 } (0x7fb3ee304a30)\"In this case that’s probably close enough, and you’ll probably see stuff about keys being written. Let’s pretend it’s still too noisy. What if we had a way to see only the different kinds of messages without the dynamic parts of each. We do! Just ask for formatString instead of eventMessage, then sort | uniq.There is a complication, though. If you append sort | uniq to the previous pipeline and run it, you will see no output – this is because both sort and unique can’t run in stream mode; they have to receive all the input before they can do their job. If you simply control-c to terminate log, this seems to cause the in-flight log data to become malformed some time before it reaches jq. Instead of figuring that out, I opted to forgo log stream in favor of log show, because log show doesn’t run forever, so I won’t have to control-c it and have broken pipes.There’s still one more problem (this is the last one, honest). Let’s have a look at the logd man page:     All processes that use os_log(3) share pages of memory with logd and\r\n     append entries to them.  logd reads pages and combines and compresses\r\n     this data.  Depending on configured policies, it keeps them in a local\r\n     ring buffer or writes them out to persistent storage.\r\n\r\n           { logd }\r\n              | `---&gt; [ buffer ] ----.\r\n              |                      ,`---&gt; { log show }\r\n              `---&gt; [ data store ] -'You may have noticed \"messageType\": \"Debug\", in the previous output, indicating that the messages of interest are logged at the debug level. When you pass the --debug option to log stream, log temporarily activates debug-level messages so you can see them as they happen, and then disables debug mode when you control-c. In other words, switching to log show won’t work until we enable debug-level messages some other way. There are at least two ways to do this according to the log man page:# change the global log level to debug\r\nsudo log config --mode \"level: debug\"\r\n\r\n# ... or set a specific subsystem to debug\r\nsudo log config --subsystem 'com.apple.defaults' --mode level:debug --mode persist:debugI don’t like the first method because it doesn’t stick – the next time a log stream command exits, log helpfully disables debug-level messages, even if they were enabled before running log stream.Note that when targeting a subsystem, we also need to enable persisting of the debug-level messages, otherwise those messages will briefly pass through the in-memory ring buffer before being forgotten.We can now finally achieve a good summary of log activity by simply counting the unique instances of formatString values.andre@boop % log show --last 10m --predicate prefs \\\r\n| egrep --line-buffered '^{' | jq '. | .formatString' &gt; fstrings\r\n\r\nandre@boop % cat fstrings | sort | uniq -c | sort -n\r\n   1 null\r\n  32 \"Data for { %@, %@ } was purged due to memory pressure\"\r\n  32 \"no cache for { %{public}s, %{public}s, %{public}s, %{public}s, managed: %d }, loading from %{public}s\"\r\n  38 \"wrote file %{public}s\"\r\n  42 \"Notifying observers of { %{public}s, %{public}s, %{public}s, %{public}s, managed: %d }\"\r\n  82 \"Process %{public}d (%{public}s) wrote the key(s) %{public}s in { %{public}s, %{public}s, %{public}s, %{public}s, managed: %d }\"\r\n  90 \"Process %{public}d (%{public}s) read data for { %{public}s, %{public}s, %{public}s, %{public}s, managed: %d }, backed by %{public}s\"\r\n 416 \"Process %{public}d (%{public}s) sent a request related to { %{public}s, user: %{public}s, %{public}s, %{public}s, managed: %d } (%p)\"\r\n 482 \"Couldn't %{public}s %{private}s due to %{public}s\"Ok, wrote file ... and process ... wrote the key(s) ... look promising for this sample case. Let’s update our .logrc file to add a stanza for show. Also change the prefs predicate macro to specify category = \"cfprefsd\" instead of process (not strictly required, but good to use categories when possible). Lastly, add another predicate macro called keys to conjure a refined version of the prefs search that will only return events that represent writes to NSUserDefaults.show:\r\n   --style compact\r\n   --color always\r\n   --last 1h\r\n   --debug\r\n   --style ndjson\r\n\r\nstream:\r\n   --debug\r\n   --style ndjson\r\n\r\npredicate:\r\n   prefs 'category = \"cfprefsd\"' \r\n   keys 'category = \"cfprefsd\" and eventMessage contains \"wrote\"'Now we just use the keys predicate macro and clean the output with egrep and jq like before:andre@boop ~ % log show --last 10m --predicate keys \\\r\n  | egrep --line-buffered '^{' | jq '. | .eventMessage'\r\n...\r\n\"wrote file /Users/andre/Library/Preferences/com.apple.symbolichotkeys.plist\"\r\n...If you came to learn how to claw law blogs from os_log’s sprawling maw, get on outta here Bob Loblaw – the rest is about hotkeys.There are at least two different representations of hotkeys you might encounter in NSUserDefaults. NSUserKeyEquivalents (as in defaults find NSUserKeyEquivalents) is pretty self-explanatory, but there’s also AppleSymbolicHotKeys which is somewhat more opaque.As an example of AppleSymbolicHotKeys, rundefaults find AppleSymbolicHotKeys &gt; hotkey1.plist… then change the spotlight hotkey in system preferences, then rundefaults find AppleSymbolicHotKeys &gt; hotkey2.plist… then diff these plists:***************\r\n*** 460,474 ****\r\n              };\r\n          };\r\n          64 =         {\r\n              enabled = 1;\r\n              value =             {\r\n                  parameters =                 (\r\n!                     32,\r\n!                     49,\r\n!                     1048576\r\n                  );\r\n                  type = standard;\r\n              };\r\n          };\r\n          65 =         {\r\n              enabled = 1;\r\n--- 460,474 ----\r\n              };\r\n          };\r\n          64 =         {\r\n              enabled = 1;\r\n              value =             {\r\n                  parameters =                 (\r\n!                     107,\r\n!                     40,\r\n!                     786432\r\n                  );\r\n                  type = standard;\r\n              };\r\n          };\r\n          65 =         {\r\n              enabled = 1;Looking at the whole file, it seems like maybe the different functions that can be assigned hotkeys are represented here by a numeric ID, and 64 is the one for “show spotlight search”. The parameter values are key codes.I found a neat app called Key Codes that can be used to understand how the key code values work. For example, if I:disable the spotlight command-space hotkey so that Key Codes can capture that hotkeyclick the little ‘i’ button adjacent to ‘Modifiers’compare that to the data we found from NSUserDefaults… we see that the codes for command-space are 32, 49, 1048576 – note especially that the stored value does not include the device-specific aspect of the modifier (0x8). This matches what is shown in the diff output above from hotkey1.plistScreenshot of the app Key Codes displaying key code information about the hotkey ‘?-space’",
  "Url": "https://dreness.com",
  "IpAddress": "75.119.204.147",
  "ReverseDns": "dreness.com",
  "Asn": null,
  "Http2": false,
  "Http3": false,
  "ResponseTimeMs": 2386,
  "StatusCode": 200,
  "ServerHeaders": [
    "Apache"
  ],
  "Ssl": {
    "Issuer": "CN=R12, O=Let's Encrypt, C=US",
    "Subject": "CN=www.dreness.com",
    "NotBefore": "2026-01-11T17:54:10-08:00",
    "NotAfter": "2026-04-11T18:54:09-07:00",
    "SubjectAltNames": [
      "DNS Name=dreness.com",
      "DNS Name=www.dreness.com"
    ],
    "Hsts": false,
    "Ciphers": [],
    "Protocol": "Tls13",
    "DaysUntilExpiry": 69
  },
  "Cdns": [],
  "HostingHints": [],
  "Cms": [
    "WordPress"
  ],
  "Frameworks": [
    "React",
    "Svelte",
    "jQuery"
  ],
  "JsLibraries": [],
  "Analytics": [
    "Google Analytics GA4"
  ],
  "AdsAndMarketing": [],
  "PaymentGateways": [],
  "EcommerceHints": [
    "PrestaShop"
  ],
  "SocialSignals": [],
  "MediaProviders": [
    "YouTube"
  ],
  "SeoTags": [
    "content-type: text/html; charset=UTF-8"
  ],
  "HtmlLanguage": "en-US",
  "HasRobots": true,
  "HasSitemap": false,
  "SecurityHeaders": [],
  "CookiesObserved": [],
  "XhrApiHints": [],
  "SitemapCounts": {},
  "ChatWidgets": [],
  "ABTesting": [],
  "PrivacyConsent": [],
  "EmailMarketing": [],
  "WebFonts": [],
  "DynamicJs": [
    "Web Server: Apache",
    "jQuery (script Resource)",
    "Bootstrap (CSS Classes)",
    "React (CDN Detection)",
    "jQuery (CDN Detection)"
  ],
  "ResourceHosts": [
    "dreness.com",
    "gmpg.org"
  ],
  "CssFrameworks": [],
  "BuildTools": [
    "Modern JS Build Tool (inferred from React)"
  ],
  "ServerTech": [
    "Generator: WordPress 6.8.3",
    "PHP (inferred from WordPress)"
  ],
  "DatabaseHints": [],
  "PageTitle": "the bits | dre&#039;s blog",
  "MetaDescription": null,
  "ImageCount": 8,
  "ScriptCount": 15,
  "LinkCount": 13,
  "Errors": [],
  "UiFrameworks": [
    "Slate",
    "Vuetify (Class Names)",
    "Angular Material (Class Names)",
    "Bootstrap (Class Names)"
  ]
}