{"id":2565,"date":"2024-11-23T08:16:38","date_gmt":"2024-11-23T08:16:38","guid":{"rendered":"https:\/\/www.andreaswacker.com\/blog\/?p=2565"},"modified":"2024-11-23T08:16:39","modified_gmt":"2024-11-23T08:16:39","slug":"synthetic","status":"publish","type":"post","link":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/","title":{"rendered":"synthetic"},"content":{"rendered":"\n

Obviously, I have no clue about how an LLM works. Having said that, I cannot fathom how synthetic data could improve things much. My suspicion is that it gets favored since it is so predictable to generate, while finding and filtering actual information is hard and messy.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

I just tried to generate the most simple code for Apple Metal \u2014 it never worked. Looks like GPT could use a closer look at actual example code from that area. And, like that, there are probably countless other aspects of what humans have come up with so far that warrant a closer look.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

\u201cOrganizing the world\u2019s information and making it accessible\u201d<\/p>\n\n\n\n

That is still a good guideline, as is \u201cDon\u2019t be evil.\u201d<\/p>\n\n\n\n

Their mileage might vary.<\/p>\n","protected":false},"excerpt":{"rendered":"

Obviously, I have no clue about how an LLM works. Having said that, I cannot fathom how synthetic data could improve things much. My suspicion is that it gets favored since it is so predictable to generate, while finding and filtering actual information is hard and messy. I just tried to generate the most simple […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[42],"tags":[],"yoast_head":"\nsynthetic - Andreas Wacker<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"synthetic - Andreas Wacker\" \/>\n<meta property=\"og:description\" content=\"Obviously, I have no clue about how an LLM works. Having said that, I cannot fathom how synthetic data could improve things much. My suspicion is that it gets favored since it is so predictable to generate, while finding and filtering actual information is hard and messy. I just tried to generate the most simple […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\" \/>\n<meta property=\"og:site_name\" content=\"Andreas Wacker\" \/>\n<meta property=\"article:published_time\" content=\"2024-11-23T08:16:38+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-23T08:16:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior-1024x469.webp\" \/>\n<meta name=\"author\" content=\"Andreas Wacker\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@_andreaswacker\" \/>\n<meta name=\"twitter:site\" content=\"@_andreaswacker\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andreas Wacker\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\"},\"author\":{\"name\":\"Andreas Wacker\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\"},\"headline\":\"synthetic\",\"datePublished\":\"2024-11-23T08:16:38+00:00\",\"dateModified\":\"2024-11-23T08:16:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\"},\"wordCount\":126,\"publisher\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\"},\"image\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior-1024x469.webp\",\"articleSection\":[\"AI\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\",\"name\":\"synthetic - Andreas Wacker\",\"isPartOf\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior-1024x469.webp\",\"datePublished\":\"2024-11-23T08:16:38+00:00\",\"dateModified\":\"2024-11-23T08:16:39+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior.webp\",\"contentUrl\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior.webp\",\"width\":2149,\"height\":984},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.andreaswacker.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"synthetic\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#website\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/\",\"name\":\"Andreas Wacker\",\"description\":\"weblog\",\"publisher\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.andreaswacker.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\",\"name\":\"Andreas Wacker\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png\",\"contentUrl\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png\",\"width\":248,\"height\":248,\"caption\":\"Andreas Wacker\"},\"logo\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/\"},\"sameAs\":[\"http:\/\/www.andreaswacker.com\",\"https:\/\/www.instagram.com\/_andreaswacker\/\",\"https:\/\/x.com\/_andreaswacker\",\"https:\/\/www.youtube.com\/channel\/UCWwFtVC_HATVr-R5EiNmhHw\"],\"url\":\"https:\/\/www.andreaswacker.com\/blog\/author\/admin2\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"synthetic - Andreas Wacker","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/","og_locale":"en_US","og_type":"article","og_title":"synthetic - Andreas Wacker","og_description":"Obviously, I have no clue about how an LLM works. Having said that, I cannot fathom how synthetic data could improve things much. My suspicion is that it gets favored since it is so predictable to generate, while finding and filtering actual information is hard and messy. I just tried to generate the most simple […]","og_url":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/","og_site_name":"Andreas Wacker","article_published_time":"2024-11-23T08:16:38+00:00","article_modified_time":"2024-11-23T08:16:39+00:00","og_image":[{"url":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior-1024x469.webp"}],"author":"Andreas Wacker","twitter_card":"summary_large_image","twitter_creator":"@_andreaswacker","twitter_site":"@_andreaswacker","twitter_misc":{"Written by":"Andreas Wacker","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#article","isPartOf":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/"},"author":{"name":"Andreas Wacker","@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a"},"headline":"synthetic","datePublished":"2024-11-23T08:16:38+00:00","dateModified":"2024-11-23T08:16:39+00:00","mainEntityOfPage":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/"},"wordCount":126,"publisher":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a"},"image":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage"},"thumbnailUrl":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior-1024x469.webp","articleSection":["AI"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/","url":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/","name":"synthetic - Andreas Wacker","isPartOf":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage"},"image":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage"},"thumbnailUrl":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior-1024x469.webp","datePublished":"2024-11-23T08:16:38+00:00","dateModified":"2024-11-23T08:16:39+00:00","breadcrumb":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#primaryimage","url":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior.webp","contentUrl":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/11\/interior.webp","width":2149,"height":984},{"@type":"BreadcrumbList","@id":"https:\/\/www.andreaswacker.com\/blog\/2024\/11\/23\/synthetic\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.andreaswacker.com\/blog\/"},{"@type":"ListItem","position":2,"name":"synthetic"}]},{"@type":"WebSite","@id":"https:\/\/www.andreaswacker.com\/blog\/#website","url":"https:\/\/www.andreaswacker.com\/blog\/","name":"Andreas Wacker","description":"weblog","publisher":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.andreaswacker.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a","name":"Andreas Wacker","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png","contentUrl":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png","width":248,"height":248,"caption":"Andreas Wacker"},"logo":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/"},"sameAs":["http:\/\/www.andreaswacker.com","https:\/\/www.instagram.com\/_andreaswacker\/","https:\/\/x.com\/_andreaswacker","https:\/\/www.youtube.com\/channel\/UCWwFtVC_HATVr-R5EiNmhHw"],"url":"https:\/\/www.andreaswacker.com\/blog\/author\/admin2\/"}]}},"_links":{"self":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts\/2565"}],"collection":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/comments?post=2565"}],"version-history":[{"count":1,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts\/2565\/revisions"}],"predecessor-version":[{"id":2568,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts\/2565\/revisions\/2568"}],"wp:attachment":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/media?parent=2565"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/categories?post=2565"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/tags?post=2565"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}