Probably because they want people to freely maintain it. I hate corporations abusing open source, but putting a big price to the end user. Open source it's great when end users benefit from it. If open source is hidden under 20 meters of proprietary garbage, why is it any different then unpaid labor?
@@ck-dl4to NTFS had streams and that failed because people hate Metadata inside the file Metadata goes in the file system, the name is Metadata, extension and file type also is
13:17 "Imagine if your JSON autocompleted and gave you errors when you were editing it" You don't even have to imagine, it's already a thing with JSON Schema.
Within the first 3 mins of this video, I was already screaming JSON Schema. It follows DRY principles, has validation, is standardized, can be transpiled to POCO code in various languages. And JSON Schema files can also be referenced in an OpenAPI/Swagger spec to generate code for entire API endpoints. But sure, Apple, do your own thing. Just like they are trying to build the next standard of podcasting when we already have a well-developed Podcasting 2.0 standard.
I found it funny because usually if I wanted to pickle something, there was a better solution assuming I wanted my project to be scalable in some way. And to be fair, you're going to choose one or the other, and as far as I know there's no external programs that open pickle files directly so you'll just be opening Apple's .pkl with a text editor and not touching pickles directly anyways.
I work at apple, i joined when it wasn’t open source and i was very skeptical about PCL ( internal it’s called PCL instead of PKL) but it does solve a lot of problems and the IDE integration is great. It has completely replaced helm in our team, it’s much better. I hope eventually helm charts will also be published in PKL.
Regex makes this all the more cursed. Now you can have a string format language inside of a data format language which can now be directly processed inside of your application's language, which means you have a language in a language in a language. I am absolutely digging this! 😂
Strictly speaking, RegEx is not a language, it is a pattern matching syntax. What would a better alternative have been? Invent yet another string pattern matching syntax for Pkl?
Sooo... They didn't know Nix, Nickel, Dhall, CUE, Jsonnet or HCL existed and therefore had to create their own thing? :/ It doesn't even look that good tbh. But yeah, impressive that Apple open sources something. That doesn't happen very often.
@@jhuglen The EU just said you need user consent before you store data on their PC for reasons other than purely functional. The Industry could have just followed the Do Not Track setting, but they want your data. Not the EU's fault that sites are evil.
chatter getting worked up about "version conflicts in config files": that's literally just a thing. The config format (or parts of it) may change over time after all, and it's important to keep track of that. It's great if Pkl can encode these existing problems and provide editor support for solving them... tho I wonder what form that'll take in practice, if and how different versions of a config format might be supported at the same time.
When I saw a configuration language that is "a blend between a static language and a general-purpose programming language" I immediately thought of Nix, a language with similar ideas created for a similar purpose. Nix doesn't seem to do very well outside Nix and NixOS ecosystems though, and Pkl does seem easier to grasp.
Totally agreed - for my NixOS system that I have been using for almost 4 years now I am happy with the subset of the Nix language that I need to know, but even then it sometimes still is hard for me to understand the syntax. And for programmer that is not used to it I think it is harder to fight with some of the constraints that you will run into when using nix in a very dynamic ecosystem: in the company I work for we are using it e.g. for building some JavaScript stuff and just the amount of work it takes for _some_ of the dependencies to be packaged is just insane (but to be honest, so is what those dependencies are doing on installation...). So yes - I really love NixOS, but I personally am sometimes struggling a bit with the nix language (yes - because I don't use it (or something similar) that often)
I would rather them put thos energy into fixing the crashing bug in Xcode. Or maybe decoupling that IDE and compiler from MacOS versions so you can work on old apps without having to switch to old Macs with old MacOS versions.
>old (anyhting) >Apple There is no backwards compatibility. There is no tolerance. You will work with the newest version, whether or not it makes sense.
@@jhuglen You really need to take a nap or some shit man. It's either extreme sleep deprivation, an absurd amount of alcohol, or you're doped the fuck up on psychedelics. Either way, you need a break
As a Typescript developer i don't see much value in this, because a pkl file have roughly the same lines of code of a regular js/ts file used for configuration, but using js/ts doesn't need to install additional binaries or dependencies. However i can see some potential for more complex languages like Go/Rust/Java/etc. that are not suited for small "scripts" since they take in account stuff that you don't care when creating a configuration file such as pointers, packages, namespaces, classes, the borrow checker, constructors, errors handling.
> but using js/ts doesn't need to install additional binaries or dependencies Huh? What world are you living in where JS and TS doesn't require binaries or dependencies?
@@recepciftci2642 What computer? No computer comes with NodeJS preinstalled. You may have Docker images, but then it makes his initial point moot. Plus you'd still need to add TSC compiler as a dependency. That is besides the point, it's comparing apples to oranges.
@@dealloc I will help you understand the comment. The comment did not mean that JS and TS doesnt require binaries / dependencies to be installed, the commentor was talking about simply using JS/TS files as a configuration file, thus not having to install any other binaries related to configuration management tools. Sometimes its okay to assume things and not take everything literal, especially in a world in which english is a secondary or tertiary language for many people. Perfect grammar is something alot of us wish we'd have. Sometimes we slip up, and the meaning of a sentence might differ from what we actually had in mind when we wrote it.
@@jhuglen hey can you stop spamming replies with this nonsense… You are conflating two completely different things… Apple is forced by the eu to conform to certain standards that the eu has set, like using USB-C ports, but that doesn’t mean that the eu has “forced” them to make a config language they developed open source… Like.. I really don’t know what you mean by “eu forced them” or “only in eu” here
All the Python folks are hissing about this (don’t blame ‘em, they’ve been using “pickle” for serialization for ages). Anyway - I wonder if at Apple, all their Kubernetes cluster manifests are written in Pkl files. Hmm… that’d be interesting to look at!
They thankfully realised that the only way to have it adopted is to not only open source it but provide extensions to major editors, even VS Code. It's a good call, if they tried to make something proprietary, it would die painfully. Pkl seems cool, but it smells of something that will be infamous for quirks and hard to make parsers like YAML. Time will tell I guess, I do like it and hope it catches on and ends up being good.
honestly this seems REALLY cool - from the title I thought it was just another way of storing data that's nicer to use than json like hjson or yaml, but no this seems like WAY more!! really cool stuff :D
Cool idea, but I'm having a hard time understanding the actual use case. I have never found myself needing a language agnostic config, Both JSON and YAML have schema files which solves auto complete.
Being a big fan of comptime in Zig, this will work beautifully. Types in more complex use cases are in desperate need of logic that can be resolved during the compilation of a particular program.
"Pickle" sounds like "Pickel" which is German for "Pimple". Can't wait to hear my coworkers say "Create a pimple file for this project!". For that reason, I'm out 😆
Dude this isn't as big of a problem in JS land. For JSON, we have schemas. For JavaScript and TypeScript, most packages come with a defineConfig out of the box, and if they don't, rest assured somebody has already published an NPM package for that purpose.
This is so awesome ! Currently I'm using json config file to validate and get autocomplete on my json files. And I do not have the best experience with it. Pkl could be a game changer !
Really i prefer to validate my jsonf config file in my code, i dont like this and i agree with you, whats with this trend of overcomplicating things....omg, for example in c# i could use a library like fluenvalidation an validate rules for my json's structure with rules like "port" is an int for example .... not needing to define a new language for that 🤣🤣
this, just writing the parser for this was probably some intern's whole summer and it only made the problem worse. JSON is from 2001 and it's not impressive to be slightly better than one part of it 20 years later.
@@duartecunhaleao but consider that what is 'valid' may change from consumer or other factors and I doubt you are going to skip server/app side validations anyways and just leave it to this config, so you will end up doubling the validations. Also validation should be close to the app code im reading/writing as it is crucial.
It seems they tried to recreate Terraform's HCL language, but without Terraform behind. Still I don't see it's usage overlapping wit json/yaml/toml or whatever. Let's see 3 use cases: 1. Transport format: it doesn't seem suitable (if I need schema oriented stuff and validation why not using binary formats such as thrift,avro or protobuffers?) 2. app configuration: imho I still would go for something simple and execute logic in my application instead of adding an additional step in my build process for compiling and packaging 3. Build configuration: do i really need standardization?eg If I'm in the jvm ecosystem I use gradle with groovy or kts and there is one in a billion cases where I need to transfer this configuration to another stack. Yes it takes more mental energy to learn all the tools and languages in order to be a polyglot developer but there is not so much to do unless you don't want to invent a an ecosystem agnostic deps/build management system...and good luck with that!
So from my understanding, this is supposed to help checking out projects, where the default config is ommitted from the repository, but you still want a default config to be created on first run, like an ENV bootstrap ? Or what is this useful for ?
So C macros for config files? something like Cmake? This is just another syntax to add to the collection I have to use once every few weeks. Between all these scripting languages, config formats, CLIs, programming languages, etc we are expected to know is nearing 100+.
you can actually use C macros in any languages, but nobody does it because it would confuse newbies who have no idea what a preprocessor is EDIT: also your IDE would complain about syntax errors lol
ngl the most interesting part to me is standardizing the way runtime json gets generated 😮 it’s an easy task but cool not to have to decipher whatever madness someone cooks up to do it
Well, both. There's the json/yaml/whatever generators in the CLI itself. With those, you could only ever *write* PKL from now on and add a pkl step to your build process which translates your pkl config your desired format. There's also the interpreter/compiler implementation for different languages, so you could also load pkl files directly from through one of the supported languages (Go, Java, Kotlin, Swift) without the intermediate step to json/yaml/...
Of course a third party might do it, but it's not likely to get first-class support from Hashicorp since they defined their own config language in HCL. It *might* make Hashicorp listen to users more and address some of the issues with HCL, though.
Had not heard of DHall or Nickel. Just found their websites and notice that while DHall has a VS Code plug-in, they have no support for JetBrains IDEs. So for that reason alone Pkl is more attractive to me, since I'm spend most of my days in GoLand.
When i heard about pkl i was not interested thinking we already have enough tools, but the features shown here have some features. I can imagine using this to share a configuration between a frontend js and a backend rust/php/c application.
Honestly, I've already seen all of this before. There's a language much smaller called Nickel, same concept but it's based on FP (perfect for config) and it's already past 1.0.0.
I like how the guy from Super Troopers agrees with me that PKL is probably the path forward in terms of configuration languages. It encodes a lot of type information, so it follows that with PKL is at least capable to generating any static configuration that requires less information. On the other hand, the fact that it is limited as a programming language guarantees that it will remain focused and stay easy to read.
Why would you create a new language with regex support and use strings for regex that need to be escaped? They could use the perl/js regex syntax of a statement surrounded by 2 slashes.
Don't think kotlin support is mainly about android. Kotlin is used to build ios apps and apps across the Apple eco system. Also it's just a better java and it's able to interop with java so it seems like low hanging fruit though if it's true multi platform kotlin it'll be a bit more that java -> kotlin. Happy to see Go support as a first class supported language btw!
Wouldn’t say say Apple dislike JavaScript when they have integrated JavaScript support all over the place in their products. But yeah, Pkl looks cool! Always great to see more safety in languages. Thanks for showcasing it.
Why they need validation in a config file? My program can read the file and tell the user what is wrong. I don't need to learn a new scripting language for that. And if you config file gets too big I want to use a real programming language to create it anyway. Plus source control.
7:52 - The Zip Code rule will break in the UK, were our equivalent, postcodes are a string in three sections. The first section is one or two letters, represinting the main postcode region, the next is the postcode district, which is 1 or 2 numbers, or a number followed by a letter. Then there is a space, then a number and two letters.
Most known Apple's OSS projects are CUPS (printing system) and Webkit (browser engine). But it looks like they handed over the development of original CUPS to openprinting and now only focus on "Apple CUPS".
Did I miss a way to fix iterating over and parsing arrays and/or objects and mixes of the two? JavaScript's nested for loops or for ins or Lodash etc.. to get properties and values is stupid. Did I miss where Pkl fixes this? The casting of obj/array just to iterate and put in the correct order and other things? Thanks for the video nonetheless.
A few years ago Apple introduced a conditional and declarative configuration mobile device management model to set conditional parameters to be set on the iOS, MacOS operating systems. This seems like the underlying programming framework is pKL.
Does it support references/pointers from one variable to another? It would make so many past JSONS of mine so much cleaner. For example: if I have a file that outlines the theme of a custom code editor and I want to have an easy to edit color scheme, I have to change each occurrence of a color in a JSON file but if I could reference variables I could put the color scheme at the top and make all uses references so it can easily be modified.
I went over the source code of Pkl and although it support non-string keys in mappings (i.e. more like msgpack than JSON), it looks like very much it only support a subset of YAML 1.1. Since the YAML 1.2 has been out since 2009, that might have to do with the state of YAML parsers/dumpers in the Java/Kotlin, world and not necessarily a conscious choice by the developers. That unfortunately makes it only a potential replacement for a subset of YAML supporting applications, and also not a potential replacement for Python's pickle format.
It should be noted and remembered that there is absolutely nothing special about any kind of data file, whether it be a real config file (globals and sections), an XML config file, a JSON file, a '90's database and multi table file like Dungeon Keeper has, or any other plain text data file that we can write. They all originally had programs that parsed them and used the data values how they needed. Like Dungeon Keeper using the multiple relatable text data tables, which I have made a Console editor for. I very recently made my own C# parser and writer for JSON data which works perfectly and is very strict on there being no errors in the text. So now I have a no-hassle way of using JSON data from a file. I could use it for app config and even game data which would allow the game to be modded. Yet long before that I made the same deal with XML, with better functionality in C#, and long before that I made the same deal with real config. I even once made a data reader that turns the first words into column names and all the next words into entry names and auto make a text table like the Dungeon Keeper ones, even with initial values. It is so easy to make custom ways to read data text files. You just need to make the app that parses the data into the runtime data, like objects etc., that it needs. This is all very fun stuff, but don't be sucked in with the hype. We can all do this.
Let's tell the truth, though. This is yet again not an actual programming language.-It doesn't result in executed binary. It's only analysed during parse. This happens to be a manifest language, just like the text data is that you write in a file for creating the Windows Cabinet (v2) file.
I'm all in for built-in declarative validation rules, but built-in programming will make it hard to maintain readability (you don't know the result until the file is executed / compiled). Still will give it a go, though
It's wild to me that this apple project has literally zero mentions of Xcode. Interesting that it can export as Plist. I'd love to see them ditch that bastardized hack of a config format. And the fact that they have LSP support coming, and no Xcode integration, makes me hope that Apple is ditching all of that codebase and they're laying the foundation (heh) for the next thing. The thing that makes me wonder, is why this didn't launch at WWDC.
plists are absolutely everywhere in OSX, so i don't think Apple will be replacing them, especially considering they just made a tool to generate them automatically, hopefully meaning you won't have to interact with plists directly ever again.
So, they created Cascading Configuration Language; they should have named it CCL. Given how maintainable the seemed-like-a-good-idea-at-the-time CSS turned out to be, I am not so sure that we should consider them creating a cascading configuration language to be a good thing... 🤷♂️ #jmtcw
A solution in search of a problem...that doesn't exist. We REALLY need to snap out of this mindset where everything needs to have a framework, transpiler, linter, build tool etc. JSON, YAML et al is super simple already. There is no need for introducing an intermediary format to "compile" it to JSON or YAML. It just ads complexity without any benefit. It's not like you can make one PKL config and then move it around between different applications, since those applications would have different config options and naming conventions.
Nope. This is the last thing the industry needs. Sensible consumers avoid their overpriced products, and they should also never touch an apple technology that tries to get into our workflow. "FOSS" or not. No more corporate closed source proprietary. Snap out of it people, development isn't fashion.
I've been using Dhall for the last 5 or 6 years, I honestly think the only reason it hasn't caught on is it came from a functional programming background.
JetBrains editors already have a decent understanding of common config files. package.json for example has the autocomplete that's shown here (it will even do lookups for dependency versions). next.config.js has this too. But I understand the value of codifying this into something common.
How does pkl solve validation? If you write the checking condition into the config file, someone can just change the condition together with changing the config. It has to be validated in the application itself. So you could just use JSON Schema to validate a JSON config and that would work better, as the config itself is smaller and you don't have to implement validation twice and it's already supported by IDEs. I can imagine it for infrastructure as code but for example Terraform already has a language for it, called HCL. Maybe pkl is better than HCL. It looks to me not like a replacement for JSON but a programming language to generate JSON. Similar to CDKTF, where you write for example TypeScript code to generate a JSON to execute with Terraform. There Pkl could help.
They open-sourced it because they want it to be a standard
because of 'Mother Nature"
I mean yeah it would be insane to keep this kind of thing proprietary no?
@@lmao4982you'd be surprised
Probably because they want people to freely maintain it.
I hate corporations abusing open source, but putting a big price to the end user.
Open source it's great when end users benefit from it. If open source is hidden under 20 meters of proprietary garbage, why is it any different then unpaid labor?
@@jhuglen whats wrong with it
The fact that Pickle and .pkl are already the name and extension for a common existing file format is driving me insane.
No one should use a file extension as identifier.
The fact that pickle ball makes such an annoying popping sound is driving me insane.
@@ck-dl4to NTFS had streams and that failed because people hate Metadata inside the file
Metadata goes in the file system, the name is Metadata, extension and file type also is
@@monad_tcp NTFS probably had streams because MacOS had resource files.
Swift was already a programming language before Apple release theirs
13:17 "Imagine if your JSON autocompleted and gave you errors when you were editing it"
You don't even have to imagine, it's already a thing with JSON Schema.
He mustn’t have edited a package.json in a while.
Within the first 3 mins of this video, I was already screaming JSON Schema. It follows DRY principles, has validation, is standardized, can be transpiled to POCO code in various languages. And JSON Schema files can also be referenced in an OpenAPI/Swagger spec to generate code for entire API endpoints.
But sure, Apple, do your own thing. Just like they are trying to build the next standard of podcasting when we already have a well-developed Podcasting 2.0 standard.
yep and it's supported natively by vscode
Typical theo
But it doesn't have for-loopsd!!@#!@#
as a person who uses python pickle files every day i find this naming choice very annoying
Literally thought the same thing (but I’ve only used the library like once)
PYTHONISTA: REEEEEEEEEEEEEEEEEE
Youre supposed to name those as ".dat" files
I found it funny because usually if I wanted to pickle something, there was a better solution assuming I wanted my project to be scalable in some way.
And to be fair, you're going to choose one or the other, and as far as I know there's no external programs that open pickle files directly so you'll just be opening Apple's .pkl with a text editor and not touching pickles directly anyways.
You should probably stop using the security nightmare that is python pickle.
You can tell they want folks to use it because they also released a neovim plugin and aren't just catering to VScode users
Why does the EU live in your head rent-free?@@jhuglen
@@jhuglen Ah okay, I thought you had some weird hate-boner for the EU 😅
the neovim plugin is crap though
I used to Pickle my Python back in the day.
Mmm Pickled python.
My mom used to as well
@@vikingthedudeYour mom used to pickle his python?
I still pickle my python. pkl is a well-known file extension for this. WTF
the smartest thing a new standard can do is make it easy to incrementally migrate, and it seems they are doing that
I work at apple, i joined when it wasn’t open source and i was very skeptical about PCL ( internal it’s called PCL instead of PKL) but it does solve a lot of problems and the IDE integration is great. It has completely replaced helm in our team, it’s much better. I hope eventually helm charts will also be published in PKL.
if only they wouldve still call it PCL here, as there is quite a confusion in the python community haha
I love that the example password they used was "hunter2" lol
What was the password? All I see is *******.
I feel bad for people that have to now use this and the pickle module for file saving in python programs
I feel bad for people that have to use python.
Yeah fuck me
@@catalystcorpi feel bad for people
@@X-3KI feel bad
@@gh0stcloud499I feel
Someone's writing Doom in that
the funny thing is is that you're probably correct
Regex makes this all the more cursed. Now you can have a string format language inside of a data format language which can now be directly processed inside of your application's language, which means you have a language in a language in a language. I am absolutely digging this! 😂
Strictly speaking, RegEx is not a language, it is a pattern matching syntax.
What would a better alternative have been? Invent yet another string pattern matching syntax for Pkl?
@@mortenhattesenIt was (basically) a tongue-in-cheek comment.
Sooo... They didn't know Nix, Nickel, Dhall, CUE, Jsonnet or HCL existed and therefore had to create their own thing? :/ It doesn't even look that good tbh. But yeah, impressive that Apple open sources something. That doesn't happen very often.
What browser did you use to make your comment?
@@jhuglenWhy on Earth are you constantly talking about the EU in every single comment?? What about any of this has anything to do with the EU????
@@jhuglenbro you’re drunk get off RUclips 💀
@@jhuglen
The EU just said you need user consent before you store data on their PC for reasons other than purely functional.
The Industry could have just followed the Do Not Track setting, but they want your data. Not the EU's fault that sites are evil.
Cuelang is still rough but the real deal. I'm trying to understand it better and contribute.
chatter getting worked up about "version conflicts in config files": that's literally just a thing. The config format (or parts of it) may change over time after all, and it's important to keep track of that. It's great if Pkl can encode these existing problems and provide editor support for solving them... tho I wonder what form that'll take in practice, if and how different versions of a config format might be supported at the same time.
There's a difference between changing config files and tracking configuration versions so you can load data from older formats properly.
About the IDE autocompletion 13:30, you do have json-schema.
@@jhuglen Wtf are you on about
@@jhuglenthe easiest comments to delete are the comments that never get made 🙏
@@jhuglenyou need to get off the internet
It’s time consuming to write, even if tools can help it’s full of boilerplate
When I saw a configuration language that is "a blend between a static language and a general-purpose programming language" I immediately thought of Nix, a language with similar ideas created for a similar purpose. Nix doesn't seem to do very well outside Nix and NixOS ecosystems though, and Pkl does seem easier to grasp.
Totally agreed - for my NixOS system that I have been using for almost 4 years now I am happy with the subset of the Nix language that I need to know, but even then it sometimes still is hard for me to understand the syntax. And for programmer that is not used to it I think it is harder to fight with some of the constraints that you will run into when using nix in a very dynamic ecosystem: in the company I work for we are using it e.g. for building some JavaScript stuff and just the amount of work it takes for _some_ of the dependencies to be packaged is just insane (but to be honest, so is what those dependencies are doing on installation...). So yes - I really love NixOS, but I personally am sometimes struggling a bit with the nix language (yes - because I don't use it (or something similar) that often)
@@miallo just learn FP .. here's a hint: you can do everything with foldl'
I would rather them put thos energy into fixing the crashing bug in Xcode. Or maybe decoupling that IDE and compiler from MacOS versions so you can work on old apps without having to switch to old Macs with old MacOS versions.
lol, apple dev will always be somewhat cursed. Its what they chose when they decided to be super proprietary.
>old (anyhting)
>Apple
There is no backwards compatibility. There is no tolerance. You will work with the newest version, whether or not it makes sense.
You do realise Apple has more than 5 engineers and not all of them can meaningfully work on xcode, right?
does Apple even use XCode internally?
My first thought was it sounds just more complicated to use
@@jhuglen You really need to take a nap or some shit man. It's either extreme sleep deprivation, an absurd amount of alcohol, or you're doped the fuck up on psychedelics. Either way, you need a break
That's my second and third thought as well. No, wait, the third is overengineered.
As a Typescript developer i don't see much value in this, because a pkl file have roughly the same lines of code of a regular js/ts file used for configuration, but using js/ts doesn't need to install additional binaries or dependencies.
However i can see some potential for more complex languages like Go/Rust/Java/etc. that are not suited for small "scripts" since they take in account stuff that you don't care when creating a configuration file such as pointers, packages, namespaces, classes, the borrow checker, constructors, errors handling.
> but using js/ts doesn't need to install additional binaries or dependencies
Huh? What world are you living in where JS and TS doesn't require binaries or dependencies?
@@dealloc Computer has already NodeJS installed. So you don't need to install anything extra.
@@recepciftci2642 What computer? No computer comes with NodeJS preinstalled. You may have Docker images, but then it makes his initial point moot.
Plus you'd still need to add TSC compiler as a dependency.
That is besides the point, it's comparing apples to oranges.
@@dealloc you don't need to add TSC to a TS project, because it's already been added. Use TS configs for TS projects, PHP for PHP projects, you get it
@@dealloc I will help you understand the comment. The comment did not mean that JS and TS doesnt require binaries / dependencies to be installed, the commentor was talking about simply using JS/TS files as a configuration file, thus not having to install any other binaries related to configuration management tools. Sometimes its okay to assume things and not take everything literal, especially in a world in which english is a secondary or tertiary language for many people. Perfect grammar is something alot of us wish we'd have. Sometimes we slip up, and the meaning of a sentence might differ from what we actually had in mind when we wrote it.
It's basically the SCSS/SASS of config. Slick.
@@jhuglen hey can you stop spamming replies with this nonsense…
You are conflating two completely different things… Apple is forced by the eu to conform to certain standards that the eu has set, like using USB-C ports, but that doesn’t mean that the eu has “forced” them to make a config language they developed open source…
Like.. I really don’t know what you mean by “eu forced them” or “only in eu” here
I'm guessing you are 14 @@jhuglen
@@SwatejTech I wan't to know what he said ):
Actually, it's mostly HOCON.
All the Python folks are hissing about this (don’t blame ‘em, they’ve been using “pickle” for serialization for ages).
Anyway - I wonder if at Apple, all their Kubernetes cluster manifests are written in Pkl files. Hmm… that’d be interesting to look at!
There's another configuration language I like which is Dhall. For those who love Haskell, Rust and etc.
Unfortunately it seems only the Haskell bindings are maintained and non of the other languages.
They thankfully realised that the only way to have it adopted is to not only open source it but provide extensions to major editors, even VS Code. It's a good call, if they tried to make something proprietary, it would die painfully.
Pkl seems cool, but it smells of something that will be infamous for quirks and hard to make parsers like YAML. Time will tell I guess, I do like it and hope it catches on and ends up being good.
honestly this seems REALLY cool - from the title I thought it was just another way of storing data that's nicer to use than json like hjson or yaml, but no this seems like WAY more!! really cool stuff :D
Yes .properties are still being used especially in default spring boot apps
Can't blame him. He lives in a frontend bubble.
you can use yaml configs which are more readable for larger configs
@shubitoxX I know I just wished my department used YAML more often 😂
Cool idea, but I'm having a hard time understanding the actual use case. I have never found myself needing a language agnostic config,
Both JSON and YAML have schema files which solves auto complete.
When you work with environments which practically live on configurations and a mistake can take down a fleet of services, this is _very_ useful.
Being a big fan of comptime in Zig, this will work beautifully. Types in more complex use cases are in desperate need of logic that can be resolved during the compilation of a particular program.
"Pickle" sounds like "Pickel" which is German for "Pimple". Can't wait to hear my coworkers say "Create a pimple file for this project!". For that reason, I'm out 😆
reading an article while recording yourself is soooo creative, original and value adding....
Dude this isn't as big of a problem in JS land. For JSON, we have schemas. For JavaScript and TypeScript, most packages come with a defineConfig out of the box, and if they don't, rest assured somebody has already published an NPM package for that purpose.
This is so awesome !
Currently I'm using json config file to validate and get autocomplete on my json files. And I do not have the best experience with it.
Pkl could be a game changer !
I dont want logic in my config files, jesus christ I cant find this appealing at all.
Really i prefer to validate my jsonf config file in my code, i dont like this and i agree with you, whats with this trend of overcomplicating things....omg, for example in c# i could use a library like fluenvalidation an validate rules for my json's structure with rules like "port" is an int for example .... not needing to define a new language for that 🤣🤣
this, just writing the parser for this was probably some intern's whole summer and it only made the problem worse. JSON is from 2001 and it's not impressive to be slightly better than one part of it 20 years later.
I would love not to have to write any more validation code along the main code...
@@duartecunhaleao but consider that what is 'valid' may change from consumer or other factors and I doubt you are going to skip server/app side validations anyways and just leave it to this config, so you will end up doubling the validations. Also validation should be close to the app code im reading/writing as it is crucial.
Seriously. And if you are creating long config files with a lot of repetition just write a script to generate them.
It seems they tried to recreate Terraform's HCL language, but without Terraform behind. Still I don't see it's usage overlapping wit json/yaml/toml or whatever. Let's see 3 use cases:
1. Transport format: it doesn't seem suitable (if I need schema oriented stuff and validation why not using binary formats such as thrift,avro or protobuffers?)
2. app configuration: imho I still would go for something simple and execute logic in my application instead of adding an additional step in my build process for compiling and packaging
3. Build configuration: do i really need standardization?eg If I'm in the jvm ecosystem I use gradle with groovy or kts and there is one in a billion cases where I need to transfer this configuration to another stack. Yes it takes more mental energy to learn all the tools and languages in order to be a polyglot developer but there is not so much to do unless you don't want to invent a an ecosystem agnostic deps/build management system...and good luck with that!
Pkl feels like Typescript meets SASS
I was about to say something similar.
Very true.
So from my understanding, this is supposed to help checking out projects, where the default config is ommitted from the repository, but you still want a default config to be created on first run, like an ENV bootstrap ?
Or what is this useful for ?
How would you compare this to Cue? Seems like they are solving the same problems
Yes, definitely! cue seems more pure and pkl more eng oriented.
They clearly share underlying abstraction.
I was thinking the same thing
Cue looks more powerful to me. The built in scripting engine in Cue is brilliant.
@@DryBones111 Hopefully no security holes.
I'm going to keep using JSON, avoid YAML, never use XML on principal and now avoid using Pkl. Sounds good!
1:26, Apple has an official Swift LSP for VSCode btw
This is the kind of content I'd subscribe for. Have seen your videos ocassionally, but valuable content like this is subsbscription worthy.
So C macros for config files? something like Cmake? This is just another syntax to add to the collection I have to use once every few weeks. Between all these scripting languages, config formats, CLIs, programming languages, etc we are expected to know is nearing 100+.
you can actually use C macros in any languages, but nobody does it because it would confuse newbies who have no idea what a preprocessor is
EDIT: also your IDE would complain about syntax errors lol
Definitely not like CMake. Thankfully.
ngl the most interesting part to me is standardizing the way runtime json gets generated 😮 it’s an easy task but cool not to have to decipher whatever madness someone cooks up to do it
Every year you present two vscode killers and three json replacements
So it doesn't replace or "kill" anything, it just makes making those things more usable? I don't think I'm understanding it right
Clickbait
Well, both. There's the json/yaml/whatever generators in the CLI itself. With those, you could only ever *write* PKL from now on and add a pkl step to your build process which translates your pkl config your desired format. There's also the interpreter/compiler implementation for different languages, so you could also load pkl files directly from through one of the supported languages (Go, Java, Kotlin, Swift) without the intermediate step to json/yaml/...
@@felixw841 But whats wrong with json schema?
I can't wait to see this for Terraform
Of course a third party might do it, but it's not likely to get first-class support from Hashicorp since they defined their own config language in HCL.
It *might* make Hashicorp listen to users more and address some of the issues with HCL, though.
I agree with your point of view！！！
Have you tried cdktf?
Honey, I shrunk the JSON!
Don’t worry, you have a great personality ❤
Did you end up with YAML?
This concept has already been executed in the form of Dhall and Nickel. Nice to see another competitor, but I’ll stick with Dhall.
Had not heard of DHall or Nickel. Just found their websites and notice that while DHall has a VS Code plug-in, they have no support for JetBrains IDEs. So for that reason alone Pkl is more attractive to me, since I'm spend most of my days in GoLand.
When i heard about pkl i was not interested thinking we already have enough tools, but the features shown here have some features. I can imagine using this to share a configuration between a frontend js and a backend rust/php/c application.
I'm afraid that someone is going to craft some overly complex config with this syntax, becoming hard to understand and edit by others
Honestly, I've already seen all of this before. There's a language much smaller called Nickel, same concept but it's based on FP (perfect for config) and it's already past 1.0.0.
I like how the guy from Super Troopers agrees with me that PKL is probably the path forward in terms of configuration languages. It encodes a lot of type information, so it follows that with PKL is at least capable to generating any static configuration that requires less information. On the other hand, the fact that it is limited as a programming language guarantees that it will remain focused and stay easy to read.
sure validation is PITA, but why solve it only for file-based config? what about envvars, CLI params and other places such as HTTP endpoints?
Is it a less powerful nix?
Why would you create a new language with regex support and use strings for regex that need to be escaped? They could use the perl/js regex syntax of a statement surrounded by 2 slashes.
Don't think kotlin support is mainly about android. Kotlin is used to build ios apps and apps across the Apple eco system. Also it's just a better java and it's able to interop with java so it seems like low hanging fruit though if it's true multi platform kotlin it'll be a bit more that java -> kotlin.
Happy to see Go support as a first class supported language btw!
Nickel also have constraints and documentation. And Nix is really cool in merging things and have inter-dependent pluggable modules of configurations.
Wouldn’t say say Apple dislike JavaScript when they have integrated JavaScript support all over the place in their products.
But yeah, Pkl looks cool! Always great to see more safety in languages. Thanks for showcasing it.
I am loving that theo has returned back to his roots in terms of tye content he is putting out.
I swear people undervalue the importance of ease of writing a parser. JSON was designed to be easy to parse; this obviously is not
Python’s pickle library: am I a joke to you?
Is this Nickel/Dhall all over again?
This came out of nowhere, they basically made a very accessible and powerful modelling language with generators and all... incredible
This is very very cursed, could not expect less from Apple
Why they need validation in a config file? My program can read the file and tell the user what is wrong. I don't need to learn a new scripting language for that.
And if you config file gets too big I want to use a real programming language to create it anyway. Plus source control.
The fact Go is considered as the first 4, shows Go is going places🔥
7:52 - The Zip Code rule will break in the UK, were our equivalent, postcodes are a string in three sections. The first section is one or two letters, represinting the main postcode region, the next is the postcode district, which is 1 or 2 numbers, or a number followed by a letter. Then there is a space, then a number and two letters.
well, of course a rule targeting US postal codes will break when given something that is not a US postal code
Awesome, finally I can write my Ansible configs in a sane way. Not the full config, but what I define in my Inventory.
Most known Apple's OSS projects are CUPS (printing system) and Webkit (browser engine).
But it looks like they handed over the development of original CUPS to openprinting and now only focus on "Apple CUPS".
Apple reinventing Nix was unexpected to say the least.
Did I miss a way to fix iterating over and parsing arrays and/or objects and mixes of the two? JavaScript's nested for loops or for ins or Lodash etc.. to get properties and values is stupid. Did I miss where Pkl fixes this? The casting of obj/array just to iterate and put in the correct order and other things? Thanks for the video nonetheless.
A few years ago Apple introduced a conditional and declarative configuration mobile device management model to set conditional parameters to be set on the iOS, MacOS operating systems. This seems like the underlying programming framework is pKL.
Does it support references/pointers from one variable to another? It would make so many past JSONS of mine so much cleaner. For example: if I have a file that outlines the theme of a custom code editor and I want to have an easy to edit color scheme, I have to change each occurrence of a color in a JSON file but if I could reference variables I could put the color scheme at the top and make all uses references so it can easily be modified.
Sad that they don't have out of the box dotnet support. Just raised an issue about that.
2:01 I wish Rust had built-in syntax for that. Ranged Ints are cool and all, but it should be built-in for any lang like Rust
So they reinvented Dhall? Looks significantly prettier and more usable though.
I went over the source code of Pkl and although it support non-string keys in mappings (i.e. more like msgpack than JSON), it looks like very much it only support a subset of YAML 1.1. Since the YAML 1.2 has been out since 2009, that might have to do with the state of YAML parsers/dumpers in the Java/Kotlin, world and not necessarily a conscious choice by the developers. That unfortunately makes it only a potential replacement for a subset of YAML supporting applications, and also not a potential replacement for Python's pickle format.
It should be noted and remembered that there is absolutely nothing special about any kind of data file, whether it be a real config file (globals and sections), an XML config file, a JSON file, a '90's database and multi table file like Dungeon Keeper has, or any other plain text data file that we can write.
They all originally had programs that parsed them and used the data values how they needed. Like Dungeon Keeper using the multiple relatable text data tables, which I have made a Console editor for.
I very recently made my own C# parser and writer for JSON data which works perfectly and is very strict on there being no errors in the text. So now I have a no-hassle way of using JSON data from a file. I could use it for app config and even game data which would allow the game to be modded.
Yet long before that I made the same deal with XML, with better functionality in C#, and long before that I made the same deal with real config.
I even once made a data reader that turns the first words into column names and all the next words into entry names and auto make a text table like the Dungeon Keeper ones, even with initial values.
It is so easy to make custom ways to read data text files. You just need to make the app that parses the data into the runtime data, like objects etc., that it needs.
This is all very fun stuff, but don't be sucked in with the hype. We can all do this.
"Interesting" you say.
I now have a bunch of new ideas to create in C#.
Let's tell the truth, though.
This is yet again not an actual programming language.-It doesn't result in executed binary. It's only analysed during parse.
This happens to be a manifest language, just like the text data is that you write in a file for creating the Windows Cabinet (v2) file.
I'm all in for built-in declarative validation rules, but built-in programming will make it hard to maintain readability (you don't know the result until the file is executed / compiled). Still will give it a go, though
apple and open source in the same sentence is funny af
Is there a specific software that records Arc pages in such a way (rounded edges, link in the middle-top, square camera feed)? Seen it a few times
So they essentially made protobuf for config files
It's wild to me that this apple project has literally zero mentions of Xcode.
Interesting that it can export as Plist. I'd love to see them ditch that bastardized hack of a config format. And the fact that they have LSP support coming, and no Xcode integration, makes me hope that Apple is ditching all of that codebase and they're laying the foundation (heh) for the next thing.
The thing that makes me wonder, is why this didn't launch at WWDC.
plists are absolutely everywhere in OSX, so i don't think Apple will be replacing them, especially considering they just made a tool to generate them automatically, hopefully meaning you won't have to interact with plists directly ever again.
That’s really interesting, thanks for doing a video on this.
This feels like a great format for openapi honestly. It's easy to generate clients for APIs if you share the pkl files
json with extra step????
Yup. At least it doesn't have JSON schemas. That's an upgrade!
So, they created Cascading Configuration Language; they should have named it CCL.
Given how maintainable the seemed-like-a-good-idea-at-the-time CSS turned out to be, I am not so sure that we should consider them creating a cascading configuration language to be a good thing... 🤷♂️
#jmtcw
A solution in search of a problem...that doesn't exist. We REALLY need to snap out of this mindset where everything needs to have a framework, transpiler, linter, build tool etc. JSON, YAML et al is super simple already. There is no need for introducing an intermediary format to "compile" it to JSON or YAML. It just ads complexity without any benefit. It's not like you can make one PKL config and then move it around between different applications, since those applications would have different config options and naming conventions.
Okay. Will it beat XML in functionality, at least in something?
Nope. This is the last thing the industry needs. Sensible consumers avoid their overpriced products, and they should also never touch an apple technology that tries to get into our workflow. "FOSS" or not.
No more corporate closed source proprietary. Snap out of it people, development isn't fashion.
So they recreated DHALL?
Til now I’ve just used URLs for configuration, this looks like the first replacement which actually adds useful functionality beyond that.
So, basically it's embedded python with "export data" wrapping over modules?
Cool, if that should become available for PHP I will use this straight away. Thanks for sharing.
this is a great tool that solves something that is not big of a deal... i'll use it too.
Nice that someone solved it and shared as open source.
If they keep extending it this way, they'll eventually end up with full blown JavaScript.
so your telling me my work who uses cucumber and gherkin for testing now needs to also use pkl instead of json?
It's like what CMAKE is to Make (and other build systems).
A meta-configuration language/syntax to generate/validate configuration files
I've been using Dhall for the last 5 or 6 years, I honestly think the only reason it hasn't caught on is it came from a functional programming background.
Did they name it pickle to annoy python developers? And maybe enough to move them to swift?
JetBrains editors already have a decent understanding of common config files. package.json for example has the autocomplete that's shown here (it will even do lookups for dependency versions). next.config.js has this too.
But I understand the value of codifying this into something common.
How does pkl solve validation? If you write the checking condition into the config file, someone can just change the condition together with changing the config. It has to be validated in the application itself. So you could just use JSON Schema to validate a JSON config and that would work better, as the config itself is smaller and you don't have to implement validation twice and it's already supported by IDEs. I can imagine it for infrastructure as code but for example Terraform already has a language for it, called HCL. Maybe pkl is better than HCL. It looks to me not like a replacement for JSON but a programming language to generate JSON. Similar to CDKTF, where you write for example TypeScript code to generate a JSON to execute with Terraform. There Pkl could help.