Schemas and Protocol Usage of JSON Lines

[adligo]

Hi All,

Now that you've done JSON Lines, what about Schemas?
https://json-schema.org/

Are you all interacting with the JSON Schema community?

Also, what about mixed formats, and also using JSON lines for buffering/streaming?

["someJsonLines"]
<binary | xml | json | csv  | yaml | etc />
["?otherJsonLines"]

Is anyone interested in collaborating on something, or is there something already in progress?

Why I asked;

I've been working on some protocols on and off over the years ... initially;
https://datatracker.ietf.org/doc/draft-adligo-hybi-asbp/

Then this;
https://github.com/adligo/cmn.adligo.org

Then, more recently, discussing here;
https://discord.gg/GkNNRTt7Ap

I was looking to create an HTTP-like header, i.e.

cmd=getSomeData;
size=45!
<binary | xml | json | csv | yaml | etc />

However, now I'm thinking JSON lines in some form might be the path of least resistance.

If JSON Lines ends up in one of my RFCs or Libraries, are you interested in a contribution to this project?

Cheers,
Scott

[wardi]

Always happy to link to users of JSON lines from this site.

If you're looking for something to encapsulate binary formats another binary format (gRPC, tar etc.) would surely be better though, right?

[adligo]

Well, gRPC (Remote Procedure Call) is a framework for request-response APIs that is built on top of Google Protocol Buffers, and tar is a indexing format. I want to abstract the data encoding/notation away from the usage, and then build in a utility first manner on top of the data encoding/notation. In other words, I'm looking to separate concerns. ... I'm looking to allow swappable serialization formats, including Google Protocol Buffers, allowing a swappable notation including JSON, XML, JSON lines, Google Protocol Buffer, and other serialization methods.

[adligo]

Also, to cross-post;
json-schema-org/website#2336

[adligo]

Hi All,

I just wanted to comment that I worked through a rough draft of a wrapper way to add a Schema to JSON Lines. I'm wondering what you all think of it;

https://github.com/adligo/ejcn_schemas.adligo.org/blob/main/example.ejcns

https://github.com/adligo/ejcn_schemas.adligo.org

https://github.com/adligo/ejcn.adligo.org

TIA,
Scott

[y377]

hi! look this To consume Codex output in scripts, use JSON Lines output:

I hope this is helpful! You can refer to how OpenAI performs the conversion.