The little UI details...
Also, we're working on bringing an "inspector" view to the Zui detail pane in the right sidebar, much like the "inspector" view in the main results, but for only the selected value. Stay tuned.
Love this quote from a happy zq user! We expect Zed is going change some norms in the data world.
#DataEngineering #DataScience
We are now creating Apple silicon builds for Zui.
We previously only built for Intel and relied on Rosetta to run on the “M” chips. If you are on a newer Mac, you’ll enjoy a performance boost thanks to our friends in Cupertino.
You can find your platform on our download page.
Red squiggly lines!
The Zui app can now detect errors in the query and mark them up within the query editor as you’re writing. It can underline your semantic errors in addition to syntax problems.
Thanks to @MattNib for the /query/describe endpoint.
#datascience #dataviz
Fresh off the build servers!
A new Zed and Zui release.
Here are the best parts:
1. Inline Editor Errors
2. Apple Silicon Support
3. Redesigned Settings
4. JSON Pretty Print CLI Option
Read the details on the Brim Data Blog: brimdata.io/blog/june-2024-r…
Brim Data retweeted
Turns out you can build a high performance, vectorized query engine (development underway) where data self-organizes around its types instead of externally defined schemas. We call this super-structured data. zed.brimdata.io/docs/formats
Zui got a big upgrade to the "export results" workflow.
You can now export the results of a query to a new pool, an existing pool , or even your clipboard's paste buffer!
Full release notes here:
github.com/brimdata/zui/rele…
And as for Zed, we've got language improvements. like nameof() supporting type values and
better scoping in user-defined operators.
The buffer size for "line" input also got bumped up to 25MB.
Full release notes here: github.com/brimdata/zed/rele…
It's a release day! We've got fresh versions of Zed and Zui up at brimdata.io/download
Zui 1.7
Zed 1.15
Data has been incredibly easy to load into Zui, now it's just as easy to export it.
Our latest Zui Insiders build includes the option to export the results of a query into a new or existing pool.
Export to Pool Demo
The whole point of schemas and tables is to have data type certainty. As soon as you put data in a JSON column however, all certainty is lost.
There is even an entirely different query language within SQL you must use to interact with the JSON columns.
If your foundation is built on table schemas, it begins to crack under the weight of complex types like arrays and objects.
With a system like Zed which supports first-class types for primitive and nested data, type certainty returns. Schemas become simple policies determining if data is of a given type, not gatekeepers of saving bytes to disk.
With Zed, the types allow for schemas rather than schemas allowing for types. What an exciting world to work in!
Here we explore an entire day of public #GitHub activity about (2GB compressed) with Zui and Zed's fuse() aggregator.
With a 4 word query, we can see the "schema" for each GitHub event type.
Zed is a powerful tool for exploring unfamiliar datasets.
The zed language now has the "grok()" function.
Use it to turn lines of text into structured records.
Here's a syslog example:
Network security users! The latest Zui (v1.6.0) is now bundling Zeek v6.0.3. Get several more event types from your loaded pcaps and support for more link layer protocols.
Loading data into Zui is pretty much as easy as it gets. Drop or paste a file, preview, load.
Now we're making it just as easy to get data out.
We will soon be adding a "Copy to Clipboard" button when exporting results. Check it out 🍿
Very cool to see Zed featured on @getmaterialized !
🏗️ With Zed's new super-structured data model, messy JSON data can easily be given the fully-typed precision of relational tables without giving up JSON's uncanny ability to represent eclectic data.
github.com/brimdata/zed
Data is consumed by two things:
1) humans
2) computers
Each need their own format.
Zed provides the ZSON format for human eyes and binary ZNG for the machines.
You can easily move between the two because they're based on the same underlying data model.
Brim Data retweeted
Replying to @Ubunta
The Zed data model has a user-friendly variant ZSON and fast machine friendly variant ZNG all based on the same underlying data model zed.brimdata.io/docs/next/fo…









