Did it happen to you that you found yourself digging inside Spark sources and output of "show" on @ApacheSpark dataframes? No more need for it if you use @ApacheZeppelin and the Big Dat Tools plugin! #ztools to the rescue!

.@awscloud EMR is very powerful. It provides us with many tools. But sometimes, it can be challenging to access certain services – for example, Zeppelin or Ganglia. To do this, you need to build an SSH tunnel to each one… Big Data Tools plugin solves this issue!

Do you have a lot of topics in your @apachekafka? We too! So now there is a way to quickly filter topics in #kafka producers/consumers!

There are plenty of connection properties in @apachekafka and sometimes it's not that easy to memorize them all. That's why we have properties autocompletion in the Connection Settings dialog for Kafka.

Do you know one of the missing features in usual cloud storage clients? They are not like Krusader/Total Commander: they don't have 2 panels! Well, we in Big Data Tools fix it! This feature and many more in our new file viewer

Struggling to create a boilerplate project with @ApacheSpark? It's easy and simple with help of the Big Data Tools plugin! jetbrains.com/help/idea/big-… As always, you can grab a plugin at jb.gg/bdt

Working with local @ApacheZeppelin notebooks is not only possible, but also easily achievable with @BigDataToolsJB youtu.be/oyHkjQuGujM

Ever wondered how to optimize Spark job performance? Watch this: youtube.com/watch?v=daXEp4Hm… #spark #performance #video

#tip If you have import which is mark unused, but you know it should not be deleted — there is special action for this!

If you try to update to the latest @PyCharm 2020.3.3 and install the Big Data Tools plugin, the IDE might ask you to install the JavaFX plugin. We strongly recommend installing it because it provides an extended version of WebView that we use in the Big Data Tools UI.

Do you have a secure installation of Zeppelin or Spark/Hadoop Monitoring? Do you want to access it without using obscure SSH console commands to create tunnels? Now is the perfect time to try the Big Data Tools plugin. Just a few clicks, and you’re connected.

The Big Data Tools plugin for @IntelliJIDEA Ultimate, @PyCharm Professional, and @DataGrip allows you to open popular data engineering file formats (CSV, AVRO, Parquet, and ORC) without ever having to leave your favorite IDE.

The Big Data Tools plugin for @IntelliJIDEA Ultimate, @PyCharm Professional, and @DataGrip allows you to copy files between cloud filesystems (Amazon @AWSCloud S3, Microsoft @Azure Files, @GoogleCloud File Storage, and more) without ever having to leave your favorite IDE.

The Big Data Tools plugin for @IntelliJIDEA Ultimate, @PyCharm Professional, and @DataGrip allows you to connect and browse cloud filesystems (Amazon @AWSCloud S3, Microsoft @Azure Files, @GoogleCloud File Storage, and more) without ever having to leave your favorite IDE.

Big Data Tools EAP 10: Overview (Video) youtube.com/watch?v=x0vsLmN4…

There is also a new tool window called “Variables” that lets you see all the local variables for the current session and introspect their values. 12/13

This also works for dataframes when you invoke code completion in Spark’s Scala code. 11/13

If you work with Spark SQL code, Big Data Tools will provide you with the exact names of columns in code completion suggestions, and will check that the names of the columns do not contain any errors. 10/13

Here’s one more thing that can help make working with Zeppelin notebooks a lot more enjoyable – ZTools. 8/13

With this update, you can now also work with Avro and ORC files, which can be stored either locally or in a distributed file storage system. 6/13