Need support or guidance? Reach out to @cwensel https://xitter.cf/t.co/5YnPV67z39
Joined November 2010
- Tweets778
- Following10
- Followers1.5K
- Likes7
Pinned Tweet
It looks like the conjars.org Maven repo was shutdown by its owners.
If you are having build failures, DM @cwensel for options to get back up.
Cascading 4.5.2 is out!
github.com/cwensel/cascading
central.sonatype.com/artifac…
Cascading retweeted
Do you miss meetups of the Big Data era, when you could learn about RAFT protocol or map-side join over pizza and beer? Us too! My friend @cwensel has launched SF Distributed Systems Meetup.
First meetup is next week, with talks by me and @conor_power23 lu.ma/t6r4mi4v
If your company is still running Cascading+HadoopMR applications and are itching to drop MR for Spark, dm me.
Some companies have 100s of @Cascading apps in production and moving them off MR in a couple lines of code would be a huge cost savings.
Also true for @scalding.
Cascading retweeted
I always suspected that Parquet and Orc weren't very good, but TIL from @ViktorLeis that one can do much much better with BtrBlocks. cs.cit.tum.de/fileadmin/w00c…
Cascading retweeted
Cascading 4.5.1 was just released to Maven Central.
buff.ly/3YgQHyh
This release includes minor bug fixes and dependency updates.
buff.ly/45qUnAf
Cascading retweeted
Before I worked at Hortonworks putting Calcite in Hive, I worked on Lingual, a SQL interface to @cascading. That was the first commercial use of Calcite (then called Optiq) and some much needed consulting $$
Cascading retweeted
I'm hanging my shingle out again.
I have some new insights I want time to work out into a developer tool for cloud data engineers, but I want to bootstrap it with contract/consulting revenue.
This is how I started @Cascading in 2007.
chris.wensel.net
Please boost!
Cascading retweeted
Scala folks: if there are open source GitHub Twitter libraries you like, you might want to make a clone/fork now. Seems like we are in a situation where anything can happen. – at Paia, HI
Cascading retweeted
really interested in adding mergeable summary as a datatype to @cascading. think having daily/hourly aggregate tables, then daily/hourly performing a last N day/hour aggregation against the partials. cost efficient way to have rolling percentiles/aggregates
Cascading 4.5 is out!
With native @ApacheParquet, @ApacheKafka, @neo4j, and @splunk support.
- cascading.wensel.net
- github.com/cwensel/cascading…
- groups.google.com/g/cascadin…
Cascading retweeted
cross your fingers, we might have a @cascading 4.1 release tonight, and a quick 4.5 release a day later w/ Hadoop 3 support. Both will include native @ApacheParquet support to replace the support dropped by Parquet. Plus some well worn enhanced Parquet support in 4.6
Cascading retweeted
For fun I really want to fork the @cascading local mode planner to support RocksDB as the backend for joins instead of the memory only hashmaps. Local mode was never intended to scale in joins.
Cascading 4.1 is out!
With native @ApacheParquet, @ApacheKafka, @neo4j, and @splunk support.
- github.com/cwensel/cascading…
- groups.google.com/g/cascadin…
Cascading retweeted
finally @cascading has Apache Hadoop 3 (and Tez 0.10) support thanks to the team at @Foursquare Labs! github.com/cwensel/cascading…
Cascading retweeted
Google gs connector does do aligned block reads...both that and this one work well for backwards seeks (footers, stripe footers -> stripes)
/2
Cascading retweeted
Improving efficiency and reducing runtime using S3 read optimization by @PinterestEng link.medium.com/KGRST76OBjb << do you have a link to the git repo?
The cascading-local repo has been merged into Cascading 4.1 providing direct support for Kafka, Splunk, S3, and Neo4j github.com/cwensel/cascading…