Apache Wayang is the API of AI, cross-platform data processing to train large models. Star / fork us on GitHub: https://xitter.cf/t.co/pZY15teRwb
Joined April 2021
- Tweets77
- Following28
- Followers92
- Likes72
Apache Wayang isn’t just limited to FedML and Data Federation; it also enhances our taste and lifestyle. Solving real world data science problems!
youtube.com/watch?v=4f24QSaj…
Apache Wayang retweeted
@apachewayang 1.0.0 build successful! The backbone for AI, decentralized data processing to access data in silos a dev can't reach typically.
Apache Wayang retweeted
@apachewayang v. 1.0.0 successfully compiled. The backbone for ASI / AGI infrastructure, devs can now reach data which is typically not in reach, like protected silos, and execute processing at the source, in-situ. FedAI is coming soon!
ALT mvn clean install screenshot
LLM's struggle to show their business benefit. Why? Data access. AI needs the right data, in a suitable format at the right time. Read how @apachewayang helps to solve that: wayang.apache.org/blog/wayan…
Our newest blogpost, written by Wayang developer Juri Petersen, explains how python works with Apache Wayang, and how we enable JSON conform UDF within a wayangPlan. #data #opensource #apachewayang
wayang.apache.org/blog/wayan…
Read part 1 of the blog series, written by Dr. Mirko Kämpf from ecolytiq, about implementing a cross-organization decentralized data processing scenario. #apachewayang #kafka #data
wayang.apache.org/blog/kafka…
EarthObservation / ESA / Copernicus: AGORA plugin (Apache Wayang): meetingorganizer.copernicus.…
We updated our website -> wayang.apache.org <-. More documentation, much more easier to contribute and add PRs.
Apache Wayang now enables AI/ML training and inference in Spark for federated learning at the enterprise level. The team just merged PR388: github.com/apache/incubator-…
We merged 380: #380 Added a new plugin to support different jdbc platforms and multiple instances of same DBMS. Wayang now adds support for multiple spark and jdbc context in one wayangPlan().
github.com/apache/incubator-…
ML4ALL implementation merged, it's the code to our reseach paper, now merged and fully operable.
github.com/apache/incubator-…
Now you can run kmeans natively on sparkML! This improvement speeds ML operations massively up. Additionally, with wayang you can have multiple _different_ spark version in one plan, that makes wayang really powerful for cross-spark ML.
github.com/apache/incubator-…
Apache Wayang: A Unified Data Analytics Framework - research paper now released with Sigmod Record => sigmodrecord.org/publication…
Wayang AgoraEO Plugin: The Framework for Scalable EO Workflows
"We recently proposed AgoraEO, a decentralized, open, and unified ecosystem, where users can find EO elements, compose cross-platform EO pipelines, and execute them efficiently.
ui.adsabs.harvard.edu/abs/20…
Apache Wayang retweeted
#CommunityOverCode NA, our flagship event, is only TWO MONTHS away! Join us in Halifax 🇨🇦 for four days of sessions, with tracks focusing on Search, Big Data, Streaming, IoT, Community, Fintech, and more.
🎟️ Register now! bit.ly/3D9fKK7
Apache Wayang retweeted
#DynamicPartitioning in Apache Doris
It means to automatically create and delete data partitions based on the user-specified rules. You can enable it upon data creation and specify the partition TTL (time to live) in the statement.
#database #DataScience #Analytics #SQL
Apache Wayang retweeted
Apache Wayang enables cross platform data processing, star it via: github.com/apache/incubator-… #dataprocessing #bigdata #analytics #hybridcloud #developers via @apachewayang
Wayang can now support simple and basic SPJ queries for decoupled JDBC sources and CSV data sources.
github.com/apache/incubator-…
Apache Wayang retweeted
Since the latest JDK21ea supports virtual threads as standard (not preview), I updated the Groovy/GPars meets virtual threads blog post:
groovy.apache.org/blog/gpars…
Why not give it a try!
#groovylang @ApacheGroovy @mittie @vaclav_pech
ALT GPars logo