CIQ’s Post

Boost data processing performance up to 13x. Join us on January 28 to learn how seamless GPU acceleration can help organizations tackle complex data challenges quickly and efficiently. ➡️ https://nvda.ws/3E4PYdv Don't miss the demo and live Q&A with the experts. #DataScience

I got some time today to explore some of the new features of HighByte Intelligence Hub 4.0 beta. Really liking the name space and smart query features. Using the existing models from my migrated 3.4 application it was super easy to build out a new UNS using name space and smart query. With 3.4 I had built the topic structure/hierarchy into the models but now with name space I can remove these fields simplifying the models. Using smart query, the whole or parts of name space can be published to the MQTT broker using a single pipe line. #HighByte #UNS #MQTT #datatransformation #dataops

One thing’s for sure, the joy of data engineering isn’t in data clean up and structuring. Make your 2025 goal to spend more time building, analyzing, and delivering. Check out our How it Works page for a quick overview and some example workflow videos. Level up with modern tooling: https://lnkd.in/gzZM4VtN

Most awaited features of delta lake are finally here! Among these features , what excites me is liquid clustering takes center stage, promising a dynamic and efficient approach to data organization. Another one Hudi write support. This marks significant leap in data management capabilities.

Pure Storage provides the foundation for real time analytics as economically as possible

cuML just improved UMAP's performance 3x... err, 30x. Wait, 300x over the existing GPU implementation??! And can now support datasets larger than the available GPU memory?!? This is insane talk. You should definitely check out this blog.

In the last months, our #DAT4Zero consortium has been working hard to deliver #innovative solutions to #digitally enhance #quality in challenging sectors. Check out some of the pilots at the link below! One of the solutions by Dipartimento di Meccanica - Politecnico di Milano focuses on the #CyberPhysicalSystem to support the #extrusion #operators in ENKI srl to reduce #scraps and improve #quality. #Physics-inspired models of the characteristics of the #microtubes and #extrusion process have been synthetized with #datadriven techniques to provide adaptable #control actions. Team: Ozan Emre Demir, Maria Chiara M., marcello colledani https://lnkd.in/dEsU5sTv

Building on the features released in Delta Lake 3.0 and 3.1, Delta Lake 3.2 introduces a host of performance enhancements and optimizations! In our latest blog post, we highlight the following improvements: ✅ Liquid clustering: A more performant, flexible table layout ✅ Hudi write support in UniForm: Expansion of the popular UniForm feature to Hudi ✅ Type widening: An easier way to handle schema updates when data changes ✅ Vacuum inventory support: Faster VACUUM operations for large tables ✅ Delta Kernel updates: Time travel support, metadata read improvements, additional protocol support for the connector ecosystem and preview version of APIs to create and append data to Delta tables. 🔗 Learn more: https://lnkd.in/ewuXNFgw #opensource #oss #linuxfoundation #deltalake

📣 See you at #RSAC, where our co-founder, Tyler, will be featured at DarkOwl's booth (#4604) to discuss why Threat Intel. companies need the ability to rapidly integrate online sources to stay competitive, and showcase how signal to noise ratios can be improved with enrichments like location inference. Want to meet 1:1 with to chat about data pipelines for your product? Reach out through the event app to schedule a time! 📍Where: Booth 4604, May 8, 1:30 - 3:30 PM 💻 Technical Demo: Watch a live demo of how online data sources can be rapidly procured, standardized, and enriched through a drag & drop interface. ❓Q&A: Does your solution monitor sources like Dark Web, News, or Social Media? We're happy to answer questions about how our platform helps you reduce noise from these sources and liberates your engineers from data plumbing. 🔄 Integration Partner: Learn how Datastreamer serves as DarkOwl's integration partner to help data teams cut through delayed implementation roadmaps with pre-built connectors that take minutes to set up.

#NewInRelease24! This new #JDEdwards feature enhances #Orchestrator notifications, allowing you to create a table from a data set in an orchestration message: https://bit.ly/3VZqQvi