FLaNK-AIM: 13 May 2024

Apache NiFi, Apache Kafka, Apache Flink, FLaNK-AIM, Open Source, Milvus, Unstructured Data processing, Apache Iceberg

https://medium.com/@tspann/flank-aim-13-may-2024-15ff0d052f6d

apache nifi, apache kafka, apache flink, flank-aim, open source, milvus, unstructured data processing

https://www.youtube.com/@FLaNK-Stack

FLaNK / KNIFe AI / FLaNK-AIM Weekly

Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

http://www.meetup.com/futureofdata-princeton/

https://www.meetup.com/futureofdata-newyork/

https://www.meetup.com/futureofdata-philadelphia/

This is Issue #137

https://github.com/tspannhw/FLiPStackWeekly

https://www.cloudera.com/solutions/dim-developer.html

Articles

Boston, Where’s My Bus? LLM + Streaming to the Rescue

Apache NiFi, MBTA, Real-Time Transit, Kafka, Postgresql, Flink, Flink SQL, KNiFe AI, FLaNK AI, Python, GTFS, GTFS-RT…

medium.com

Small Language Models (SML) for the Win

I don’t need a model that knows a little bit about a lot of things up to last year. I need a model that knows…

medium.com

Maybe Four Smaller Open “LLM”s are Better Than One?

Let’s run four at once with Apache NiFi. Why not?

medium.com

Building a Milvus Connector For NiFi

Apache NiFi, Python, Milvus, Zilliz, Cloudera, Vector Database

medium.com

Searching Slack from Apache NiFi

Open Source Slack Search Engine Integration

medium.com

Milvus Supports Imports of Apache Parquet Files for Enhanced Data Processing Efficiency

By embracing Apache Parquet, users can streamline their data import processes and enjoy substantial storage and…

milvus.io

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.26.0

https://www.cloudera.com/about/news-and-blogs/press-releases/2024-05-07-cloudera-announces-data-in-motion-products-will-be-made-available-as-kubernetes-operators-for-red-hat-openshift.html

https://www.jetson-ai-lab.com/research.html#meeting-schedule

https://jack-vanlightly.com/blog/2024/5/7/learning-and-reviewing-system-internals-tactics-and-psychology

https://blog.min.io/the-future-of-ai-is-open-source/

https://dagshub.com/blog/common-pitfalls-to-avoid-when-using-vector-databases/

https://medium.com/@adam.bellemare/preventing-and-fixing-bad-data-in-event-streams-part-1-27bf2a99b48e

https://www.linkedin.com/pulse/milvus-community-newsletter-beginner-rag-guides-learn-ok3bc/

https://spring.io/blog/2024/05/09/spring-ai-structured-output

https://openai.com/index/instruction-following/

https://blog.miguelgrinberg.com/post/how-llms-work-explained-without-math

https://www.dell.com/en-uk/blog/the-rise-of-the-small-language-models-slms/

Netflix Data Tech Stack

Videos

Generative AI with Milvus

Four Models at Once

Slides

Generative AI on Enterprise Cloud with NiFi and Milvus

Generative AI on Enterprise Cloud with NiFi and Milvus - Download as a PDF or view online for free

www.slideshare.net

Events

May 30, 2024: Conf42: Machine learning

Enriching Generative AI as Events in Real-Time Streaming Pipelines | Conf42

Let's build streaming pipelines that convert streaming events into prompts and call LLMs and process the results.

www.conf42.com

June 12, 2024: Budapest Data + ML Forum. Virtual.

Speakers - Budapest ML Forum 2024

Our Data Science and ML speakers English talks Przemyslaw BiecekAssociate ProfessorWarsaw University of…

budapestml.hu

June 20, 2024: AI Camp Meetup. NYC.

Sept 24, 2024: JConf.Dev. Dallas.

https://2024.jconf.dev/session/598816

Nov 5–7, 10–12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

Nov 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

Cloudera Events https://www.cloudera.com/about/events.html

https://www.cloudera.com/events/cloudera-now-cdp.html?internal_keyplay=ALL&internal_campaign=FY25-Q1-AMER-WS-Cloudera-Now-Events-Page-P06&cid=701Hr000000tW6qIAE&internal_link=p06

More Events: https://www.linkedin.com/pulse/schedule-2024-tim-spann--y4coe

Code

• https://github.com/tspannhw/FLaNK-python-processors

• https://github.com/tspannhw/FLANKAI-Boston

• https://github.com/tspannhw/FLaNK-IrelandTransit

Models

• https://github.com/ollama/ollama/releases/tag/v0.1.33-rc5

• https://github.com/NVlabs/RADIO

Tools

• https://github.com/judahpaul16/gpt-home

• https://github.com/teachingai/spring-ai-examples

https://opea.dev/

• https://github.com/FalkorDB/FalkorDB

• https://github.com/NielsRogge/Transformers-Tutorials/blob/master/Idefics2/Fine_tune_Idefics2_for_JSON_extraction_use_cases_(PyTorch_Lightning).ipynb

• https://github.com/strapi/strapi

• https://github.com/traceloop/openllmetry

• https://research.ibm.com/blog/granite-code-models-open-source

• https://github.com/instructlab

• https://hurl.dev/docs/installation.html

https://devenv.sh/

https://gulpjs.com/

• https://github.com/context-labs/mactop

https://dokploy.com/

• https://github.com/NimbleMarkets/ntcharts

• https://github.com/abi/secret-llama

• https://github.com/wandb/openui

• https://huggingface.co/spaces/chencws/stable-text-to-motion-framework/tree/main

• https://github.com/sato-team/Stable-Text-to-Motion-Framework

• https://github.com/IST-DASLab/PanzaMail

• https://github.com/huggingface/lerobot

• https://github.com/run-llama/llama_parse

• https://github.com/Efficient-Large-Model/VILA

• https://github.com/google-research/timesfm

• https://github.com/hugeicons/hugeicons-react

• https://github.com/galliumdata/adumbra

• https://bytewax.io/blog/stream-processing-using-python-on-a-raspberry-pi

• https://github.com/AdityaNG/kan-gpt

• https://github.com/meetbryce/open-source-slack-ai

• https://github.com/google-research/timesfm

• https://pyspread.gitlab.io/

• https://github.com/Upsonic/Tiger

• https://github.com/MHNightCat/superfile

• https://github.com/IceWhaleTech/CasaOS

• https://github.com/travisdoor/tine

• https://github.com/NickCulbertson/Teensy-Arcade-Synth

Cool Tool

• https://github.com/cloudera/CML_AMP_Deploy-Mistral7B-CML-Native-Model

New

https://ai.meta.com/blog/raft-llama-retrieval-augmented-generation-supervised-fine-tuning-microsoft/

© 2020–2024 Tim Spann https://www.youtube.com/@FLaNK-Stack FLaNK-AIM with LLAMA 3