Big stuff

• Added support for streaming LLMs.
• Upgraded to PyTorch 2.1

Changelog

• add list item to take color, small refactors by @chillenberger in #1126
• Updated according to qa by @SilasMarvin in #1127
• Added TransformerPipeline by @SilasMarvin in #1128
• Added decent questions to the chatbot by @SilasMarvin in #1129
• Updated endpoint by @SilasMarvin in #1130
• Dont show embedding projects, yet by @levkk in #1132
• update plan to pricing url by @chillenberger in #1133
• Small updates and fixes to tests and the transformer pipeline by @SilasMarvin in #1136
• Fix type for transformer pipeline for js by @SilasMarvin in #1137
• Dan marketing nav rebuild by @chillenberger in #1138
• spell check by @chillenberger in #1139
• Update template.html by @chillenberger in #1140
• small screen top nav background contrast by @chillenberger in #1141
• Invalid forms style by @levkk in #1143
• add company to nav by @chillenberger in #1144
• Dan new footer by @chillenberger in #1148
• add reindex to syntax highlight by @chillenberger in #1149
• Add streaming by @SilasMarvin in #1145
• Updated to support streaming by @SilasMarvin in #1151
• Migration for 2.8.0 by @levkk in #1152
• Move PythonIterator into its own function by @levkk in #1156
• pgml-components watch by @levkk in #1157
• make TransformStreamIterator::new pub by @kczimm in #1162
• Update extension for cloud streaming use by @SilasMarvin in #1163
• Added support for llama and mistral GPTQ models by @SilasMarvin in #1164
• Made transformers_pipeline public by @SilasMarvin in #1166
• Added peft by @SilasMarvin in #1167
• Bust CI cache to fix version mismatch by @levkk in #1170
• Upgrade to Rocket 0.5 by @levkk in #1171
• Revert "Upgrade to Rocket 0.5" by @levkk in #1177
• items for contact page update by @chillenberger in #1178
• Dont reload on HTML/Rust changes by @levkk in #1179
• Fix warnings by @levkk in #1180
• Added pyarrow==11.0.0 to requirements to solve postgres segfault by @ns1000 in #1182
• make DROPs safer by default by @montanalow in #1184
• Revert "make DROPs safer by default" by @montanalow in #1185
• add careers by @montanalow in #1176
• Fix clippy lints by @kczimm in #1188
• Add prettier by @levkk in #1189
• fix warnings by @montanalow in #1193
• Montana/norly by @montanalow in #1194
• more env by @montanalow in #1195
• Fix Gitbook relative links by @levkk in #1196
• Dan notification banner by @chillenberger in #1197
• prevent warnings by @chillenberger in #1198
• add formerly twitter in footer by @chillenberger in #1204
• Dan resize site by @chillenberger in #1207
• Added OpenSourceAI and conversational support in the extension by @SilasMarvin in #1206
• General clean ups by @SilasMarvin in #1208
• fix breadcrumb, nav, bug by @chillenberger in #1209
• Working streaming tokenizer by @SilasMarvin in #1210
• Python & JavaScript CLI by @levkk in #1201
• bump sdk for dashboard by @montanalow in #1211
• handle nav sections, badly by @montanalow in #1212
• rust by default by @montanalow in #1213
• use CLI by @montanalow in #1214
• Readme: Fix docs link to quick start with Docker by @spinscale in #1216
• Updated the social share for open source ai by @SilasMarvin in #1217
• fixing bugs by @chillenberger in #1218
• Added correct timeout by @SilasMarvin in #1219
• For max tokens using max new tokens instead of max_length by @santiatpml in #1220
• Updated to use parking_lot and cleaned up tests by @SilasMarvin in #1221
• Bumped version by @SilasMarvin in #1222
• Dan alert notification update by @chillenberger in #1223
• quick fix to sdk to fix warnings by @chillenberger in #1224
• add the link by @chillenberger in #1225
• update pgrx by @montanalow in #1229
• rocket macros use deprecated lints by @montanalow in #1230
• gitbook page link cleanup by @montanalow in #1231
• trim warnings by @montanalow in #1232
• Dan fix head by @chillenberger in #1233
• make sortable available to notebooks by @chillenberger in #1234
• Dan inter file name change by @chillenberger in #1235
• freeze all requirements and document the project requirements by @montanalow in #1236
• update Cargo.lock by @montanalow in #1237
• pgml chat opensourceai by @santiatpml in #1238
• Working simple python thread metrics by @SilasMarvin in #1239
• add missing linux requirements by @montanalow in #1240
• Dont crash watch on error by @levkk in #1241
• Skip decoding special tokens by @SilasMarvin in #1244
• Added filename and modulename by @SilasMarvin in #1245
• freeze all dependencies based on platform by @montanalow in #1246

New Contributors

• @ns1000 made their first contribution in #1182
• @spinscale made their first contribution in #1216

Full Changelog: v2.7.13...v2.8.1