Skip to content

pgml.embed trust_remote_code #1169

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kczimm opened this issue Nov 17, 2023 · 3 comments · Fixed by #1555
Closed

pgml.embed trust_remote_code #1169

kczimm opened this issue Nov 17, 2023 · 3 comments · Fixed by #1555

Comments

@kczimm
Copy link
Contributor

kczimm commented Nov 17, 2023

A user on Discord submitted the following query with subsequent error:

SELECT pgml.embed(
    transformer => 'jinaai/jina-embeddings-v2-base-en',
    text => 'Dynamical Scalar Degree of Freedom in Horava-Lifshitz Gravity"}',
    kwargs => '{"trust_remote_code": true}'
);
ERROR:  ValueError: Loading this model requires you to execute custom code contained in the model repository on your localmachine. Please set the option trust_remote_code=True to permit loading of this model.

We are currently using sentence_transformers and InstructorEmbedding Python packages for the pgml.embed function. This model gets dispatched to the sentence_transformers package which does not appear to support the trust_remote_code keyword.

Huggingface shows, for this model, to use transformers.AutoModel. We should probably add this in, but how do we determine which model should use which package? Can they all use transformers? These questions need answering.

@kczimm
Copy link
Contributor Author

kczimm commented Nov 21, 2023

@agapebondservant
Copy link

Is there any progress on this issue?

@tomaarsen
Copy link
Contributor

@agapebondservant #1555 has resolved this now.

  • Tom Aarsen

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy