LANGCHAIN — Can Free OSS Models be Integrated with Fireworks AI for the Playground?

Technology alone is not enough. It’s technology married with the liberal arts, married with the humanities, that yields the results that make our hearts sing. — Steve Jobs

When it comes to using open source models with Fireworks AI for the LangSmith Playground, the integration process is seamless and completely free of cost. Fireworks AI is a platform that provides API access to a wide range of open-source models. This integration allows developers to utilize these models without needing an API key. Here’s how you can integrate open-source models from Fireworks AI into the LangSmith Playground.

First, head over to the LangSmith Hub and filter the prompts for Llama-2. Once you’ve chosen a prompt, such as hwchase17/llama-rag, you can open it in the playground. By default, the playground uses OpenAI, but you can change the model provider to Fireworks and select the specific model you want to use. Then, simply plug in your inputs and run the model.

Fireworks AI offers a Generative AI platform that grants developers access to lightning-fast OSS models, LLM inference, and state-of-the-art foundation models for fine-tuning. This integration into the LangChain Playground allows easy access to high-performing open-source and fine-tuned models, enhancing productivity in building LLM workflows.

Logged-in users can try Fireworks in the playground without an API key, free of charge. If you don’t have an account, you can create one directly from Fireworks. The following are the instructions to set up an account with Fireworks.ai:

Step 1: Visit app.fireworks.ai.

Step 2: Click the “Sign In” button and authenticate with your Google account.

Step 3: A new Fireworks developer account will be provisioned for you.

Step 4: Create a new API key by clicking on “API Keys” and then “New API Key.”

Step 5: Once the API key is created, open-source models like Llama 2 13B Chat are ready to be used in the LangChain Playground.

Step 6: Enter your API key in the Secrets & API Keys section in the playground.

By following these steps, you can seamlessly integrate open-source models from Fireworks AI into the LangSmith Playground and leverage their capabilities for your LLM workflows.