Free AI web copilot to create summaries, insights and extended knowledge, download it at here

2796

Abstract

quote>Run the following script with <code>root </code>priviledges:<div id="ca20"><pre>curl -fsSL https://ollama.com/install.sh | sh</pre></div>Once ollama is setup, open your terminal (in both Windows or Linux) and type the following command:<div id="9f60"><pre>ollama pull llama3</pre></div><figure id="5b90"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*_W7f8UlwxvS_rUo-0TR0rA.png"><figcaption>This pulling of the files will take some time (for me it took approx 5min)</figcaption></figure>Open your preffered python editor and create a folder with the name <code>local_llm</code>.Inside this folder create a <code>requirements.txt</code> file and paste the follwoing content.<div id="d102"><pre>ollama==0.1.8 streamlit==1.33.0</pre></div>Now, let’s create a file named <code>app.py</code> and add the following code:<div id="5ef4"><pre>import streamlit as st import ollama</pre></div>Next, we’ll create the Streamlit app. We’ll start by setting the title and initializing the message history:<div id="3676"><pre>st.title("💬 Local LLMBot")

if "messages" not in st.session_state: st.session_state["messages"] = [{"role": "assistant", "content": "How can I help you?"}]</pre></div>Now, let’s display the chat history by iterating through the messages:<div id="5df4"><pre>for msg in st.session_state.messages: if msg["role"] == "user": st.chat_message(msg["role"], avatar="🧑‍💻").write(msg["content"]) else: st.chat_message(msg["role"], avatar="🤖").write(msg["content"])</pre></div>Creating the Response Generator<p id="f311"

Options

To generate responses using Ollama, we’ll create a function called <code>generate_response()</code>. This function will use the <code>ollama.chat()</code> function to generate responses in a streaming manner:<div id="41f7"><pre>def generate_response(): response = ollama.chat(model='llama3', stream=True, messages=st.session_state.messages) for partial_resp in response: token = partial_resp["message"]["content"] st.session_state["full_message"] += token yield token</pre></div>Adding User Input and Generating ResponsesLastly, we’ll add a chat input field using Streamlit and create a function to handle the user’s input. When the user enters a message, we’ll append it to the messages list and display it in the chat window. We’ll then clear the <code>full_message</code> state variable and start streaming the response:<div id="d199"><pre>if prompt := st.chat_input(): st.session_state.messages.append({"role": "user", "content": prompt}) st.chat_message("user", avatar="🧑‍💻").write(prompt) st.session_state["full_message"] = "" st.chat_message("assistant", avatar="🤖").write_stream(generate_response) st.session_state.messages.append({"role": "assistant", "content": st.session_state["full_message"]})</pre></div>Running the AppTo run the app, simply execute the following command in your terminal:<div id="4de5"><pre>streamlit run app.py</pre></div><h2 id="4e58">Conclusion</h2>In this article, we’ve learned how to create a local chatbot using Ollama and Streamlit. By combining these powerful tools, you can build your own chatbot with a user-friendly interface, making it easy to interact with the ‘llama3’ model. This is just the beginning, and you can further customize and expand the functionality of your chatbot by integrating additional features and models.</article></body>

The Last Year 2024

what’s the date today? I think you lost your two months in 2024, what about other months? Do you have any plans for the rest of 2024? You say I wanna become successful this year but how? Where’s the plan? Why do you ruin your time? Why are you not doing something? you don’t have time? You don’t do this, but why?

Every individual on this earth has finite time. You have 24 hours in a day and Bill Gates or Elon Musk also have the same time. But why some people are successful and the rest are not? what thing makes this difference between people? why are you not doing what you want? why are you waiting?

Oh, you think this is god’s will, but why? why god select others but not you? Do you think about it anytime or not? I’ll tell you the right thing. It is all about the game of time. If you have respect for time, time also respects you. here respect means the use of time in direction. In simple words utilization of time. Those evolve with time those are successful you very well know that truth.

The question arises here in your mind how do I utilize the time I’m doing this and this lab lab lab. But you also utilize your time and become productive and successful, you only need a good plan for time management.

Here are some important tips and tricks by using these you also save 10 months this year and the rest of the years. Most of successful people work on time management and results are in front of you. Tips are here-

1.Think about your goal: the most important thing in your mind is your goal. If you are not clear about your goal you do nothing. first of all, find your interest and set a goal. If you are confused about what you want to become give time to things. make a list of all the things you want to do and choose only 5 most important things. Try these 5 things for short intervals of time. This is the best method to find your interest. After finding your interest set a definite goal.

2.Plan: After finding your interest and setting a goal you want a solid plan for reaching out to your goal. make a simple plan but follow your plan by heart and with continuity. If you follow your plan by continuity you save your most of time and effort.

3.Discipline: discipline is key to success. become disciplined with your goal. Discipline helps you to convert your dream into reality.

4.Believe: To achieve something you have to believe in yourself and believe in your path. If you believe in yourself you will reach your goal in less time.

5.Learn from others: you don’t need to do experiments learn from others. Read books related to your field. Read case studies about the topic in which you are interested. Talk to other people who are successful in your field. Learn from others’ failures. this will help you in saving your time.

6.Time: success depends upon the time you also hear that line. it is true. set a fixed time to achieve your goal. fixed time for everything you do. Time is most precious in your journey so use it cleverly.

7.fix your time management because what you do you know very well so manage your own time and use it for your future.

8.keep believing in yourself and every day write your dream on a paper read it loudly and say to yourself I can do this.

The Last Year 2024

if you wanna become successful work on yourself self manage your time and keep working.