Yarn Mistral 7B 128k LARGE context window, Small size 🤯 INSANE 🚀 Setup Tutorial!

Key Takeaways

this is a huge update imagine you have a large language model which has 128,000 context window that means you can feed a whole book inside the large language model and ask question based on that that's exactly what we're going to see today is this large language model worth it let's see that in this video let's get [Music] started hi everyone I'm really excited to show you about mystal 7 billion parameter model which has 128,000 context window I'm going to take you through step by step on how to set this up in your local computer and we are going to review this model if you see about this model you can see that the Yan mral 7 B 128,000 model is capable of handling large Contex window without degrading much in the quality even in this table you can see that even after the context window increases the quality doesn't degrade much compared to the 7 billion parameter model with a lower context window one way of running llm is by using LM Studio you can go to the search and then type mral 128,000 and you should be able to see the list there you can navigate to the preferred model you want to download Based on the quantization you can click download button and you should be able to download and use it another way of using this model is using text generation web Bui so to use text generation web UI get clone text generation web UI and click enter next navigate into the the folder next type bash. Macos Dosh if you're using Windows or Linux use that accordingly and click enter that will start the text generation web UI and you should be able to navigate to this URL to open the text generation web UI portal I'm pasting the name of the model which is Yan Mr 7 bli 128,000 ggf it is by the blow and after that I'm going to enter the file name I'll put all these details in the description below and then click download download now the download is done next click the refresh button and you should be able to see in the drop- down list click that and click load and then you can save settings now you are able to click the chat and able to talk to the large language model arithmetic operation what is 5 + 3 the calculation is eight if it raining should you take an umbrella it's just the context awareness it depends on your preference what you feel comfortable with some people prefer to take an umbrella when it's raining While others prefer not to ultimately it's up to the individual to decide whether or not they want to bring in umbrella in case of rain that's a generic answer next logical reasoning if all roses are flowers are all flowers are roses no all roses are not necessarily flowers and not flowers are necessarily roses next language proficiency test correct the sentence she don't know the correct form of the sentence would be she doesn't know that's correct next up basic programming test write a python function to find the factorial of five here you can see the code if n is equal Z return one lse return n star factorial n minus one yeah that looks correct apart from the spacing next as a general knowledge who is the prime minister of the UK in 2012 it's David Cameron that's correct yeah we did some basic test with this model we will be doing some Advanced test in the upcoming videos I hope you like this video do like share and subscribe and thanks for watching