Spreadsheets are all you need
31–40 of 178 posts
Re: Spreadsheets are all you need
#32Re: Spreadsheets are all you need
#33Is RLHF even strictly necessary?
Re: Spreadsheets are all you need
#34Brilliant idea/URL. It’s often true though. So many things I think “I could make an app for that” I wind up just using a spreadsheet for. At least it helps me explore the use cases more deeply for when I’d want to actually take it to the next level. I hung out with a friend while they solved Advent of Code challenges in Excel, that was a trip to watch.
That sounds wild. Do you or your friend have anything to share about this?
Re: Spreadsheets are all you need
#35Brilliant idea/URL. It’s often true though. So many things I think “I could make an app for that” I wind up just using a spreadsheet for. At least it helps me explore the use cases more deeply for when I’d want to actually take it to the next level. I hung out with a friend while they solved Advent of Code challenges in Excel, that was a trip to watch.
Re: Spreadsheets are all you need
#36Re: Spreadsheets are all you need
#37Creator here. Thanks for posting this! Happy to answer questions or take suggestions and hope it helps folks better understand LLMs. Next video will be on embeddings and hopefully done soon-ish.
Re: Spreadsheets are all you need
#38Re: Spreadsheets are all you need
#39Creator here. Thanks for posting this! Happy to answer questions or take suggestions and hope it helps folks better understand LLMs. Next video will be on embeddings and hopefully done soon-ish.
Re: Spreadsheets are all you need
#40> Aside from the minuscule context length, it also lacks the instruction tuning and reinforcement learning from human feedback (RLHF) that turn a large language model into a chatbot. Is RLHF even strictly necessary?
Even if URIAL works with GPT2 small, the really small context length in the Excel file as currently implemented will make it hard to leverage. I've considered a more flexible implementation to support a longer context length (e.g. using Macros to build the layout of the sheet) but have prioritized the teaching videos first.
[1] https://allenai.github.io/re-align/index.html [2] Summary https://twitter.com/intuitmachine/status/1732089266883141856