Finished Analysis Questions

Anubad_MIS769_HW9_Text_Generation.ipynb

@@ -162,7 +162,7 @@
         {
           "data": {
             "application/vnd.jupyter.widget-view+json": {
-              "model_id": "c5414bef6bd548adb20feb1758f59005",
+              "model_id": "03d186647408438da121033e0d9d98bb",
               "version_major": 2,
               "version_minor": 0
             },
@@ -207,7 +207,7 @@
           "name": "stderr",
           "output_type": "stream",
           "text": [
-            "Passing `generation_config` together with generation-related arguments=({'do_sample', 'max_new_tokens', 'pad_token_id'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
+            "Passing `generation_config` together with generation-related arguments=({'pad_token_id', 'max_new_tokens', 'do_sample'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
             "Both `max_new_tokens` (=50) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"
           ]
         },
@@ -220,9 +220,7 @@
             "Prompt: \"The future of artificial intelligence\"\n",
             "\n",
             "Generated:\n",
-            "The future of artificial intelligence: The potential for artificial intelligence to be a social force for billions of people, and it's far from certain that the technology will be the same for everyone.\n",
-            "\n",
-            "In a 2014 article in the journal Nature, Stanford professor and MIT professor of computer\n"
+            "The future of artificial intelligence and the future of the social contract is yet to be determined. The future of our society may or may not take many forms. We may have a new kind of social contract, our new political contract, our new economic contract, or perhaps even the\n"
           ]
         }
       ],
@@ -268,7 +266,7 @@
           "name": "stderr",
           "output_type": "stream",
           "text": [
-            "Passing `generation_config` together with generation-related arguments=({'do_sample', 'max_new_tokens', 'temperature', 'pad_token_id'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
+            "Passing `generation_config` together with generation-related arguments=({'pad_token_id', 'temperature', 'max_new_tokens', 'do_sample'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
             "Both `max_new_tokens` (=30) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n",
             "Both `max_new_tokens` (=30) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"
           ]
@@ -281,7 +279,7 @@
             "============================================================\n",
             "\n",
             "Temperature 0.3:\n",
-            "  , the world was a place of great beauty, and the world was a place of great fear...\n"
+            "  , the world was a place of peace and harmony. But now, the world is a place of w...\n"
           ]
         },
         {
@@ -297,12 +295,12 @@
           "text": [
             "\n",
             "Temperature 0.7:\n",
-            "   there were people who were all angry with the country, but he decided it was wo...\n",
+            "  , it was a small part of his life that would end up coming into fruition.\n",
             "\n",
-            "Temperature 1.2:\n",
-            "  , all was right with humankind. And one day the day would come now.\n",
+            "In th...\n",
             "\n",
-            "One day it ...\n"
+            "Temperature 1.2:\n",
+            "   he had thought his dreams would turn him, to the true power where his strength ...\n"
           ]
         }
       ],
@@ -342,7 +340,7 @@
           "name": "stderr",
           "output_type": "stream",
           "text": [
-            "Passing `generation_config` together with generation-related arguments=({'top_p', 'do_sample', 'pad_token_id', 'top_k', 'max_new_tokens'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
+            "Passing `generation_config` together with generation-related arguments=({'pad_token_id', 'top_k', 'max_new_tokens', 'do_sample', 'top_p'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
             "Both `max_new_tokens` (=30) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"
           ]
         },
@@ -358,7 +356,6 @@
           "name": "stderr",
           "output_type": "stream",
           "text": [
-            "Both `max_new_tokens` (=30) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n",
             "Both `max_new_tokens` (=30) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"
           ]
         },
@@ -368,10 +365,23 @@
           "text": [
             "\n",
             "top_k=10:\n",
-            "  , I had a friend who was a teacher in my class who had been in the military for ...\n",
+            "  , you might have a few friends who are going to get together and play a game tha...\n"
+          ]
+        },
+        {
+          "name": "stderr",
+          "output_type": "stream",
+          "text": [
+            "Both `max_new_tokens` (=30) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"
+          ]
+        },
+        {
+          "name": "stdout",
+          "output_type": "stream",
+          "text": [
             "\n",
             "top_k=50:\n",
-            "  , I wrote that this was a book that was to be read by anyone who would listen. S...\n"
+            "  , when I was a kid, children would watch the movies on your computer screen and ...\n"
           ]
         },
         {
@@ -387,10 +397,10 @@
           "text": [
             "\n",
             "top_p=0.9:\n",
-            "  , the world was a place of fear and of conflict, and a place of war and wariness...\n",
+            "  , the owners of the ships were full of hope and inspiration. They knew that if t...\n",
             "\n",
             "top_p=0.5:\n",
-            "  , the most important thing to remember is that the people who have been in power...\n"
+            "  , I had been in a relationship with a woman who was a virgin. She was very attra...\n"
           ]
         }
       ],
@@ -455,7 +465,7 @@
           "name": "stderr",
           "output_type": "stream",
           "text": [
-            "Passing `generation_config` together with generation-related arguments=({'temperature', 'repetition_penalty', 'do_sample', 'pad_token_id', 'max_new_tokens'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
+            "Passing `generation_config` together with generation-related arguments=({'pad_token_id', 'repetition_penalty', 'temperature', 'max_new_tokens', 'do_sample'}) is deprecated and will be removed in future versions. Please pass either a `generation_config` object OR all generation parameters explicitly, but not both.\n",
             "Both `max_new_tokens` (=80) and `max_length`(=50) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)\n"
           ]
         },
@@ -480,12 +490,15 @@
           "text": [
             "\n",
             "No penalty (repetition_penalty=1.0):\n",
-            "   it would no longer be able to sell smartphones using the same SIM card.\n",
+            "   it had sold the $13.9 million stake in the business to an undisclosed buyer.\n",
             "\n",
-            "The new phone is one of five in its line of RI...\n",
+            "The company's stock has fallen to $19.55 ...\n",
             "\n",
             "Penalty 1.3 (repetition_penalty=1.3):\n",
-            "   it would be releasing a new smartphone in the coming months. The device, called Sleeves 2, is expected to have six came...\n"
+            "   it had acquired the rights to run a high-tech communications service, Voice of America.\n",
+            "\n",
+            "\n",
+            " (Photo: Google) Story Highli...\n"
           ]
         }
       ],
@@ -644,7 +657,7 @@
           "output_type": "stream",
           "text": [
             "* Running on local URL:  http://127.0.0.1:7860\n",
-            "* Running on public URL: https://aed497a651ba2c996b.gradio.live\n",
+            "* Running on public URL: https://286b750b9905015c55.gradio.live\n",
             "\n",
             "This share link expires in 1 week. For free permanent hosting and GPU upgrades, run `gradio deploy` from the terminal in the working directory to deploy to Hugging Face Spaces (https://huggingface.co/spaces)\n"
           ]
@@ -652,7 +665,7 @@
         {
           "data": {
             "text/html": [
-              "<div><iframe src=\"https://aed497a651ba2c996b.gradio.live\" width=\"100%\" height=\"500\" allow=\"autoplay; camera; microphone; clipboard-read; clipboard-write;\" frameborder=\"0\" allowfullscreen></iframe></div>"
+              "<div><iframe src=\"https://286b750b9905015c55.gradio.live\" width=\"100%\" height=\"500\" allow=\"autoplay; camera; microphone; clipboard-read; clipboard-write;\" frameborder=\"0\" allowfullscreen></iframe></div>"
             ],
             "text/plain": [
               "<IPython.core.display.HTML object>"
@@ -931,7 +944,7 @@
           "text": [
             "\n",
             "Prompt: Write a professional email starting with: Dear hir...\n",
-            "Output:  I appreciate your time and support, but I have a problem with the online hiring process. As of Wedn...\n"
+            "Output:  I'm looking for a project manager, I'm looking for a project manager who can help me to get started...\n"
           ]
         },
         {
@@ -947,10 +960,12 @@
           "text": [
             "\n",
             "Prompt: Create a product description for: A smart water bo...\n",
-            "Output:  can be worn, cleaned and sanitized. For example: a smart water bottle that can be worn, cleaned and...\n",
+            "Output:  you can use to test your drink. You can add or remove liquids, fill, or even make an empty bottle. ...\n",
             "\n",
             "Prompt: Generate a tweet about: The benefits of remote wor...\n",
-            "Output:  (see https://twitter.com/jamesmcgrath/status/94549675927152559), the benefits of living off the far...\n"
+            "Output: , and the barriers to getting a job when you're not.\n",
+            "\n",
+            "The benefits of remote work, and the barriers ...\n"
           ]
         }
       ],
@@ -996,15 +1011,15 @@
         "\n",
         "**Q2:** What trade-offs did you make for Spaces deployment?\n",
         "\n",
-        "*Your answer:*\n",
+        "**A2:** Since I am using the free tier of HuggingFace Spaces, I had to use the small version of GPT-2 instead of something like GPT-4 or Llama-3. High-memory GPUs as needed by those models are not available on the free tier. I also needed to stick with Gradio as the SDK for HuggingFace since it creates an interactive UI quickly, for quick deployment to Spaces.\n",
         "\n",
         "**Q3:** What would you add to make this production-ready?\n",
         "\n",
-        "*Your answer:*\n",
+        "**A3:** A production-ready version of this would probably use a moderation feature to prevent both user input and model output from being accepted. Additionally, the main issue with this model is accuracy. Even the simplest input will produce nonsensical output. Deployment would necessitate a change in the underlying model or further tuning.\n",
         "\n",
         "**Q4:** Your HuggingFace Spaces URL:\n",
         "\n",
-        "*Your URL:*"
+        "**A4:** https://huggingface.co/spaces/AMahapatra1/Example_Text_Generation"
       ]
     },
     {