10.9.26.75 updated ui, data, features, and backend
Roland Ding
004db8a
ui
+ added new page for summary generation and allows user to select specific
articles from the database for summary generation
+ updated app.py to include new page
data
+ created four local dataset for testing summary generation prompts
features
+ pulled features, application, cloud_db, chains from main branch (studies demo)
+ added generate summary prompt function to features.py
+ created hand_chains.py for manually creating summary prompt chains
(may be removed later)
+ removed cloud_textract since it was no longer used
+
env settings
+ updated requirements.txt to exclude unused packages
+ updated the backend_update.ipynb for the latest procedure plus all the
new function/class creation and experimentation.
On branch summary
Changes to be committed:
new file: .data/chain.json
new file: .data/instruction_agg_performance.json
new file: .data/overview_chains.json
new file: .data/summary_prompts.json
modified: README.md
modified: app.py
modified: application.py
…
9.9.24.72 updated recursion for chains.py
Roland Ding
7564bac
update execute_concurrent with recursion for traverse along the prompt
chain.
On branch main
modified: chains.py
9.9.23.71 updated llm initialization with openai api key in gen_segments and execute_concurrent.
Roland Ding
5c94939
9.9.23.69 try to fix huggingface openai api key by changing application.py os.envron.get to os.getenv.
Roland Ding
451cda9
provided the api key to the chatmodel in chains.py
modified: application.py
modified: chains.py
9.9.23.68 revise and correction as per email
Roland Ding
364c11a
As per email from 2023-10-09, after review of the cross check results,
the following changes were made to the algorithm:
+ chains.py updated term argument detection in the dictionary for the
case of keyword abscence
+ features.py updated term validation from any to all
+ features.py excluded introduction from the key_content in the article
for the term search.
+ features.py removed all return symbol before search for any key terms
to ensure the terms were picked up properly.
Next step:
+ features.py
- add the ability to stream line the prompts for processing cascading
and combination prompts.
modified: chains.py
modified: features.py
9.9.22.67 mass update of the application
Roland Ding
bb32635
+ Revised internally to apply usage of langchain and async call
+ Realigned the application to use the new terms and prompts from
search term 13n
+ Added the new chains.py module to support the new langchain
+ revised the application.py to align with all the new backend data
structure.
modified: app.py
modified: application.py
new file: chains.py
modified: features.py
modified: requirements.txt
modified: supplier.py
modified: ui_studies.py
modified: ui_study.py
