Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: worldbank/llm4data
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.0.2
Choose a base ref
...
head repository: worldbank/llm4data
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.0.3
Choose a head ref
  • 6 commits
  • 33 files changed
  • 1 contributor

Commits on Jun 5, 2023

  1. Add guide for external services (#12)

    * Add content for the indicators section
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add guide for setting up services
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    ---------
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    avsolatorio authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    f873907 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Integrate document vector indexing (#13)

    * Add docs and document loading script
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add METADATA_KEY
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Update DB environment variable names
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add QDRANT to the environment for configuration
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Migrate and test load_docs and add the GUIDE.md
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Implement wbdocs to schema converter
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Update document metadata
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add other fields
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add disciple field
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Update the document schema
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Apply black format
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Fix typing for qdrant file
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Fix linting
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Fix lint
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add note on the advantages of using the metadata standard
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Fix wbdocs metadata mapper
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add context generation script and schema2info
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add APIPrompt
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Fix static method
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add the indexing guide to the documentation
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    ---------
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    avsolatorio authored Jun 15, 2023
    Configuration menu
    Copy the full SHA
    8f088e4 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. Fix schema access to title (#14)

    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    avsolatorio authored Jun 16, 2023
    Configuration menu
    Copy the full SHA
    2641e6e View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2023

  1. Integrate indicators indexing and guide (#15)

    * Use the schema for context generation
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Update guide and add wbdocs metadata migrate script
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add nada_wdi scraper and create secrets dir
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add generation of text for the wdi
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Implement indicator indexer scripts
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    ---------
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    avsolatorio authored Jun 18, 2023
    Configuration menu
    Copy the full SHA
    38b8dca View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2023

  1. Improve data indexing and prompt template for WDI (#16)

    * Implement db storage of wdi data and fix indicators loading
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Add script to create a qdrant index over fields to prevent timeout errors
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    * Update the prompt template for the WDI SQL
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    
    ---------
    
    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    avsolatorio authored Jun 19, 2023
    Configuration menu
    Copy the full SHA
    0ab0e52 View commit details
    Browse the repository at this point in the history
  2. Bump version for v0.0.3 release (#17)

    Signed-off-by: Aivin V. Solatorio <avsolatorio@gmail.com>
    avsolatorio authored Jun 19, 2023
    Configuration menu
    Copy the full SHA
    2e1d3e6 View commit details
    Browse the repository at this point in the history
Loading