- Optimized simple_mode:

  - Removed dependencies on `Torch` and `Transformers` libraries
  - Reduced memory footprint
  - Eliminated related imports
  - Enhanced compatibility with AWS Lambda environment

Author: Jet Xu

CHANGELOG.md

@@ -5,6 +5,15 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.1.4] - 2024-10-14
+
+### Improved
+- Optimized `simple_mode`:
+  - Removed dependencies on `Torch` and `Transformers` libraries
+  - Reduced memory footprint
+  - Eliminated related imports
+  - Enhanced compatibility with AWS Lambda environment
+
 ## [0.1.3] - 2024-10-14
 
 ### Added
@@ -63,6 +72,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Basic functionality for retrieving context from GitHub repositories
 - Integration with LLM for processing and generating responses
 
+[0.1.4]: https://github.com/JetXu-LLM/llama-github/compare/v0.1.3...v0.1.4
 [0.1.3]: https://github.com/JetXu-LLM/llama-github/compare/v0.1.2...v0.1.3
 [0.1.2]: https://github.com/JetXu-LLM/llama-github/compare/v0.1.1...v0.1.2
 [0.1.1]: https://github.com/JetXu-LLM/llama-github/compare/v0.1.0...v0.1.1

llama_github/llm_integration/initial_load.py

@@ -1,5 +1,4 @@
 # initial_load.py
-import torch
 from typing import Optional, Any
 from threading import Lock
 from langchain_openai import ChatOpenAI
@@ -10,11 +9,6 @@
 from llama_github.config.config import config
 from llama_github.logger import logger
 
-from transformers import AutoModel
-from transformers import AutoModelForSequenceClassification
-from transformers import AutoTokenizer
-
-
 class LLMManager:
     _instance_lock = Lock()
     _instance = None
@@ -74,6 +68,10 @@ def __init__(self,
             self.model_type = "Hubgingface"
 
         if not self.simple_mode:
+            import torch
+            from transformers import AutoModel
+            from transformers import AutoModelForSequenceClassification
+            from transformers import AutoTokenizer
             # initial model_kwargs
             if torch.cuda.is_available():
                 self.device = torch.device('cuda')

llama_github/version.py

@@ -1 +1 @@
-__version__ = '0.1.3'
+__version__ = '0.1.4'

setup.cfg

@@ -1,6 +1,6 @@
 [metadata]
 name = llama-github
-version = 0.1.3
+version = 0.1.4
 author = Jet Xu
 author_email = [email protected]
 description = Llama-github is an open-source Python library that empowers LLM Chatbots, AI Agents, and Auto-dev Agents to conduct Retrieval from actively selected GitHub public projects. It Augments through LLMs and Generates context for any coding question, in order to streamline the development of sophisticated AI-driven applications.