Michael Yang
							
						 
						
							 
							
							
							
							
								
							
							
								b732beba6a 
								
							 
						 
						
							
							
								
								lint  
							
							 
							
							
							
						 
						
							2024-08-01 17:06:06 -07:00  
						
					 
				
					
						
							
							
								 
								Jeffrey Morgan
							
						 
						
							 
							
							
								
								
							
							
							
								
							
							
								9e35d9bbee 
								
							 
						 
						
							
							
								
								server: lowercase roles for compatibility with clients ( #5695 )  
							
							 
							
							
							
						 
						
							2024-07-15 13:55:57 -07:00  
						
					 
				
					
						
							
							
								 
								Daniel Hiltgen
							
						 
						
							 
							
							
							
							
								
							
							
								97c9e11768 
								
							 
						 
						
							
							
								
								Switch use_mmap to a pointer type  
							
							 
							
							... 
							
							
							
							This uses nil as undefined for a cleaner implementation. 
							
						 
						
							2024-07-01 08:44:59 -07:00  
						
					 
				
					
						
							
							
								 
								Daniel Hiltgen
							
						 
						
							 
							
							
							
							
								
							
							
								7e7749224c 
								
							 
						 
						
							
							
								
								Fix use_mmap parsing for modelfiles  
							
							 
							
							... 
							
							
							
							Add the new tristate parsing logic for the code path for modelfiles,
as well as a unit test. 
							
						 
						
							2024-06-21 12:27:19 -07:00  
						
					 
				
					
						
							
							
								 
								Daniel Hiltgen
							
						 
						
							 
							
							
							
							
								
							
							
								171796791f 
								
							 
						 
						
							
							
								
								Adjust mmap logic for cuda windows for faster model load  
							
							 
							
							... 
							
							
							
							On Windows, recent llama.cpp changes make mmap slower in most
cases, so default to off.  This also implements a tri-state for
use_mmap so we can detect the difference between a user provided
value of true/false, or unspecified. 
							
						 
						
							2024-06-17 16:54:30 -07:00  
						
					 
				
					
						
							
							
								 
								Michael Yang
							
						 
						
							 
							
							
							
							
								
							
							
								e40145a39d 
								
							 
						 
						
							
							
								
								lint  
							
							 
							
							
							
						 
						
							2024-06-04 11:13:30 -07:00  
						
					 
				
					
						
							
							
								 
								Jackie Li
							
						 
						
							 
							
							
								
								
							
							
							
								
							
							
								af47413dba 
								
							 
						 
						
							
							
								
								Add MarshalJSON to Duration ( #3284 )  
							
							 
							
							... 
							
							
							
							---------
Co-authored-by: Patrick Devine <patrick@infrahq.com> 
							
						 
						
							2024-05-06 15:59:18 -07:00  
						
					 
				
					
						
							
							
								 
								Patrick Devine
							
						 
						
							 
							
							
								
								
							
							
							
								
							
							
								47cfe58af5 
								
							 
						 
						
							
							
								
								Default Keep Alive environment variable ( #3094 )  
							
							 
							
							... 
							
							
							
							---------
Co-authored-by: Chris-AS1 <8493773+Chris-AS1@users.noreply.github.com> 
							
						 
						
							2024-03-13 13:29:40 -07:00