Log In
Sign Up
Jobs
Job Search
Explore all available job openings across industries and locations.
Company Search
Find your dream jobs categorized by company names.
Themed Jobs
Discover job opportunities organized by specific themes or industries.
Download our App
Tools
Resume
Create your job-winning resume using our free resume builder.
Portfolio
Showcase your skills and projects with a professional portfolio.
Cake AI
Utilize our Cake AI-powered products to accelerate job search and talent match.
Resume
Create your job-winning resume using our free resume builder.
Resume Builder
Make a resume for free.
Resume Templates
Access our extensive library of professional & ready-to-use templates.
Resume Examples
Get inspired by real resume examples to create your own.
Occupation Guide
Access resume writing guides tailored for different professions.
Resume Help
Get expert advice on all things resume from our team of recruitment specialists.
Cake AI Resume Checker
New
Analyzes your resume using Cake AI for detailed feedback.
Portfolio
Showcase your skills and projects with a professional portfolio.
Portfolio Maker
Create a professional portfolio to highlight your skills and projects.
Portfolio Gallery
Browse through our collection of real portfolios for inspiration and networking.
Cake AI
Utilize our Cake AI-powered products to accelerate job search and talent match.
Resources
Articles
Read insightful articles on career development, job search strategies, and more.
View All Articles
Job Search Guide
Resume & CV
Cover Letter
Portfolio
Interview Skills
Job Search Tips
Industry & Job Overview
Career Guidance
Career Planning
Career Tools
Career Development
Personal Branding
Success Stories
Success Stories
Business Excellence
People Operations
Recruitment & HR
About Cake
People & Culture
News & Updates
Events
Featured Reads
Resume & CV
What to Write in an Email When Sending a Resume [+ Examples & Tips]
Read More
Hire
Talent Search
Find Resumes.
Job Posting
Start for Free.
Recruitment Consulting
Acquire Talent.
Employer of Record (EOR)
Empower Your Business in Taiwan.
Employer Branding
Build and promote your employer brand.
Pricing
Job Posting Plans
Talent Search Plans
Resume Builder Plans
Build your Network
My Network
Access your personal network connections and manage your contacts.
Cake Meet
Expand your professional network by meeting and connecting with other users.
Log In
Sign Up
Jobs
Job Search
Explore all available job openings across industries and locations.
Company Search
Find your dream jobs categorized by company names.
Themed Jobs
Discover job opportunities organized by specific themes or industries.
Download our App
Tools
Resume
Create your job-winning resume using our free resume builder.
Portfolio
Showcase your skills and projects with a professional portfolio.
Cake AI
Utilize our Cake AI-powered products to accelerate job search and talent match.
Resume
Create your job-winning resume using our free resume builder.
Resume Builder
Make a resume for free.
Resume Templates
Access our extensive library of professional & ready-to-use templates.
Resume Examples
Get inspired by real resume examples to create your own.
Occupation Guide
Access resume writing guides tailored for different professions.
Resume Help
Get expert advice on all things resume from our team of recruitment specialists.
Cake AI Resume Checker
New
Analyzes your resume using Cake AI for detailed feedback.
Portfolio
Showcase your skills and projects with a professional portfolio.
Portfolio Maker
Create a professional portfolio to highlight your skills and projects.
Portfolio Gallery
Browse through our collection of real portfolios for inspiration and networking.
Cake AI
Utilize our Cake AI-powered products to accelerate job search and talent match.
Resources
Articles
Read insightful articles on career development, job search strategies, and more.
View All Articles
Job Search Guide
Resume & CV
Cover Letter
Portfolio
Interview Skills
Job Search Tips
Industry & Job Overview
Career Guidance
Career Planning
Career Tools
Career Development
Personal Branding
Success Stories
Success Stories
Business Excellence
People Operations
Recruitment & HR
About Cake
People & Culture
News & Updates
Events
Hire
Talent Search
Find Resumes.
Job Posting
Start for Free.
Recruitment Consulting
Acquire Talent.
Employer of Record (EOR)
Empower Your Business in Taiwan.
Employer Branding
Build and promote your employer brand.
Pricing
Job Posting Plans
Talent Search Plans
Resume Builder Plans
Build your Network
My Network
Access your personal network connections and manage your contacts.
Cake Meet
Expand your professional network by meeting and connecting with other users.
Download our App
Portfolios
蔡智丞
本地部署AI模型
本地部署AI模型
本地部署AI模型
By
蔡智丞
待業中
・
Pingtung County, Taiwan
Connect
本地部署AI模型,使用
Llama3
作範例
首先安裝LM Studio,安裝完成後打開介面搜尋"Llama 3"並下載
下載完成後到LM Studio的資料夾尋找剛下載的AI模型資料夾,點擊進去後找到.gguf的檔案
路徑:C:\你的名稱\你的用戶名稱\.cache\lm-studio\models下就可找到
安裝Jan AI這個軟體,這個軟體可以直接在本地電腦上運行任何語言模型
網址:https://jan.ai/
之後把GGUF檔案移動到Jan資料夾內名為models的資料夾,這樣Jan的軟體才能讀取到gguf的檔案
路徑:C:\你的名稱\你的用戶名稱\jan\models
安裝完成後,進入到介面左邊旁邊有一個Hub(四個小方塊的圖形),點擊進去後進入到該介面,點選Import Model
點擊進去後按GGUF的選項,就是剛才說的GGUF檔案
點選Continue importing
讀取下載好的AI模型
之後問他就可以正常對話,但是使用英文比較精準,用中文的話AI會給很多錯誤的答案
由於我的電腦比較舊了,讀取這種8B的AI模型會非常慢,舊電腦的人可以用比較低階的AI模型,比如2B的資料模型等等
以Llama3模型為範例,使用LM Studio與Jan軟體部署AI模型,讓使用者更能夠簡單的在本地使用AI模型。
Report
Please login to comment.
Post
蔡智丞
Connect
Published: Jul 29th 2024
41
5
0
jan
llama3
lm studio
AI
Share
Other works from
蔡智丞
AI繪圖之XL模型使用方法及心得
軟體開發流程(日本)
網頁後端功能圖
使用Python訓練基本小模型
使用python訓練出小模型(套入真實數據)
Java作品(程式碼)