liwenyun
/
CLIP
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
56 Commits 3 Branches 0 Tags 21 MiB
Commit Graph

56 Commits

Author SHA1 Message Date
tminer dcba3cb2e2
import packaging to be compatible with setuptools==70.0.0 (#449) 
* import packaging to be compatible with setuptools==70.0.0

* importing the version module

---------

Co-authored-by: Jamie <Jamie@Alexandras-MacBook-Pro.local>
Co-authored-by: Jong Wook Kim <jongwook@nyu.edu>
 2024-06-05 04:47:22 +09:00
James Thewlis a1d071733d
Fix torch._C.Node attribute access (#372) 
Attribute access with subscripting would previously work
due to patching in https://github.com/pytorch/pytorch/pull/82511
but this has been removed.

This commit uses the fix proposed in https://github.com/pytorch/pytorch/pull/82628
to define a helper method to call the appropriate access method.
 2023-07-08 02:26:30 -07:00
Jong Wook Kim a9b1bf5920
Update README.md (#326) 2023-02-20 11:49:43 -08:00
Harry Wang 3702849800
np.float is removed in numpy 1.24 (#315) 2023-01-20 11:31:18 -08:00
sarveshwar-s d50d76daa6
Removed another unused f-string (#276) 2022-07-27 12:42:37 -07:00
sarveshwar-s c5478aac7b
Removed unused f-string (#273) 2022-07-27 00:30:08 -07:00
Penn f69a9bc217
Remove inefficient computation from `AttentionPool2d` Module (#271) 
* fix inefficient attention computation

* remove erroneous formatting

* simplified flatten

Co-authored-by: Jong Wook Kim <jongwook@nyu.edu>
 2022-07-21 13:04:35 -07:00
John Sutor 4d120f3ec3
Add PyTorch Hub configuration file (#259) 2022-07-14 08:40:02 -04:00
ProGamerGov b46f5ac758
Don't reuse nn.ReLU modules (#239) 2022-05-01 14:31:46 -07:00
Jong Wook Kim b4ae44927b
ViT-L/14@336px (#234) 2022-04-21 16:45:46 -07:00
neverix e58d49454c
use pkg_resources for PyTorch version checks in notebooks (#191) 
* use pkg_resources for PyTorch version checks in notebooks

* remove version checking in notebook code cell

Co-authored-by: Jong Wook Kim <jongwook@nyu.edu>
 2022-04-10 14:08:16 -07:00
liuxingbaoyu 3482bb6ed3
fix utf8 username on windows (#227) 2022-04-10 14:07:46 -07:00
Jong Wook Kim c0065a27ad
Update README.md 2022-04-10 13:39:41 -07:00
In-Ho Yi 7ef63f265b
Patch clip model for ONNX compatibility (#219) 
* Patch clip model for ONNX compatibility

Changes to use INT32 for tokenization, since ONNX doesn't yet support ArgMax(INT64)
Use explicit dimension for norm

* Add compatibility fix for torch 1.7
 2022-04-10 13:35:32 -07:00
Jong Wook Kim 40f5484c1c update torch versions in workflow 2022-01-25 17:23:09 -08:00
Jong Wook Kim 67fc250eb6 add RN50x64 and ViT-L/14 models 2022-01-25 17:04:00 -08:00
Tan Jia Huei 573315e83f
use `pkg_resources` for PyTorch version comparison (#176) 
use `pkg_resources` from `setuptools` to parse version strings, it is required by Pytorch >= 0.4.1 anyway
 2021-11-09 01:57:26 -05:00
Tan Jia Huei 1a8b4b2899
Fix PyTorch version check for nightly builds (#173) 2021-11-05 01:17:26 -04:00
Santiago Castro 2867559c5f
Fix PyTorch version check (#160) 
* Fix PyTorch version check

* Fix suggestion

Co-authored-by: Jong Wook Kim <jongwook@openai.com>
 2021-11-04 17:32:10 -04:00
Jong Wook Kim c7ba4f3907
Add 1.10.0 in tests 2021-11-04 17:20:40 -04:00
Jong Wook Kim e184f608c5
Full list of Kinetics700 (Fix #158) 2021-10-19 01:40:06 -04:00
Jong Wook Kim 04f4dc2ca1 fix prompts format 2021-09-24 00:59:23 -04:00
Jong Wook Kim 4496d72f25 fix eurosat templates 2021-09-23 23:21:49 -04:00
Jong Wook Kim 7df882c555 add prompt data 2021-09-23 23:06:39 -04:00
Jong Wook Kim efe8cbbdf3 added Country211 and Rendered SST2 dataset info 2021-09-23 21:56:48 -04:00
Gianluca Gippetto c13005fd42
In Compose, replace lambda function with named function (#151) 
This prevents the following error on Windows (when using
a multi-process DataLoader, for example):

AttributeError: Can't pickle local object '_transform.<locals>.<lambda>'
 2021-09-23 21:42:20 -04:00
or-toledano 3b473b0e68
Reduce half of similarity muls after encoding (#140) 
(cAB)^T = c B^T A^T
Saves half of the similarity products in the CLIP model.py after the visual/text encoding stages
 2021-08-29 05:15:03 -04:00
Jong Wook Kim 539cdcbd48
launch tests on push and PR to main (#145) 2021-08-29 05:08:37 -04:00
Jong Wook Kim fa56f25251 add test.yml (#139) 2021-08-12 03:28:49 -07:00
or-toledano fcab8b6eb9
Update Prompt_Engineering_for_ImageNet.ipynb (#137) 
* Can specify root directory when loading model

* specifying download_root instead

* Update Prompt_Engineering_for_ImageNet.ipynb

Fix bug caused by changing default to jit=False with handling the case jit=True as well

* Reduce size of diff

* Reduce size of diff #2

* Reduce size of diff #3

* updated Interacting_with_CLIP.ipynb

* update Prompt_Engineering_for_ImageNet.ipynb

Co-authored-by: kcosta42 <kcosta@student.42.fr>
Co-authored-by: Jong Wook Kim <jongwook@openai.com>
 2021-08-09 01:29:38 -07:00
Kevin Costa 22fde59cbe
Can specify root directory when loading model (#136) 
* Can specify root directory when loading model

* specifying download_root instead

Co-authored-by: Jong Wook Kim <jongwook@openai.com>
 2021-08-08 23:43:22 -07:00
Santiago Castro ff339871f3
Use tqdm with 1024 instead of 1000 unit scale (#131) 2021-08-08 23:20:38 -07:00
Jong Wook Kim 8cad3a736a
Update README.md 2021-07-20 04:02:06 -07:00
Jong Wook Kim dff9d15305 add ViT-B/16 and RN50x16 models 2021-07-19 14:57:31 -07:00
Haofan Wang ea41722f9f
Rename VisualTransformer -> VisionTransformer (#97) 
Fixes #94
 2021-07-18 20:41:49 -07:00
Jong Wook Kim 504cf9e491 test fix 2021-07-18 20:28:30 -07:00
Romain Beaumont a2737ac264
Add truncate option to tokenize (#126) 
* Add truncate_text option to tokenize

This makes it possible to run tokenize on texts that are longer than the number of tokens
that fit the context length without having to try to guess how to cut in number of 
characters beforehand

* add doc, rename to just "truncate", use eot_token

Co-authored-by: Jong Wook Kim <jongwook@openai.com>
 2021-07-18 20:17:40 -07:00
Jong Wook Kim db20393f4a Using non-JIT by default; compat fix with 1.8+ 2021-07-18 18:45:21 -07:00
Jong Wook Kim cfcffb90e6 add YFCC100M subset information 
(#50)
 2021-04-11 02:29:52 -07:00
Jong Wook Kim 8a665a683d fixed model loading issue (#66) 2021-03-23 03:05:17 -04:00
Jong Wook Kim 290ac5cb15
Correctly initializing the logit scale parameter 
adding numpy import
 2021-03-22 22:09:57 -04:00
Jong Wook Kim 43c953e231
Correctly initializing the logit scale parameter 
cf. #46
 2021-03-22 18:07:08 -04:00
Smittyvb beba48f353
Update models URIs in notebook (#52) 2021-03-07 21:58:54 -05:00
Jong Wook Kim fd6c1443c2 add RN101 and RN50x4; update paper URL and model card 2021-03-04 12:30:39 -05:00
Sebastian Berns 4c0275784d
Load model from path (#41) 
* Load model from path

* showing download progress in "MiB"

* clip.load() now can take a file path

Co-authored-by: Jong Wook Kim <jongwook@openai.com>
 2021-02-16 06:19:42 -05:00
Jong Wook Kim 8f6deb52a1 showing download progress in "MiB" 2021-02-15 22:00:33 -05:00
Jong Wook Kim e5347713f4 add prompt engineering notebook 2021-01-30 16:54:01 +09:00
Jong Wook Kim d1cf43d17e using compatible version specifier in requirements.txt 2021-01-30 06:33:56 +09:00
Jong Wook Kim c42a8e3c9e added parameter initialization (fixes #15) 2021-01-30 03:26:10 +09:00
Jong Wook Kim 4a443c18a4 updated README.md to include pip install command 2021-01-30 03:09:59 +09:00