Skip to content

Commit 4bb7a1d

Browse files
author
ayasyrev
committed
old resblock -> xresblock, new resblock, some refactoring
1 parent 0c96685 commit 4bb7a1d

20 files changed

+7023
-1953
lines changed

README.md

Lines changed: 0 additions & 134 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,4 @@
1-
<!--
2-
3-
#################################################
4-
### THIS FILE WAS AUTOGENERATED! DO NOT EDIT! ###
5-
#################################################
6-
# file to edit: nbs/index.ipynb
7-
# command to build the docs after a change: nbdev_build_docs
8-
9-
-->
10-
111
# model_constructor
12-
132
> Constructor to create pytorch model.
143
154

@@ -22,97 +11,49 @@ _
2211
## How to use
2312

2413
model = Net()
25-
<div class="codecell" markdown="1">
26-
<div class="input_area" markdown="1">
2714

2815
```python
2916
model = Net()
3017
```
3118

32-
</div>
33-
34-
</div>
35-
3619
# Resnet as example
3720

3821
Lets create resnet18 and resnet34 (default Net() is resnet18()).
39-
<div class="codecell" markdown="1">
40-
<div class="input_area" markdown="1">
4122

4223
```python
4324
resnet18 = Net(block=BasicBlock, blocks=[2, 2, 2, 2])
4425
```
4526

46-
</div>
47-
48-
</div>
49-
<div class="codecell" markdown="1">
50-
<div class="input_area" markdown="1">
51-
5227
```python
5328
resnet34 = Net(block=BasicBlock, blocks=[3, 4, 6, 3])
5429
```
5530

56-
</div>
57-
58-
</div>
59-
6031
# Predefined Resnet models - 18, 34, 50.
61-
<div class="codecell" markdown="1">
62-
<div class="input_area" markdown="1">
6332

6433
```python
6534
from model_constructor.resnet import *
6635
```
6736

68-
</div>
69-
70-
</div>
71-
<div class="codecell" markdown="1">
72-
<div class="input_area" markdown="1">
73-
7437
```python
7538
model = resnet34(num_classes=10)
7639
```
7740

78-
</div>
79-
80-
</div>
81-
<div class="codecell" markdown="1">
82-
<div class="input_area" markdown="1">
83-
8441
```python
8542
model = resnet50(num_classes=10)
8643
```
8744

88-
</div>
89-
90-
</div>
91-
9245
# Predefined Xresnet from fastai 1.
9346

9447
This ie simplified version from fastai v1. I did refactoring for better understand and experiment with models. For example, it's very simple to change activation funtions, different stems, batchnorm and activation order etc. In v2 much powerfull realisation.
95-
<div class="codecell" markdown="1">
96-
<div class="input_area" markdown="1">
9748

9849
```python
9950
from model_constructor.xresnet import *
10051
```
10152

102-
</div>
103-
104-
</div>
105-
<div class="codecell" markdown="1">
106-
<div class="input_area" markdown="1">
107-
10853
```python
10954
model = xresnet50()
11055
```
11156

112-
</div>
113-
114-
</div>
115-
11657
# Some examples.
11758

11859
We can experiment with models by changing some parts of model. Here only base functionality, but it can be easily extanded.
@@ -123,26 +64,15 @@ Here is some examples:
12364
## Custom stem
12465

12566
Stem with 3 conv layers
126-
<div class="codecell" markdown="1">
127-
<div class="input_area" markdown="1">
12867

12968
```python
13069
model = Net(stem=partial(Stem, stem_sizes=[32, 32]))
13170
```
13271

133-
</div>
134-
135-
</div>
136-
<div class="codecell" markdown="1">
137-
<div class="input_area" markdown="1">
138-
13972
```python
14073
model.stem
14174
```
14275

143-
</div>
144-
<div class="output_area" markdown="1">
145-
14676

14777

14878

@@ -168,29 +98,14 @@ model.stem
16898

16999

170100

171-
</div>
172-
173-
</div>
174-
<div class="codecell" markdown="1">
175-
<div class="input_area" markdown="1">
176-
177101
```python
178102
model = Net(stem_sizes=[32, 64])
179103
```
180104

181-
</div>
182-
183-
</div>
184-
<div class="codecell" markdown="1">
185-
<div class="input_area" markdown="1">
186-
187105
```python
188106
model.stem
189107
```
190108

191-
</div>
192-
<div class="output_area" markdown="1">
193-
194109

195110

196111

@@ -216,31 +131,16 @@ model.stem
216131

217132

218133

219-
</div>
220-
221-
</div>
222-
223134
## Activation function before Normalization
224-
<div class="codecell" markdown="1">
225-
<div class="input_area" markdown="1">
226135

227136
```python
228137
model = Net(bn_1st=False)
229138
```
230139

231-
</div>
232-
233-
</div>
234-
<div class="codecell" markdown="1">
235-
<div class="input_area" markdown="1">
236-
237140
```python
238141
model.stem
239142
```
240143

241-
</div>
242-
<div class="output_area" markdown="1">
243-
244144

245145

246146

@@ -256,42 +156,21 @@ model.stem
256156

257157

258158

259-
</div>
260-
261-
</div>
262-
263159

264160
## Change activation function
265-
<div class="codecell" markdown="1">
266-
<div class="input_area" markdown="1">
267161

268162
```python
269163
new_act_fn = nn.LeakyReLU(inplace=True)
270164
```
271165

272-
</div>
273-
274-
</div>
275-
<div class="codecell" markdown="1">
276-
<div class="input_area" markdown="1">
277-
278166
```python
279167
model = Net(act_fn=new_act_fn)
280168
```
281169

282-
</div>
283-
284-
</div>
285-
<div class="codecell" markdown="1">
286-
<div class="input_area" markdown="1">
287-
288170
```python
289171
model.stem
290172
```
291173

292-
</div>
293-
<div class="output_area" markdown="1">
294-
295174

296175

297176

@@ -307,19 +186,10 @@ model.stem
307186

308187

309188

310-
</div>
311-
312-
</div>
313-
<div class="codecell" markdown="1">
314-
<div class="input_area" markdown="1">
315-
316189
```python
317190
model.body.layer_0.block_0
318191
```
319192

320-
</div>
321-
<div class="output_area" markdown="1">
322-
323193

324194

325195

@@ -340,7 +210,3 @@ model.body.layer_0.block_0
340210
)
341211

342212

343-
344-
</div>
345-
346-
</div>

docs/_data/sidebars/home_sidebar.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,8 +22,8 @@ entries:
2222
title: xresnet
2323
url: /xresnet
2424
- output: web,pdf
25-
title: Layers_tests
26-
url: /test_layers
25+
title: Title
26+
url: /test_xresnet
2727
output: web
2828
title: model_constructor
2929
output: web

0 commit comments

Comments
 (0)