Skip to content

Commit

Permalink
Merge pull request #551 from feeeper/patch-2
Browse files Browse the repository at this point in the history
`chunk_size` should be instead of `block_size`
  • Loading branch information
osanseviero authored Dec 20, 2023
2 parents 16f9009 + 1d5471a commit 60f7702
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion chapters/en/chapter7/3.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -347,7 +347,7 @@ print(f"'>>> Concatenated reviews length: {total_length}'")
'>>> Concatenated reviews length: 951'
```

Great, the total length checks out -- so now let's split the concatenated reviews into chunks of the size given by `block_size`. To do so, we iterate over the features in `concatenated_examples` and use a list comprehension to create slices of each feature. The result is a dictionary of chunks for each feature:
Great, the total length checks out -- so now let's split the concatenated reviews into chunks of the size given by `chunk_size`. To do so, we iterate over the features in `concatenated_examples` and use a list comprehension to create slices of each feature. The result is a dictionary of chunks for each feature:

```python
chunks = {
Expand Down

0 comments on commit 60f7702

Please sign in to comment.