from datasets import load_dataset

spanish_dataset = load_dataset("amazon_reviews_multi", "es")

english_dataset = load_dataset("amazon_reviews_multi", "en")

english_dataset

'>> Title: Worked in front position, not rear'

'>> Review: 3 stars because these are not rear brakes as stated in the item description. At least the mount adapter only worked on the front fork of the bike that I got it for.'

'>> Title: meh'

'>> Review: Does it’s job and it’s gorgeous but mine is falling apart, I had to basically put it together again with hot glue'

'>> Title: Can\'t beat these for the money'

'>> Review: Bought this for handling miscellaneous aircraft parts and hanger "stuff" that I needed to organize; it really fit the bill. The unit arrived quickly, was well packaged and arrived intact (always a good sign). There are five wall mounts-- three on the top and two on the bottom. I wanted to mount it on the wall, so all I had to do was to remove the top two layers of plastic drawers, as well as the bottom corner drawers, place it when I wanted and mark it; I then used some of the new plastic screw in wall anchors (the 50 pound variety) and it easily mounted to the wall. Some have remarked that they wanted dividers for the drawers, and that they made those. Good idea. My application was that I needed something that I can see the contents at about eye level, so I wanted the fuller-sized drawers. I also like that these are the new plastic that doesn\'t get brittle and split like my older plastic drawers did. I like the all-plastic construction. It\'s heavy duty enough to hold metal parts, but being made of plastic it\'s not as heavy as a metal frame, so you can easily mount it to the wall and still load it up with heavy stuff, or light stuff. No problem there. For the money, you can\'t beat it. Best one of these I\'ve bought to date-- and I\'ve been using some version of these for over forty years.'

english_dataset.set_format("pandas")

english_df = english_dataset["train"][:]

# Show counts for top 20 products

english_df["product_category"].value_counts()[:20]

home                      17679

apparel                   15951

wireless                  15717

other                     13418

beauty                    12091

drugstore                 11730

kitchen                   10382

toy                        8745

sports                     8277

automotive                 7506

lawn_and_garden            7327

home_improvement           7136

pet_products               7082

digital_ebook_purchase     6749

pc                         6401

electronics                6186

office_product             5521

shoes                      5197

grocery                    4730

book                       3756

Name: product_category, dtype: int64

def filter_books(example):

    return (

        example["product_category"] == "book"

        or example["product_category"] == "digital_ebook_purchase"

    )

english_dataset.reset_format()

spanish_books = spanish_dataset.filter(filter_books)

english_books = english_dataset.filter(filter_books)

show_samples(english_books)

'>> Title: I\'m dissapointed.'

'>> Review: I guess I had higher expectations for this book from the reviews. I really thought I\'d at least like it. The plot idea was great. I loved Ash but, it just didnt go anywhere. Most of the book was about their radio show and talking to callers. I wanted the author to dig deeper so we could really get to know the characters. All we know about Grace is that she is attractive looking, Latino and is kind of a brat. I\'m dissapointed.'

'>> Title: Good art, good price, poor design'

'>> Review: I had gotten the DC Vintage calendar the past two years, but it was on backorder forever this year and I saw they had shrunk the dimensions for no good reason. This one has good art choices but the design has the fold going through the picture, so it\'s less aesthetically pleasing, especially if you want to keep a picture to hang. For the price, a good calendar'

'>> Title: Helpful'

'>> Review: Nearly all the tips useful and. I consider myself an intermediate to advanced user of OneNote. I would highly recommend.'

from datasets import concatenate_datasets, DatasetDict

books_dataset = DatasetDict()

for split in english_books.keys():

    books_dataset[split] = concatenate_datasets(

        [english_books[split], spanish_books[split]]

    )

    books_dataset[split] = books_dataset[split].shuffle(seed=42)

# Peek at a few examples

show_samples(books_dataset)

'>> Title: Easy to follow!!!!'

'>> Review: I loved The dash diet weight loss Solution. Never hungry. I would recommend this diet. Also the menus are well rounded. Try it. Has lots of the information need thanks.'

'>> Title: PARCIALMENTE DAÑADO'

'>> Review: Me llegó el día que tocaba, junto a otros libros que pedí, pero la caja llegó en mal estado lo cual dañó las esquinas de los libros porque venían sin protección (forro).'

'>> Title: no lo he podido descargar'

'>> Review: igual que el anterior'