INF558_project

compound stats

irratant

ingredients.irritant.apply(lambda x:max(x) if x is not None else None).describe() count 163.000000
mean 0.748466
std 1.172438
min 0.000000
25% 0.000000
50% 0.000000
75% 2.000000
max 5.000000
Name: irritant, dtype: float64
sum(ingredients.irritant.apply(lambda x:max(x) if x is not None else None)>=3) = 14

acne

ingredients.acne.apply(lambda x:max(x) if x is not None else None).describe() count 163.000000
mean 1.539877
std 1.611093
min 0.000000
25% 0.000000
50% 1.000000
75% 2.000000
max 5.000000
Name: acne, dtype: float64
sum(ingredients.acne.apply(lambda x:max(x) if x is not None else None)>=3) = 40

safety

ingredients.safety.apply(lambda x:max(x) if x is not None else None).astype('float').describe([.8, .9, .95])

count 3176.000000
mean 1.383501
std 1.085465
min 0.000000
50% 1.000000
80% 1.000000
90% 3.000000
95% 3.000000
max 9.000000
Name: safety, dtype: float64

Outputs

1. The original product list: sephora_skincare_product.jl

   • #2386
   • 15 duplicates, same product with same id, but having different product name
     • product_id = [2163400, 2057669, 1802677, 2161636, 2028397, 2196467, 2156925, 1973841, 1907229, 1765007, 1723873, 2231504, 2021897, 1764950, 2087047]
   • 56 products have no ingredients

2. based on the original product list to simplify the ingredient text: sephora_skincare_product_revised.jl

   • because cosdna is not able to process long text of ingredients
     • [p['product_id'] for p in product_list3 if p['ingredient_list']==[] and p["minicategory"]=="Value & Gift Sets"] = [2202505]
   • #2382
   • 71 products have no ingredients

3. base on simplified ingredient text to generate ingredient list: sephora_skincare_product_ingredient_list.jl

   • #2384
   • 73 products have no ingredients, are saved in product_wo_ingredient.jl
   • 78 products have empty ingredient list

4. ingredients.jl

Reference

• THESE ARE THE SKINCARE INGREDIENTS YOU SHOULD NEVER MIX

• FDA-Allergens in Cosmetics