This blog is a companion to my recent book, Exploring Data in Engineering, the Sciences, and Medicine, published by Oxford University Press. The blog expands on topics discussed in the book, and the content is heavily example-based, making extensive use of the open-source statistical software package R.

Saturday, February 16, 2013

Finding outliers in numerical data

One of the topics emphasized in Exploring Data in Engineering, the Sciences and Medicine is the damage outliers can do to traditional data characterizations.  Consequently, one of the procedures to be included in the ExploringData package is FindOutliers, described in this post.  Given a vector of numeric values, this procedure supports four different methods for identifying possible outliers.

Before describing these methods, it is important to emphasize two points.  First, the detection of outliers in a sequence of numbers can be approached as a mathematical problem, but the interpretation of these data observations cannot.  That is, mathematical outlier detection procedures implement various rules for identifying points that appear to be anomalous with respect to the nominal behavior of the data, but they cannot explain why these points appear to be anomalous.  The second point is closely related to the first: one possible source of outliers in a data sequence is gross measurement errors or other data quality problems, but other sources of outliers are also possible so it is important to keep an open mind.  The terms “outlier” and “bad data” are not synonymous.  Chapter 7 of Exploring Data briefly describes two examples of outliers whose detection and interpretation led to a Nobel Prize and to a major new industrial product (Teflon, a registered trademark of the DuPont Company).

In the case of a single sequence of numbers, the typical approach to outlier detection is to first determine upper and lower limits on the nominal range of data variation, and then declare any point falling outside this range to be an outlier.  The FindOutliers procedure implements the following methods of computing the upper and lower limits of the nominal data range:

1.                  The ESD identifier, more commonly known as the “three-sigma edit rule,” well known but unreliable;
2.                  The Hampel identifier, a more reliable procedure based on the median and the MADM scale estimate;
3.                  The standard boxplot rule, based on the upper and lower quartiles of the data distribution;
4.                  An adjusted boxplot rule, based on the upper and lower quartiles, along with a robust skewness estimator called the medcouple.

The rest of this post briefly describes these four outlier detection rules and illustrates their application to two real data examples.

Without question, the most popular outlier detection rule is the ESD identifier (an abbreviation for “extreme Studentized deviation”), which declares any point more than t standard deviations from the mean to be an outlier, where the threshold value t is most commonly taken to be 3.  In other words, the nominal range used by this outlier detection procedure is the closed interval:

            [mean – t * SD, mean + t * SD]

where SD is the estimated standard deviation of the data sequence.  Motivation for the threshold choice t = 3 comes from the fact that for normally-distributed data, the probability of observing a value more than three standard deviations from the mean is only about 0.3%.  The problem with this outlier detection procedure is that both the mean and the standard deviation are themselves extremely sensitive to the presence of outliers in the data.  As a consequence, this procedure is likely to miss outliers that are present in the data.  In fact, it can be shown that for a contamination level greater than 10%, this rule fails completely, detecting no outliers at all, no matter how extreme they are (for details, see the discussion in Sec. 3.2.1 of Mining Imperfect Data).

The default option for the FindOutliers procedure is the Hampel identifier, which replaces the mean with the median and the standard deviation with the MAD (or MADM)  scale estimate.  The nominal data range for this outlier detection procedure is:

            [median – t * MAD, median + t * MAD]

As I have discussed in previous posts, the median and the MAD scale are much more resistant to the influence of outliers than the mean and standard deviation.  As a consequence, the Hampel identifier is generally more effective than the ESD identifier, although the Hampel identifier can be too aggressive, declaring too many points as outliers.  For detailed comparisons of the ESD and Hampel identifiers, refer to Sec. 7.5 of Exploring Data or Sec. 3.3 of Mining Imperfect Data.

The third method option for the FindOutliers procedure is the standard boxplot rule, based on the following nominal data range:

            [Q1 – c * IQD, Q3 + c * IQD]

where Q1 and Q3 represent the lower and upper quartiles, respectively, of the data distribution, and IQD = Q3 – Q1 is the interquartile distance, a measure of the spread of the data similar to the standard deviation.  The threshold parameter c is analogous to t in the first two outlier detection rules, and the value most commonly used in this outlier detection rule is c = 1.5.  This outlier detection rule is much less sensitive to the presence of outliers than the ESD identifier, but more sensitive than the Hampel identifier, and, like the Hampel identifier, it can be somewhat too aggressive, declaring nominal data observations to be outliers.  An advantage of the boxplot rule over these two alternatives is that, because it does not depend on an estimate of the “center” of the data (e.g., the mean in the ESD identifier or the median in the Hampel identifier), it is better suited to distributions that are moderately asymmetric.

The fourth method option is an extension of the standard boxplot rule, developed for data distributions that may be strongly asymmetric.  Basically, this procedure modifies the threshold parameter c by an amount that depends on the asymmetry of the distribution, modifying the upper threshold and the lower threshold differently.  Because the standard moment-based skewness estimator is extremely outlier-sensitive (for an illustration of this point, see the discussion in Sec. 7.1.1 of Exploring Data), it is necessary to use an outlier-resistant alternative to assess distributional asymmetry.  The asymmetry measure used here is the medcouple, a robust skewness measure available in the robustbase package in R and that I have discussed in a previous post (Boxplots and Beyond - Part II: Asymmetry ).   An important point about the medcouple is that it can be either positive or negative, depending on the direction of the distributional asymmetry; positive values arise more frequently in practice, but negative values can occur and the sign of the medcouple influences the definition of the asymmetric boxplot rule.  Specifically, for positive values of the medcouple MC, the adjusted boxplot rule’s nominal data range is:

            [Q1 – c * exp(a * MC) * IQD, Q3 + c * exp(b * MC) * IQD ]

while for negative medcouple values, the nominal data range is:

            [Q1 – c * exp(-b * MC) * IQD, Q3 + c * exp(-a * MC) * IQD ]

An important observation here is that for symmetric data distributions, MC should be zero, reducing the adjusted boxplot rule to the standard boxplot rule described above.  As in the standard boxplot rule, the threshold parameter is typically taken as c = 1.5, while the other two parameters are typically taken as a = -4 and b = 3.  In particular, these are the default values for the procedure adjboxStats in the robustbase package.



To illustrate how these outlier detection methods compare, the above pair of plots shows the results of applying all four of them to the makeup flow rate dataset discussed in Exploring Data (Sec. 7.1.2) in connection with the failure of the ESD identifier.  The points in these plots represent approximately 2,500 regularly sampled flow rate measurements from an industrial manufacturing process.  These measurements were taken over a long enough period of time to contain both periods of regular process operation – during which the measurements fluctuate around a value of approximately 400 – and periods when the process was shut down, was being shut down, or was being restarted, during which the measurements exhibit values near zero.  If we wish to characterize normal process operation, these shut down episodes represent outliers, and they correspond to about 20% of the data.  The left-hand plot shows the outlier detection limits for the ESD identifier (lighter, dashed lines) and the Hampel identifier (darker, dotted lines).  As discussed in Exploring Data, the ESD limits are wide enough that they do not detect any outliers in this data sequence, while the Hampel identifier nicely separates the data into normal operating data and outliers that correspond to the shut down episodes.  The right-hand plot shows the analogous results obtained with the standard boxplot method (lighter, dashed lines) and the adjusted boxplot method (darker, dotted lines).  Here, the standard boxplot rule gives results very similar to the Hampel identifier, again nicely separating the dataset into normal operating data and shut down episodes.  Unfortunately, the adjusted boxplot rule does not perform very well here, placing its lower nominal data limit in about the middle of the shut down data and its upper nominal data limit in about the middle of the normal operating data.  The likely cause of this behavior is that the relatively large fraction of lower tail outliers, which introduces a fairly strong negative skewness (the medcouple value for this example is -0.589).



The second example considered here is the industrial pressure data sequence shown in the above figure, in the same format as the previous figure.  This data sequence was discussed in Exploring Data (pp. 326-327) as a troublesome case because the two smallest values in this data sequence – near the right-hand end of the plots – appear to be downward outliers in a sequence with generally positive skewness (here, the medcouple value is 0.162).  As a consequence, neither the ESD identifier nor the Hampel identifier give fully satisfactory performance, in both cases declaring only one of these points as a downward outlier and arguably detecting too many upward outliers.  In fact, because the Hampel identifier is more aggressive here, it actually declares more upward outliers, making its performance worse for this example.  The right-hand plot in the above figure shows the outlier detection limits for the standard boxplot rule (lighter, dashed lines) and the adjusted boxplot rule (darker, dotted lines).  As in the previous example, the limits for the standard boxplot rule are almost the same as those for the Hampel identifier (the darker, dotted lines in the left-hand plot), but here the adjusted boxplot rule gives much better results, identifying both of the visually evident downward outliers and declaring far fewer points as upward outliers.

The primary point of this post has been to describe and demonstrate the outlier detection methods to be included in the FindOutliers procedure in the forthcoming ExploringData R package.  It should be clear from these results that, when it comes to outlier detection, “one size does not fit all” – method matters, and the choice of method requires a comparison of the results obtained by each one.  I have not included the code for the FindOutliers procedure here, but that will be the subject of my next post.

92 comments:

  1. I know it isn't released yet, but are pre-release versions of this package available?

    ReplyDelete
    Replies
    1. Jon - as I indicate at the end of my most recent post, I don't have a pre-release version available yet. Sorry about that.

      Delete
  2. I would love to have a simple explanation of the basis for using 1.5 for identifying outliers when using the boxplot method. This method of identifying outliers is taught to my middle school students and they always ask me, "Why 1.5?" Therefore, I need something simple to explain to them the basis for using this number as opposed to 1 or 2, etc.
    Thanks, Mike

    ReplyDelete
  3. Thank you for sharing such a valuable article with good information in this blog.learn Data science course with advanced technology.
    Data Science Training in Hyderabad

    ReplyDelete
  4. Beautiful post! This is extraordinarily well explained and describes particularly favorable circumstances for commercial accommodation. I am currently an avid reader of your blogs. Thank you most for the extraordinary assortment, keep writing.
    Thank you and yours!

    DedicatedHosting4u.com

    ReplyDelete
  5. I learned World's Trending Technology from certified experts for free of cost. I got a job in decent Top MNC Company with handsome 14 LPA salary, I have learned the World's Trending Technology from Data science training in btm layout experts who know advanced concepts which can help to solve any type of Real-time issues in the field of Python. Really worth trying Freelance SEO Expert in bangalore

    ReplyDelete
  6. Hey,Thanks for sharing.very interesting.I have bookmarked your blog because very clear information is given.Keep updating more
    big data courses in bangalore with placement

    ReplyDelete
  7. This comment has been removed by the author.

    ReplyDelete
  8. Thanks for Valuable Information man, IT was Really helpful for me.

    Also, Please reach me for all types of loans - Personal loan at low interest rate in Bangalore

    Trust me Its Really Worth trying for
    Certified Mobile repair center in marathahalli


    ReplyDelete
  9. Thanks for your effects that you put in for giving very informative and clear post.I always like your posts.Thanks for sharing.Python Programming is king for a majority of ranking metrics.If you need any help in python programming visit our site.
    Python Training Institute In Bangalore

    ReplyDelete

  10. Reading on the recent ban on dank vapes have made everyon buy weed online and the FDA looks like they are serious this time around.But with weed for sale online, what makes it so certain that we won't see others online without medical marijuana cards buy marijuana or
    mail order cannabis online. This has created a big confusion in the marijuana dispensaries near me regading the issue of
    marijuana for sale online
    Some good articles on buy weed online or marijuana for sale have been published but the reecent ban on Juul pods and juul pods for sale or juul pods online have created dispair on the population. So what is your take on the recent ban on juul? But the weed for sale industry is gradually taking over. Click here to get some insights on medical marijuana for sale and shrooms for sale online .Dank Vapes

    ReplyDelete
  11. Thanks for sharing such informative peice of work ,Welcome to our for Pinball machines ,At pinball machine for sale, we love fixing, customizing and selling all types pinball machine and have been doing it for over 20 years. With all the innovation and new pinball companies starting up, it’s great that we’re in the epicenter of pinball world, Chicago. Pinball machine manufacturers have been forming in Chicago from the earliest days of pinball. That’s probably why we’re able to find great vintage pinballs tor refurbish! Buy pinball machines online such as antique pinball machine,refurbished pinball machines ,stern pinball machine and many more.
    s

    ReplyDelete

  12. WELCOME TO pug puppies BREEDERS HOME BUY A PUG ONLINE|PUG PUPPIES FOR SALE|ADOPT A PUG ONLINE|PUG|BLACK PUG PUPPIES FOR SALE
    We are so glad you stopped by to check out our amazing TEACUP Pug puppies. All of our animals come fully up to date on vaccinations, heart-worm tested negative, and de-wormed, as well as neutered, and treated for any ailments found upon veterinary examination Adopt a teacup Pug puppy
    Ownership of a Pug includes a commitment that is wider in scope than providing doggy necessities and allowing this jovial little pet to occupy a portion of your home. Pug ownership is a give-and-take relationship that will continue throughout the little dog’s life. That enjoyable companionship thrives when each member of the pair respects the other and camaraderie rules the union. Your Pug will entertain you, love you, and be obedient and faithful to you if you spend time with your doggy friend.
    Adopt a pug puppies online puppy onlie or pug puppies for sale online does not all depends on the money involve. You have to love
    Black pug puppies for sale at heart before you go in search of pug puppies for sale or adopt a pug puppy.This means that you have to keep the pug puppy price or cost of a pug puppy or a teacup puppy in mind before you harnest the interest of buying a pug online.

    Welcome to Scottish Fold Cattery and thanks for your interest click here to Adopt A Scottish Fold Kitten online to our scottish cats and kittens For sale! My name is VERA S. Matt. Me and my husband Owns the small scottish fold farm with the best Scottish fold kitten prices and share my biggest hobby/ Scottish Fold Kittens For Sale cat breeding hence scottish fold Breeders. We breed breeds Scottish Folds. All our Scottish Fold cats have very special Grand Champion blood lines from Europe . We love our cats, they live in the Cattery with us.Scottish Folds are known to be very good natured, affectionate cats who are very human-orientated and become extremely attached to their owners.here Scottish Fold Cats They are easy going and will appreciate the company and cubby holes of any type. They enjoy attention and are not usually shy with strangers. Affectionate without being “pushy”,they make ideal pets and companions.scottish cats and kittens For saleBrowse through our available scottish fold cats and see the Munchkin Scottish folds,Grey Scottish fold kittens,Black scottish fold kittens Since we offer shipping worldwide.Scottish Fold kittens breederKittens For Sale at the catter.Scottish fold kitten prices We also offer Scottish fold kittens near me,Scottish Fold Breeders,Scottish fold Price.
    <a

    ReplyDelete
  13. Marijuana—also called weed, herb, pot, grass, bud, ganja, Mary Jane, and a vast number of other slang terms—is a greenish-gray mixture of the dried flowers of Cannabis sativa.

    The main active chemical in marijuana is THC (delta-9-tetrahydrocannabinol), the psychoactive ingredient. The highest concentrations of THC are found in the dried flowers, or buds. When marijuana smoke is inhaled, THC rapidly passes from the lungs into the bloodstream and is carried to the brain and other organs throughout the body. THC from the marijuana acts on specific receptors in the brain, called cannabinoid receptors, starting off a chain of cellular reactions that finally lead to the euphoria, or "high" that users experience. Feeling of a relaxed state, euphoria, and an enhanced sensory perception may occur. With higher THC levels in those who are not used to the effects, some people may feel anxious, paranoid, or have a panic attack.
    Cannabis plant used for medical or recreational purposes. The main psychoactive part of cannabis is tetrahydrocannabinol, one of the 483 known compounds in the plant, including at least 65 other cannabinoids. 
    buy real weed online
    how to buy weed online
    buy legal weed online
    buy recreational weed online
    buy weed edibles online
    can i buy weed online
    buy medical weed online
    buy weed online canada
    buying weed online reviews
    buy weed online legit
    buy weed online without medical card
    buy weed seeds online canada
    order marijuana online
    order marijuana seeds online
    how to order marijuana online
    order marijuana online without a medical card
    can you order medical marijuana online
    order marijuana online

    ReplyDelete
  14. https://tjparrotshome.com/available-parrots/

    ReplyDelete
  15. Do you know the best cure for Cancer is buy consuming cannabis and talking about consuuming cannbais, it is very disadvantageous to consume cannabis by smoking thats why Vapes have been introduced. The best place to get good vape carts if from

    dank vapes

    dank vapes review

    dank vape

    dank woods


    dank vapes

    mars og

    backwoods


    dank vapes

    blue-glitter-juul-wrap
    cucumber-juul

    juul-basic-kit

    juul-basic-kit-maroon


    mango juul

    ReplyDelete
  16. I would like to say that this blog really convinced me to do it! Thanks, very good post.
    Weed for sale online

    ReplyDelete
  17. A good blog always comes-up with new and exciting information and while reading I have feel that this blog is really have all those quality that qualify a blog to be a one.
    i recommend cbd vape juice

    ReplyDelete
  18. Howdy! bi xêr hatî Buy Dank Vape, li wir hûn dikarin sinifa bilind bibînin vaping hilberên mîna
    exotic dank vapes,
    brass knuckles vapes all from the most trust worthy
    online vape shop.

    ReplyDelete
  19. Thanks for sharing this quality information with us. I really enjoyed reading. Will surely going to share this URL with my friends.
    thc oil cartridges shipped anywhere

    ReplyDelete
  20. Swarit Advisors is a performance-driven organization and always aim to provide tailor-made solutions to fulfil every client's business requirement. Swarit's team of experts dedicate themselves in providing the best legal services with their comprehensive understanding of the industry.

    For more details, log on to - https://swaritadvisors.com/

    ReplyDelete
  21. These are some great tools that i definitely use for SEO work. This is a great list to use in the future..
    CBD MoonRocks

    ReplyDelete
  22. I just want to let you know that I just check out your site and I find it very interesting and informative..
    Buy dmt vape juice online

    ReplyDelete
  23. order cialis Online overnight shipping no script in usa canada legally cheap
    Buy generic tadalafil Cialis pills for sale Online Without Prescription online overnight discreetly in usa canada australia europe legally cheap
    purchase Cialis Online no Prescription needed online next day delivery for anxiety asthma energy depression pain impotence kidney stones
    Buy Dexedrine Without Prescription for sale online legally overnight delivery in usa canada australia europe mexico order generic Dexedrine no Prescription online overnight shipping cheap
    purchase Dexedrine spnsule medication online no script next day delivery use for weight loss
    Buy Subutex Online cheap for sale without prescription overnight legally cheap in usa canada
    Order subutex Online medication cheap for sale no script pharmacy with next day delivery legally cheap in usa canada
    purchase buprenorphine Subutex Online cheap for sale no prescription needed with discreet delivery use for pain sleep
    Buy hydrocodone without prescription overnight legally cheap in usa canada
    order hydrocodone for sale overnight delivery no script pharmacy cheap legally safe in usa canada
    purchase hydrocodone acetaminophen without membership next day delivery legally for pains cough headaches
    Buy Dilaudid Online Without Prescription overnight delivery legally in usa canada
    order generic Dilaudid tablets Online no script pharmacy overnight shipping discreetly cheap
    purchase Dilaudid pills Online no Prescription needed for sale next day delivery use for adhd pain cancer heroin addiction
    Buy Norco Online Without Prescription overnight delivery legally in usa canada
    order Norco Online medication no script discreet delivery cheap in usa canada australia europe mexico
    purchase Norco acetaminophen pills Online next day shipping for sale in pharmacy use for pains
    Buy Generic Ativan Online without prescription overnight delivery discreetly cheap in usa canada australia europe
    order Generic Ativan lorazepam Online medication no script overnight shipping
    purchase Generic Ativan tablets Online for sale next day delivery use for anxiety sleep pain insomnia nausea catatonia

    ReplyDelete
  24. Thanks for this. I really appreciate your good work
    Buy medical marijuana online at [url=https://medicanabudshop.com] The Best Bud Shop [/url]

    content so valid. keep up i love this

    so much meaning. I enjoyed my self


    I cant neglect. Reading such a content

    Ethical facts. one just cant neglect

    I always appreciate. Valid content

    Never a dull. moment reading online

    I have learned. A new thing today

    nothing is so meaningful. like reading a good content

    ReplyDelete
  25. This was really an interesting topic and I kinda agree with what you have mentioned here!
    buy smartbud cans online

    ReplyDelete
  26. We are a global trader in Agricultural and other products from Uganda and Eastern Africa. More than 80% of our products comes from our facilities.
    The rest of the less than 20% comes from well trusted sources.
    In Business we believe in a combination of high qality and affordability. We sell our products at the best rates in the market. We present a great opportunity for clients who buy to resell.

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Rhodes grass online

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Rhodes grass online

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Almond Nuts online

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Rhodes grass online

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    <a

    ReplyDelete
  27. We are a global trader in Agricultural and other products from Uganda and Eastern Africa. More than 80% of our products comes from our facilities.
    The rest of the less than 20% comes from well trusted sources.
    In Business we believe in a combination of high qality and affordability. We sell our products at the best rates in the market. We present a great opportunity for clients who buy to resell.

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Rhodes grass online

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Rhodes grass online

    buy Hardwood Charcoal online

    buy Cow Gallstones online

    buy Betel Nuts online

    buy Barley Feed online

    buy Almond Nuts online

    buy Hardwood Charcoal online

    <a

    ReplyDelete
  28. I really impressed after read this because of some quality work and informative thoughts . I just wanna say thanks for the writer and wish you all the best for coming!.
    marijuana for sale

    ReplyDelete
  29. This comment has been removed by the author.

    ReplyDelete
  30. Great write-up, I am a big believer in commenting on blogs to inform the blog writers know that they’ve added something worthwhile to the world wide web!..
    Scottish Fold Cats

    ReplyDelete
  31. This blog looks just like my old one! It's оn a totally different subject but it has pretty much the same layout and design. Great choice of colours!
    Century Arms VSKA 7.62×39

    ReplyDelete
  32. where to get the best of herbal incense
    https://syntheticworldwide.com/

    ReplyDelete
  33. https://www.cocainehydrochloride.comWhat an amazing blog you have here Cocaine for Sale thank you for sharing this real good content buy colombian cocaine online will like to also say we have an amazing blog too if you will love to take a look buy peruvian cocaine online thanks for your time to check on our blog. Today cocainehydrochloride is one of the world-leading buy cocaine online manufacturers in the USA . for you to order cocaine online , there is a variety of cocaine websites you can purchase and have it delivered Worldwide . And Yes, you can buy crack cocaine online illegal drugs on the Internet, and it's a lot safer .

    http://curemedpharmaceutical.com
    https://www.cocainepowdersale.com
    https://www.cocainehydrochloride.com

    ReplyDelete
  34. Wе’vе wіtnеѕѕеd a vеrу rаріd grоwth іn juѕt ѕоmе fеw уеаrѕ оf еxіѕtеnсе. Dеаlіng fоr аlmоѕt a dесаdе Dаrknеtdrugѕ hаѕ grоwn ѕоlеlу оn thе fоundаtіоnѕ numеrоuѕ rеfеrrаlѕ аll аrоund the wоrld from wеll ѕаtіѕfіеd сlіеntѕ bаѕеd оn thе quality оf рrоduсtѕ wе ѕuррlу, соuрlеd wіth оur 100% guаrаntее оn аll оur dеlіvеrіеѕ.
    Quality plaforms that supply includes,
    Darknetvendors
    Stealthbaymeds
    compre anfetaminas

    ReplyDelete
  35. Buy Colombian and Crack Cocaine Online from a reputed and trusted Vendor in the USA
    Contact: darknetdrugs20@gmail.com
    Wickr Me: Puritypharma90
    whatapp: +16195376439
    Telegram: +16195376439

    Stealthbaymeds іѕ a verified аnd еѕtееmеd undеrgrоund drugѕtоrе dеаlіng іn thе mаnufасturе, аnd ѕаlеѕ of ѕоmе wеll sorted аftеr hаrd drugѕ lіkе Stеrоіdѕ, Crуѕtаl mеth (Methamphetamine), Cосаіnе іn dіffеrеnt fоrmѕ lіkе, Pеruvіаn Cосаіnе, Cоlоmbіаn Cосаіnе, Crасk Cocaine, Bоlіvіаn Cосаіnе аnd a lоt more. Tоgеthеr with MDMA ріllѕ, оf varying dоѕаgе аnd brаndѕ, MDMA Crуѕtаlѕ, MDMA Pоwdеr аnd ѕоmе рrеѕсrірtіоn drugѕ lіkе Addеrаll, Oxусоntіn, Hydrocodone, Rіtаlіn ріllѕ, Pеrсосеt, Tramadol аnd a lоt mоrе.

    Buy Peruvian Cocaine Online
    buy Crack cocaine
    Black Tar Heroin for sale
    Buy Brown Powder Heroin
    Buy Adderall online
    Buy Crystal Meth Online

    ReplyDelete
  36. BUY QUALITY CRYSTAL METH ONLINE HERE

    We (STEALTHBAYMEDS) are #1 Research chemicals and pharmacy grade products supplier on the web.

    Working with one of the biggest research chemical suppliers in China and India has made us one of the biggest and trusted manufacturers, exporters, drop shipper, and suppliers of a wide range of research chemicals and pharmaceutical formulation, specializing in Painkillers, Anti Cancer, Weight loss, Steroids HGH, ADHD, and ED Medicines, Sex enhancers, etc, available at unbeatable prices. buy Colombian cocaine online


    Thеrе are lots оf gооd rеаѕоnѕ tо ѕhор fоr your рhаrmасеutісаl drugѕ at our оnlіnе store. We have рhаrmасеutісаl drugѕ for ѕеvеrаl hеаlth-rеlаtеd рrоblеmѕ thаt реорlе face аt the рrеѕеnt tіmе, which might not be presently listed on our site. So feel free to request any product you want.

    Buy Quality Amphetamines here
    Black tar heroin for sale
    Buy Hydrocodone online here
    buy mephedrone powder online
    Buy Top Quality and cheap crystal meth online
    buy ketamine crystal
    buy Adderall online
    buy diazepam here

    ReplyDelete
  37. QUEM SOMOS NÓS?
    Somos o fornecedor nº 1 de produtos químicos de pesquisa e produtos farmacêuticos na web.

    Trabalhar com um dos maiores fornecedores de produtos químicos de pesquisa na China e na Índia nos tornou um dos maiores e mais confiáveis fabricantes, exportadores, despachantes e fornecedores de uma ampla gama de produtos químicos de pesquisa e formulações farmacêuticas, com especialização em analgésicos, anticâncer, peso perda, esteróides HGH, TDAH e medicamentos para disfunção erétil, intensificadores de sexo, etc, disponíveis a preços imbatíveis.

    Existem muitos bons motivos para procurar suas drogas comerciais em nossa loja online. Temos medicamentos para vários problemas de saúde relatados que possuem rosto no momento anterior, que podem não estar listados no momento em nosso site. Portanto, sinta-se à vontade para solicitar qualquer produto que desejar.

    compre cocaine peruana
    compre cocaine colombiana
    comprar metanfetamina online
    compre anfetaminas online
    comprar Adderall online
    XANAX
    compre heroina em po branco online
    compre mdma ecstasy online

    ReplyDelete
  38. deepnetdrugs.com
    substituível e Tentativa de droga drogaria namoro on-line no manufatura, e alguns bem começar depois de drogas duras como Méto incrível (metanfetamina), cocaína em formas diferentes como, cocaína peruana, cocaína colombiana, crack cocaína, cocaína boliviana e um mais. Juntamente com os pacotes de MDMA, de vários livros e livros, MDMA Crуѕtаlѕ, MDMA Pоwdеr e algumas drogas especiais como Addеrаll, Oxусоntіn, Hуdrосоdоnе, Rіtаlіna comprimidos, Pеrсосеt, tramadol e mais nem.
    comprar cocaína online

    Compre tablets Adderall online
    Compre tablets MDMA online
    Compre heroína online
    Compre comprimidos de methamphetaminas online

    ReplyDelete
  39. Are you looking for Skip Hire Services Near Me? Skip Hire Near Me offering Cheap Skip Hire Services in the UK at cheap rates. Now you can choose your ideal skip according to your budget and requirements. Compare Prices Now!

    ReplyDelete
  40. https://k2incenseonlineheadshop.com/ sales@k2incenseonlineheadshop.com https://liquidincenseshop.com/ sales@liquidincenseshop.com / https://k2incenceshop.com/ sales@k2incenceshop.com
    Buy liquid incense cheap ,Incense for sale online offers ,Liquid Spice ,k2 chemical spray for sale , where to buy k2 near me ,K2 E-LIQUID. liquid k2 , k2 spice spray ,herbal incense for sale , Liquid Herbal Incense, cheap herbal incense , strong herbal incense for sale , Liquid k2 on paper , Liquid K2 , Legal High Incense , liquid herbal incense for sale, Order Strong Liquid Incense , Herbal Incense For Sale , Buy Vape Cartridges , Cheap K2 Spice , Legal Potpourri , Buy Herbal Incense Discrete , Legit Herbal Incense Website , Liquid Incense Overnight Delivery , Buy Potpourri With Credit Cards , buy herbal incense with debit card, , Where To Order Liquid Incense Online , Buy Liquid Incense With Bitcoin , Buy K2 Liquid Incense On Paper In USA , Strongest Incense In USA

    ReplyDelete
  41. Gladias ISO Consulting Pvt. Ltd. is a full-service ISO Consulting and Marketing firm that has over 5+ years of experience helping organizations achieve their ISO and Marketing goals. Our mission is to help organizations to reduce or eliminate risks and waste, increase profitability, increased operational efficiency and build brand awareness in this digital era.

    ReplyDelete
  42. Weeds eaters can be electric or battery powered. They can also be powered by gas or a mixture of gas and oil buy weed online

    ReplyDelete
  43. This is highly informatics, crisp and clear. I think that everything has been described in systematic manner so that reader could get maximum information and learn many things.
    thc e liquid 1000mg

    ReplyDelete
  44. Buy Dmt оr N, N-dimеthуltrурtаminе in mеdiсаl tаlk — iѕ a hаlluсinоgеniс trурtаminе drug. Sоmеtimеѕ rеfеrrеd tо аѕ Dimitri, thiѕ drug рrоduсеѕ еffесtѕ ѕimilаr tо thоѕе оf рѕусhеdеliсѕ. Buy DMT

    ReplyDelete
  45. Great post.winchester usa forged review Very satisfactory and the very helpful blog commenting sites listing which you have published. I really like it very much. please hold on to doing this great work. Thanks for sharing with us.

    ReplyDelete
  46. your blog commenting source is trustworthy as well as long-lasting helpful for us.j131t18m genuinely I prefer Hubspot but your article parallel compares that platform. you guys rock

    ReplyDelete
  47. ecommerce application development company
    best ecommerce website designers

    ReplyDelete
  48. This is my first time i visit here. I found so many entertaining stuff in your blog, especially
    its discussion. From the tons of comments on your articles,texas orange caps mushrooms
    I guess I am not the only one having all the leisure here! Keep up the good work.
    I have been meaning to write something like this on my website and you have given me an idea.

    ReplyDelete
  49. Buy Meth Online. Crystal mеth iѕ the common name fоr сrуѕtаl methamphetamine, a ѕtrоng аnd highly addictive drug that affects the central nеrvоuѕ ѕуѕtеm. buy crystal meth online

    ReplyDelete
  50. N, N-dimеthуltrурtаminе in mеdiсаl tаlk — iѕ a hаlluсinоgеniс trурtаminе drug. Sоmеtimеѕ rеfеrrеd tо аѕ Dimitri, thiѕ drug рrоduсеѕ еffесtѕ ѕimilаr tо thоѕе оf рѕусhеdеliсѕ, likе LSD аnd mаgiс muѕhrооmѕ.. buy dmt

    ReplyDelete
  51. iѕ a ѕtimulаnt drug dеrivеd frоm соса рlаnt lеаvеѕ. It еnhаnсеѕ thе еffесtѕ оf a brаin сhеmiсаl саllеd dораminе, lеаding tо a ѕеnѕе оf inсrеаѕеd еnеrgу аnd роwеr. Cocaine for sale

    ReplyDelete
  52. Buy Cheap Herbal Incense Online in the USA https://hightimesdispensary420.com/

    ReplyDelete