r/DestinyTheGame Oct 24 '24

The Perk-Distribution Bug has existed since at least Final Shape, 4 months ago. It just didn't happen on any popular perk combinations, so it flew under everyone's radar. Media

https://x.com/mossy_max/status/1849246476041605224

"There's no reason that Moving Target + Threat Detector should be 17x more likely than MT + Repulsor Brace."

Truthteller was reissued when Final Shape came out. Notoriously, it was panned as a pretty shitty reissue, with no good rolls, no clearly defined god roll, and overall just everyone moved on and ignored it.

However, even on Truthteller, the perk distribution is night and day. This is the exact same bug that's on Chill Inhibitor.

It's just that nobody was crying they couldn't get "Harmony + Grave Robber" on the GL. Out of tens of thousands of drops, only 161 people got Danger Zone + Elemental Capacitor.

That is fractions of a percent.

This bug has existed for a while. It's only just now, just this season, just recently, that it's finally happened to a meta defining god roll trait combination.

How long as this been in the system?

1.7k Upvotes

784

u/EpicAura99 Oct 24 '24

This it about what I expected, both sides are telling the truth. There’s no way to weight perks, and the distribution is off. It’s like how the Skyrim devs debunked the popular myth that following foxes led you to new locations, except since fleeing creatures pick a random nearby nav point to flee to, and there are more nav points at locations, it did unintentionally work out that way.

319

u/Legitimate-Space4812 Oct 24 '24

both sides are telling the truth

Ironically, demonstrated by Truthteller data.

100

u/EpicAura99 Oct 24 '24

🥁🥁🐍

31

u/Sailing_Mishap Oct 24 '24

🥁🥁🐍

lol at the snake emoji for "tss"

11

u/EpicAura99 Oct 24 '24

You can also use 💿 for a cymbal

5

u/ThePizzaDevourer Oct 24 '24

Wait, isn't that the opposite of ironic? IDK, I am not smart 

6

u/TruthAndAccuracy Eris Morn has got it goin' on! Oct 24 '24

What would be ironic is if everyone was made of iron.

2

u/aircj16 Oct 24 '24

That's fitting for an Iron Lord.

4

u/Legitimate-Space4812 Oct 24 '24

Shit you're right. I am not smart either lol

27

u/Stenbox GT: Stenbox Oct 24 '24

Off-topic, but I remember I was part of a forum for Diablo 1 (Diablo Strategy Forum), where the game code was analyzed in detail - so in addition to just testing stuff as we do in Destiny, they could actually check damage formulas etc in the code as well.

There was some interesting stuff discovered, for example weapon/armor some perks were in the code that could never drop on weapons, since they had multiple drop conditions that could never be met at the same time (eg perk "of the Wyrm"). In same way, some perk combinations were only possible in a very short level range (eg character level had to be around 27-29 and only in Cave area where monster level was correct as well), but you levelled through that part so fast that you only had a couple of drops to get lucky - so the tactic was to get to that level and re-load the social space instance and check a vendor (this included some of the best bow perk combinations such as Massive bow of Swiftness, Massive bow of Lightning and Massive bow of Fire).

There was also a funny bug that never got patched where Warrior was supposed to have an intrinsic block bonus, but this lasted only during your first game, so as soon as you closed the game and played again (eg next day), the bonus was gone forever.

9

u/Nannerpussu Oct 24 '24

Diablo 1

Ah, the nostalgia!

Remember when the smith just so happened to sell a Godly Plate of the Whale, but it cost more gold than you could hold in your inventory? Pepperidge Farm remembers.

117

u/Square-Pear-1274 Oct 24 '24

Bungie probably has some convoluted way of rolling perks so this kind of anomaly wouldn't be readily apparent

And I guess they didn't bother to test for even distribution either

This whole episode is also a great example of why you don't roll your own cryptography 😬

61

u/futon_potato Oct 24 '24

I'm guessing some saucy developer tried some Carmack-level optimization wizardry for the perk rolling algo that failed to account for a random # of multi-perk columns (1-3) and/or the introduction of so many newer perks.

22

u/2enty3 Oct 24 '24

That's a great summary of my thoughts. I also believe some dude decided to solve a small problem with lots of maths.

3

u/Faerye_ Oct 24 '24

I feel called out, I understand the developers.

3

u/FFaFFaNN Oct 24 '24

Maybe, same like ignitions stealth nerfed that transformed into a massive game breaking bug.Classic Bungie, as a company that dont deserve to be trusted.

5

u/futon_potato Oct 24 '24

For sure.

Out of boredom I crawled through their API, and even just at a cursory glance it seems like they may have over-generalized their architecture early on and are very deeply pot committed to it now.

It I'm not mis-interpreting their API, they reuse the concepts of "sockets" & "plugs" across so many different gameplay features that I wouldn't be surprised if there's generic code to determine plug randomness that happens to be improperly distributing perks evenly to weapons.

This also explains why they sometimes take so long to patch what seems like a simple thing - imagine changing logic that is shared by 15 different gameplay features. Oof.

-1

u/Yavin4Reddit Oct 25 '24

So...spitballing, how would you fix and address this in a newly updated version of Tiger engine or Destiny 3?

27

u/JaegerBane Oct 24 '24 edited Oct 24 '24

This whole episode is also a great example of why you don't roll your own cryptography

That. 100x, that.

They've managed to create their own predictable trend, and they're so obsessed with RNG they couldn't even track it.

Tbf, I can totally see how no-one picked this up. There's no reason why a dev team adding perks to a gun would have reason to assume that their distribution of the perk entries would affect their roll chances.

29

u/cuboosh What you have seen will mark you forever Oct 24 '24

When people started complaining it should have been pretty easy to sanity check though. How hard is it to do some group by count query on pairs of the final two perks? They have all the data so they’d immediately see it’s not right 

Hopefully as an action item from the post mortem they set up some automated alert that fires if the RNG breaks again 

Given RNG is the core of the whole game you’d have hoped this alert existed already 

18

u/JaegerBane Oct 24 '24

When people started complaining it should have been pretty easy to sanity check though

The thing is, Bungie had no incentive to. Even if some well-meaning developers got a bee in their bonnet over this, they would have needed access to months of data to see these patterns quickly, and if Bungie weren't storing it or made it accessible, then it would have been far far harder and more work that they would have to get ok'd. It would have only been easy if Bungie were actively curating the drop rates.

Bungie's whole retention model is built around keeping people on the hamster wheel. If people stayed on the wheel, there was no reason to dig. Its exactly why I hate the RNG obsession, as its a crazily complicated discipline to be this cavalier about and the people who get screwed over when it breaks is us.

5

u/Mahavadonlee Oct 24 '24

And that right there is the reason we have a knockout system for exotics and not what we had in D1. With such a large pool of loot you’d want your player base, especially new players to be able to play with all the toys you’ve created in the game, if not what’s the point of releasing new gear or even chasing for it if it gets replaced later.

1

u/cuboosh What you have seen will mark you forever Oct 24 '24

I don’t know, this kind of flirts with “Bungie did it on purpose territory”

The incentive to fix the bug is that chasing god rolls is the whole point of the game, and if perks are busted people will play less and bungie will make less money

I think we can trust them that they really do want to fix bugs like this. They just didn’t handle investigating the issue in the most competent of manners

3

u/JaegerBane Oct 24 '24

I guess, personally, I see a difference between intentionally screwing over players and drinking too much of the Bungie koolaid to be bothered to look. The point I was really making was that I see wilful ignorance being far more likely then malicious engineering or sheer ineptitude.

I'd concede though that while there might be an ethical difference, both are a bit shit and Bungie should be doing better.

1

u/AgentUmlaut Oct 24 '24

Bungie's whole retention model is built around keeping people on the hamster wheel.

Makes me think when the qualifications for the Seraph Tower activities done to unlock Felwinter's was severely lowered when people pretty much game up and there was that napkin math floating around how if the progress stayed steady and round the clock(obviously unlikely since there probably would've been further decline), Felwinter's would be unlocked around 2 1/2-3 weeks after Season of Worthy ended, possibly even longer.

7

u/CrescentAndIo Oct 24 '24

unrelated, but can you explain more on the skyrim fox thing? That sounds funny af

21

u/TerrorSnow awright awright awright Oct 24 '24

Extrapolating from what was said, without knowing if I'm really correct:
Fox runs away from you, chooses a random nearby nav point. If locations like towns n shit have more nav points than random fields or wood areas, then the likelihood of the random nav point being one of those is higher, as there just are more of them.

20

u/IronmanMatth Oct 24 '24

Fox get scared  Fox run away

That is the base Interaction with foxes specifically

But, creatures that are scared runs to a nearby nav point, which is an area designated for NPC AI to move around in. 

Since there is going to be none of these zones in the bum fuck of nowhere, but a lot of these zones near caves or other points of interest, the Fox usually ends up running to a POI.

Hence developers saying that there is no designed feature of foxes running to the nearest POI, but in practice they often do.

It's not a feature, just some unintended behavior of two different gameplay systems working together

-27

u/OO7Cabbage Oct 24 '24

ok, have to point out one thing here, they could weight perks if they wanted to, it's just probably not done.

23

u/EpicAura99 Oct 24 '24

The engine isn’t set up to do it, it wouldn’t a trivial change.

-4

u/Maar7en Oct 24 '24 edited Oct 24 '24
  1. That's not an engine feature.

  2. Regardless it would be a trivial change.

To expand upon that:

  1. Without a doubt something like loot drops is a server side thing. You tell the server you've opened an engram(or maybe received this is already decided when the engram is created but that'd be wasteful) and it rolls the metaphorical dice for you. Doing something like this client side would have already been exposed through hacking a decade ago.

  2. The generation code is going to be something incredibly simple that is optimised for speed. All it needs to do is check the engram type, roll a weapon from the pool, then roll 8-10 more times for traits, masterwork and whether it has a mod. That last one is already weighted btw.

Rewriting that code and redirecting all loot calls to it is trivial. It just is. The only possible obstacle in doing so could be optimising it enough so it doesn't mess with the player experience speed wise. (And this time writing something that is proper random or purposefully weighted.

7

u/EpicAura99 Oct 24 '24

The engine is custom tuned for Destiny, I absolutely do think something as basic as random rolls would be baked in by now.

Not to mention, you know, the employees confirming this.

-10

u/Maar7en Oct 24 '24

See the extra stuff I added to my previous comment. It is not an engine feature without a doubt. Engine features would be local and loot without a doubt isn't.

From your comments it sounds like you don't quite understand what a game engine is.

9

u/EpicAura99 Oct 24 '24

Local/server has nothing to do with it being on the engine or not. Both are running the engine. The engine isn’t just the visual stuff.

-4

u/Maar7en Oct 24 '24

Lol no the server is not running the engine. It is running completely different software.

4

u/EpicAura99 Oct 24 '24

Have you developed on a gave engine before my guy. Because I have.

-3

u/Maar7en Oct 24 '24

Yes.

This isn't in engine. Just like your inventory is pretty much entirely disconnected from the engine.

The game makes API calls just as light.gg and dim do.

-9

u/OO7Cabbage Oct 24 '24

no, I mean if they wanted to, they could set it up, nothing to do with how easy or hard it might be, but they could do it.

27

u/EpicAura99 Oct 24 '24

I mean sure there’s a lot of stuff you can do in software lol

12

u/saibayadon Oct 24 '24

"Nothing is impossible, it just takes time"

10

u/EpicAura99 Oct 24 '24

And moolah 💰

5

u/Legitimate-Space4812 Oct 24 '24

And dev sanity

2

u/EpicAura99 Oct 24 '24

That’s a lot cheaper though! 🙃

→ More replies

-88

u/McCaffeteria Neon Syzygy Oct 24 '24

both sides are telling the truth.

The difference is that one side knows what the fuck they are talking about, has a universe worth of experience over the other, and has the data to back it up, and the other side are ignorant devs who confidently assert that it’s impossible and think that players don’t know anything.

I have been saying it for days and I will keep saying it: players are more knowledgeable about games than the devs who make them. When players say something you shut the fuck up and listen, because you will never have as much hands on experience as the hive mind can accumulate over the span of a single day.

42

u/SrslySam91 Oct 24 '24

I mean.. you said it in a cringe way, but you're not entirely wrong about the end result I guess. The difference is that there are 10s of thousands (millions for some games) of players doing any number of different random things at any given moment.

because you will never have as much hands on experience as the hive mind can accumulate over the span of a single day.

And what I mentioned above was in regard to this, but it's not that one single player has more experience necessarily - it's literally that you're talking about 1000s of times more players who are playing. By sheer numbers, this is why they find out "more" than the limited number of devs (plus bungies play test team is either incredibly small, or doesn't exist to begin with).

have been saying it for days and I will keep saying it: players are more knowledgeable about games than the devs who make them.

This was the part you lost me. some players know more than some devs, sure. A lot of devs don't have the time to play actively all day. But to my above points - the simple fact is that the players figure most things out by sheer numbers and RNG.

I'm certainly not trying to defend Bungie here. But you sound like someone throwing a tantrum with how you delivered that post. Most players couldn't fathom what game devs have to do on a daily basis, and a lot of players are genuine single digit IQ specimens who think they know everything when they don't.

You're mistaking sheer numbers + trial and error for actual knowledge my man.

12

u/sundalius Destiny is Still Good Oct 24 '24

I like that you are apparently a Tiger engine developer and the uh…. Tiger Engine Developers are “ignorant” know nothings.

Yeah. Great feedback.

41

u/EpicAura99 Oct 24 '24

Absolutely breathtaking amount of narcissism in this comment.

→ More replies

15

u/positivedownside Oct 24 '24

The difference is that one side knows what the fuck they are talking about, has a universe worth of experience over the other, and has the data to back it up, and the other side are ignorant devs who confidently assert that it’s impossible and think that players don’t know anything.

The players don't know anything. Please, by all means, explain to me how the engine works.

10

u/stillpiercer_ Oct 24 '24

If you’ve ever listened to the firing range podcast with Chris Proctor as a guest, you’d know that Bungie absolutely has the data to know how many times an X/Y perk combination has dropped.

They can track and do monitor things like total playtime using a weapon/perk/ability/etc combination and have publicly commented on that data and its influence over sandbox changes.

13

u/Rider-VPG UNGA BUNGA BROTHERS Oct 24 '24

If anyone is going to have more data, it's the devs.

→ More replies

2

u/Yuenku Oct 24 '24

Most players just bitch or echo whatever they think sounds nice.

4

u/MoronicIdiot529 Oct 24 '24

Get a life homie, most people in this fanbase know nothing about this game

1

u/NotoriousCHIM Oct 24 '24

lmao ok buddy let's trust the side that started the conversation with a pitifully small sample size

least schizophrenic D2 poster right here

235

u/ready_player31 Oct 24 '24

I think something is definitely going on, also not sure if this is related or not but i've noticed that since earlier this year, at least since ITL, i've noticed that getting 2 of the same weapon drop in quick succession almost always gives both weapons the exact same main column perks.

72

u/ananchor Oct 24 '24

Also noticed this farming the dungeon before they patched the ball dupe. If the same weapon dropped back to back times it was almost always the same roll

17

u/PetSruf Oct 24 '24

So THIS is why i couldn't get the volatile+repuslive brace solstice bow! I swear i kept getting the same roll over and over. Must've gotten one of the rolls like 4 times total

3

u/PorkSouls Oct 24 '24

Funny because I got like 5 volatile/repulsor rolls in a row. Sorry bud

33

u/EvenBeyond Oct 24 '24

Same, I've had a large lag spike and got two identical weapons down to even the alt barrel. 0.00000128547261686% chance of it happening. Which by itself isn't proof but it's still a very very unlikely outcome

9

u/Terrible_Welcome8817 Oct 24 '24

Improbable but not impossible. 🤗

3

u/EvenBeyond Oct 24 '24

I know it's not proof. But it is evidence.

29

u/EpicAura99 Oct 24 '24

Back in arrivals when umbrals first became a thing, if you spammed them too fast they’d always give you the same item. I don’t recall if the roll was the same though.

11

u/YouMustBeBored Oct 24 '24

It wasn’t the same roll because I remember using that to farm guillotine

8

u/nickfrancis86 Oct 24 '24

I hadn’t really put much thought into this as I rarely grind for weapons. But I was running GotD yesterday with some friends and I got 3 Cold Comforts, all with Envious/Explosive Light. My friend got one too, from the same chest with the same perk combo. While it *could * happen by chance, it’s definitely very ominous given the recent discourse on perk distributions.

5

u/Uncle_Pastuzo Hunter Memelord of Earth Oct 24 '24

when i was farming GoS, i had at least 4-5 drops of the pulse rifle with heating up + desperado, some of them back to back even. it could genuinely just be a bug that flew under the radar

3

u/itsRobbie_ Oct 24 '24

This doesn’t happen for me

3

u/NullRef_Arcana "You and I are one forever" Oct 24 '24

I did notice this. I called weird RNG the first couple of times, but when it kept happening, I started to have questions

6

u/Menirz Ares 1 Project Oct 24 '24

That's been a long standing bug that's presumably due to network latency causing both drops to roll with the same RNG seed, so they'll produce the same result.

2

u/F4NT4SYF00TB4LLF4N Oct 24 '24

I've noticed this as well. Even rolling focused loot at core playlists, id wait till 99 engrams and open most of them as quickly as possible. Numerous numerous times I'd get 2 or 3 drops in a row with the same 3rd and 4th column perks. Odds of that with truly RNG drops are astronomically low..

2

u/nfreakoss Oct 24 '24

This might just be pure RNG, but when I was dunking spoils for Word of Crota adepts after yeeting him off the map, I got 2 nearly identical rolls back to back. I was hunting for a dragonfly/repulsor toggle with destab. Instead I got:

Demo/Dragonfly/Subsistence + Rampage/Destab/AJ

Demo/Repulsor/Subsistence + Rampage/Destab/AJ

Both with tac mag, though everything else was different.

Actually insane how triple perk rolls ended up being almost identical, even down to the ORDER of each column.

2

u/ready_player31 Oct 24 '24

When I did GOS farms last week, i got 2 sacred provenances in a row both with killing wind and kinetic tremors. I would chalk it up to RNG but killing wind and kinetic tremors are both the same # perk in their respective columns

2

u/notthatguypal6900 Oct 24 '24

This has been a thing for forever. I've received duplicates many times. I assume it's one of those bugs that is rare and hard to track, so bungie and the community just never addressed it.

1

u/ready_player31 Oct 24 '24

I've been playing the franchise since D1 alpha, never noticed this for anything until season of the wish / into the light came out. Thats when I really started seeing it. I do everything in the game, trials adept farming, master raids and dungeon farms, GM speedruns, i've never noticed it for anything else before maybe season of wish last year.

1

u/xastey_ Oct 24 '24

THIS... Have have it happen often.. this always made me thing something is off with their rng seed generation.. if they are using just a simple timer that's not going to work well at scale. The Division had it as well to a point 2 different ppl that tried to craft at the same time would get the same perk combo. They ended up looking into it and fixed it somehow

1

u/MrTheWaffleKing Consumer of Grenades Oct 24 '24

There is actually a technical reason for this. There's a coding function rand(seed) and a lot of coders will just put time in as the seed- down to microseconds so 2 lines of code ran after eachother will be different. However, it's run on the server's which can lag, and get stuck in the same microsecond. If 2 weapons drop during this lag period, both will have the same roll.

1

u/ready_player31 Oct 24 '24

Yeah I get that but the point is I have never noticed it before, and I dont recall it ever happening prior to probably season of the wish.

0

u/[deleted] Oct 25 '24

[deleted]

1

u/MrTheWaffleKing Consumer of Grenades Oct 25 '24

I haven't, but this is something I've learned in coding 101 and it's pretty standard practice in RNG seeding in gaming- you can see discussions here about how it's likely from a lot of people smarter than myself
https://www.reddit.com/r/raidsecrets/comments/ffxwxn/is_rng_actually_linked_to_the_clock_on_the_server/

51

u/MagusUnion "You are a dead thing, made by a dead god, from a dead power..." Oct 24 '24

Honest Question: From a programming perspective, when do the guns get the perks on them?

Because it doesn't seem like it's at the same time as when the activity is actually completed.

48

u/Soft_Light Oct 24 '24

Based on how people have been able to store pre-determined engrams (such as exotics back when lost sectors dropped specific slotted armor), I think it's at the moment the engram is decrypted.

7

u/MagusUnion "You are a dead thing, made by a dead god, from a dead power..." Oct 24 '24

Ah, yeah, I think you are right. I used to do that myself once upon a time. So there is some proof that choices have been silo'd in the past.

So now the question is how far into the RNG chain are the choices being silo'd? Because if the loot reward system is rolling against every possible weapon combination, then roll variance should be higher than it is now.

8

u/saibayadon Oct 24 '24

We don't know - it could be at many points and it all depends.

But it's probably something like: Generate Drop Event (Could be an engram drop, decryption, etc) -> Roll Weapon MW, Perks, etc -> Send Weapon to Player

There's no efficient way to store pre-determined outcomes for each player, if that's what you're saying and we know rolls must be dynamic because otherwise they wouldn't be able to do double or triple perk weapons without exponentially increasing the storage for each "preset" weapon per player.

191

u/PoorlyWordedName Oct 24 '24

My friend has done the dungeons a single time and has the roll with envious and bait and switch. I hate him now

73

u/Psyduckdontgiveafuck Oct 24 '24

They had dream luck

62

u/JustMy2Centences Oct 24 '24

This is a tier of RNG that possibly beats getting Gally and Vex on your first Vault of Glass clear in D1.

8

u/Terrible_Welcome8817 Oct 24 '24

One of my friends has shit rng but got the god roll chill inhibitor on our second clear of the dungeon and then my other fireteam member got vex and anarchy first runs. RNG do be wildin. 

6

u/DanTheRadarMan itzRadarDan Oct 24 '24

I got Gally on the very first nightfall of D1.

2

u/Exodus_Green Oct 24 '24

I have a single clear of Last Wish and got both the curated Nation of Beasts back when it was S tier, and 1KV in the same run.

1

u/that_bermudian Oct 24 '24

I got both on my first clear in November 2014………

1

u/JustMy2Centences Oct 24 '24

How does it feel knowing RNGesus has found a new favorite?

1

u/MrTheWaffleKing Consumer of Grenades Oct 24 '24

Probably quite easily. These superweighted combos are about 1/450-500 range just for the 2/5 (MossyMax on twitter). If D1 was even close to D2, we're looking at 5-10%. Even if it was .5% back then that's 1/200 lol.

0

u/ValendyneTheTaken Oct 24 '24

I got Icebreaker my third run, Envious+Bait on around my 7th run, and Demo+Attrition on Velocity on or around my 5th. What does that make mine?

1

u/Psyduckdontgiveafuck Oct 24 '24

Devils side ho luck. LOL

9

u/th3groveman Oct 24 '24

I’ve done Warlord’s Ruin once. I have a Lead from Gold/Voltshot Indebted Kindness

13

u/Wacky-Walnuts Oct 24 '24

I got it and immediately locked it before this whole controversy happened

2

u/ABRRINACAVE Oct 24 '24

Same thing with a buddy of mine. His FIRST drop from the dungeon was a spike nade/handling masterwork/envious/BnS roll

52

u/sunder_and_flame Oct 24 '24

How long as this been in the system?

Likely since Forsaken. Yes, that's the OG Crooked Fang random roll, the left being the raw numbers and the right being normalized by dividing each cell by the sum of the column and row to reduce the impact of better perks.

8

u/AsDevilsRun If I fail, let me be wormfood. Oct 24 '24

Clever way to do the adjustment.

2

u/MrTheWaffleKing Consumer of Grenades Oct 24 '24

Nice one. I've been trying to do this for a few other weapons- would you mind sharing how you got those numbers from lightgg?

4

u/sunder_and_flame Oct 24 '24

The page source on light.gg weapon pages contains counts of perk combos. The line contains the string "perk5". I wrote a shitty python parsing script to match the hashes from the combos list with the perk names as well. 

3

u/MrTheWaffleKing Consumer of Grenades Oct 24 '24

Awesome, thank you sir

125

u/Maleficent-Shoe-7099 Oct 24 '24

That’s a really fucking large pool of data, at least people won’t be able to just say “only 1k sample size” now. The only thing we can do now is to wait for BUNGIE to address and investigate this, because at this point it doesn’t matter what they do, it’s going to be a shitstorm regardless. Better sooner than later though. Also you can help contribute to chill inhibitor data here: https://d2-loot-tracker.vercel.app/inventory.

23

u/thegil13 Oct 24 '24

If only there was a way to reduce the RNG impact with some sort of bad luck protection where we could farm weapons, and, if after a certain amount of drops....we could I dunno...craft our own weapon?

-2

u/Morgan-CR Oct 24 '24

This is not even random dawg

4

u/thegil13 Oct 25 '24

Still solved by crafting.

1

u/Morgan-CR Oct 25 '24

They solved that with Curse of Osiris. All weapons have 1 static roll.

25

u/[deleted] Oct 24 '24

[deleted]

35

u/Turin_Agarwaen Oct 24 '24

Why would 35,000 samples be a requirement? The Chi-squared test does take sample size into account when determining the p-value. Even at only 450 samples Chill Inhibitor showed a very statistically significant deviation from an even perk distribution.
Why do you need 70 times the number of samples when it is already statistically significant?

12

u/[deleted] Oct 24 '24

[deleted]

10

u/Turin_Agarwaen Oct 24 '24

Yea, that deviation and pattern is shocking. I was expecting something to be weird due to the light.gg data but this data is wild.

13

u/Maleficent-Shoe-7099 Oct 24 '24

99% confidence is extremely easy to achieve. A pool of 150 weapons and no envious arsenal is 1% chance of not getting the roll. People have been reporting this with a way larger sample size than 150 ever since the dungeon released.

17

u/[deleted] Oct 24 '24 edited Oct 24 '24

[deleted]

10

u/dumb_trans_girl Oct 24 '24

Damn you for reminding me of my stats classes

7

u/sundalius Destiny is Still Good Oct 24 '24

It should be noted the kneewoah’s site is specifically collecting drop instances. Once scraped, it can be deleted. It checks once a minute iirc. The only reason there’d be an issue is if people maliciously skewed the data by intentionally preventing scrapes of specific rolls. It’s not like Light GG that just queries all existing inventories every update tick.

8

u/BNEWZON Drifter's Crew Oct 24 '24

My question is, how can you honestly still not be convinced when it’s the same perk combination as a statistical anomaly every single time. Are you accusing the people gathering or submitting data of lying? Surely if it wasn’t true it would be a different set of perks in 1 of the 3 different data sets (the intial 13 people farming/light.gg/Newo’s data)?

1

u/Kozak170 Oct 24 '24

Such a joke, if people with your viewpoint has their way in the original thread, this issue would’ve been downvoted and buried to oblivion, leading to this issue continuing on for another few years.

→ More replies

3

u/notthatguypal6900 Oct 24 '24

They have been caught with their pants down many times. Exp reduction, 0.04%, IB armor and weapons not dropping on multiple occasions, Eververse, "New investment" into PvP, ect ect.

0

u/ninth_reddit_account DestinySets.com Dev Oct 24 '24

The problem is that any light.gg data is going to skewed to more selective rolls from a selective audience. Yes, it would probably skew against this particular combo (people keep better rolls), but it's representative of weapons kept, not weapons dropped.

60

u/Zeros294 Oct 24 '24

Its probably always been in the system since random rolls returned.

26

u/n080dy123 Savathun vendor for Witch Queen Oct 24 '24 edited Oct 24 '24

It's hard to tell especially with Wish being as long as it was, we can only look at drop rates now (after this issue was for sure introduced) or historical drops via Light.gg which are subject to change the further back we get due to dismantles and incomplete lists of the combos (assuming past Top 8 aren't visible somewhere I'm not aware of), plus almost every weapon no longer available which wouldn't have been potentially skewed post-TFS (like Multimach in the original report) is a craftable which would skew results further.

If we could get a full distribution from one of the playlist weapons that got sent into legacy focusing in TFS that could shed additional light on the matter, or maybe even the Gambit weapons from Deep.

23

u/sunder_and_flame Oct 24 '24 edited Oct 24 '24

Some of the dogshit, forgotten weapons from Forsaken's release suggest it goes back that far. I've looked at a few, and Crooked Fang-4fr's original release looks to have the issue, especially when normalizing the data by dividing each cell by the sum of the column and row to remove the impact of desirable perks: https://i.imgur.com/H9vFjOn.png

Others seem to have a similar issue, such as Good Bone Structure but Erentil does not, presumably because people farmed the shit out of it.

Edit: I was mistaken, Erentil has whispers of it but not nearly as strong as Crooked Fang's.

7

u/kelgorathfan8 Oct 24 '24

The plot thickens!!

9

u/n080dy123 Savathun vendor for Witch Queen Oct 24 '24 edited Oct 24 '24

My first thought was to go back and check Mountaintop so see where the elusive (at least for me, holy hell) ALH/Recomb roll was but the perks themselves are so skewed towards the godroll (which I believe is in one of the common spots in the distribution) that it's futile to try to find anything.

4

u/ImJLu Oct 24 '24

Per the consensus current working theory, recomb should be the most commonly dropped perk with ALH, yeah

26

u/truser_over9000 Oct 24 '24

As someone who works in a software company, I can confirm that the amount of times where we get bug reports and our reaction is “why the fuck would it do this? No way in hell” is rather frequent. Then we look into it and find some ancient code that was not designed for some of the new features. So, yeah, I get it. Hopefully, on Bungie’s side, this might be fixable

1

u/blackest-Knight Oct 24 '24

Or the more simple "Off by 1" error that most programmers are so prone to.

1

u/[deleted] Oct 25 '24

[deleted]

1

u/truser_over9000 Oct 25 '24

I get what you’re saying, but it increases engagement times for the players who are dedicated enough to really grind for certain rolls, and most players don’t. I think, as seen from the backlash, the situation just pissed off the dedicated players, and no profitable business survives by pissing off its best customers. Besides, they were never that dishonest

13

u/TheAwesomeMan123 Gambit Prime // There can only be one! Oct 24 '24

The person at Bungie who decided to remove crafting for future weapons must be kicking themselves. No one would have cared to dig into this if we could just farm any old red border roll and craft it instead lol.

3

u/Aggressive-Pattern Oct 24 '24

These are dungeon weapons that have never been craftable tho

0

u/TheAwesomeMan123 Gambit Prime // There can only be one! Oct 24 '24

Yes but this is the first dungeon available since the release of the Final Shape and according to the data is about the same time the issue has reared its head. 4 months ish. So yeah they let the cat loose amongst the pigeons. Good call bungie

5

u/TheZacef Oct 24 '24

I wanna see the data on Aurvandil FR6 for the chill clip/reconstruction roll. I’ve focused over 200 of them without getting this roll that it’s starting to feel impossible lol

1

u/Lepidopterran Oct 24 '24

I have this roll, but I only ever saw it once, so yeah it's probably pretty rare.

1

u/TheZacef Oct 24 '24

Yep I rarely see it around. I’m determined to get it tho. Been trying with double perks recently and I keep getting subsistence or slideshot/ways with chill. Only a matter of time….

1

u/Lepidopterran Oct 24 '24

You'll get it! I believe in you! :)

6

u/platonicgryphon Stasis Go Zoom Oct 24 '24

How is light.gg getting it's drop data? Is the API providing read access to every guardians vault or only those who have connected to Light.gg allowing it access?

8

u/jonijoniii Oct 24 '24

If you check a weapon you can click learn more under "Popular Individual Perks".

Q: What do you mean by the "global Destiny population"?

A: As part of this feature, we are now tracking all active players using the Bungie API, not just those who have signed in on light.gg. The statistics displayed here are based on all players that have logged in over the past 2 weeks.

1

u/platonicgryphon Stasis Go Zoom Oct 24 '24

Somehow missed that option looking at the site, but seeing this part of that Q and A:

Q: So this hits literally every player and every weapon they own?

A: Yes and no. Every player should be seen by our scraper. The process will compute stats on items seen in the vault / inventory of players who have granted access to their "non-equipped Inventory". However, the default Bungie.net permissions only allow us to see the full details on weapons that are equipped by each player's characters. 

So they are not actually getting every person's full vault, only those that connected and then just seeing those that had the weapon equipped. So that could cause issues with weapon drop data.

6

u/jonijoniii Oct 24 '24

If you think about it it should show way better rolls for each weapon. Why would people keep trash rolls in their inventory for a long duration? It is affecting data but towards god rolls not against it.

1

u/ctaps148 Oct 25 '24

Why would people keep trash rolls in their inventory for a long duration?

  1. Sentimentality

  2. Forgetfulness

  3. In hopes that the bad perks get buffed one day

1

u/jonijoniii Oct 25 '24

1.and 2 ok but it would not show up on the data so much. Not everyone will love the same niche combos.

3 Those are not your equipped ones. Those sit in the vault and would not show up unless you give permission to light.gg.

3

u/SCRIBE_JONAS Oct 24 '24

I believe it's only people connected and with what they currently have, not things they have dismantled

17

u/MrDeathCoctail Oct 24 '24

It’s existed since into the light, everyone was complaining about weighted rolls then too

33

u/Soft_Light Oct 24 '24

Mountaintop's Autoloading + Recombination perks are lined up identically to one another in the API. The perks are horizontal with one another.

https://www.light.gg/db/items/568611922/the-mountaintop/?p=,,,,,0,0

So if you want to argue that Final Shape's "perk weighting" bug existed back then, then you'd also need to argue why the #1 most likely, highest drop chance perk combination wasn't dropping.

Same for Elsie's Rifle. Zen Moment + Headseeker are separated by +3 perks, and therefore should be rare by this bug, and yet Light.gg rates it as the #1 combination at 17.8% of all rolls.

https://www.light.gg/db/items/2372514509/elsies-rifle/?p=1482024992,679225683,2387244414,460017080,2489430594,0,0

It was likely just a thing in the brand new expansion. No data exists that verifies it was a thing for Into The Light.

26

u/Zeto_0 worst golden gun Oct 24 '24

dont look at lightgg for "perk ordering", look at the api directly with for ex. destiny data explorer or another website that doesnt reshuffle the perks like d2foundry. regardless you are correct that alh and recomb are right "next to each other".

8

u/saibayadon Oct 24 '24

The Perk Explorer shows the perks in API order like d2foundry would do; They're right: https://d2foundry.gg/w/2372514509?p=0,0,2387244414,460017080&m=0&mw=0

Zen Moment + Headseeker should be a moderately rare roll. The same applies for Luna's Howl; The #3 and #4 most popular trait combo is the most furthest away perk combo possible, akin to EA + BnS.

8

u/Zeto_0 worst golden gun Oct 24 '24

correct, d2foundry is right. be aware of analyzing lightgg datasets for especially popular weapons with a large sample size, as they are HEAVILY skewed towards player favorite rolls and are more a reflection of player behaviour than perk drop rates

5

u/Halo_cT Oct 24 '24 edited Oct 24 '24

when you use an older weapon it's much more skewed to good rolls people have kept. I dropped probably 50-100 elsies during that event and i only got one with that zen/hs roll. It's also one of the few remaining ones that have survived many vault audits.

it being popular so much later and it being a good roll both mean this is still very possible.

5

u/L1onhawk Oct 24 '24

Is it possible the bug existed back then but the distribution was shifted? Is elsie's +1 roll equal to the current bug?

8

u/Soft_Light Oct 24 '24

You would need to gather data on all Into The Light weapons, and also acknowledge that given the longer duration, more people have naturally gotten the ideal god rolls anyway (the bug isn't that certain trait pairings are impossible, just that they're rare. More time = More people would hit the unbalanced 0.01% chance required).

It would be difficult to prove that without another set of comprehensive testing.

4

u/PerfectlyFriedBread Oct 24 '24

Double perk drops mess with the data set especially if they're generated row-wise.

9

u/sunder_and_flame Oct 24 '24

I don't see any issues with ITL weapons but I'm seeing some in older weapons, possibly going back to Forsaken:

Crooked Fang-4fr (raw/normalized by dividing each cell by the sum of the row and column to remove perk popularity impact): https://i.imgur.com/H9vFjOn.png

Indebted Kindness (raw/normalized): https://i.imgur.com/dmt31ms.png

All Warlords Ruin dungeon weapons (raw): https://i.imgur.com/K7T7Gs6.png

Aurvandil (raw): https://i.imgur.com/cQyd8xI.png

I'm not suggesting this is conclusive, just that there's evidence it goes back further than TFS release.

3

u/sundalius Destiny is Still Good Oct 24 '24

You’re forgetting that time has happened and that older weapons have had rolls sharded. The data on old weapons gets worse every second. It’s why Multimach only slightly shows the striations on some of the chart.

5

u/apackofmonkeys Oct 24 '24

I got Autoloading/Recombination on my 201st Mountain top. I have to wonder.

9

u/saibayadon Oct 24 '24

As someone else pointed out, https://d2foundry.gg/w/568611922?p=0,0,3300816228,469285294&m=0&mw=0 that roll would've been one of the "common" ones. So either the bug didn't exist or de distribution offset was different (but it would have to mean that equal row perks would never roll together which woudl've been SUPER evident)

-1

u/Prophecy_X3 Oct 24 '24

Yeah it took me 200+

4

u/No-Past5307 Oct 24 '24

Possibly before then. There are certain guns that you can find a bunch of posts complaining about RNG for. Aurvandil (recon + chill) and circular logic (ea + Target lock) come to mind

3

u/saibayadon Oct 24 '24

The issue is that if you start retroactively trying to apply this logic things start to break down;

For example, ALH + Chill Clip are side by side on Riptide, same as Recombination and ALH on Mountaintop - which were "hard" to get; Aurvandil (recon + chill) does fit the PPT as it's the furthest distance, but if that's true then the first two examples must be true also and as we know those were hard rolls to get.

2

u/stillpiercer_ Oct 24 '24

Riptide comes to mind, a LOT of people bitched about getting ALH/Chill Clip around the time where Chill Clip was really desirable.

4

u/lightningbadger Oct 24 '24

I want someone to test igneous hammer so I can see if I'm just a schizo or not, cause man did it feel tough trying to get a PvE roll

5

u/ParmesanCheese92 Oct 24 '24

God I love it when incompetence and/or dumb decisions are discovered and plastered all over for anyone to see. Bungie has been getting dogged on constantly since they throttled XP gains back in VANILLA D2 and yet for some goddamn reason people continue to give them the benefit of the doubt, 8 years on.

2

u/3N_breeze Oct 24 '24

don't count on it bro. there's a good percentage of the community that is stuck so deeply in Bungie's bums that they will still find a way to call people criticizing them "haters", or they'll tell them to "simply play another game if you don't like it". mark my words

1

u/Kozak170 Oct 24 '24

This whole thread and the last one are filled to the brim with people still defending them as if they’re getting paid. Hell, there’s even deniers of the whole throttling XP disaster now.

A large part of this community will never learn and that is Bungie’s market segment to keep whaling for all their worth.

4

u/DrainLegacy Kamehameha Oct 24 '24 edited Oct 24 '24

I reckon the RNG system in this game had always been tied to a Time-based RNG

Ever since Forsaken, when I joined the game. Getting multiple drops at the same time would be EXTREMELY likely to be duped if the same item dropped. Be it raids like Leviathan (especially common in raids since 6 ppl would receive rewards at the same time) or double drop events like Double Loot Nightfall. If two engrams drop as the SAME time and they were the SAME weapon, the 3rd and 4th column would likely be EXACTLY the same (first row for guns with multiple rolls). The barrel and magazine perks would always be random AFAI remember.

I bet somewhere during TFS development, they switched their old Time-based RNG to a new Time-based one, and this new one is "skipping frames" in some sense, that's why we get this distinguishable diagonal pattern

1

u/Kozak170 Oct 24 '24

I’m inclined to agree to a certain extent because I have also noticed a few instances where I’ve received duplicate drops of a weapon’s perks at the same time.

4

u/thricestrat Oct 24 '24

I can tell you exactly when I noticed it got “bad”. The last season where scarlet keep was still cheese-able and palindrome was re-issued. It was literally impossible to get the shit god roll (yes the new perk pool was garbage at that time). After 90 runs, it was very evident that certain perks dropped together. It was also evident that If you got good barrel perks your last 2 columns were trash. Vice-versa as well- if your dmg perks were decent / good (meaning even 1 god roll perk 4th column) you barrel perks and masterwork were trash and didn’t synergize

2

u/AlphaSSB MakeShadersUnlimited Oct 24 '24

I wonder if this has affected rolls on the Exotic class items? Or, one step further, has started diddling with how stats are rolling on armor?

2

u/Brinks29 Oct 24 '24

This is why crafted weapons are great, you do your grinding and are rewarded with the exact weapon you want. You don't have to worry about RNG and/or in game errors.

1

u/wundahwaffle Vanguard's Loyal Oct 24 '24

So this is why I couldn't get a better devils with reconstruction + explosive payload to drop...

1

u/Kapusi Oct 24 '24

Its been going on since way before. I have over 800 attempts at getting demo headstone on unending tempest since it came out. 1/800 is kind of a fucking joke. All the time its under over, gutshot, discord, harmony or whatever. 7 roll had headstone. 28 had demo. I just gave up and crafter taken smg with perpetual headstone.

1

u/hyde9318 Oct 24 '24

Something that is strikingly funny to me is looking back at various arguments made when they announced that Crafting wasn’t being carried over the same going forward…

“If balance changes make certain features weaker, we then have to farm new things entirely because we can’t edit them through crafting”.

Many made the argument that it wouldn’t be that bad of an issue, Ignitions immediately get busted and become nearly useless, leaving rolls catered to ignition builds dead.

“Getting red borders is already a grind, now we will have to farm endlessly with terrible drop rates for even the slightest chance of getting what we are looking for”.

Many argue that the grind won’t be too bad, and that it’ll be more rewarding to just farm what we want…. Immediately exposes that drop rates are bugged and broken, leaving specific perk combos ridiculously hard to get.

It’s kind of funny to think that the two biggest criticisms of removing seasonal crafting were dismissed by a large chunk of the community, only for both to turn into the biggest controversies of the season less than a month into the episode. Like, of all the things that could have happened after such a controversial removal, Bungie somehow ended up getting possibly the two worst outcomes… WITHIN a week of each other… not only did this show that their mantra of “you just need to grind more” is a terrible outlook on how things should be, but it’s proved that said mindset is dangerous to the game because we see clearly now that we can’t trust that the systems we are being forced to make use of even work as advertised. And if if they break, we are left with literally no alternative for weeks until a fix is finished because, by someone’s dumb idea, they decided the workaround wasn’t grindy enough….

Bungie, bud, homie, bestest friend…. If you’re going to move away from popular quality of life features, you HAVE to make sure the systems you want us to partake in ACTUALLY work. And I don’t envy Bungie right now… the Halloween event is almost here and that is one of the bigger gear grinding events of the year, and then afterwards is Iron Banner with a new weapon everyone wants specific rolls on…. They’ve got to get this fixed as quickly as possible WHILE getting said content finished in time. One hell of a task ahead, guys, good luck.

1

u/TennoDeviant Oct 24 '24

So it wasn't a bug it was a feature...

1

u/engineeeeer7 Oct 24 '24

Light.gg has a tool to check perk combo distributions going back to Forsaken. Pattern seems to have been present in Lightfall. Possibly Haunted. Could go far as back as Shadowkeep. The further back the more polluted data is.

https://www.light.gg/god-roll/popular/trait-combos/

1

u/Staticks Oct 24 '24

Does this problem affect the Exivuae hand cannon? I can't get the PVP combination of Keep Away + Precision Instrument to drop even once, even though I've farmed it countless times.

1

u/Lilscooby77 Oct 24 '24

Does moving target/headseeker fall into this? Feel like the wild card messenger couldnt get this combo compared to the season before.

1

u/Bullmoogle Oct 25 '24 edited Oct 25 '24

We all “knew” certain exotics and perk combos seemed much harder to get. I’m old enough to remember punch cards: “Buy 10 snow cones and get one free”. I’d love a punch card for Warlords Ruin. Maybe there isn’t a conspiracy to screw players, BUTT they could have done more to ease our frustration—aka “quality of life” changes. Except we have no punch card and get one shot per week per character to get Buried Bloodline, for example. Some people have played it 100 times and still haven’t gotten it to drop. I’m at something like 60 times. I just can’t sometimes, and I grinded through Act 3 of Echoes like three days before the end I had stopped at the Red Death catalyst node—around 150. So, I played maybe a combined week of that episode. If some dude played your dungeon like 21 times, one punch per character per week for 7 magickal weeks, that’s gotta be enough dude. They just need to tune the message back to “F$&@ the players” instead of “the players can go F$&@ themselves”—because sometimes I do go f**k myself by not playing your game for 6+ months at a time. Give us a path at least. What do I know, I’m just a dumbass with hundreds of dollars to give a company that just wants ooooone more Benjamin.

1

u/probablysum1 Oct 28 '24

My money is on weapon enhancing!

1

u/JaegerBane Oct 24 '24

The thing is everyone's had their own horror story (no pun intended) and the fact RNG is such a heavily focused part of the game means that all these cases have been put down to it, and the only people in a position to properly look at this were Bungie. Who clearly didn't.

Over the last few seasons I must have focused hundreds of Loaded Questions and not once did I see a Overflow/RB roll. I only saw one ALH/RB roll. But about 40% of the rolls had Pugilist and/or Firmly Planted and at one point I rolled 5 separate Pugilists in a row. At the time I just assumed I was unlucky.

0

u/[deleted] Oct 24 '24

[deleted]

2

u/kelgorathfan8 Oct 25 '24

No, that’s because for the first few weeks of forsaken, it was the ONLY heavy weapon in the world drop loot pool

0

u/SeimousReign Oct 24 '24

It happened on Elsie Zen Moment Headseeker. But no Pve's suffered... Thats why you didnt know.

0

u/thescottmitch Oct 24 '24

Even American RNG is lazy. “Do I really need to go all the way on both sides?!? Ugh 😩

0

u/MamboJevi Oct 24 '24

Hmm... when was deterministic recoil introduced?

0

u/thefiglord Oct 24 '24

there has to be another reason why bungo NEEDS you to keep running an event beyond reason to get. a drop - there has to be a cost break where you pay xxx for a release and that equals xxxxx of play time for running their servers etc - that if a person plays xxxxx hours they also spend xx on eververse - vs a player that plays x hours and spends 0 on things or that. xxxx hour people are 99% likely to buy the next release

-11

u/itsRobbie_ Oct 24 '24

Envious destabalizing was my god roll and I got it…

Also, I have a really hard time believing a lot of community made data points for this topic… You do not have the same tools and info that bungie does. Where are you getting your info that “only 161 people” got that drop? Lightgg? That isn’t 100% accurate and lightgg is based on popularity anyway.

6

u/namesjwoosh Oct 24 '24

That's why they issued a community sourced document, and started tracking different rolls. This isn't to say getting a god roll is impossible. It's saying that certain perk distribution based on the where the perk is in the API affects how likely it is to drop. Look at the data points and tell me that you don't think something is skewed. Not trying to be rude but how can you have a hard time believing it when a weapon perk drop that most people want (new dungeon stasis GL) that has a 1/36 chance to drop ends up taking about 454 drops to get that roll.

→ More replies

-20

u/ThisWaxKindaWaxy Oct 24 '24

Like with the discourse in perks being distributed wrong, it's like we've been talking about this for a while, for however it's lasted. It's like no one wanted to even check in the live game if, like, the perks aren't truly being dropped randomly.

→ More replies